How I would do it:

-*
+*/talks/*
+*/pubs/*
+*/talks.html
+*/publications.html
+*.gif +*.jpg +*.png +*.css +*.js

This effectively excludes everything, and then progressively adds exactly what
you require.