Features of EncFSMP:
Mounts EncFS folders on Windows and OS X
Can create, edit, export and change the password of EncFS folders
Is 100% compatible with EncFS 1.7.4 on Linux
Completely free, no nags, no additional downloads like toolbars etc.
Although the website says “beta software”, I am very happy using it without problems on multiple Windows nodes.
Check Encfs MP Windows docs for how to use it.