Here is the overall guide for how VMware implements memory techniques. You can look on page 14 for a small snippet how when to reclaim resources are done but honestly to get a good overall understanding you will have to read more of the documentation
http://www.vmware.com/files/pdf/mem_mgmt_perf_vsphere5.pdf
Here is also a good post by Frank Denneman which is old but the percentages are still good and give a good overview.
Memory reclamation, when and how? - frankdenneman.nl
Let me know if this helps and mark as helpful or solved if it does.