If your marriage is registered under Hindu marriage act then as you discus. Even after two span of you marriage, if still your spouse not allowing any physical relation, then you can as for Divorce under the ground of Cruelty and you know about her ex-affaire.
This is much similar as..
A husband cannot ask his wife that he does not like her company, but she can or should stay with other members of the family in matrimonial home. Such an attitude is cruelty in itself on the part of the husband; Yudhishter Singh v. Sarita , AIR 2002 Raj 382.
For Further details and procedure you can contact me on LawyerNU.
Disclaimer : This answer is based on information given by you hence, It is just opinion of Lawyer. For specific answer you have to give details and facts and choose the Lawyer of your choice.