He continues with her even after you know about his relationship, which means he does not care about you or your emotions. However, he might be trying to convince you that he is not into the relations but if you are sure about sms and mails then he is fooling you. If you can compromise with the situation and accept it as your fate then stay on. Before thinking about divorce make sure that you are financially capable enough to live separately.