In most of the extra-marital relationships, women want emotional support and men want sex. You will get sexual satisfaction but emotional satisfaction is not guaranteed. In future if he will start avoiding you, which is usually happens when he is sexually done with you, then you may get feeling of used up. Moreover if he is married then his first priority will be his wife and not you. If you are ready to accept this fact of life then and then you should go ahead.