In male-female relationship, it is difficult to step back once there is a sexual element in the relationship. I mean, you cannot expect relationship at the same level once you keep sex out of relationship. Moreover, female can be comfortable without it but not male. You may go ahead stepping back on this ground but be mentally prepared for break up. If he continues without it then hold him tight because it is rare to find such males.