There are no perfect relationships, no perfect partners. Leave when he gets abusive (emotional, psychological, physical etc). Other than that, he's probably a fine/normal dude.
Having said that, I agree with several ladies who commented on LTRs whilst escorting. Especially, VC, MH, DM... I have seen some posts, mentioning some men seek out escorts for dating (e.g. sexually liberated, good in bed, money she brings, etc). However, love does tend to go through several stages. Things never stay the same, what was fine at the benning/1st stage may not be fine in the much later stages. If this guy isn't usually abusive, then makes me wonder if his honesty comes out during the heated argument.
He is not in a position to say, escorting isn't great because he knows he/the family "needs and wants" the money, and all the luxury like a holiday it can afford. He knows the score. He's using his logics/reasoning to "quietly accepting" or he has no other choice. You say, that he used to see escorts. I doubt he's doing that if money is tight or if he respects you too much to do that. Money is power and he knows he shouldn't have said, but maybe, if he actually meant that?
Men usually want a Princess, to look after, provide, protect and nurture etc. Having said that, I'm sure some men will gladly "cope" with their partner escorting for money, especially, if he liked her a lot, but for others, I bet it could be so hard to see their wife "entertaining men". At least, he's trying hard to keep things going.