Harvey was one of the "Original Kings of Comedy," but he's also re-invented himself in recent years as a clean, somewhat family-friendly comic. He's also been quite outspoken when it comes to subjects such as children treating their parents with respect, husbands treating their wives like equals, and always dressing like you're proud of yourself (IOW, no torn jeans, foul-mouthed T-shirts and the like).
O'Hurley was a great FF host, but it wasn't his main interest. I read an interview in a golf magazine a few weeks ago where O'Hurley called FF the greatest part-time job in the world, adding that he saw his top priorities (in order) as family, golf and outside business interests.
IIRC, O'Hurley is independently wealthy thanks to his involvement in hedge fund management and other business interests, so he can pick and choose what acting work he'd like to do.
JD