While growing up and watching lots of 80s daytime shows, I remember my Mom did not like Barker at all. She didn't mind the other game shows (except that PYL was too loud!) - but she just didn't like Barker. Watching these episodes from this era, I can see why.
Must have been an interesting dynamic between Barker and the rest of them during this time. Given the ratings, Barker probably felt like he could get away with it. Can't think of any other hosts of the era that were as overt with comments like this.