All you can eat buffets are gross?

When I was younger my family would often go to Golden Buffet. It was a big nice place and I remember it being clean. But now I wouldn't go to one if my life depended on it. Was my family gross? Or did buffets (and it's customers) get grosser?

Now when I do get "all you can eat" it's usually sushi and they bring items to you a few at a time to prevent waste.