Does anyone else get annoyed when people try to entertain/play with a tired baby?

When your baby is tired does it annoy anyone else when people try to play with your baby?

It annoys me, especially when I've said, "oh he's tired, it's close to nap time", and people dismiss it. Like, he's a human who deserves respect too?

I just think to myself, I'd be pissed if I was dead tired and someone kept shaking keys in my face, so why would my baby be any different? Am I crazy?