Judged by badges and tabs

Recently I checked into a new unit and started wearing a sanitized uniform.. just to see how people would treat me. I’m a SFC with a little under 11 years in, four deployments, and I’ve got more than a few things on my STP. BUT in the name of research, I got new uniforms and kept off all badges, combat patch, and tab and when I tell you I have never felt so judged in my life. By officers and enlisted alike and mind you this is a non deploying and mixed unit. we have reservists, AGR, and active duty. Why in what I would consider not a time of war are people still so stuck on these badges and patches? Not even in a petty way I was straight up told “you’ve never deployed how can you lead troops” by a Kuwait rotatee. What are y’all’s opinions on the matter? I really think I’m going to keep everything plain going forward.