As a man, I prefer wearing towels around my chest
In society, men are generally expected to wear towels around their waists after getting out of a bath/shower. However I, as a man, feel much more comfortable wearing my towel around my chest, in the way women are generally expected to wear theirs.
I find that I feel the cold more in my upper body than I do in my legs, so covering more of my upper body is preferable. Wearing the towel around my waist results in it hitting my ankles or even dragging against the floor, which is annoying. I also personally feel more comfortable in general exposing my legs than exposing my upper body, especially my nipples. I don't really know why, but walking around shirtless has never been comfortable at all for me.