When are we supposed to sleep on our right side?

Every OB I go to has a different opinion, and some say don’t even worry about it. I’m curious of the overwhelming majority. I’m 11 weeks and sleeping on the right side feels very uncomfortable right now.