Help with gauge issues

I’m knitting the Sabai top and was recommended by my LYS to use Zooey by Juniper Moon. To me, it seems finer than the recommended yarns but I’m trying to make it work. Pattern calls for 20sts in a 4x4 and I got 24 stitches with the recommended 4mm needles. I went up to 4.5mms and got 23 stitches in a 4x4. Both swatches were washed and blocked, but I’m surprised there isn’t much difference? I’m also concerned that getting gauge with this yarn is going to give me a very sheer fabric. My current plan is to exchange this yarn and use a recommended one by the pattern, but I’m looking for guidance on my gauge anyhow. Do the results I’m getting after making adjustments seem right? I’ve attached pictures of my swatches to give a visual. The left swatch is 4mm and right is 4.5mm.

I’m knitting the Sabai top and was recommended by my LYS to use Zooey by Juniper Moon. To me, it seems finer than the recommended yarns but I’m trying to make it work. Pattern calls for 20sts in a 4x4 and I got 24 stitches with the recommended 4mm needles. I went up to 4.5mms and got 23 stitches in a 4x4. Both swatches were washed and blocked, but I’m surprised there isn’t much difference? I’m also concerned that getting gauge with this yarn is going to give me a very sheer fabric. My current plan is to exchange this yarn and use a recommended one by the pattern, but I’m looking for guidance on my gauge anyhow. Do the results I’m getting after making adjustments seem right? I’ve attached pictures of my swatches to give a visual. The left swatch is 4mm and right is 4.5mm.