Debian for gaming ?

I am a somewhat long timer linux user and heard a lot about gaming finally works on linux. I including today still dual boot just to game. Last weekeng gave it a shot and tried to play PoE2 with Steam's Vulkan support and boy things went sideways. I am currently getting a shitload of freezes up to 2-3 seconds and somethimes tremendous input latencies. I tried to update my amdgpu drivers but turns out they were already fine. What might be the problem here?

gpu: 6900xt
cpu: 5800x