Do med breaks destroy you?

I have been on Vyvanse (30-60mg) for a few months and decided to take a break because it hasn’t felt effective lately. These past 4 days without it, I have slept 10-13 hours each night (usually sleep like 6), and have still felt soooo tired everyday. Constantly yawning, feel like I can barely keep my eyes open, want to lay down all day, etc. Is this normal? I can’t even function with how exhausted I feel. Does anyone else have this experience?

Edit: thank you all for sharing your experiences, much appreciate the insight!