Am I the Ass Hole?

Me(30f) and my bf(45m) were out enjoying lunch yesterday and walking around. I jokingly said “I’m about to mark you as a dependent on my taxes” and he got very mad at me, called me names, and is now being very distant with me(it is now the next day). For context, he lost his job coming up on two years ago and has not been able to find one. I am the one paying rent, buying groceries, paying for when we go out, paying for utilities. He still pays for his credit bills, car, and insurance. I understand that what I said could have came off kind of heartless but I really was just playing around and laughed when I said it…