Should I avoid moving to Germany given the rise of the far right?

Northeast Arab African here. Obviously I don't look "Bio-German. I know that the vast majority of Germans are not racist, but I'm worried that my, and my wife's, daily life would include a lot of unpleasant situations, and the risk of physical assault or something more dangerous due to our looks. I have been to Germany, I love the country and the (relative) peace of mind that it provides, but I'm wondering if my looks would make me not able to enjoy that over the upcoming few years. What do you think? Am I catastrophizing?