Fessy says KellyAnne was making wrong assumptions about how he would treat Amber