Most fat/ginger people would just laugh the comment off as a bit of banter, racism is considered offensive as it is to do with equality and stuff. Similar to sexism and why a huge example was made of Keys and Gray.
It is a lot to do with the history as well.
Ginger and fat people are just...