One should care though as it wasn’t just an offhand remark. But I’m hesitant to be too critical of a person who was brought up / raised in a different time. Not condoning it but putting it into perspective. Still, Ronnie isn’t the Saint many like to think he is.
People care because while things were different back then it was still racist, and more is and should be expected from the man at the top. They also care because it's been happening again with the current president. May be fodder to some but to many it certainly isn't.