That does not come from prejudice at all, stop talking nonesense.
The whole country absolutely adored Naseem Hamed, who was also an Asian fighter.
The reason people dislike Khan, is that they were force fed being told that he was a world champion before he had actually done anything at all, he was forced down our throats even when he was still an amatuer...they had his last amatuer fight on tv FFS anf with a sizeable crowd.
Then he starts his pro career and it was clear to see that he had severe vulnerabilities, but still we were fed this great Khan from Bolton was a big superstar, even when he was getting knocked down by the likes of Willie Limmond. Then he got absolutely sensationally knocked out by Prescott...and everyone just went "told you so"
After that fact, he continued to try and scam the public into thinking he was some kind of superstar, and while he did well to progress his skillset and win some good fights, the initial Khan push just made everyone hate him
Plus he is a fucking bellend