Is prejudice always wrong?

If you don't want to live there because the majority of people there are of color, then it's wrong. If it's because it's known to be a dangerous area, there is nothing wrong with that.