Okay, here's one: If you believe that closed borders are morally indefensible, that means that you have a moral compass; if you believe that your moral compass points in the right direction, you would want to advance your ethical principles in the world (in fact, you ought to believe that you have a moral obligation to do so); thus, if you thought that the culture of a particular people was immoral, you could justify that people's exclusion from your homeland by appealing to the potentially sinful effect of their presence.
This is actually one of the issues that liberal Democrats face these days. There are many people who believe that excluding other cultures is morally indefensible. However, they also believe strongly in the values of modernity, which are not universally respected across human cultures. This leads to a paradox where they resolve to embrace cultures that reject their most deeply held beliefs. The resolution that is oftentimes adopted is that people simply refuse to criticize or sometimes even acknowledge retrograde views promulgated in other cultures (e.g. Islam endorsing intensely homophobic views).