Most rich Wall Streeters and Ivy Leaguers are Democrats, so Romney is seen as a traitor to his class.
Speaking of Wall Streeters, I saw on one of the financial news channels recently a Wall Streeter who said the reason Obama in 2008 got so much Wall Street money was the hate and fear Wall Street had for Sarah Palin. These people are not stupid, so they could not be distracted by the MSM themes about Palin's pregnant daughter or $150,000 wardrobe. No, they read up on how Palin as Alaska Governor instituted strict government ethics laws and pounded Big Oil on taxes and the natural gas pipeline.
Most "Wall Streeters" are Republicans, through and through.
Election results from Manhattan would seem to belie that statement.
Wall Street tycoons are a very small percentage of the total vote of an area that is over 1 million in population.
How about "election results from the Upper East Side and other neighborhoods Wall Street tycoons live in" if you didn't like my shorthand.
The UES also votes Democratic.
Actual Wall Street employment among Manhattan residents is pretty low. Manhattan has a huge population in all kinds of industries. A lot of Wall Streeters are voting R in places like NJ-5 or Monmouth County. The Wall Streeters on the UES are voting R but are outvoted by others.