In languages like German and Swedish the word for human is more obviously related to the word for man which makes it a bit easier to accept this stuff (mensch/mann/männer, etc)
English is complicated by Latin. Man is from the latin word for hand, and the german word for human. So we end up with older words like manipulate, manumission, and manual having something to do with handling, and newer words like mancrush, manpurse, and mancave, all having to do with masculinity. We also have Manhattan, which has nothing to do with either of those things.
