(Romney's parents weren't millionaires when he was born either).
That's not very believable.
Mitt was born in 1947, George was at the time working for the Automobile Manufacturers Association. It was a decent middle-class job, but not millionaire territory. In 1948 he went to work for Nash-Kelvinator (one of the forerunners of AMC) and when Nash-Kelvinator merged with Hudson to become American Motors Corporation, George was tapped to become CEO's. But that was still in an era when income tax rates were confiscatory and unless they owned stock, CEO's of major corporations did not become millionaires. It also was in a era when a million dollars was a lot more money than it is today.
So while George was upper middle class when Mitt was born and later rose to become upper class, it's quite believable that he wasn't a millionaire at the time.