Did presidential terms expire at noon before the 20th amendment?

[President Johnson]

Before the 20th Amendment was enacted in 1933, presidents were sworin in on March 4 after the election rather than January 20. Did the presidential term expire at noon (12 p.m.) on March 4, or at midnight? Was that even specified?

Because congressional terms at that time expired at the end of March 3 according to Wikipedia's infoboxes. I've also seen some lists of presidents that had March 3 as ending date. For example James Buchanan as president from March 4, 1857 to March 3, 1861, while Lincoln was listed from March 4 onwards. Midnight is kind of weird, just look at New York governors. Some sources say David Paterson was governor until January 1, 2011, others say December 31, 2010.