The Carters may have had a young daughter but they also had three daughters-in-law by the time Jimmy became president, and most of the family moved to Washington. 

Jack and wife Juliette "Judy" Langford stayed in Georgia, where they had welcomed son Jason James Carter on Aug. 7, 1975, and where daughter Sarah Rosemary would be born Dec. 19, 1978. (After their divorce, Jack married mother of two Elizabeth Brasfield on May 15, 1992.)

The Carters' second son, James Earl "Chip" Carter III, worked for the Democratic National Committee in Washington while his dad was in office and moved into the White House with wife Caron Griffin, who was eight months pregnant on Inauguration Day. Still, she strolled along the parade route with the rest of the family for a few blocks when the president and first lady made the unprecedented move to walk the whole mile and a half from the Capitol to 1600 Pennsylvania Avenue.

"People along the parade route, when they saw that we were walking, began to cheer and weep," Jimmy later wrote, "and it was an emotional experience for us as well."