Born in Charlottesville, Fountain was a descendant of Wormley Hughes and Ursula Granger his grandparents were among the the house slaves owned by Jefferson at Monticello. Jefferson authorized two of Sally's little ones to depart Monticello without having official manumission when they came of age 5 other slaves, which includes the two remaining sons of Sally, ended up freed by his will upon his loss of life.