After Heathcote's loss of life at the House, it was bought from Morris by a wealthy stockbroker, Edmund Charlesworth (1831-1890), who lived there from 1879 to 1889 with his spouse Marta and daughter Laura. In 1903 the House was acquired by Henry Muff (1850-1910), a draper from Bradford who lived there with his spouse Maude and their son Edward, who later on became a famous architect.