Charles was baptised at St Pancras, Chichester, by George and Elizabeth Hersey. Charles’ father was a Master Shoemaker in Tangmere. Elizabeth died in 1854, and in the 1861 Census Charles was living with his paternal grandparents in Boxgrove. He was inspired to become a gardener by his grandfather.