His parents, Thomas E. Oliver and Helena Born née Ash, were married at Portsmouth in the first quarter of 1921, and Ernest was born there in the fourth quarter of the year. By 1928 they had moved to 44c Bognor Road, Chichester, where Ernest died.