Stephen was born on September 12th, 1741 in Henfield. Stephen's father was Stephen Woolgar and his mother was Mary Elsey. His paternal grandparents were William Woolgar and Sarah Hill; his maternal grandparents are John Elsey and Mary Pick. He had three brothers and a sister, named John, Samuel, Samuel and Mary. He was the second oldest of the five children. He died at the age of 80 on October 7th, 1821 in Bramber.