Ruth Leeds was Joseph’s first wife and mother of both of his sons Joseph and Benjamin, ancestors of Priscilla Hayden Hollis. After Ruth died, Deacon Joseph married second Rebecca and then third Lydia Holbrook, widow of Samuel. Lydia is also an ancestor of Priscilla Hayden Hollis from her marriage to Samuel Holbrook.

Deacon Joseph was the first Deacon of the Church in the Middle Precinct, Braintree, organized 10 Sep 1707.

There is a memorial for him on find-a-grave.