Ernest Kennedy was born in Kingman, Maine to James Kennedy and Edith (Bailey) Kennedy but lived all his life in Argyle, Maine. He had two brothers and four sisters. He worked in the woods and on the booms in Argyle for fifty years. He was married and had nine children.