He is married to Patricia Davis Baker, and they have three children - Elizabeth, Robert and Anne Scott. The Baker family enjoys water sports, snow skiing, motorcycles and attending his children's sports. They are active in the Kings Mountain Wesleyan Church. Dr. Baker is also a member of the Kings Mountain Rotary Club, and serves on the Executive Board of the Piedmont Council Boy Scouts of America.
He is married to Sandra Baker, and they have three children - Caroline, Sam, and Meredith. He enjoys attending his children's sporting events with his wife. They are active in the First Baptist Church of Kings Mountain. He also enjoys auto racing with the Sports Car Club of America and the National Auto Sports Association, scuba diving, fishing, and hunting.