Jim practiced as a veterinarian in Connecticut for a short time before being called to fulfill his Army obligation and entering into service as a Second Lieutenant January 1960 in San Antonio, Texas. He was moved around frequently and was involved in the inspection of animal operations including dairy processing and meat packing plants; whereby he developed a keen interest in infectious diseases. While stationed in Huntsville AL, he met a nurse Rose Marilyn (Smith), and they were married December 16, 1961. Jim applied for a job (and was accepted) at the CDC in Atlanta but had simultaneously applied (and was accepted) to medical school at Tulane University. He chose medical school and moved to New Orleans with his new bride.

Upon completion of medical school, Jim received a highly coveted residency placement with Johns Hopkins. He and Marilyn moved to Baltimore in 1966 shortly after honorably completing Army service as a reservist with the rank of Captain. At Hopkins, Jim continued research on infectious diseases while working with partner physicians from the World Heath Organization. Over a several year period his research took him around the world for several months at a time to places like India, Micronesia, and Colombia.

In 1970 he and Marilyn moved to a small farm in rural Baltimore County, where they began a family and enjoyed raising beef cattle (and other animals). Through his involvement with the school of public health at Hopkins, Jim drifted towards pediatrics which would become his dominant professional pursuit. He opened a private pediatric practice in Bel Air, Maryland in the early 1980s which grew into a thriving group with multiple partners. Dr. Brayton served as Chief of Pediatrics at Franklin Square Hospital from 1988-1994 and also as an adjunct professor of pediatrics with the Johns Hopkins School of Medicine.

He retired in 2003 and enjoyed travel, golf, and spending time with family. He was a long-time parishioner at St. Johns the Evangelist in Hydes, MD and a member and volunteer with the Knights of Columbus, working concessions at Oriole baseball games and delivering food to the homeless. He was a member of American Legion Post 39 in Poultney, VT. Throughout his life he was always surrounded by a collection of animalsthat typically included at least one dog and several cats. He could usually be found each summer at the Harford County Farm Fair as a 4H livestock buyer. He was known for his kindness and would greet everyone with a smile, a hearty laugh, and often a story. His ability to work a room was perhaps learned from his father who served as mayor of Poultney VT. Always the joker, Jim said it gave him great pleasure parking his farm truck next to the BMWs at the hospital parking lotand he tried not to scratch them.

Dr Brayton passed away peacefully at his home. He was predeceased by his brother William (1937), sister Mary (2006), and wife Marilyn (2007). He is survived by his two children, Michael James Brayton and Rose Kathleen Brayton Cano; by four grandchildren Patrick, Rachel, James, and Hannah; and by several nieces and nephews. A Mass of Christian Burial will occur at 10:00am on Saturday, October 14 at St. Raphael Church in Poultney, VT.