Olivias brother, Conner Harry Flowers, passed away on January 30, 2023, at the age of 32. Olivia confirmed that her brothers cause of death was Lyme disease, which he had been battling for 17 years. In an Instagram post on May 9, 2023, Olivia explained that Lyme disease is often difficult to diagnose and that her brother had faced several misdiagnoses and unnecessary medicinal treatment at a young age. She also mentioned that by the time he was properly tested and given a diagnosis from an infectious disease specialist, the disease had caused severe internal damage, and the consequences from his earlier "treatment" were just as long-lasting and devastating. Olivias brothers death was a significant event on the reality TV show "Southern Charm," and the cast was devastated by the news. Olivias co-stars rallied around her, offering support and comfort in various ways. Olivia has spoken publicly about her brothers death and his battle with Lyme disease to raise awareness and help others avoid the same struggles that he suffered.