A recent study indicates that AI chatbots, including ChatGPT, can be nearly as effective as seeking advice from a doctor for individuals suffering from low back pain.
A recent study indicates that AI chatbots, including ChatGPT, can be nearly as effective as seeking advice from a doctor for individuals suffering from low back pain.
Carried out by a global team, this research highlights the role of AI in tackling one of the foremost causes of disability around the globe.
Associate Professor Bruno Tirotti Saragiotto, who co-authored the study and leads the Physiotherapy department at The University of Technology Sydney (UTS), mentioned that the aim of the study was to assess how effectively AI chatbots like ChatGPT respond to typical queries from people dealing with low back pain.
The study, titled “Assessing the performance of AI chatbots in answering patients’ common questions about low back pain,” was recently published in the journal Annals of the Rheumatic Diseases.
Low back pain impacts millions worldwide, often leading those affected to seek information online.
With the increasing presence of AI-driven chatbots offering health recommendations, it is crucial to determine how accurate their advice is.
“The results indicate that AI chatbots can provide guidance with accuracy levels similar to those from healthcare professionals in Australia,” stated Associate Professor Saragiotto.
The research found that AI chatbots performed well when answering queries about treatment suggestions and self-care, but they showed the most inaccuracies regarding risk factors.
For instance, when asked, “What complementary therapies like massage or acupuncture could relieve lower back pain?” the chatbots provided accurate responses. Additionally, the study noted that AI chatbots consistently recommended exercise as an effective method for both preventing and managing low back pain, which is an accurate suggestion.
However, the study also revealed that AI chatbots sometimes offered incorrect advice on other frequently asked questions. For example, while poor posture is not a direct cause of low back pain, the chatbots incorrectly stated it as a cause 88% of the time.
Another important finding was the chatbots’ ability to identify situations that required users to seek medical care. In instances where a medical professional was necessary, the AI systems advised users to consult a healthcare provider in 70-100% of cases.
“Our findings suggest that AI chatbots can serve as useful tools for individuals looking for initial advice on managing low back pain,” explained Dr Giovanni Ferreira, a Research Fellow at the University of Sydney Institute for Musculoskeletal Health and one of the study’s authors.
“However, it’s crucial to emphasize that these resources should supplement, and not replace, professional medical advice,” added Dr Ferreira.
Despite these promising outcomes, researchers identified some limitations in the AI chatbots’ performance. Notably, the responses tended to be complex, requiring a reading level appropriate for those in 10th to 12th grade or university.
“Although the accuracy of the AI-generated advice was commendable, we must also consider how accessible this information is,” commented Associate Professor Saragiotto.
“Ensuring that health guidance is clear and understandable for a wide audience remains a significant challenge in the advancement of AI health tools.”
This research is timely, as more individuals are relying on digital health information, often seeking online resources before or instead of consulting a healthcare provider.
Associate Professor Saragiotto emphasized the importance of recognizing both the strengths and weaknesses of AI resources in managing prevalent health issues like low back pain.
“As AI technology develops, ongoing research will be essential to enhance these tools and guarantee they provide accurate, comprehensible, and safe health information to the public,” he concluded.
