Summary of Performance Of a Large Language Model-artificial Intelligence Based Chatbot For Counseling Patients with Sexually Transmitted Infections and Genital Diseases, by Nikhil Mehta et al.
Performance of a large language model-Artificial Intelligence based chatbot for counseling patients with sexually transmitted infections and genital diseases
by Nikhil Mehta, Sithira Ambepitiya, Thanveer Ahamad, Dinuka Wijesundara, Yudara Kularathne
First submitted to arxiv on: 11 Dec 2024
Categories
- Main: Computation and Language (cs.CL)
- Secondary: Artificial Intelligence (cs.AI)
GrooveSquid.com Paper Summaries
GrooveSquid.com’s goal is to make artificial intelligence research accessible by summarizing AI papers in simpler terms. Each summary below covers the same AI paper, written at different levels of difficulty. The medium difficulty and low difficulty versions are original summaries written by GrooveSquid.com, while the high difficulty version is the paper’s original abstract. Feel free to learn from the version that suits you best!
| Summary difficulty | Written by | Summary |
|---|---|---|
| High | Paper authors | High Difficulty Summary Read the original abstract here |
| Medium | GrooveSquid.com (original content) | Medium Difficulty Summary Medium Difficulty Summary: The paper presents Otiz, a novel AI-based chatbot platform designed for sexually transmitted infections (STIs) detection and counseling. Built upon GPT4-0613 and Deterministic Finite Automaton principles, Otiz employs a multi-agent system architecture to provide contextually relevant, medically accurate, and empathetic responses. The chatbot’s components include modules for general STI information, emotional recognition, Acute Stress Disorder detection, and psychotherapy. A question suggestion agent operates in parallel. Evaluations were conducted using prompts mimicking patient language, with 23 venereologists grading Otiz on six criteria. Results showed high scores for diagnostic accuracy (4.1-4.7), overall accuracy (4.3-4.6), correctness of information (5.0), comprehensibility (4.2-4.4), and empathy (4.5-4.8). However, relevance scores were lower (2.9-3.6), suggesting some redundancy. The study demonstrates Otiz’s potential to alleviate the burden on healthcare systems by providing accurate, correct, discrete, non-judgmental, readily accessible, and easily understandable STI-related information in an empathetic manner. |
| Low | GrooveSquid.com (original content) | Low Difficulty Summary Low Difficulty Summary: This paper introduces a new AI chatbot called Otiz that helps people with sexually transmitted infections (STIs). The chatbot is special because it’s designed to talk to people about their health concerns and provide helpful information. It can recognize emotions, detect stress, and even suggest questions to ask the doctor. Doctors were asked to test Otiz by giving it a series of tests. The results showed that Otiz did a great job providing accurate and helpful information. This could be very useful because many people don’t have access to healthcare professionals when they need help. |
