Dataset of Comparative Analysis of Dengue Fever and Virus Query Responses from ChatGPT, Google Bard, Google Search, and Bing in Bangla
Description
Dengue fever poses a significant health challenge in Bangladesh, exacerbated by the country's conducive environment for the disease. To address the public's concerns about dengue symptoms, transmission, and treatment, many are turning to web search engines and chatbots like Google, Bing, BARD, and ChatGPT since smartphone and Internet users are regularly increasing in Bangladesh. A questionnaire-based dataset has been developed using these tools to provide comprehensive information. These chatbots, powered by Large Language Models (LLMs), offer content in Bengali, catering to the local population's preference for their native language. The study aims to compare the accuracy of responses from these digital platforms, utilizing ChatGPT-3.5 due to the inaccessibility of GPT-4. This research is significant for understanding public confusion and misinformation regarding dengue, as observed in various media in Bangladesh. This study introduces the 'Dengue Query Dataset Bangla', a meticulously curated dataset derived from queries observed in printed news media, television podcasts, and talk shows. It offers a comprehensive overview of the key questions and areas of confusion surrounding the recent dengue outbreak in Bangladesh. This dataset serves as a valuable resource, consolidating answers to various aspects of dengue in a single, accessible location. Each file in the dataset is in MS Excel (.xlsx) format, containing a total of 310 queries and corresponding responses in 17 sheets with 5 columns each. These sheets comprehensively cover a range of topics related to dengue. Each Excel file in the dataset is structured (as sheets) to address the following related topics concerning dengue: 1. Signs And Symptoms Related 2. Current Situation Related 3. Post-Dengue Implications Related 4. Treatment Related 5. Dengue Prevention Related 6. Economical Effect Related 7. Dengue Research Related 8. Child Care Related 9. Dengue Lifecycle And Gene Structure Related 10. Dengue And Other Diseases Related 11. Dengue And Social Crisis Related 12. Dengue And Mass Media Related 13. Dengue And International Organizations Related 14. Dengue, AI, And E-Hospital Service Related 15. Dengue And New Therapies Related 16. Dengue Tests Related 17. Dengue Vaccine Related Each of the sheets contains 5 columns as follows: 1. Questions: This column lists validated questions in Bangla. 2. Answer: Responses from the corresponding search engine/chatbot in Bangla. 4. Correctness: Measures the authenticity of responses from the corresponding search engine/chatbot where the scoring are: 1- Correct, 2- Nearly Correct, and 3- Irrelevant 5. Fluency: Evaluates the fluidity of responses from the corresponding search engine/chatbot where the scoring are: 1- Amazing, 2-Good, 3- Average, 4- somehow understandable, and 5-not understandable. 6. Goal Achieved Status: Assesses if the expected answer was obtained. Scored as 1 if the answer meets the target goal and 0 otherwise.