How Physician Reviews Affect Online Consultation Demand: An Innovative Small Language Model with Fine-Tuning

References

• AHRQ (2019) Examples of physician quality measures for consumers. Retrieved December 22, https://www.ahrq.gov/talkingquality/measures/setting/physician/examples.html.Google Scholar
• AHRQ (2024) Mission and budget. Retrieved December 22, https://www.ahrq.gov/cpi/about/mission/index.html.Google Scholar
• Al-Abri R, Al-Balushi A (2014) Patient satisfaction survey as a tool towards quality improvement. Oman Medical J. 29(1):3–7.Crossref, Google Scholar
• Anthropic (2023) Model card and evaluations for Claude models. Retrieved May 7, https://www-cdn.anthropic.com/bd2a28d2535bfb0494cc8e2a3bf135d2e7523226/Model-Card-Claude-2.pdf.Google Scholar
• Ballard DJ (2014) The Guide to Achieving STEEEP Health Care: Baylor Scott & White Health’s Quality Improvement Journey (Productivity Press, Boca Raton, FL).Google Scholar
• Carr-Hill RA (1992) The measurement of patient satisfaction. J. Public Health Medicine 14(3):236–249.Google Scholar
• Chen Y, Rui H, Whinston AB (2024) Conversation analytics: Can machines read between the lines in real-time strategic conversations? Inform. Systems Res. 36(1):440–455.Link, Google Scholar
• Cottier B, Rahman R, Fattorini L, Maslej N, Besiroglu T, Owen D (2024) The rising costs of training frontier AI models. Preprint, submitted May 31, https://arxiv.org/abs/2405.21015.Google Scholar
• Dagger TS, Sweeney JC, Johnson LW (2007) A hierarchical model of health service quality: Scale development and investigation of an integrated model. J. Service Res. 10(2):123–142.Crossref, Google Scholar
• Dai AM, Olah C, Le QV (2015) Document embedding with paragraph vectors. Preprint, submitted July 29, https://doi.org/10.48550/arXiv.1507.07998.Google Scholar
• Devlin J, Chang M-W, Lee K, Toutanova K (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. Burstein J, Doran C, Solorio T, eds. Proc. Conf. North Amer. Chapter Assoc. Comput. Linguistics: Human Language Tech. (Association for Computational Linguistics, Kerrville, TX), 4171–4186.Google Scholar
• Dong Z, Dong Q (2003) Hownet: A hybrid language and knowledge resource. Zong C, ed. Proc. Internat. Conf. Natural Language Processing Knowledge Engrg. (IEEE Press, Piscataway, NJ), 820–824.Google Scholar
• Dorsey ER, Topol EJ (2016) State of telehealth. New England J. Medicine 375(2):154–161.Crossref, Google Scholar
• Emmert M, Meier F (2013) An analysis of online evaluations on a physician rating website: Evidence from a German public reporting instrument. J. Medical Internet Res. 15(8):e2655.Crossref, Google Scholar
• Epstein RM, Street RL (2011) The values and value of patient-centered care. Ann. Family Medicine 9(2):100–103.Crossref, Google Scholar
• Evans R, Berman S, Burlingame E, Fishkin S (2020) It’s time to take patient experience measurement and reporting to a new level: Next steps for modernizing and democratizing national patient surveys. Retrieved May 3, https://www.healthaffairs.org/do/10.1377/forefront.20200309.359946.Google Scholar
• Fan W, Zhou Q, Qiu L, Kumar S (2023) Should doctors open online consultation services? An empirical investigation of their impact on offline appointments. Inform. Systems Res. 34(2):629–651.Link, Google Scholar
• Fang X, Gao Y, Hu PJH (2021) A prescriptive analytics method for cost reduction in clinical decision making. MIS Quart. 45(1):83–115.Crossref, Google Scholar
• Fleiss JL, Levin B, Paik MC (2013) Statistical Methods for Rates and Proportions (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Fung CH, Elliott MN, Hays RD, Kahn KL, Kanouse DE, McGlynn EA, Spranca MD, et al. (2005) Patients’ preferences for technical versus interpersonal quality when selecting a primary care physician. Health Services Res. 40:957–977.Crossref, Google Scholar
• Gao G, Greenwood BN, Agarwal R, McCullough J (2015) Vocal minority and silent majority: How do online ratings reflect population perceptions of quality? MIS Quart. 39(3):565–589.Crossref, Google Scholar
• Gao GG, McCullough JS, Agarwal R, Jha AK (2012) A changing landscape of physician quality reporting: Analysis of patients’ online ratings of their physicians over a 5-year period. J. Medical Internet Res. 14(1):e38.Crossref, Google Scholar
• Google (2024) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. Retrieved May 7, https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf.Google Scholar
• Grabner-Kräuter S, Waiguny MK (2015) Insights into the impact of online physician reviews on patients’ decision making: Randomized experiment. J. Medical Internet Res. 17(4):e93.Crossref, Google Scholar
• Grand View Research (2024) Healthcare IT market size, share & trends analysis report by application (EHR, CPOE, electronic prescribing systems, medical imaging information), by delivery mode, by end use, by region, and segment forecasts, 2024-2030. Retrieved October 25, https://www.grandviewresearch.com/industry-analysis/healthcare-it-market.Google Scholar
• Grøndahl VA, Wilde-Larsson B, Karlsson I, Hall-Lord ML (2013) Patients’ experiences of care quality and satisfaction during hospital stay: A qualitative study. Eur. J. Personality Centered Healthcare 1(1):185–192.Crossref, Google Scholar
• Guo J, Wang X, Wu Y (2020) Positive emotion bias: Role of emotional content from online customer reviews in purchase decisions. J. Retailing Consumer Services 52:101891.Crossref, Google Scholar
• Hao H (2015) The development of online doctor reviews in China: An analysis of the largest online doctor review website in China. J. Medical Internet Res. 17(6):e134.Crossref, Google Scholar
• Hao H, Zhang K, Wang W, Gao G (2017) A tale of two countries: International comparison of online doctor reviews between China and the United States. Internat. J. Medical Inform. 99:37–44.Crossref, Google Scholar
• Hendershott T, Zhang MX, Zhao JL, Zheng E (2017) Call for papers—Special issue of information systems research fintech: Innovating the financial industry through emerging information technologies. Inform. Systems Res. 28(4):885–886.Link, Google Scholar
• Hirpa M, Woreta T, Addis H, Kebede S (2020) What matters to patients? A timely question for value-based care. PLoS One 15(7):e0227845.Crossref, Google Scholar
• Jiang L, Hou J, Ma X, Pavlou PA (2024) Punished for success? A natural experiment of displaying clinical hospital quality on review platforms. Inform. Systems Res. 36(1):285–306.Link, Google Scholar
• Ko D, Mai F, Shan Z, Zhang D (2019) Operational efficiency and patient-centered health care: A view from online physician reviews. J. Oper. Management 65(4):353–379.Crossref, Google Scholar
• Koonin LM, Hoots B, Tsang CA, Leroy Z, Farris K, Jolly B, Antall P, et al. (2020) Trends in the use of telehealth during the emergence of the Covid-19 pandemic—United States, January–March 2020. Morbidity and Mortality Weekly Rep. 69(43):1595–1599.Crossref, Google Scholar
• Lamprecht R, Struppek J, Heydecke G, Reissmann DR (2020) Patients’ criteria for choosing a dentist: Comparison between a university-based setting and private dental practices. J. Oral Rehabilitation 47(8):1023–1030.Crossref, Google Scholar
• Lau JH, Baldwin T (2020) An empirical evaluation of Doc2vec with practical insights into document embedding generation. Blunsom P, Cho K, Cohen S, Grefenstette E, Hermann KM, Rimell L, Weston J, Yih SW, eds. Proc. 1st Workshop Representation Learn. NLP (Association for Computational Linguistics, Kerrville, TX), 78–86.Google Scholar
• Le Q, Mikolov T (2014) Distributed representations of sentences and documents. Xing EP, Jebara T, eds. Proc. 31st Internat. Conf. Machine Learn. (PMLR, New York), 1188–1196.Google Scholar
• Lee V (2017) Transparency and trust: Online patient reviews of physicians. New England J. Medicine 376(3):197–199.Crossref, Google Scholar
• Lepagnol P, Gerald T, Ghannay S, Servan C, Rosset S (2024) Small language models are good too: An empirical study of zero-shot classification. Calzolari N, Kan MY, Hoste V, Lenci A, Sakti S, Xue N, eds. Proc. Joint Internat. Conf. Comput. Linguistics, Language Resources Evaluation (ELRA, Marseille, France).Google Scholar
• Li M, Tan CH, Wei KK, Wang K (2017) Sequentiality of product review information provision. MIS Quart. 41(3):867–892.Crossref, Google Scholar
• Liu B (2022) Sentiment Analysis and Opinion Mining (Springer Nature, Cham, Switzerland).Google Scholar
• Menon S, Sarkar S (2016) Privacy and big data. MIS Quart. 40(4):963–982.Crossref, Google Scholar
• Michel J, Kawonga M, Rubin H (2023) Pandemic-driven telehealth uptake: The missing healthcare provider, system and patient voices. Frontiers Digital Health 5:1293921.Crossref, Google Scholar
• Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Burges CJC, Bottou L, Welling M, Ghahramani Z, Weinberger KQ, eds. Adv. Neural Inform. Processing Systems (Curran Associates, Inc., Red Hook, NY), 3111–3119.Google Scholar
• NEJM Catalyst (2017) What is patient-centered care? Retrieved January 1, https://catalyst.nejm.org/doi/full/10.1056/CAT.17.0559.Google Scholar
• OpenAI (2023) Gpt-4 technical report. Retrieved May 7, https://arxiv.org/pdf/2303.08774.Google Scholar
• Pan X, Zhou X, Yu L, Hou L (2023) Switching from offline to online health consultation in the post-pandemic era: The role of perceived pandemic risk. Frontiers Public Health 11:1121290.Crossref, Google Scholar
• Pang B, Lee L (2008) Opinion mining and sentiment analysis. Foundations Trends Inform. Retrieval 2(1–2):1–135.Crossref, Google Scholar
• Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, et al. (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J. Machine Learn. Res. 21(1):5485–5551.Google Scholar
• Saifee DH, Zheng Z, Bardhan IR, Lahiri A (2020) Are online reviews of physicians reliable indicators of clinical outcomes? A focus on chronic disease management. Inform. Systems Res. 31(4):1282–1300.Link, Google Scholar
• Salazar J, Liang D, Nguyen TQ, Kirchhoff K (2020) Masked language model scoring. Jurafsky D, Chai J, Schluter N, Tetreault J, eds. Proc. 58th Annual Meeting Assoc. Comput. Linguistics (Association for Computational Linguistics, Kerrville, TX), 2699–2712.Google Scholar
• Scaletta T (2015) Timely patient satisfaction surveys: No longer an option. Retrieved May 3, https://www.fiercehealthcare.com/healthcare/timely-patient-satisfaction-surveys-no-longer-option.Google Scholar
• Schlesinger M, Grob R, Shaller D (2015) Using patient-reported information to improve clinical practice. Health Services Res. 50(S2):2116–2154.Crossref, Google Scholar
• Siegrist RB (2013) Patient satisfaction: History, myths, and misperceptions. Virtual Mentor 15(11):982–987.Google Scholar
• Singh A, Prasher A, Kaur N (2020) Assessment of hospital service quality parameters from patient, doctor and employees’ perspectives. Total Quality Management Bus. Excellence 31(13–14):1467–1486.Crossref, Google Scholar
• Singh A, Alryalat MAA, Alzubi JA, Sarma HK (2017) Understanding Jordanian consumers’ online purchase intentions: Integrating trust to the Utaut2 framework. Internat. J. Appl. Engrg. Res. 12(20):10258–10268.Google Scholar
• Tahoe Forest Health System (2025) Quality and safety. Retrieved September 20, https://www.tfhd.com/about/quality-safety/#toc_Quality_and_Safety_Defined.Google Scholar
• Thomas Craig KJ, McKillop MM, Huang HT, George J, Punwani ES, Rhee KB (2020) US hospital performance methodologies: A scoping review to identify opportunities for crossing the quality chasm. BMC Health Services Res. 20(1):640.Crossref, Google Scholar
• Touvron H, Lavril T, Izacard G, Martinet X, Lachaux MA, Lacroix T, Rozière B, et al. (2023) Llama: Open and efficient foundation language models. Preprint, submitted February 27, https://doi.org/10.48550/arXiv.2302.13971.Google Scholar
• Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, et al. (2017) Attention is all you need. von Luxburg U, Guyon I, Bengio S, Wallach H, Fergus R, eds. Proc. 31st Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Inc., Red Hook, NY),Google Scholar
• Vennik FD, Adams SA, Faber MJ, Putters K (2014) Expert and experiential knowledge in the same place: Patients’ experiences with online communities connecting patients and health professionals. Patient Ed. Counseling 95(2):265–270.Crossref, Google Scholar
• Wan Y, Peng Z, Wang Y, Zhang Y, Gao J, Ma B (2021) Influencing factors and mechanism of doctor consultation volume on online medical consultation platforms based on physician review analysis. Internet Res. 31(6):2055–2075.Crossref, Google Scholar
• Xu Y, Armony M, Ghose A (2021) The interplay between online reviews and physician demand: An empirical investigation. Management Sci. 67(12):7344–7361.Link, Google Scholar
• Yang H, Guo X, Wu T (2015) Exploring the influence of the online physician service delivery process on patient satisfaction. Decision Support Systems 78(C):113–121.Crossref, Google Scholar
• Yang K, Lau RY, Abbasi A (2023) Getting personal: A deep learning artifact for text-based measurement of personality. Inform. Systems Res. 34(1):194–222.Link, Google Scholar
• Yaraghi N, Wang W, Gao G, Agarwal R (2018) How online quality ratings influence patients’ choice of medical providers: Controlled experimental survey study. J. Medical Internet Res. 20(3):e99.Crossref, Google Scholar
• Zaheer M, Guruganesh G, Dubey KA, Ainslie J, Alberti C, Ontanon S, Pham P, et al. (2020) Big bird: Transformers for longer sequences. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Inc., Red Hook, NY), 17283–17297.Google Scholar