Patient-generated health communication: a novel readability analysis of online reviews in orthopaedic surgery

Authors

  • Delaney G. Shroat Department of Medicine, University of Kentucky, Lexington, KY, USA
  • James R. Goetz Department of Medicine, University of Kentucky, Lexington, KY, USA
  • Edward L. Major Department of Medicine, University of Kentucky, Lexington, KY, USA
  • Amber N. Carroll Department of Medicine, University of Kentucky, Lexington, KY, USA
  • James D. Nash Department of Orthopaedic Surgery, University of Arizona, Tucson, Arizona, USA
  • Sameer Badarudeen Department of Orthopaedic Surgery, University of Kentucky, Lexington, KY, USA

DOI:

https://doi.org/10.18203/issn.2455-4510.IntJResOrthop20252627

Keywords:

Health literacy, Artificial intelligence, Orthopaedic surgery, Patient education, Health communication

Abstract

Background: Health literacy plays a critical role in patient outcomes, treatment adherence, and care satisfaction. Leading national health organizations and institutions recommend that health communication materials be written at or below the sixth-grade reading level to maximize accessibility. However, the appropriateness of this standard for digitally engaged patient populations remains unclear. This study examined the readability of patient-written online reviews of orthopaedic surgeons to explore whether higher readability levels may still support effective patient communication.

Methods: Orthopaedic surgeons were randomly selected from the American Association of Hip and Knee Surgeons (AAHKS) directory. The most recent online patient review (minimum 50 words) for each surgeon was retrieved from Healthgrades.com, along with the surgeon’s star rating and reviewer’s ZIP code. Readability was assessed using validated tools, including the Flesch-Kincaid grade level (FKGL). Statistical analyses were performed to explore the relationships between readability scores and surgeon rating, geographic region, and household income.

Results: A total of 114 reviews and ratings were analyzed. The mean FKGL was 7.46 (SD 2.49; median: 7.24), significantly above the sixth-grade recommendation (t (114) =6.251, p<0.001). No significant associations were found between the readability level and star rating (p=0.976), region (p=0.697), or median income (p=0.720).

Conclusions: These results suggest that patients actively participating in online health communication exhibit higher literacy levels than the current guidelines assume. This suggests that health communication materials can be crafted at a higher readability level, potentially enhancing message clarity, engagement, and educational value without reducing patient comprehension.

Metrics

Metrics Loading ...

References

Mitchell JP. Association of provider communication and discharge instructions on lower readmissions. J Healthc Qual. 2015;37:33-40. DOI: https://doi.org/10.1097/01.JHQ.0000460126.88382.13

Institute of Medicine (US) Committee on Health Literacy. Health Literacy: A Prescription to End Confusion. Nielsen-Bohlman L, Panzer AM, Kindig DA, editors. Washington (DC): National Academies Press (US). 2004.

Weiss BD. Health literacy: help your patients understand: a continuing medical education (CME) program that provides tools to enhance patient care, improve office productivity, and reduce healthcare costs: American Medical Association Foundation and American Medical Association. 2003.

Badarudeen S, Sabharwal S. Assessing readability of patient education materials: current role in orthopaedics. Clin Orthop Relat Res. 2010;468:2572-80. DOI: https://doi.org/10.1007/s11999-010-1380-y

Roberts H, Zhang DF, Dyer GSM. The Readability of AAOS Patient Education Materials: Evaluating the Progress Since 2008. J Bone Joint Surg-Am. 2016;98:6. DOI: https://doi.org/10.2106/JBJS.15.00658

Rooney MK, Santiago G, Perni S, Horowitz DP, McCall AR, Einstein AJ, et al. Readability of patient education materials from high-impact medical journals: a 20-year analysis. J Patient Exp. 2021;8:2374373521998847. DOI: https://doi.org/10.1177/2374373521998847

Ghanem D, Covarrubias O, Maxson R, Sabharwal S, Shafiq B. Readability of Trauma-related Patient Education Materials From the American Academy of Orthopaedic Surgeons and Orthopaedic Trauma Association Websites. J Am Acad Orthop Surg. 2024;32:e642-50. DOI: https://doi.org/10.5435/JAAOS-D-23-00449

Badarudeen S, Sabharwal S. Readability of patient education materials from the American Academy of Orthopaedic Surgeons and Pediatric Orthopaedic Society of North America web sites. J Bone Joint Surg Am. 2008;90:199-204. DOI: https://doi.org/10.2106/JBJS.G.00347

Jiggins K. A content analysis of the Meaningful Use clinical summary: do clinical summaries promote patient engagement? Prim Health Care Res Dev. 2016;17:238-51. DOI: https://doi.org/10.1017/S1463423615000353

Wang LW, Miller MJ, Schmitt MR, Wen FK. Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm. 2013;9:503-16. DOI: https://doi.org/10.1016/j.sapharm.2012.05.009

Semega J, Kollar M. Income in the United States: 2021. US Census Bureau, Current Population Reports. 2022;60-76.

Clear Communication National Institutes of Health (NIH). National Institutes of Health. 2023. Available at: https://www.nih.gov/institutes-nih/nih-office-director/office-communications-public-liaison/clear-communication. Accessed on 12 May 2025.

Weiss BD, Coyne C, Michielutte R, Davis TC, Meade CD, Doak LG, et al. Communicating with patients who have limited literacy skills - Report of the National Work Group on Literacy and Health. J Fam Pract. 1998;46:168-76.

Kutner M, Greenberg E, Baer J. National Assessment of Adult Literacy (NAAL). A first look at the literacy of America’s adults in the 21st century: Washington DC: National Center for Education Statistics, US Department of Education. 2005.

Sabharwal S, Badarudeen S, Unes Kunju S. Readability of online patient education materials from the AAOS web site. Clin Orthop Relat Res. 2008;466:1245-50. DOI: https://doi.org/10.1007/s11999-008-0193-8

Weiss BD. Health literacy. American Medical Association. 2003;253:358.

Nielsen-Bohlman L. Health Literacy: A Prescription to End Confusion: National Academies Press. 2004;345. DOI: https://doi.org/10.17226/10883

Miskiewicz M, Capotosto S, Ling K, Hance F, Wang E. Readability Analysis of Patient Education Material on Rotator Cuff Injuries From the Top 25 Ranking Orthopaedic Institutions. J Am Acad Orthop Surg Glob Res Rev. 2024;8:20240509. DOI: https://doi.org/10.5435/JAAOSGlobal-D-24-00085

Ribeiro LFR, Bansal, Mohit, Dreyer, Markus. Generating Summaries with Controllable Readability Levels. 2023. Available at: https://arxiv.org/abs/ 2310.10623. Accessed on 12 May 2025.

Downloads

Published

2025-08-25

How to Cite

Shroat, D. G., Goetz, J. R., Major, E. L., Carroll, A. N., Nash, J. D., & Badarudeen, S. (2025). Patient-generated health communication: a novel readability analysis of online reviews in orthopaedic surgery . International Journal of Research in Orthopaedics, 11(5), 1013–1018. https://doi.org/10.18203/issn.2455-4510.IntJResOrthop20252627

Issue

Section

Original Research Articles