biostudies-literatureUnknown5Shen SM<h4>Background</h4>Peer review remains central to ensuring research quality, yet it is constrained by reviewer fatigue and human bias. The rapid rise in scientific publishing has worsened these challenges, prompting interest in whether large language models (LLMs) can support or improve the peer review process.<h4>Objective</h4>This study aimed to address critical gaps in the use of LLMs for peer review of papers in the field of organ transplantation by (1) comparing the performance of 5 recent open-source LLMs; (2) evaluating the impact of author affiliations-prestigious, less prestigious, and none-on LLM review outcomes; and (3) examining the influence of prompt engineering strategies, including zero-shot prompting, few-shot prompting, tree of thoughts (ToT) prompting, and retrieval-augmJMIR AIe84322https://www.ebi.ac.uk/biostudies/studies/S-EPMC12936655biostudies-literatureEvaluation of Large Language Models for Peer Review in Transplantation Research: Algorithm Validation Study.PMC12936655Li MHShen SMPaul KHuang XKoizumi NWang ZfalseEvaluation of Large Language Models for Peer Review in Transplantation Research: Algorithm Validation Study.<h4>Background</h4>Peer review remains central to ensuring research quality, yet it is constrained by reviewer fatigue and human bias. The rapid rise in scientific publishing has worsened these challenges, prompting interest in whether large language models (LLMs) can support or improve the peer review process.<h4>Objective</h4>This study aimed to address critical gaps in the use of LLMs for peer review of papers in the field of organ transplantation by (1) comparing the performance of 5 recent open-source LLMs; (2) evaluating the impact of author affiliations-prestigious, less prestigious, and none-on LLM review outcomes; and (3) examining the influence of prompt engineering strategies, including zero-shot prompting, few-shot prompting, tree of thoughts (ToT) prompting, and retrieval-augm2026-01-01T00:00:00Z2026 Feb2026-07-16T22:04:48.674Z2026-07-11T03:11:31.846ZS-EPMC129366554167247410.2196/84322