As an editor of a scientific journal, one frequently hears complaints about the challenges of finding reviewers for manuscripts. These claims are often backed by anecdotal evidence, but what does the data say? To shed light on this topic, the Editor-in-Chief of the Journal of Comparative Physiology A, Günther K. H. Zupanc, conducted an analysis of editorial data on the journal spanning the years 2014 to 2021. The goal was to examine whether the difficulties in finding reviewers were substantiated by empirical evidence.
The study focused on various aspects of reviewer recruitment and performance. Contrary to popular belief, the findings challenged the perceived difficulties:
- Increasing Number of Invitations: The average number of invitations per submission remained steady.
- Lengthy Response Times: The mean response time remained consistent throughout the analyzed period.
- Decreasing Completion Rates: The fraction of reviewers who completed their review reports remained consistently high and did not decrease over time.
- Delayed Submission of Reports: While some reviewers submitted their reports later than agreed, the proportion of late reviews did not change significantly. Interestingly, the average number of days late reviewers submitted their reports did increase, but early reviewers remained consistently punctual.
- Changing Recommendation Behavior: Reviewers' recommendation behavior, including rejection, major revision, minor revision, and acceptance, did not exhibit significant changes over the analyzed period.
Insights and Implications
The analysis challenges the widely held belief that finding reviewers for manuscripts has become increasingly difficult. The data from the Journal of Comparative Physiology A suggests stability in reviewer recruitment and performance. The findings indicate that hasty generalizations based on a few instances of reviewer shortage may not accurately represent the overall situation.
Factors Affecting Reviewer Recruitment
The analysis also highlights potential factors influencing reviewer recruitment and performance. Journals that serve smaller communities and have editors personally contacting potential reviewers tend to fare better in terms of reviewer engagement compared to those with large submission volumes and reliance on editorial assistants for invitations.
The insights provided by this analysis contribute to a better understanding of the peer review process. Authors and readers can gain a clearer understanding of the evaluation journey manuscripts undergo after submission to a scientific journal. Additionally, it encourages a more nuanced perspective when discussing reviewer shortage and emphasizes the importance of empirical evidence over anecdotal claims.
About the Journal
The Journal of Comparative Physiology A, which is celebrating 100 years in 2024, publishes studies focused on the understanding of physiological mechanisms that relate to the evolution and/or natural behavior of the animal.