COPE Forum – can peer review weather the storm?

On the 7th September 2023, the COPE Forum took place, discussing peer review models and examining the current threats to the systems and challenges faced by all parties involved.

Peer review has long been the cornerstone of scholarly publishing, serving as a quality control mechanism to ensure the accuracy and integrity of research. This communal effort involves authors, editors, publishers, and reviewers working together to uphold the standards of academic discourse. However, the peer-review process is facing unprecedented challenges that threaten its effectiveness. Here, we will discuss the importance of peer review, the emerging challenges it faces, and potential solutions to fortify this vital system.

 

Peer Review

Peer review plays a pivotal role in maintaining the credibility and trustworthiness of scholarly publications. Its benefits include:

  1. Quality Assurance: Peer review helps identify errors, flaws, and biases in research, ensuring that only high-quality and reliable studies are published.
  2. Validation of Findings: It serves as a validation mechanism, confirming the authenticity and significance of research findings.
  3. Feedback for Improvement: Reviewer feedback provides authors with valuable insights for improving their work.
  4. Conflict Resolution: Peer review resolves conflicts and disputes regarding research claims and methodology.

 

Challenges Facing Peer Review

Despite its essential role, the peer-review process is facing several challenges:

  1. Shortage of Skilled Reviewers: There is a growing scarcity of qualified reviewers willing to dedicate their time and expertise to the peer review process. This can lead to overburdened reviewers and delays in publishing.
  2. Fraud and Misconduct: Organized fraud, such as peer-review rings, fake papers, and manipulated results, threatens the integrity of peer review, undermining trust in scholarly publishing.
  3. AI and Large Language Models: The advent of AI tools and large language models has introduced new challenges, including the generation of convincing but false research papers and the potential automation of the peer-review process.

 

Solutions for Strengthening Peer Review

To address these challenges and preserve the integrity of peer review, several strategies can be considered:

  1. Reviewer Recognition and Training: Acknowledging and rewarding reviewers for their contributions can help motivate and retain skilled reviewers. Providing training and guidelines for reviewers can enhance the quality of their assessments.
  2. Transparency and Accountability: Journals can adopt transparent peer-review practices, such as open peer review or preprint reviews, to increase accountability and trust in the process.
  3. Technology and AI: Utilize AI tools not only to detect fraud but also to assist in the peer-review process. AI can help identify potential conflicts of interest, plagiarism, and statistical errors.
  4. Diversifying Reviewer Pools: Encourage diversity among reviewers in terms of gender, ethnicity, and geographical location to ensure a broader range of perspectives.
  5. Collaboration Among Stakeholders: Authors, editors, publishers, and reviewers should work together to establish and maintain best practices for peer review.

 

The peer-review process is at a critical juncture, facing challenges that threaten its efficacy and credibility. However, with concerted efforts from all stakeholders, including researchers, journals, and the broader academic community, it is possible to fortify peer review, adapt to the changing landscape, and ensure that scholarly publishing continues to uphold the highest standards of research integrity. Only through collective action can we safeguard the trust that underpins the dissemination of knowledge in academia.

“… highly efficient and professional.”

Read more

“… impeccably organized, with unfailing professionalism.”

Read more

What Does a Journal Administrator Actually Do?

Managing Editors, Administrators, Journal Staff, Editorial Assistants – whatever you want to call us, we play an integral role in getting your manuscript through peer review. But you may wonder what it is we actually do.

You see, we Managing Editors wear many hats. The honest answer to What It Is We Do is really that we do whatever our particular editor, publisher, and journal workflow needs us to do. But there are some tasks that are common for most of us, so here’s a quick TEH Blog rundown.

System support

Most journals these days make use of an online submission system. These systems are absolutely invaluable to the smooth running of a busy global journal (more on that here), but we are all too aware that they can be confusing and frustrating if you aren’t used to using them.

Your friendly neighbourhood Managing Editors are therefore on hand to answer any questions, resolve any upload problems, and generally support authors, reviewers, and editors in successfully navigating their way through all the buttons, links, and questions.

Administrator checks

Once you’ve submitted your manuscript (whether you needed our help do to so or not), the first thing that will happen is that somebody will check it over to make sure that nothing is missing, and that it’s suitable for peer review. And just who might that “somebody” be? You’ve guessed it: the Managing Editor.

The checks we’re asked to perform varies journal to journal. Sometimes it is literally a case of making sure the manuscript text hasn’t been missed out by mistake, and sometimes it’s an in-depth analysis of your referencing format. Whatever the checks are, it’ll be us who gets in touch to guide you through making any changes, and it’s us who will approve it for review.

Status updates

It might feel like you submitted your manuscript aaaages ago and the status in your author centre has been saying the same thing for a really long time… When the waiting game finally gets too much and you fire off an email to the journal’s Editorial Office, it’s one of us who will respond to give you some idea of what’s happening.

Unfortunately delays do happen – editors and reviewers are, after all, busy people and inevitably deadlines get missed periodically – but we are always working to keep them to a minimum, and are always happy to give you an update. You can find out more about what goes on behind the scenes here.

Point of contact

It’s not just status updates for authors that we handle, however. Been asked to review a paper but need an extension on the deadline? Drop us an email. Need to return your conflict of interest form for your accepted paper? Send it over to us. Somehow wound up with multiple accounts on the submission system that are causing you login problems? We can help with that, too.

In fact, pretty much anything you need as an author, reviewer or editor can be sent to us. If we’re unable to help you ourselves then we will know who to forward the message on to. We Managing Editors are your one-stop shop for all your peer review needs.

Reporting

One of the many benefits of peer review being handled through a submission system is that we can gather data on number of submissions, how many of those get accepted, and even where in the world the research originated from.

When you’re down in the trenches working away at getting the papers assigned to you through peer review it’s not always easy to see the bigger picture, so being able to get actual figures on how many submissions are coming into your journal (and, crucially, how that compares to how many submissions you’ve received in previous years) is absolutely invaluable.

And it’s we Managing Editors who can not only get you this data, but organise it into a report that makes sense of it all.

“… one of the best journal experiences I ever had.”

Read more