The Gentle Art of Reviewer Selection

Apr 14, 2022 | Scholarly publishing

Reviewer selection is arguably the most important part of an academic editor’s job; without good reviewers, the whole peer-review process grinds to a halt. So, if you are a good reviewer, I would like to take this opportunity to say, on behalf of editors and authors everywhere: Thank You!

What makes a good reviewer?

A good reviewer is somebody who reads the paper thoroughly, with an unbiased mind, and gives an honest opinion without being unnecessarily unkind to the authors or getting upset that their own work hasn’t been referenced enough (this happens more often than it should).

But the key thing that elevates someone to the ranks of a “good reviewer” is that they return their reviews on time. And, on the odd occasion that they can’t – things come up, life happens, it’s inevitable – they let the editorial team know. When it comes to the peer-review process, there is nothing worse than a reviewer who agrees to review a manuscript then disappears off the face of the earth.

For all we know, they could be busy crafting the greatest review academia has ever seen, but if it takes so long that the authors lose patience and withdraw their manuscript then it honestly doesn’t help anybody.

How do you find a good reviewer?

If you’re a new editor, you will probably start with your colleagues, your professional acquaintances, people who you know you can rely on to do a good job. But there comes a point when you have to take the plunge and start asking people who you don’t know so well – your colleagues aren’t available, it’s slightly outside of their specialism, they’ve already reviewed eight papers for you this month – so where do you begin to look for specialists who you’ve never bumped into at a conference?

1. The Editorial Board

If you’ve taken over the editorship of an established journal, then the Editorial Board should be your first port of call. The Board will almost certainly be made up of specialists from all over the world and often it is a condition of being listed as a Board member that they review a certain number of manuscripts for the journal. They are also a fantastic resource as they will know other experts in their particular field who they can recommend to undertake the review if/when they can’t do it themselves.

2. Your Reviewer Database

Again, this applies to established journals, but if peer review is run through an online submission system, then you will have a reviewer database at your fingertips. This database should be searchable by key word so you can, in effect, ask your system to suggest suitable candidates for you at the click of a button.

3. Advertise for Volunteers

We were recently talking to an editor who has a sign-up sheet on his journal’s homepage for people who wish to be considered as reviewers. He sends out regular emails containing the abstracts of submitted manuscripts and the reviewers on the list simply reply to volunteer for any they’d like to review. An unusual and ingenious tactic.

4. Ask Jane

Jane, or the Journal/Author Name Estimator, is an online tool which uses the title of a manuscript to search for relevant journals to submit it to, relevant articles to cite in it, and authors who’ve written on similar topics who might make good reviewers. In order to find these authors-of-similar-papers-who-might-make-good-reviewers, simply enter the title or abstract of the article in question in the box and click “Find authors”. She’ll then trot off to do a PubMed search and come back with a list of names and email addresses for you. If you’re struggling to find reviewers for a paper, we suggest you give her a go!

Online Submission Systems

Mar 14, 2022 | Scholarly publishing

Absolutely everything is done online these days and peer review is no different. If you’ve ever written a journal article, or been asked to review one, then you will no doubt be familiar with online submission systems.

They generally involve filling out a lengthy form, inputting a lot of information, and then attempting to persuade your manuscript files to upload. It probably won’t be surprising to hear, then, that a question all peer-review administrators will have heard at some point or other is:

Wouldn’t it be easier to just email it?

Online submission systems are used for a reason (and we promise said reason isn’t just to annoy researchers).

Tedious as it is to have to fill out all that information during submission, it is all information that we need. If you were to just email it, we would simply have to go back and forth via email until all the information had been supplied. Trust us when we tell you that it is actually much quicker to just fill in the form.

With the pressure for academics and researchers to publish more and more of their research, journals are receiving more and more submissions. Online submission systems which house all the information pertaining to each individual manuscript and automatically record when reviews and revised versions come in are an invaluable tool when trying to keep up with this demand for publication.

Successful journals these days are global enterprises with Editors and Associate Editors based all over the world. Having a system where everyone can just log in and see what manuscripts are assigned to them, what stage they’re all at, and whether any action needs to be taken makes this process far easier to manage.

Yes, but surely this could all be managed on a spreadsheet?

Those of us who’ve been in this game long enough will remember the days of running journals using emails and spreadsheets. This is a perfectly reasonable system in principle, however all it takes is for one email to go astray or for one piece of progress not to be recorded on the spreadsheet (easy to do, especially when working on a busy journal) and the peer-review process stalls. Online systems are designed to make sure that manuscripts can’t “fall through the cracks”.

The other great feature of online submission systems is that they automatically remind people when they need to be doing something. If you’ve used an online submission system as a reviewer, then you’ll no doubt have received reminders sent from the system when your comments are due to be submitted. What you may not realise is that the editorial team also receive automated notifications – a new manuscript’s been submitted and needs to be checked over, more potential reviewers need to be assigned as none of those already invited is available, a decision needs to be taken, etc.

The other (and arguably the most important) thing that the online submission systems have over spreadsheets is good old-fashioned layout. When we log into the system as administrators, we get an overview of how many manuscripts are in each stage. We can then check each stage and see how long each manuscript has been there and whether any action is overdue. We can then go into that individual manuscript and see who’s done what and when they did it.

But I’m really struggling with uploading my files and it just won’t let me submit.

Please send the Administrator an email and ask for help. Just because the majority of journals don’t accept submissions via email these days doesn’t mean you aren’t allowed to email us. We are here to help and to do everything we can to make sure the peer-review process runs smoothly – most of us are more than happy to help you submit your article, advise you how to prevent the problem from occurring in future, and even to upload your files if you’re having connection problems.