View by category
How do I run the Reviewer Performance Report in Editorial Manager?
Last updated on May 27, 2022Watch this short video to see how to run this report.
The Reviewer Performance Report provides a summary of Reviewer activity for all submissions received during the selected time period. Detailed performance statistics are provided for each Reviewer, along with a link to more detailed information about each Reviewer. See a screenshot of a Reviewer Performance Report .
Information includes number of invitations sent, agreed, declined, and completed, average turnaround times, etc.
- From the Editor main menu move down to the ‘Administrative Functions’ heading at the bottom and click on ‘Reports’. If this link is missing, then you have no permissions to run any reports.
- Under ‘Summary and Annual Reports’, select ‘Reviewer Performance Report‘ . If the option Is missing, then you do not have permission to run this specific report.
- Define the submission date range by clicking on the radio button next to the desired submission date range – either a fixed range (selected from the drop-down menu) or customized dates.
- The dates range determine which submissions and decision are included in the report, as detailed in the section below
- To customize your own date range, enter a starting and ending date. The dates must be entered in the mm/dd/yyyy format (i.e., August 5, 2012, would be represented as 08/05/2012) Alternatively, use the calendar icon to select the dates.
- You may further refine your results by Article Type and/or Section set by choosing one or more values in the selection lists .
- If nothing in the list is selected, then no filter is applied for that parameter.
- On a PC, multiple values may be selected by holding down the ‘Ctrl’ key on your keyboard, while using the mouse to select the desired items in the selection box.
- On a Mac, hold down the ‘Command’ key while using the mouse to select the desired items
- Select any additional criteria by which you wish to run your report.
- List Board Members first: pre-sorts the result with board members first. Board member is a yes/no value set in each reviewer’s account.
- Include Reviewer and Manuscript Ratings in result set: adds additional statistics showing the manuscript rating values set by the reviewers and the review rating values set by editors. Not all journals use these rating schemes and so the statistics are optional.
- Create Extraction file for download: select this option to add a download link to the report for offline use.
- Include Reviewer’s Classifications in download file: adds an optional column to the download with list of each reviewer’s personal classifications.
- Include Reviewer’s Keywords in download file: adds an optional column to the download with list of each reviewer’s personal keywords.
- Display All Reviewers in the system: includes all accounts with any reviewer role, regardless of whether they have any activity in the selected period.
- IMPORTANT: If you will need a download file, be sure to tick the ‘Create extraction file for download parameter’, which is in the middle of the list .
- Click on the ‘Submit’ button to generate the report.
This report generates a summary of reviewer activity for all submissions and revisions received by the journal office during the selected time-period. Some journals will sue this report to determine which reviews should or should not be editorial board members. See a screenshot of a Reviewer Performance Report .
The report is interactive, you can:
- Click on the arrows under column headings to sort the table as you wish.
- Change the number of records displayed per page
- Click on the reviewer’s name which is hyperlinked to see more information about the reviewer’s activity history in the journal.
- Download a .tab file of the results, if the ‘Create extraction file' option was selected before running the report.
The column headings are
- Reviewer Name: linked to a popup with more details about the reviewer.
- Role: the reviewer role as set in the reviewer’s account.
- Board Member: Yes or No, depending on the option selected in the reviewer’s account.
- Reviews In Progress: current number of reviews the have been started but not submitted.
- Statistics for Invitations:
- Total Invitations: total invitations sent in the selected period.
- Outstanding Invitations: current number of active invitations.
- Agreed: number of invitations agreed, (or assigned without invitation) during the selected period.
- Declined: number of invitations declined during the selected period.
- Un-invited Before Agreeing: number of invitations that were either manually uninvited, or automatically expired due to lack or response, within the selected period.
- Terminated Before Agreeing: number where the editor made a decision before this reviewer responded to the invitation.
- Avg Days to Respond: the average time to either agree or decline
- Statistics for Agreed reviews:
- Avg Days to Complete: the average number of days from agreement to completion.
- Submitted on Time: the number submitted on or before the review due date.
- Submitted Late: the number submitted after the review due date.
- Avg Days Late: the average number of days late. A negative number indicates early reviews.
- Un-invited After Agreeing: the number either manually uninvited after agreeing, or automatically expired after being overdue.
- Terminated After Agreeing: the number where the editor made a decision after the reviewer agreed but before they completed the review.
- Avg # Reminders Sent: average number of reminders sent between invitation and when each review was completed/terminated/uninvited.
- Optional Statistics for manuscript ratings (must be selected before running the report): for journal where the reviewers are asked to rate submissions 1-100:
- # MS Ratings
- Avg MS Rating
- Min MS Rating
- Max MS Rating
- Std Dev MS Rating
- Optional statistics for Review Ratings (must be selected before running the report): for journals where editors are asked to rate each competed review 1-100
- # Reviewer Ratings
- Avg Rev Rating
- Min Rev Rating
- Max Rev Rating
- Std Dev Rev Rating
- Download Reports can include additional columns that are not displayed in the on-screen version:
- People ID: the account identification number, to allow for distinction between accounts with similar names.
- Reviewer classifications (if selected in the parameters).
- Reviewer keywords (if selected in the parameters).
The list of reviewers is generated by reviewer role, as well as by the parameter selections
- Accounts that currently have no reviewer role will never be included, even if they otherwise should be based on activity and other parameters.
- If no Reviewer Roles are explicitly selected in the report parameters, then all are included. Otherwise only the selected roles are included.
- If Display All Reviewers in the system is not ticked, then only reviewers who were invited to review submissions received in the selected period will be included. In other words, those reviewers where all statistics come out to 0 will be excluded.
- If Display All Reviewers in the system is ticked, then everyone with the selected reviewer roles
The statistics are generated by looking at manuscripts submitted during the selected time period, regardless of when reviewers were invited, responded, completed, etc. this means that:
- The statics may include reviewer activity that occurred outsaid of the period, as long as the submission was received during the period.
- The report may exclude reviewer activity that occurred during the period if the submissions itself was received outside of the period.
- If Article Type or Section/category parameters have been selected, then only the relevant submission will be included when calculating the statistics.
The Reviewer Performance Report allows editors to look at the performance of reviewers during a selected period. Common uses are:
- To decide if any reviewer role designations should be changed.
- To look for new candidates for Editorial Boards or other groups.
- To identify high-performing reviewers.
Did we answer your question?
Related answers
How are Automated Reviewer Reminders sent from Editorial Manager?
Video Guide: Reporting in Editorial Manager - Reviewer Performance Report
Video Guide: Using the Declaration Tool in Editorial Manager
Recently viewed answers
Functionality disabled due to your cookie preferences