Many conferences simply keep the default review form that is in the system, but may others modify it slightly or completely change the review form set up. Below is an overview of what is possible.
Scoring categories questions:
By default, the scoring categories are what you see in the image below. Each category can be expanded to see more details. You can customise the text and numbering system.
Many conferences simply keep the default scoring grades that you see below. However, you can choose to modify the marking scheme and:
- disable one, two or more of these categories
- completely change the title and text of the categories (e.g., instead of Relevance, ask reviewers to provide a score on ethical standards)
- add new categories, although we do recommend limiting the number of scoring categories so your reviewers don't feel that the process is overwhelming
- change the scoring grades. For example, instead of having 1-5 scores, you can have 1-3, 0-10, etc.
- it is possible to have different scoring grades for different categories. For example, you may need 1-5 for the Technical Merit category but only 1-3 for Readability.
- In some cases, conferences need to have a score for some submissions, but not all submissions. For example, the Technical Merit category may be important for papers but not posters. In this case, we can add a 0 to the marking scheme and you can instruct reviewers to select 0 if the scoring category is not applicable to the submission they are reviewing.
Please email support@exordo.com to request changes to the numbers on your review form.
Drop-down style questions:
You can also create drop-down menu style questions. Some conferences keep these exactly as they are now (see image below), other conferences edit or disable these.
For example, you may:
- have more formats than just oral and poster. You can add more formats here.
- not want your reviewers to recommend a format at all, so you disable the question completely.
- have custom questions to add. We have seen conferences use drop-downs to ask if a paper should be considered for an award and if so, reviewers can pick an appropriate award from the drop-down menu.
Comment fields:
Finally, you can either require comment fields or make them optional. There are two types of comment fields to choose from:
- one that will be visible to authors when published
- another that will be visible only to chairs.
These fields can be required, optional or you disable them entirely. If you want to require one and make the other optional or remove it, that is ok, too!
