Decision Support

For program committees, coming to decisions quickly and effectively is a challenging process. Even using "Identify the Champion", it can be difficult to compare reviews from different reviewers effectively. This is why we have developed and implemented a new decision support system in Continue 2.0 that effectively combines reviewers' preferences in order to reliably produce a more accurate picture of which papers are good, which are bad, and which are in conflict. We are offering this system for your use as an alternative to "Identify the Champion".

If you choose to use the decision support system, your reviewers will give scores from 0-9 instead of A-D, and score summaries like "A-D" will be replaced by the following five categories:

/	Good
/	Good (In Conflict)
/	Unknown
/	Bad (In Conflict)
/	Bad

In tests on past conferences, this system performed similarly to Identify the Champion: while it was slightly less reliable at identifying good papers, it is better at identifying conflict, and it can provide more information about papers near the middle of the pack. It is also more flexible, as the system can be tuned to be more or less selective. And in all of our tests, there was not a single case of a not-in-conflict paper marked "Bad" being accepted.

We encourage you to choose this decision support system for your conference. In addition to supporting ongoing research in an important field, you will gain a powerful tool for saving you and your program committee time and energy. For more information, please contact us.