The Evaluations tab displays evaluation results to submitters and team members on the View Idea page. This tab allows administrators and sponsors to close the loop with the user base that participated in their challenge and will provide transparency in the evaluations of each submission.
Table of Contents
Viewing Evaluations
There are multiple ways to access the Evaluation Results for submissions. The first way is to navigate to the View Submission page on the front-end and click on the Evaluations tab.
Alternatively, you can navigate to the Evaluations Results from the back-end. When viewing your Pipeline in the Step View, you may see a score to the right-side of individual submissions which indicates the Evaluation Result.
If you click on View Results, it will navigate you to the Manage Step page where you can access the evaluations for your submission.
Step Configuration
- When configuring your Step within the back-end Pipeline, you will see an 'Evaluation Results' section under the Advanced Settings. From here, you have the option to extend visibility to Submitters, Evaluators, or all Users.
- Note: This option is limited to Gate, Single Scale, and Scorecard tooltypes.
- Once the option is enabled there are several options to control when the results are displayed in the Evaluations tab for the submission:
- Display when the first Action Item for submission is complete
- Display when all Action Items for the submission is complete
- Display when all Action Items in the Step are complete
- Display when the Submission moves to a new Step
- Display when the Step is closed
- There are also options to "Make evaluators anonymous" and to "Send submitters a notification when evaluation results are ready"
- Note: If you don't want to expose the evaluator's user information to your submitters, please make sure to enable the anonymous option!
- The notification option will display a notification within the Global Navigation notification's icon.
Evaluations Tab in View Submission Page
- After the option for the Evaluations tab are enabled and results are available from a scorecard step, they will appear within the "Evaluations" tab on the view submission page:
- The first metric displayed is a summary of the evaluations showing the "Overall Score", "Percentile of Submissions" and "Evaluations Completed".
- Overall Score: This is the average scorecard score this submission received based on the evaluator results.
- Percentile of Submission: This show the percentile the submission ranks compared to other submissions that had gone through the same step.
- Evaluations Completed: Shows the number of evaluation completed over the total number of evaluations which have been assigned for the submission.
- The second metric shows a "Distribution of Ideas" relative to the overall score
- The third metric shows results per each evaluator assigned in the step for that submission:
- The last metric displays the evaluation questions and the points attributed to each answer
- Note: Long and short answer types will display but there will be no points associated with each answer.
Comments