Judging

The Judging tool type allows Administrators to assign Action Items to Judges to help find the best submissions using a lightweight, user-friendly evaluation tool in real time as the submissions are presented.

Table of Contents

• Overview of the Judging Tool Type
• Configuring Judging Steps
• Completing Judging Action Items

Overview of Judging Tool Type

The Judging tool is built for easy evaluation during real-time presentations, giving Evaluators a streamlined experience so that they can focus on speakers and presentations.

Judging Action Items can be fully customized with configurable templates and offer a mobile-optimized experience that allows Judges to easily complete on mobile or tablet devices. Additional features like sliders and audio commenting also give Judges an easy way to quickly capture scores and feedback while keeping the focus on presentations.

Configuring Judging Steps

To configure the Judging tool type, edit a Step and set the tool type to Judging.

Once set, navigate to Step Menu > Configure Judging:

 

This will display the Configure Judging popup, allowing you to configure your Judging Action Items:

• Judges: Select the Judges who will be assigned to rate the submissions.
• Scorecard Template: Select the template which will be used and assigned for each submission to the Judges.
  • Learn more about Scorecard templates here.
• Due Date: Admins can set the due date dynamically based on the date assigned or manually select a date
• Idea Editing: Judges are not allowed to edit submission attributes.
• Action Items options: Cancel open Action Items when submission moves out of Step

Additional options are available in the Advanced Settings section:

• Email Alerts: Select whether or not to send an email notification to alert Judges of assigned submissions.
• Email Subject and Body:  Admins can input any desired email subject and body text to be sent to the selected Evaluators.
• Recurring Reminders: Send email reminders to assignees after the specified number of days of inactivity.
• Action Item Escalation: Notify certain recipients when an Action Item hasn’t been completed in X days.

After saving your configuration, Action Items will be sent to Judges once submissions are added to the Step.

Reordering Submissions for Judging

Administrators can rearrange the order in which Judges will evaluate Submissions to match the order in which submitters or teams will present during an event.

• Navigate to Step Menu > Update Judging Order
• A popup displaying the current order will open, allowing Admins to drag and drop submissions into the desired order.

• Submissions can also be automatically ordered by name or by number of evaluations completed.
• Once changes are made and saved, Judges will see the updated order reflected in their Action Items.

Completing Judging Action Items

After the Action Items are Assigned, Judges will receive an email and in-app notification of their Judging Action Item to complete.

In the Judging Action Item view, Evaluators will see the list of submissions on the left, and the questionnaire on the right.

The Evaluators can complete their Judging Action Items by filling out the configured questions. Admins can use slider questions in the Judging template, allowing Evaluators an easy, responsive way to score submissions. Once all questions are answered, Judges can select Complete to save their responses and automatically advance to the next submission on the list.

Judges can view the team members on each submission by selecting the Team tab in the questionnaire:

If View Idea 3.0 is enabled, selecting the View Details link below the submission title will open a preview in a popup.

Audio Comments

Judging Action Items also feature Audio Comments, which allow Judges on tablets to quickly and easily leave feedback for submitters.

Press and hold the microphone icon at the questionnaire's top to bring up the audio recorder.

• Note: You must allow microphone permissions from your browser to record audio comments.

Once the comment has been recorded, a popup will appear allowing you to play back, re-record, or save your comment. You can also set the comment permissions (by default, the permission will be set to Submitter Q&A, and visible only to the Idea submitter, the Judge, and Admins).

After saving, a comment will be posted to the submission with the audio file attached, allowing playback directly from the View Idea page.