Auto-Scoring Questionnaires

Auto-scoring allows your Reviewers to automatically score Questionnaires with a click of a button.

You can Auto-Score a Questionnaire based on the way vendors responded to your questions. To do this you will need to first define what score the vendor should receive based on their responses. We suggest this be done while you are creating the Questionnaire.

NOTE: This feature must be enabled by Bonfire Support in the backend. Contact us at support@gobonfire.com if you wish to enable it.

In this article we will cover the following:

• Pre-Defined Auto-Scoring Percentages
• Bulk Edit Questions
• Setting up Auto-Scoring for Reviewers

Pre-Defined Auto-Scoring Percentages

First, let's look at pre-defining the scoring percentages for a single question. From your Questionnaire setup page, click the pencil icon under the Actions column (or if you haven't created a Question yet, click the Add Question button).

The Add/Edit Question box will pop open, and at the very bottom you'll see a Vendor Response Options section with a Define auto-scoring points allocation checkbox. 

The Define auto-scoring points allocation feature allows you to optionally assign each Vendor Response Option a percentage of the total points, which can then be used to auto-score a question. (Vendors will not see these point allocations.)

In the example below the Vendor Response Options are Fully Complaint, Partially Compliant, or Non-Compliant.

Under the % of Total Points Allocated column, you can allocate a percentage of the point value to each response option.

In the example below, if a vendor answers with the "Fully Compliant" option they will receive 100% of the 4 points allocated. If they select the "Partially Compliant" answer they'll receive 50% (2 points), and 0 points (0%) if they choose the "Non-Compliant" response.

Bulk Edit Questions

While you can set up the auto-scoring on a per-question basis, you can also use the Bulk Edit Question feature to define the scoring percentages for many questions at once.

First, select the questions you wish to bulk edit via the checkboxes on the left-hand side, then click Bulk Edit Questions in the top-right corner:

Once the Bulk Edit Questions window appears, you can check Change Vendor Response Options to enable bulk editing for that field. You can then go ahead, check off Define auto-scoring points allocation, and then enter in the Vendor Response Options and/or fill out the % of Total Points Allocated fields, which will then apply to all your selected questions:

Setting up Auto-Scoring for Reviewers

As a project owner, you can always give your reviewers the option to use the Auto-Score feature on their own scores. To enable this:

1. Navigate to the Criteria section.
2. Click on the Manage button.
3. Toggle on the Auto-Scoring feature.

NOTE: Checking off Auto-Scoring only enables the option for Reviewers to use Auto-Score. This will not apply scores automatically on behalf of the Reviewer. 

Next, the reviewer can open their scorecard (either by clicking the Scorecard button in the Submissions section or by navigating to the Your Scores section) and select which Questionnaire and Question Set they wish to review. This will then take them to the side-by-side view, where they can click the Auto-Score button in the bottom right corner:

From the side-by-side view, you will notice the Auto-Score button in the bottom-right corner of the screen:

The Auto-Score button will allow the user to score all questions that have been filtered via the Filter Questions button next to it. You can quickly check this by looking at the bottom of the screen for the number of questions displayed (in the example above, 15 questions are about to be auto-scored). The Filter Questions options allows reviewers to filter by All Scored questions, All Unscored Questions, per Question Set, and per Subset.

In our example, the questions to be auto-scored in the screenshot use the same options as in the earlier example: Fully Compliant, Partially Compliant, and Non-Compliant. Questions with different auto-scoring options will be auto-scored later; the Next and Prev buttons in the bottom right corner allow you to navigate between the different questions and response options.

The reviewer inputs the percentage of the point value that is to be assigned to each question. For instance, if the questions were out of 4 points each, then a question that was answered as "Fully Compliant" will receive 4 points, "Partially Compliant" will receive 2 points, and so forth. Once you have entered in your desired percentages on each response type, the Reviewer can click on Auto-Score to have their auto-score options be applied.

Reviewers can also enter in scoring comments in bulk for each set of questions being auto-scored. Bonfire automatically inserts a generic scoring comment outlining the auto-scoring methodology that was applied. Once the auto-score has been completed, the comment will be attached to all questions that were auto-scored. Reviewers are able to edit these comments on an individual basis later on.

After completing an Auto-Score, the user's scoring progress will be updated immediately. If you click on any of the scored questions within the scorecard, you will see the comments section has been updated with the comments generated from the Auto-Score. This comment section can also be edited.