Quality check responses and flag outliers

Updated at November 18th, 2020

Protobi now has a built-in quality check or "QC" tool that allows you to identify outliers and flag respondents who might be providing low quality responses. 

Access the QC dialog

Select an element (e.g. Q13) and press SHIFT + Q + C on your keyboard to bring up the QC dialog.

You can also select the element, then go to the "Advanced" button. Scroll to the bottom of the list and choose "QC check (beta)".

QC a single element

Single elements have three pre-set QC options. cS8sv2 asks respondents how many patients they manage per month with Condition Y. Check the "more than" QC option and enter a value to flag respondents that exceed that value.

"$flag" element

After you add a QC check, it creates a new special element called "$flags". Every QC check is in the $flags element. The percent represents the people who meet that flag criteria. 

Edit flag formats

To change the name of a flag, edit the "Format..." for $flags. [NA] values below have a format of "Not flagged".

QC a group

QC options for groups include pre-set conditions for "Any child", "All children" and "Sum of children".  

Straightline check

Select "All children are equal (aka straightline)" to flag respondents that entered the same answer for all questions in a group (e.g. Q13). 

Straightline flag result

Create your own custom flags

You can define a condition to create custom flags. Q3 asks how many Condition Y patients are on a gamma antagonist, and S8 asks how many Condition Y patients the respondent manages. 

You can set a custom condition that flags respondents that entered a greater value for Q3 than S8. Custom conditions can reference any element, you can even create the QC in an element, and not include it in the condition. 

Javascript operators 

The custom condition text box will accept conditional statements written with Javascript operators. Below is a list of to create operators you can use to create custom conditions. 



- Subtraction
/ Division
* Multiplication


== Equal
!= Not equal
> Greater than
>= Greater than or equal to
< Less than
<= Less than or equal to
=== Equal to, and the same data type (Identical)
!== Not identical


&& AND
|| OR

Advanced support

There are complex cases where you might want to flag respondents, not limited to what's shown in this tutorial. Contact us at support@protobi.com to discuss your specific needs.

Was this article helpful?