Anti-Cheating and Quality Control

Socratic uses many automated tests and protocols for detecting potential cheaters and lazy respondent behavior.

Sophisticated systems, operating in the background, now use an algorithm to compare the values of many profiling fields to produce a "cheating probability score" (CPS) for each panelist. Each profile data point is assigned a weight and the number of similarities between the data points will contribute to a total CPS; the higher the score, the more likely that an individual is a cheater or lazy respondent. People with high CPSs are quietly removed on a regular basis, without notification, in order to prevent the possibility of future invitations to the known cheaters.

CPS Tests include:

Repeat Survey Attempts

Using Handshake Protocols
A unique URL suffix-code is generated and used for the link in the email invitation
Cookie check

Pattern Recognition Protocols

XMas Treeing
Straight Lining

Click to see larger version

Advanced Handshake Protocols

Browser Configuration Check
IP Address
Browser String
Language Setting

Handshake Code Key Protocols

CAPTCHA – To prevent bots and other automated form completers from entering surveys

Time Threshold Protocols

Minimum Survey Time Thresholds

Internal Validity Protocols

Convergent/Divergent Validity Tests
Logic Traps

Techno-Cheater Detection

Form Populators
Key-Stroke Replicators