Fraud detection and response quality
QuestionPunk automatically flags suspicious responses and groups them by quality level.
QuestionPunk checks typing behavior, response timing, answer patterns, and available IP or panel-profile signals. Suspicious responses are flagged as low, medium, or high so you can review them before analysis. A flag is a review signal, not proof of fraud.
Before you start
Collect at least some responses first. Plan how you will review flagged responses before exporting or analyzing data.
Steps
Understand the automatic classification
QuestionPunk automatically evaluates response timing, typing behavior (paste events and tab switches), duplicate submissions, and open-ended answer quality. To add a pre-survey bot challenge, open Survey settings → Privacy and turn on Block bots, which runs an automatic Cloudflare Turnstile check before a respondent starts.Filter responses in Results
In Results, use the quality filter. Choose No flags detected to review responses without automatic flags, or Flagged (high + medium) to investigate the flagged group. Neither selection proves whether an answer is valid; compare the answers and available context before deciding what to include.English interface · Results → Responses showing 24 demo responses with List and Table views.
Review the response signals
Open each response to review its session details, including IP address, location, device info, time spent, and events. Use these details to assess response quality.
Details and limitations
Fraud detection runs automatically on responses. Checks include typing behavior (speed, paste/copy use, backspacing), speeding, and straight-lining on rating scales. When the necessary data is available, checks also include anonymizer IPs, a country mismatch with panel residence, shared IPs within the survey, and signs of machine-written pasted text.
The suspicious level and optional fraud data can be included in CSV and Excel exports. The Results quality filter applies to those exports. Including fraud columns does not itself exclude flagged responses. Respondent-code and answer-content filters are not carried into exports, so check the downloaded file if you used those to define a subgroup.
Select responses and click Label to add a respondent code (e.g., "Needs review", "Confirmed valid") for organized follow-up.
For QuestionPunk Panel studies, medium and high flags hold submissions for review before automatic approval. Review the answer content and the specific reasons before deciding what to do. A shared IP alone is a low-level signal: households, offices, and campuses can share an address. Neither a quality flag nor the absence of flags proves whether a response is valid.
IP address and IP-based location are unavailable for responses collected with Minimize IP and location data enabled. Review the remaining signals and the answer content instead of treating missing location as suspicious.
Check the result
You can see which responses are unflagged or flagged as low, medium, or high, and you can filter or label them for review.
If something goes wrong
If you do not see the filter you need, make sure you are in Results and not in Build or Share.
