AutoSurvey

Fraud & Quality Shield · included in AutoSurvey

Stop paying bots for survey answers.

If you pay respondents, every bot and every repeat submitter costs you money and dirties your data. The Shield decides, for each submission to a public survey, whether it is a real person's answer. It holds the doubtful ones for review before any payout goes out.

Built for research panels, market-research firms, and programs that give gift cards for feedback. It runs inside Salesforce, on the surveys you already run with AutoSurvey. Einstein can review the open-text answers. AI review uses Salesforce's Einstein Trust Layer and the customer's configured model, subject to the applicable service terms and data-handling settings.

What it does

One decision per submission

The Shield scores each submission from 0 to 100 on signals you choose. The score lands in one of four decisions. You set the thresholds.

Allow

Submitted as normal.

The respondent sees the completion screen. Most real answers end here.

Flag

Submitted and marked for attention.

Counted in your analytics. The respondent sees the completion screen.

Hold

Submitted, but kept out of analytics and out of any payout.

A reviewer approves or rejects it in the queue. The respondent sees the completion screen and learns nothing.

Block

Not submitted.

The run closes as invalid. The respondent sees a polite stop screen with no reason and no count.

Why it is useful

Money not paid out. Data you can trust. Hours you get back.

Payouts stop at the queue

A held submission never reaches your payout Flow until a reviewer approves it. You set the incentive value per form, and the dashboard shows an estimated payouts-avoided figure. The label says estimated, because it is.

Clean data by default

Held and blocked submissions stay out of your reports and dashboards. Duplicate emails, duplicate devices, copied answer patterns, and straight-line responses are caught before they skew a result.

Review in minutes, not days

Every held submission shows why it was held: each rule, its measured value, and its weight. A reviewer approves or rejects in bulk. No spreadsheet export, no manual de-duplication.

Einstein only

Einstein reads the answers, through the Trust Layer

Einstein scores each submission for risk and for answer quality, and writes a one-paragraph rationale for the reviewer. AI review uses Salesforce's Einstein Trust Layer and the customer's configured model, subject to the applicable service terms and data-handling settings. Which model answers is set by your org's Einstein configuration, not by the Shield. The review is off until an admin turns it on. It needs Einstein generative AI (Agentforce) enabled; without it, the rest of the Shield runs unchanged.

A challenge only when risk is raised

Pick reCAPTCHA v2, reCAPTCHA v3 or Cloudflare Turnstile. Set the challenge to never, always, or only when the policy raises risk. Most real respondents never see it.

Start in monitor mode, then tighten

Monitor mode scores everything and holds nothing. Run it for two weeks, replay a new policy against the last 30 days, and switch holds on only when the numbers look right to you.

The screens

The Shield, screen by screen

Every organization, person and number on these screens is fictional.

The Shield dashboard counts screened, blocked and held submissions and shows the top risk reasons

01 · Shield dashboard

One dashboard for every protected survey

The Shield dashboard counts screened, blocked and held submissions and shows the top risk reasons.
A review queue for held submissions, with the reason codes and a hashed email prefix

02 · Review queue

Held submissions, with the reasons in plain codes

A review queue for held submissions, with the reason codes and a hashed email prefix.
The policy page sets thresholds, duplicate caps, the Einstein review and each signal's weight

03 · Policy configuration

Thresholds, duplicate caps and signal weights on one page

The policy page sets thresholds, duplicate caps, the Einstein review and each signal's weight.
One held submission shows each rule's value and weight, and Einstein's risk and quality scores

04 · Submission risk detail

Every hold shows why

One held submission shows each rule's value and weight, and Einstein's risk and quality scores.
A respondent sees the challenge only when the policy raises it; a blocked attempt sees a neutral stop

05 · The respondent's view

What a respondent sees on a phone

A respondent sees the challenge only when the policy raises it; a blocked attempt sees a neutral stop.

What it does, and what it does not do

What it does

  • Adds a challenge step: reCAPTCHA v2, reCAPTCHA v3 or Cloudflare Turnstile, set to never, always, or only when risk is raised.
  • Detects duplicates on hashed email, hashed device key, answer pattern and open text, per form and across the org.
  • Checks speed and attention: too fast per screen, straight-line answers, garbage text, a hidden honeypot field.
  • Scores each submission with weighted reason codes and thresholds you set, with a monitor-only mode.
  • Reviews risk and answer quality with Einstein and stores the rationale. Einstein only. AI review uses Salesforce's Einstein Trust Layer and the customer's configured model, subject to the applicable service terms and data-handling settings. Einstein receives the open-text answers and their question codes, never the email, the device key or the user agent.
  • Rate-limits per form and per device, on top of the guest limits already in AutoSurvey.
  • Holds doubtful submissions in a review queue with bulk approve and reject, and a platform event your payout Flow listens to.
  • Stores a salted hash of the email, never the address. A reviewer sees a six-character prefix. The salt stays in your org.
  • Gives every signal an on/off switch in the policy. A signal you turn off has weight zero.
  • Purges Shield events on the same retention schedule as the submissions they belong to.

What it does not do

  • Does not capture IP address, location, device fingerprint, canvas or font probes, mouse or keystroke data.
  • Does not call any AI model outside Salesforce.
  • Does not run behaviour analytics or IP reputation checks.
  • Does not verify emails through an outside service.
  • Does not keep blocklists, allowlists or cross-flow risk profiles.
  • Does not tell a blocked respondent why, or how many attempts were seen.
  • Does not host the challenge widget. The widget is the provider's own, under the provider's privacy terms. You pick the provider.

Requires AutoSurvey. The Einstein review requires Einstein generative AI (Agentforce) enabled in your org.

See it on your own work.

Bring one program and one workflow. We will walk through Fraud & Quality Shield with you on that work and answer your questions.

Every person and organization on these screens is fictional.