Vibeleaderboard
← All Intel
Intel / repo

We submitted 105 AI-built contact forms – 27 said "sent", sent nothing

Source
github.com
Author
Formgong
Date

Context

Formgong, a company that sells a hosted backend for website forms, tested the contact forms on public sites built with the AI app builders Lovable and Bolt and found that 27 of the 105 forms it could test showed a success message such as "Message sent!" without sending the message anywhere (study repository). Only 54 of the 105 sent what the visitor typed. When Formgong read the code behind 21 of the fake forms, it found a placeholder rather than a broken connection: the pattern was nearly always a submit handler that waits about a second, shows a confirmation pop-up and clears the fields, with no call to an email service, database or server (write-up). The visitor believes the message went through, and the site owner never hears about it.

The test was built so that nothing reached real site owners. A Chrome browser driven by the Playwright automation library filled each form with obvious test values, pressed send, and from that moment recorded and blocked every outgoing request. A form counted as sending only if a request carried the typed text, and as fake only if no such request went out and a success message appeared within five seconds. The rules were written down before testing in a pre-registration file that also logs each later fix, including analytics pings first mistaken for a sent message and a hidden anti-spam field whose filling triggered a fake thank-you meant for bots. Because requests were blocked, the study shows whether a form tried to send, not whether an email would have arrived.

Many of the fake forms sat on demos where nobody expects mail. Before counting, Formgong sorted sites by a fixed rule: 9 of 15 demo sites (hackathon entries or pages with placeholder contacts) faked their forms, against 16 of 73 sites with no demo signs (results). Formgong itself cautions that "no demo signs" does not prove a business depends on the form, that the sample came from public listings that lean towards developer projects, and that it is a snapshot from October 2026.

Formgong did not test what Lovable or Bolt generate by default, so its explanation of the cause is its own reading: the visible form needs only page code, while delivery needs someone to choose an email service, account or server, and a form that only looks finished is what remains when nobody makes that choice. The useful takeaway is the check, which takes about thirty seconds: open the browser's developer tools on the Network tab, submit the form once, and look for a new request containing the text you typed. If none appears, the form sends nothing whatever message it shows. Formgong's suggested fixes include its own service alongside alternatives such as building the backend in Supabase or using Formspree.

Terms in this piece · Glossary
  • agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
Recommended reads
Comments

Checking sign-in…

Loading comments…