More AIs Are Taking Polls and Surveys
I already knew about the declining response rate for polls and surveys. The percentage of AI bots that respond to surveys is also increasing.
Solutions are hard:
1. Make surveys less boring.
We need to move past bland, grid-filled surveys and start designing experiences people actually want to complete. That means mobile-first layouts, shorter runtimes, and maybe even a dash of storytelling. TikTok or dating app style surveys wouldn’t be a bad idea or is that just me being too much Gen Z?2. Bot detection.
There’s a growing toolkit of ways to spot AI-generated responses—using things like response entropy, writing style patterns or even metadata like keystroke timing. Platforms should start integrating these detection tools more widely. Ideally, you introduce an element that only humans can do, e.g., you have to pick up your price somewhere in-person. Btw, note that these bots can easily be designed to find ways around the most common detection tactics such as Captcha’s, timed responses and postcode and IP recognition. Believe me, way less code than you suspect is needed to do this.3. Pay people more.
If you’re only offering 50 cents for 10 minutes of mental effort, don’t be surprised when your respondent pool consists of AI agents and sleep-deprived gig workers. Smarter, dynamic incentives—especially for underrepresented groups—can make a big difference. Perhaps pay-differentiation (based on simple demand/supply) makes sense?4. Rethink the whole model.
Surveys aren’t the only way to understand people. We can also learn from digital traces, behavioral data, or administrative records. Think of it as moving from a single snapshot to a fuller, blended picture. Yes, it’s messier—but it’s also more real.
Subscribe to comments on this entry
Joe • May 21, 2025 9:06 AM
If a survey or survey link is hosted by a third party, don’t do it. If it is hosted by the company that wants results but has many offsite scripts, don’t do it. If the company wants survey results but the questions they ask shows a thinking person that they will likely be used to increase prices or decrease service, don’t do it. If the survey demands positively identifying you (not just that you are a customer and haven’t already answered the survey) and you don’t trust the company not to store or forward to a company that will add it to their dossier (e.g. Lexus Nexis), don’t do it.
Come to think of it, I can’t recall many surveys that I answered because they don’t show me any respect for my privacy or give me reason to trust them.