<- blog

Bot Traffic Is Now an Analytics Problem

Bots and AI agents are becoming normal website traffic. Operators need cleaner analytics, crawler policy, and separate metrics for machine visitors.

#analytics#seo#ai-agents

Bot traffic is no longer just a security-team nuisance. The useful takeaway from the latest bot-traffic reporting is that website operators now need to treat machine visitors as a first-class measurement problem: some bots should be welcomed, some should be blocked, and none should be allowed to quietly corrupt the numbers you use to make marketing, SEO, CRO, and product decisions.

Semrush's June 13 write-up says bot traffic now exceeds human traffic in Cloudflare's web-page traffic view, citing Cloudflare Radar at roughly 57% bot requests and 43% human requests for HTML traffic. Cloudflare Radar's own traffic dashboard describes that chart as bot versus human HTTP requests to HTML content on Cloudflare's network — not every internet interaction everywhere. That caveat matters, but it does not make the signal small.

The headline number is not the whole story#

The safest way to read the 57% claim is as a network-specific web-page request signal. It is not a universal census of the internet. It is still important because Cloudflare sits in front of a large slice of the public web, and because other security vendors are pointing in the same direction.

HUMAN Security's 2026 State of AI Traffic and Cyberthreat Benchmark Report says automated traffic grew eight times faster than human traffic in 2025, AI-driven traffic rose 187% from January to December, and agentic AI traffic grew 7,851% year over year. The report is based on more than one quadrillion interactions across HUMAN's customer base.

Imperva's 2026 Bad Bot Report page says bots now account for the majority of global web traffic and frames agentic AI as making intent harder to detect. Its 2025 report page also said automated traffic had already surpassed human activity, accounting for 51% of web traffic, with bad bots making up 37%.

Those measurements are not identical. They use different datasets, customers, definitions, and traffic categories. That is exactly why operators should avoid turning one number into a slogan. The stronger conclusion is simpler: machine traffic is now too large, too varied, and too business-relevant to leave as an analytics footnote.

AI agents make the bot bucket less useful#

The old split was comfortable: good bots like search crawlers and uptime monitors, bad bots like credential stuffers and scrapers, humans in the middle. AI agents make that split weaker.

HUMAN defines agentic AI as autonomous systems that navigate pages, complete forms, and execute transactions. That is different from a crawler that reads pages for an index. An agent might compare products, check stock, fill a booking form, or complete a checkout on behalf of a real customer. The same mechanical behaviour — fast navigation, unusual timing, repeated requests, non-human interaction patterns — might be useful automation or fraud.

Cloudflare's bot documentation makes a related distinction. A bot is simply software that performs tasks. Cloudflare separately documents verified bots, signed agents, AI bot blocking, and rule ordering. That is the direction site owners need to move in too: not "block bots" or "allow bots," but classify machine traffic by purpose, identity, risk, and value.

For a small business site, ecommerce store, SaaS landing page, or booking funnel, that changes the operating model. The question is not whether a request came from a human hand on a mouse. The question is whether the request should influence measurement, consume capacity, see content, submit forms, trigger automations, or count toward conversion.

Analytics gets noisy before security gets scary#

Security is the obvious bot concern, but analytics is where many operators will feel the pain first. Cloudflare's explainer on bot traffic notes that bot activity can distort page views, bounce rate, session duration, location data, and conversions. That is enough to break everyday decisions.

A few examples:

This matters because small teams often make decisions from thin data. If a local-service site gets 800 real human visits a month, a few hundred bot sessions can meaningfully change the story. If an ecommerce store is testing a new product page, fake traffic can bury the signal from buyers.

The operator checklist#

I would handle this in layers, starting with measurement rather than vendor shopping.

First, create a bot-traffic view in analytics. Keep your normal dashboard, but add a second view that excludes known bot and internal traffic as aggressively as your stack allows. In GA4, that means reviewing unwanted referrals, internal traffic rules, form-spam filters, and server-side tagging options. If you use Cloudflare, Vercel, Shopify, or another edge/platform layer, compare application logs with analytics so you can see what analytics missed or misclassified.

Second, separate business metrics by intent. Human conversion rate, AI referral traffic, crawler volume, form spam, checkout abuse, and server load are different questions. Do not force them into one "sessions" number. For a content-led business, AI crawler visibility might be useful. For a paid landing page, the same crawler traffic should probably be excluded from CAC and CRO reporting.

Third, make crawler policy explicit. Review robots.txt, AI crawler rules, CDN bot settings, rate limits, and WAF rules. Decide which AI crawlers you want to allow, which you want to block, and which paths should be off-limits. A public blog post, pricing page, support article, checkout, account area, and lead form should not all have the same machine-visitor policy.

Fourth, protect forms and conversion events. The easiest way for bot traffic to poison reporting is through fake leads, fake accounts, and fake purchases. Add server-side validation, honeypot fields where appropriate, rate limits, email verification, payment checks, and spam scoring before a submission becomes a trusted conversion. Your CRM should distinguish "raw submission" from "qualified lead."

Fifth, start measuring AI visibility separately. Semrush's article points to citation rate, share of voice in AI answers, AI referral traffic, cited URLs, and brand mentions in AI-generated answers. You do not need an enterprise dashboard to start. Pick your important buyer questions, test them across the AI tools your customers use, record whether your site appears, and compare that with actual referral logs.

Ecommerce and local businesses should care first#

This is not only a concern for large publishers. HUMAN says more than 95% of observed AI-driven traffic in 2025 was concentrated in retail and ecommerce, streaming and media, and travel and hospitality. Those are exactly the categories where autonomous agents can compare options, check availability, and transact.

For ecommerce, the practical risks are mixed with opportunity. Helpful agents may bring high-intent buyers. Bad automation may scrape prices, hoard inventory, test cards, or spam checkout flows. Either way, the store needs to know which is which before it trusts product-page analytics or checkout-funnel data.

For local and service businesses, the same pattern shows up in lead capture and booking. If an AI assistant fills in a quote request for a real customer, that is useful. If a bot floods the form with junk, it wastes time and distorts channel reporting. The website needs better validation, clearer source tracking, and enough structured information for legitimate assistants to answer questions without hammering every page.

My take#

The bot-majority story is easy to overstate, but dangerous to ignore. The exact percentage will move around depending on the network, content type, and classification method. The direction is clearer: the web is no longer mostly humans clicking pages in a way analytics tools were designed to understand.

That means website audits need a new line item. Alongside Core Web Vitals, SEO, accessibility, conversion copy, and page speed, operators should ask: how does this site handle machine visitors? Are good crawlers able to understand it? Are bad bots contained? Are AI agents visible separately? Are conversion events protected? Are analytics dashboards reporting people, machines, or an accidental blend of both?

The businesses that get this right will not simply block more bots. They will build cleaner measurement and clearer policy. Humans remain the customer. But machines are increasingly part of how customers discover, compare, automate, and transact. Your website should know the difference.

Need technical help?

I'm a software engineer who builds web apps, APIs, and AI tooling. If you've got a project or a problem to talk through, book a free 30-minute call.

Book time with me ->