Most businesses still treat AI traffic as a side effect. That is becoming expensive.
TechRadar's June 24 piece on invisible AI traffic argues that many organizations cannot tell how much site traffic comes from AI agents, which ones are legitimate, and which ones are spoofing trusted names. Cloudflare's crawl-versus-referral work points to the same operational problem from a different angle: not all automated traffic returns value.
Source Note
This post is grounded in TechRadar's reporting on invisible traffic and Cloudflare's reporting on crawl behavior versus referral behavior. TechRadar is an interpretation source here; Cloudflare is the first-party infrastructure source.
Why the traffic is invisible
AI traffic is invisible in two ways. First, it often does not look like normal referral traffic tied to a user session you can monetize clearly. Second, it is mixed together with more useful automation, less useful scraping, and agent traffic that may be acting for a real person in real time.
That means the old question, "is the bot human or not?" is too crude. The useful question is "what is this traffic doing here?"
Three traffic types worth separating
- Discovery traffic. Search-style crawling that can still support citations or future retrieval.
- Action traffic. Agents visiting on behalf of users to compare, retrieve, fill, or complete a task.
- Extractive traffic. Crawlers or impersonators taking content, pricing, or data with no clear return.
Analysis: if you do not separate those three, you either block too much or allow too much.
What to do next
A small service brand does not need a security-operations team to respond. It needs three simple moves:
- log which page types attract the most automated activity;
- separate public discovery pages from sensitive or transactional pages;
- review whether allowed automation sends any useful visibility or referrals back.
Once that is in place, crawl policy becomes a business decision instead of a hunch.
CTA: If your site is already being read by machines before humans arrive, then traffic classification is part of website operations now, not just SEO theory.