We Tracked Every AI Bot That Hit Our Website in 24 Hours. Google Analytics Missed All of Them.

The podcast addresses the issue of "invisible traffic" from AI bots that standard analytics tools like Google Analytics fail to detect. It highlights that over 50% of internet traffic is from bots, with AI crawlers like ChatGPT, Claude, Perplexity, and MetaAI comprising over 4% of web requests, which Google Analytics can't track because AI bots don't use browsers or execute JavaScript. Ahrefs' AI visibility tool is also criticized for only catching 2-3% of actual AI mentions due to its reliance on broad queries. The podcast advocates for server-side tracking as a solution, which intercepts every request at the server level to accurately log bot activity, and shares findings from a 24-hour test that revealed 754 AI bot requests, including unexpected traffic from Amazon Q. The speaker emphasizes the importance of optimizing websites for AI, including cleaning up Bing's index and using self-referencing canonical tags.