Changelog

Discovery: see how fast bots and readers find your new articles

Publish an article and watch Googlebot, Bingbot, the AI crawlers and the first real reader arrive, minute by minute.

Colizzi Coin Giacomo

If you publish news, the first hours of an article are the ones that count, so we built a whole section around one question: once a page goes live, how long does it take for the world to find it? Discovery reads the publication dates from your news sitemaps and feeds and matches them with your logs. Real Time shows every article of the last 24 hours as a card, with the time it took Googlebot, Bingbot, the first AI bot and the first referred visitor to show up. Open a card and you'll see everyone who reached it, in order. Above the feed, one card per bot gives you its median time to the first visit, and two leaderboards tell you which crawler usually gets there first and which source brings you the first reader, whether that's Google, ChatGPT, Bing or Claude. The page refreshes itself while you keep it open, so you can literally watch a story being picked up. Trends is the long view, covering every article older than 24 hours. Choose a bot category and a hostname, and you get the median time to first crawl of each bot by day, week or month, how many articles each bot saw within 24 hours, and a funnel with the share it crawled within one hour, one day and one week. The articles table puts it all together: sort it by any bot and filter the articles a crawler did or didn't visit. A slow week for Googlebot? A pile of stories the AI crawlers never touched? Now you'll see it, and you'll see it early.

14-day Free Trial

Try HoneyLog 14-day Free Trial

If you are interested in HoneyLog, you can try it with our Free Trial!

No credit card required