Bots Management: keep track of how you handle every bot

You block a bot at your CDN, move on, and never find out whether it actually stopped. The new Bots Management page closes that loop. It shows you the bots that crawled your website in the last 7 days, each with its crawl count and its category, such as AI, SEO or monitoring. For every bot you simply record how you are handling it: Allowed, Blocked or Not Managed. This page does not block or allow anything by itself. It tracks your decisions over time, and that is exactly what makes it useful. Once we know what you intended, we can compare it against real traffic and flag problems. For example, if a bot you marked as blocked is still hitting your site, that is a sign your CDN rule is not working, and we can tell you. Filters let you focus on bots in a specific state, whether allowed, blocked or not yet managed, and you can sort the list to bring the most relevant bots to the top. Everything is paginated, so even sites visited by hundreds of different bots stay easy to review. Start by going through your most frequent bots and marking the decisions you already made. From then on, you will always know whether reality matches your intentions.