Free public ranking

SaaS Robots.txt Leaderboard

How the web's top SaaS companies & web apps compare on openness to AI crawlers. Graded straight from each site's robots.txt against the major AI bots (GPTBot, ClaudeBot, Google-Extended and more). Use this page to see how your site compares, and to check if your robots.txt is blocking or allowing the AI bots you want to allow or block.

1%

of 211 ranked sites block GPTBot in robots.txt

211

sites graded, last checked Nov 11, 2026

99/100

average openness score (higher = more open to AI)

Share of sites blocking each AI crawler

Click a bot to filter the ranking to sites that block it.

Grade distribution

A = wide open to AI, F = walled off.

A
204 sites
B
4 sites
C
2 sites
D
1 site
F
0 sites
# AI crawlers Region
101
Jasper
jasper.ai
A 100 0/11 Allows all US
102
JetBrains
jetbrains.com
A 100 0/11 Allows all EU
103
JFrog
jfrog.com
A 100 0/11 Allows all MENA-Africa
104
Jotform
jotform.com
A 100 0/11 Allows all US
105
Kintone
kintone.com
A 100 0/11 Allows all Asia
106
Kit
kit.com
A 100 0/11 Allows all US
107
Klaviyo
klaviyo.com
A 100 0/11 Allows all US
108
Lark
larksuite.com
A 100 0/11 Allows all Asia
109
LastPass
lastpass.com
A 100 0/11 Allows all US
110
Lattice
lattice.com
A 100 0/11 Allows all US
111
Linear
linear.app
A 100 0/11 Allows all US
112
LiveChat
livechat.com
A 100 0/11 Allows all EU
113
Lokalise
lokalise.com
A 100 0/11 Allows all EU
114
Lovable
lovable.dev
A 100 0/11 Allows all EU
115
Lucid
lucid.co
A 100 0/11 Allows all US
116
Mailchimp
mailchimp.com
A 100 0/11 Allows all US
117
MailerLite
mailerlite.com
A 100 0/11 Allows all EU
118
Make
make.com
A 100 0/11 Allows all EU
119
Matillion
matillion.com
A 100 0/11 Allows all UK
120
Midjourney
midjourney.com
A 100 0/11 Allows all US
121
Mirakl
mirakl.com
A 100 0/11 Allows all EU
122
Miro
miro.com
A 100 0/11 Allows all EU
123
Mistral AI
mistral.ai
A 100 0/11 Allows all EU
124
Mixpanel
mixpanel.com
A 100 0/11 Allows all US
125
Mollie
mollie.com
A 100 0/11 Allows all EU
126
monday.com
monday.com
A 100 0/11 Allows all MENA-Africa
127
MongoDB
mongodb.com
A 100 0/11 Allows all US
128
n8n
n8n.io
A 100 0/11 Allows all EU
129
Netlify
netlify.com
A 100 0/11 Allows all US
130
New Relic
newrelic.com
A 100 0/11 Allows all US
131
NICE
nice.com
A 100 0/11 Allows all MENA-Africa
132
Odoo
odoo.com
A 100 0/11 Allows all EU
133
Okta
okta.com
A 100 0/11 Allows all US
134
Omnisend
omnisend.com
A 100 0/11 Allows all EU
135
OpenAI
openai.com
A 100 0/11 Allows all US
136
Otter.ai
otter.ai
A 100 0/11 Allows all US
137
Outreach
outreach.io
A 100 0/11 Allows all US
138
OutSystems
outsystems.com
A 100 0/11 Allows all EU
139
OVHcloud
ovhcloud.com
A 100 0/11 Allows all EU
140
Paddle
paddle.com
A 100 0/11 Allows all UK
141
PagerDuty
pagerduty.com
A 100 0/11 Allows all US
142
PandaDoc
pandadoc.com
A 100 0/11 Allows all US
143
PayFit
payfit.com
A 100 0/11 Allows all EU
144
Paystack
paystack.com
A 100 0/11 Allows all MENA-Africa
145
Perplexity
perplexity.ai
A 100 0/11 Allows all US
146
Personio
personio.com
A 100 0/11 Allows all EU
147
Pipedrive
pipedrive.com
A 100 0/11 Allows all EU
148
Plaid
plaid.com
A 100 0/11 Allows all US
149
Pleo
pleo.io
A 100 0/11 Allows all EU
150
PostHog
posthog.com
A 100 0/11 Allows all US
Showing 101 to 150 of 211 results
Download full leaderboard (CSV)

All 211 graded sites from the latest weekly check, regardless of the filters above.

Methodology

For each site we fetch its public robots.txt and grade it against 11 of the major AI crawlers, including GPTBot, ClaudeBot, Google-Extended, PerplexityBot and CCBot. A site “blocks” a bot when its robots.txt has a Disallow rule that applies to that crawler’s user-agent token. The openness score is the share of graded bots that are allowed, rolled up into an A–F grade.

This measures declared access in robots.txt, not enforcement. robots.txt is a request, not a firewall: a well-behaved crawler obeys it, but it does not technically stop anything. A site can also block AI bots at the edge (WAF, rate limits, IP blocks) in ways this ranking cannot see. Treat the grades as a signal of intent, not a guarantee.

The trend combines two sources: current grades come from a live scan of each site’s robots.txt, re-run every week, while historical snapshots are reconstructed from the Internet Archive (Wayback Machine): we grade the nearest archived robots.txt at or before each quarter. Historical points therefore reflect the best available capture, not necessarily the exact first of the period.

Last checked: Nov 11, 2026, refreshed every week. Reads stored scan data only: no live requests are made when you load this page.

14-day Free Trial

Your Logs already store the data you need,
you just need a way to use it!

If you are interested in HoneyLog, you can try it with our Free Trial!

No credit card required