Ewelina Podrez-Siama · bot profiles
OAI-SearchBot the crawler behind ChatGPT search: user-agent, IP addresses and robots.txt
OAI-SearchBot is OpenAI’s crawler for ChatGPT search. Sites that block it won’t be shown in ChatGPT search answers. It is separate from GPTBot, OpenAI’s training crawler.
Below you’ll find the strings OAI-SearchBot sends, OpenAI’s IP list, ready-made robots.txt rules and what it does on podrez.pl. I checked the facts against OpenAI’s documentation and the sources below on November 12, 2026.
confirmed requests
Oct 7 – Nov 11, 2026
days with a visit,
about 24 requests a day
robots.txt checks,
about 7 a day
At a glance
OAI-SearchBot at a glance
| Question | Answer |
|---|---|
| Operator | OpenAI |
| Purpose | Surfaces websites in ChatGPT’s search features. Sites that opt out won’t be shown in ChatGPT search answers, though they can still appear as navigational links. |
| robots.txt token | OAI-SearchBot |
| Without an OAI-SearchBot group | The User-agent: * group applies. |
| Honors robots.txt | Yes, according to OpenAI. A change can take about 24 hours to reach ChatGPT search. |
| IP addresses | openai.com/searchbot.json: 39 IPv4 prefixes, file dated January 2, 2026. |
| Reverse DNS | Not documented. Use the IP list. |
| Runs JavaScript | Not documented. A 2024 measurement found that it doesn’t render JavaScript. |
| Other OpenAI bots | GPTBot (training), ChatGPT-User (user-triggered: fetches a page someone asks about) and OAI-AdsBot (ad landing pages). Each setting is independent. |
| In my list | AI: indexes and answers (see the entry in “What bot is this?”) |
User-agent
The OAI-SearchBot user-agent
OpenAI documents two strings: a regular one and one with a robots.txt marker, used when fetching robots.txt. Both reached my site from OpenAI’s addresses, along with an older version 1.0:
| Requests | User-agent string |
|---|---|
| 601 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot |
| 136 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot |
| 115 | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot |
Requests from OpenAI’s published addresses to podrez.pl, Oct 7 – Nov 11, 2026. 1 more request used a rarer variant, not shown here.
On my site the versions had separate jobs. Version 1.4 without the marker fetched pages, images and the REST API; version 1.0 and version 1.4 with the marker fetched nothing but robots.txt. Unlike GPTBot, confirmed OAI-SearchBot requests used the format from OpenAI’s documentation; only the version number differs in 1.0.
The 61 requests from outside OpenAI’s list (56 of them from Google Cloud) mostly used a shorter string without the Macintosh and Chrome part. Don’t rely on that, though: some impersonators copied the documented string too. The IP address decides.
robots.txt
How to block or allow OAI-SearchBot in robots.txt
OAI-SearchBot follows the robots.txt group that names it (a group is a block of rules that starts with User-agent). It decides whether you appear in ChatGPT search, so think twice before blocking it.
Variant 1 · In ChatGPT search
training offI want to appear in ChatGPT search but keep my content out of OpenAI’s training.
User-agent: OAI-SearchBot
Allow: /
User-agent: GPTBot
Disallow: /
Variant 2 · Out of ChatGPT search
OAI-SearchBot stays outI keep my site out of ChatGPT search answers.
User-agent: OAI-SearchBot
Disallow: /
OpenAI says a robots.txt change can take about 24 hours to reach ChatGPT search.
On my site, OAI-SearchBot is also the name under which OpenAI fetches robots.txt. It checked the file on every one of the 36 days, 251 times in total, including 115 requests with the robots.txt marker from addresses that are also on the GPTBot list. OpenAI says it may use one crawl for both bots when both are allowed.
Check your file
Not sure what your robots.txt tells OAI-SearchBot? Enter your domain or paste the file into Can AI bots read your site?, my free robots.txt checker. It shows whether OAI-SearchBot may crawl your pages and which line decides it.
IP check
Is it really OAI-SearchBot? How to check the IP address
OpenAI publishes OAI-SearchBot’s addresses at openai.com/searchbot.json. On November 12, 2026, the file, dated January 2, 2026, listed 39 IPv4 prefixes. GPTBot and ChatGPT-User have lists of their own; six of OAI-SearchBot’s 39 prefixes are also on the GPTBot list. OpenAI documents no reverse DNS name for its bots.
Quick glossary: the user-agent is the name a bot gives itself, and anyone can type any name. A prefix is a block of IP addresses. Reverse DNS turns an address back into a host name. A WAF (web application firewall) is the filter in front of your site, such as Cloudflare, your host’s firewall or a security plugin.
- Take the IP address from the log line.
- Check whether it falls within one of the prefixes in
searchbot.json. A match confirms OpenAI; the user-agent tells you which bot. - No match means an impersonator. If it’s causing trouble, block it on the server or in your WAF, not in robots.txt.
Between October 7 and November 11, 2026, 61 of the 914 requests claiming to be OAI-SearchBot (6.7%) came from outside OpenAI’s list, 56 of them from Google Cloud. My server refused 26 with a 403, all of them impersonators.
To check a whole log file at once, load it into Check AI bots in your logs, my free log checker. The file never leaves your browser, and the tool checks every address against OpenAI’s list.
JavaScript
Does OAI-SearchBot run JavaScript?
Probably not. OpenAI doesn’t say.
A widely cited measurement by Vercel and MERJ (published December 17, 2024) lists OAI-SearchBot among the AI crawlers that don’t render JavaScript.
My logs agree: between October 7 and November 11, 2026, confirmed OAI-SearchBot requests included just 1 script in 853.
If you want to be found in ChatGPT search, make sure the text that answers people’s questions is in the HTML your server sends, not added later by JavaScript.
Data from my logs
What OAI-SearchBot does on my site
OAI-SearchBot is OpenAI’s steadiest bot on my site: 23 confirmed requests a day between February 2 and October 6, 2026, and 24 a day between October 7 and November 11, 2026, on all 36 days. The busiest day was October 11, 2026, with 48 requests.
More than a quarter of its requests were robots.txt checks (251). Pages got 256, images 172, the WordPress REST API 93 and the home page 78. It also fetched 27 Markdown versions of my pages. The page it requested most often was a Polish article about a data incident, followed by my lists of bots and AI knowledge cutoff dates in both languages.
| podrez.pl logs | Feb 2 – Oct 6, 2026 | Oct 7 – Nov 11, 2026 |
|---|---|---|
| Requests claiming to be OAI-SearchBot | 5,891 | 914 |
| Confirmed requests | 5,604 (95%) | 853 (93%) |
| Confirmed requests per day | 23 | 24 |
“Confirmed” means the IP address is on OpenAI’s published list. “Content” means any page other than the home page, robots.txt, sitemaps, WordPress system paths (/wp-content/, /wp-includes/, /wp-json/) and .php files. The February–October figures are the ones in my list What bot is this?; October–November is a fresh count against the list as it stood on November 12, 2026. Identical log lines are counted once, and each request is assigned to a single bot: the one whose name appears first in the user-agent.
Questions
Frequently asked questions about OAI-SearchBot
Does blocking OAI-SearchBot stop OpenAI from training on my content?
No. Training is GPTBot’s job, and it has its own token. Blocking OAI-SearchBot only takes you out of ChatGPT search answers.
Will blocking OAI-SearchBot remove my site from ChatGPT completely?
Not completely. OpenAI says opted-out sites can still appear as navigational links, and ChatGPT-User may fetch a page someone asks about, because robots.txt rules may not apply to user-triggered requests.
How long does a robots.txt change take?
About 24 hours for ChatGPT search, according to OpenAI.
Why does OAI-SearchBot request robots.txt so often?
On my site it checks the file about 7 times a day. Some of those requests carry a robots.txt marker and come from addresses that are also on GPTBot’s list, and OpenAI says it may use one crawl for both bots.
Should I allow OAI-SearchBot?
If you want to appear in ChatGPT search, yes. OpenAI recommends allowing both the bot and its published IP ranges. On podrez.pl I let all AI bots in, OAI-SearchBot included.
Sources
Sources and method
I read all the sources below on November 12, 2026. Figures about my site come from the podrez.pl server logs for February 2 – October 6 and October 7 – November 11, 2026.
- OpenAI: Overview of OpenAI Crawlers – GPTBot, OAI-SearchBot, ChatGPT-User, OAI-AdsBot, example user-agent strings, the robots.txt marker, IP lists.
- OpenAI: OAI-SearchBot IP address list (searchbot.json) – 39 prefixes, file dated January 2, 2026.
- Vercel: The rise of the AI crawler – measurement with MERJ, published December 17, 2024: which AI crawlers render JavaScript.
Compiled by Ewelina Podrez-Siama, working in SEO since 2009. Facts last checked: November 12, 2026.
Other bot profiles: ClaudeBot · GPTBot · Bytespider · Applebot · Amazonbot · Meta-ExternalAgent · CCBot · PerplexityBot. Or go back to What bot is this?, my searchable list of bots and user-agents.
Check your site
What does your site tell OAI-SearchBot?
Two free tools: one reads your robots.txt the way OAI-SearchBot would, the other shows whether OAI-SearchBot really visits you.