
How long does it take ChatGPT to find a new page?
EasyFound · · 6 min read
OpenAI doesn't say how long ChatGPT takes to find a new page. On our own small Malaysian website, its search crawler came in occasional sweeps and took about two to five days to fetch the new articles it found. Many newer articles hadn't been fetched at all after a week. So publish time-sensitive pages, like festive offers, at least a week early.
On our own small website, ChatGPT's search crawler took about two to five days to find most of the new pages it fetched, and many of our newest pages weren't fetched at all in the days we watched. OpenAI doesn't publish a timetable, and its crawler came in sweeps rather than right after each post went live.
We published 33 articles on easyfound.co between 25 September and 2 October 2026. By 3 October, our server logs showed that OpenAI's search crawler had fetched 15 of them.
How long did ChatGPT's crawler take to find each new page on our site?
ChatGPT's search crawler, OAI-SearchBot, first fetched our new articles anywhere from under a day to nearly five days after they went live. For the ones it fetched, the median wait was about three days. Here's each publishing day:
| Went live | Articles | OAI-SearchBot's first fetch |
|---|---|---|
| 25 Sep | 1 | 30 Sep, after 4.7 days |
| 26 Sep | 3 | 30 Sep, after 3.8 days |
| 27 Sep | 3 | 30 Sep, after 2.9 days |
| 28 Sep | 5 | 30 Sep, after 2.0 days |
| 29 Sep | 4 | 1 on 2 Oct; 3 not yet after 4 days |
| 30 Sep | 5 | 1 on 2 Oct; 4 not yet after 3 days |
| 2 Oct | 12 | 1 after 15 hours; 11 not yet after 1 to 1.5 days |
Watched until 3 October 2026, 15:09 UTC. "Not yet" means no request from OAI-SearchBot reached our server.
Our reading is that "how long" depended less on the page than on the calendar. Every new article live by 28 September was fetched in the same sweep. Most of what came after was still waiting.
Why did ChatGPT find some pages in two days and others not at all?
ChatGPT's crawler visited our site in sweeps, and in our logs a new page waited for the next sweep that included it. On 30 September, OAI-SearchBot requested 17 of our blog articles in one burst. It took 20 seconds. The list held every new article published from 25 to 28 September, plus older posts, but none of the four published on 29 September.
The next pickup of new pages came late on 2 October (UTC), with three new articles. Between sweeps, it re-read older posts one at a time.
About two days before the 30 September sweep, OpenAI's training crawler, GPTBot, had fetched the same 12 new articles in one pass. OpenAI says that if a site allows both crawlers, "we may use the results from just one crawl for both use cases to avoid duplicative crawling"1. Our reading is that the two crawlers may share a list of pages to visit, but OpenAI doesn't say so. Blocking GPTBot is still your choice: the two crawlers do different jobs.
Does a sitemap or IndexNow make ChatGPT find a page faster?
Not in our logs. OAI-SearchBot didn't request our sitemap once in the eight days we watched. It did read our robots.txt 28 times. GPTBot read the sitemap almost every day, but never fetched an article published after 28 September.
IndexNow didn't help with OpenAI either. We pinged it for at least four of our publishing batches, and Bing's crawler fetched none of the new articles from our server. IndexNow goes to Bing and other participating engines, and OpenAI isn't on its list3. Our Bing article covers where ChatGPT does use Bing.
A sitemap does work for crawlers that read it. Anthropic's ClaudeBot checked ours every few hours. It fetched most of the new articles within ten hours of going live.
What does OpenAI say about how long ChatGPT takes to see a new page?
OpenAI gives no timeline for new pages. Its publisher FAQ says "Any public website can appear in ChatGPT search" and asks you to "make sure you aren't blocking OAI-SearchBot"2. It describes no way to submit a page.
The only timing OpenAI publishes is for robots.txt: "it can take ~24 hours from a site's robots.txt update for our systems to adjust"1. That covers unblocking the crawler, not finding a new page. For the wider question of when answers change, see how long until AI notices you.
What can't our crawl timeline tell you?
- Other websites. This is one small, new site over eight days. A busy site with many links to it may be crawled more often.
- Whether ChatGPT showed the page. A fetch isn't an answer. We didn't test whether each article then appeared in ChatGPT.
- Every route in. We only see requests that reached our server. ChatGPT also uses other search providers, so it may know a page it hasn't fetched from you.
How do I get ChatGPT to find my new page sooner?
You can't book a crawl, but you can make sure the page is ready for the next sweep and plan for a few days' wait.
- Request EasyFound's free check. See what ChatGPT says about your business now, then go through it with us on a free call.
- Publish time-sensitive pages at least a week early. That's our advice from one site's logs, not an OpenAI rule. A Deepavali promotion or a Ramadan buffet menu posted three days before may not be fetched in time. Our slowest fetch took nearly five days, and most of our newest pages hadn't been fetched at all.
- Link the new page from pages ChatGPT already reads, such as your homepage. OAI-SearchBot fetched our homepage five times in the window, and our reading is that links from it help the page get onto the next list.
- Check that OAI-SearchBot can reach your site. Allow it in robots.txt and in Cloudflare or your host's firewall, as our bot guide shows.
- Re-check ChatGPT's answer a week after publishing, not the next morning, using the same test questions each time.
EasyFound, an AI SEO service for Malaysian businesses, checks six AI tools in English, Malay and Chinese and works on the pages they draw on, including whether their crawlers can reach yours. The free check is below.
Has ChatGPT found your page yet?
See what ChatGPT says about your business today, then go through it with us on a free call.
Frequently asked questions
How long does it take for ChatGPT to index a new page?
OpenAI doesn't publish a timeline. On EasyFound's own website, OpenAI's search crawler OAI-SearchBot first fetched new articles from 15 hours to nearly five days after they went live, with a median of about three days for the 15 articles it fetched. 18 of the 33 articles we published between 25 September and 2 October 2026 hadn't been fetched by 3 October. A fetch also isn't the same as appearing in an answer.
Does ChatGPT read my sitemap?
Not in our logs. OAI-SearchBot, the crawler OpenAI uses for ChatGPT search, didn't request easyfound.co's sitemap once from 25 September to 3 October 2026, though it read our robots.txt 28 times in those eight days. OpenAI's training crawler GPTBot read the sitemap almost daily. Anthropic's ClaudeBot, which read the sitemap every few hours, fetched most new articles within ten hours.
Can I ask ChatGPT to crawl my website?
There's no documented way. OpenAI's crawler page and its publisher FAQ describe no tool for submitting a page to ChatGPT search. What OpenAI asks is that you don't block OAI-SearchBot in robots.txt and that your host or firewall allows its published IP addresses.
Does IndexNow help ChatGPT find new pages faster?
Not directly. IndexNow tells Bing and other participating search engines about a new page, and OpenAI isn't one of them. EasyFound pinged IndexNow for at least four of its publishing batches between 25 September and 2 October 2026, and Bing's crawler fetched none of the 33 new articles from our server by 3 October.
Sources
Our data: EasyFound, How long AI and search crawlers took to first fetch new articles on easyfound.co. Every request that reached easyfound.co's server from 25 September 2026, 15:35 UTC, to 3 October 2026, 15:09 UTC (5,582 requests in Railway's HTTP logs), for the 33 blog articles that went live in that time. Crawlers were identified by user agent and counted only when the IP address was in the company's published list. An article's live time is when the deployment that first served it started taking traffic. Cloudflare cache hits never reach our server, so they aren't counted. Download the CSV.
Other sources:
- OpenAI, Overview of OpenAI Crawlers, read 3 October 2026 (link)
- OpenAI, Publishers and Developers - FAQ, Help Center, read 3 October 2026 (link)
- IndexNow, list of participating search engines, read 3 October 2026 (link)
The results are shared under CC BY 4.0: you're free to reuse them, with credit to EasyFound.
Crawlers change their schedules; treat these figures as a dated measurement of one website.
Research by Janice Pang, EasyFound.