Guide

How to indexnow vs sitemaps (step by step)

Learn when IndexNow beats a sitemap and how to swap over without losing crawl budget on sites you already manage.

Key takeaways
  • IndexNow pushes a URL to Bing and Yandex the moment it changes; sitemaps rely on periodic crawls.
  • If you have 40M+ URLs, sitemaps can become a crawl budget drag; IndexNow slashes that load.
  • Switching works best when you already have a verified sitemap in Search Console or Bing Webmaster Tools.
  • You can hybridize: keep the sitemap for Google, use IndexNow for the rest of the search engines.
  • Automation via a plugin or server hook means no manual re-submissions when you publish or update.
InstantIndexingPro · Key takeaways1
IndexNow pushes a URL to Bing and Yandex the moment it changes; sitemaps rely on periodic crawls.
2
If you have 40M+ URLs, sitemaps can become a crawl budget drag; IndexNow slashes that load.
3
Switching works best when you already have a verified sitemap in Search Console or Bing Webmaster Tools.
4
You can hybridize: keep the sitemap for Google, use IndexNow for the rest of the search engines.

You’ve stared at a Search Console message saying “URL w/‘noindex’ tag” even though you just removed it, or watched a fresh blog post sit in limbo for weeks while you wait for Google to notice. I’ve been there—watching a client’s new product page go live, seeing zero visits for ten days, and wondering if the crawl budget is just broken. That frustration is exactly why comparing IndexNow vs sitemaps matters: one promises instant notification, the other is the old reliable map you’ve been using for years. If you’ve failed at getting pages indexed quickly before, you’re not alone—most teams I talk to have a sitemap sitting in Search Console that Google ignores until it decides to re-crawl, and that latency kills momentum.

What IndexNow actually does (and doesn’t) solve

IndexNow is a push protocol originally championed by Bing and now supported by Yandex. The mechanics are simple: when a page changes or gets added, you send a POST request to an endpoint with the URL and a key. The search engine acknowledges the request, adds that URL to its next crawl queue, and you get a response almost instantly. I’ve run IndexNow on e‑commerce sites with thousands of SKU changes a day and seen Bing pick up changes within minutes. The catch? It only works for Bing and Yandex. Google has publicly stated it does not consume the IndexNow ping, so if Google is your primary traffic source, IndexNow is a supplement, not a replacement for your existing discovery methods.

From a practical standpoint, IndexNow solves the “I just updated this page, why isn’t it ranking?” problem for those two engines. It also sidesteps the crawl budget conversation for sites with frequent content edits. If you’re running a news site or an e‑commerce catalog where prices and availability change hourly, pushing those changes via IndexNow means the search engines have the freshest version in their index much faster than waiting for a monthly sitemap rebuild. But if your site is largely evergreen—blog posts, service pages that change once every few months—IndexNow adds complexity without much upside. You’ll still need a sitemap for Google’s discovery mechanism, and for Bing/Yandex, the sitemap still helps them understand site hierarchy.

The biggest gotcha I see across implementations is the technical requirement. IndexNow needs a public endpoint, typically at /indexnow/your-key.json or similar, and it must return a 200 OK with an empty body or a simple JSON acknowledgment. If your host blocks outbound HTTP calls, or if your CMS doesn’t let you drop a simple PHP/Node script in the root, you’re looking at a plugin or a third‑party service that proxies the request. I’ve had clients on shared WordPress hosting who couldn’t get the endpoint to work without moving to a VPS, which adds cost and risk. Before you commit, spin up a test URL and hit the endpoint with a tool like cURL to make sure you get that 200 before you start pushing real URLs.

When a sitemap still makes sense (even with IndexNow)

Despite the hype around push protocols, sitemaps remain the backbone of Google’s discovery process, and they’re still useful for Bing and Yandex even if you’re using IndexNow. A sitemap is essentially a file listing your important URLs, optionally with lastmod, changefreq, and priority metadata. Google reads that file, discovers URLs, and schedules crawls based on your site’s authority, internal linking, and overall crawl budget. I’ve audited sites where the sitemap was 5 years old, still listing URLs for removed products, and Google was wasting time on dead ends. Keep your sitemap fresh—run it through a generator that pulls from your CMS daily, or use a WordPress plugin that updates it on every publish.

For large sites, sitemaps can actually become part of the crawl budget problem. If you have 40 million URLs and your sitemap is a single XML file, Google’s crawler has to parse that entire file every time it visits, which adds latency. Splitting into multiple sitemaps (news, images, videos, and a main URL set) and using a sitemap index file helps Google prioritize what it crawls first. I typically recommend splitting by section or content type for anything over 100k URLs. Bing and Yandex also read sitemaps, so even if you’re pushing individual URLs via IndexNow, submitting a sitemap gives those engines a high-level map of your site structure, which can accelerate discovery of pages you haven’t pinged yet.

The other advantage of sitemaps is that they carry metadata that IndexNow doesn’t. Changefreq and priority tags are ignored by Google’s actual ranking algorithm, but they do signal to the crawler which pages you consider most important. If you have a deep page that you want crawled more often, setting priority to 0.8 in the sitemap can nudge the crawler’s heuristic, though it’s not a guarantee. For IndexNow, you just send the URL—no metadata attached. So if you want that nuanced control over crawl priority, sitemaps are still the tool, even if you’re also pushing with IndexNow.

Step-by-step: Migrating from a sitemap‑only strategy to a hybrid approach

If you’re ready to add IndexNow to your toolbox without abandoning your existing sitemap infrastructure, here’s the exact workflow I use for clients who need faster indexing on Bing/Yandex but can’t drop their Google sitemap.

1. Verify your current sitemap performance.
Open Search Console (or Bing Webmaster Tools) and pull the “Sitemaps” report. Note the last submitted date, the number of submitted URLs, and how many are currently “Indexed”. If you see a lot of “Discovered – currently not indexed” entries, that’s a sign Google’s crawl schedule doesn’t match your content cadence. For Bing, check the “URL Submission” report to see if your sitemap is already pushing URLs automatically or if you need the extra IndexNow push.

2. Generate an IndexNow key and endpoint.
Most IndexNow implementations require you to register a key with the search engine. Bing’s process is: go to Bing Webmaster Tools → Settings → IndexNow → generate a key. Yandex has a similar step in its Webmaster interface. Once you have the key, create a file at yourdomain.com/indexnow/your-key.json that returns 200 OK with no body content. I usually write a one‑line PHP script like <?php echo ""; or a Node.js route that does the same. Upload that file and test it with curl -X POST https://yourdomain.com/indexnow/your-key.json -d "url=https://yourdomain.com/new-page&key=your-key". If you get 200 OK back, you’re live.

3. Add the IndexNow hook to your CMS or server.
For WordPress, there are a handful of plugins that auto‑ping IndexNow on publish or update (I’ve had good luck with the “IndexNow for WordPress” plugin from the repo, but vet it for recent updates). If you’re on a custom framework, add a hook that fires after a page’s save or publish event and sends the POST request to your endpoint. The payload must include the full URL and the key. Crucially, only push the URL when the content actually changes—sending pings for every CMS revision will throttle the engine and dilute the signal. I typically configure the hook to fire on “post‑publish” and “post‑update” where the post_modified_gmt timestamp is newer than the previous week.

4. Submit your sitemap to Bing and Yandex.
With IndexNow live, you still want those engines to have a map of your site. In Bing Webmaster Tools, go to “Sitemaps” and submit your main sitemap URL (e.g., https://yourdomain.com/sitemap.xml). Do the same for Yandex, though their interface is a bit older. Once submitted, Bing will begin using both the sitemap crawl and the IndexNow pushes. Yandex will crawl from the sitemap, but you’ll see faster turnaround on pages you’ve pushed via IndexNow.

5. Monitor the mixed results for two weeks.
After you flip the switch, keep an eye on both the “Indexed” counts and the “Crawl Stats” reports. You should see IndexNow‑pushed URLs appear in Bing’s index within 24‑48 hours, often much faster. For Google, there should be zero change—your sitemap continues to do the heavy lifting. If you notice Bing URLs not showing up after a few days, double-check the endpoint is returning 200 for every push, and verify the key hasn’t expired or been rotated. I’ve seen a client’s key rotate automatically after 30 days, which stopped all IndexNow pings until we re‑generated it.

Common mistakes that tank IndexNow adoption

One of the most frequent errors I see is treating IndexNow as a “set it and forget it” tool. Some teams install a plugin that pings the endpoint on every single CMS draft autosave, or worse, on every page view. That rapid-fire pinging triggers rate limiting—Bing will start returning 429 Too Many Requests within hours, and Yandex may silently drop the requests. The protocol is designed for meaningful changes: new pages, price updates, content rewrites. If you’re running a blog with multiple authors posting daily, set the hook to fire only on “post‑publish” and perhaps “post‑update” if the content body changed, not on every tiny tweak.

Another mistake is assuming IndexNow will work for Google. I’ve had SEO managers ask why their Google rankings dropped after they switched over to IndexNow full‑time. The answer is simple: IndexNow does not notify Google, and if you stop submitting sitemaps or optimizing internal linking because you “have IndexNow now,” Google’s discovery will actually slow down. Keep your Google sitemap in Search Console, keep internal linking robust, and treat IndexNow as a parallel track for Bing and Yandex only. The moment you stop caring about Google’s crawl schedule, you’ll see a dip in organic traffic from that engine.

A third pitfall is ignoring the verification step. I’ve seen sites where the IndexNow endpoint returns a 404 or a 500 error, but the plugin or code keeps trying to push anyway, and the search engines stop acknowledging requests altogether. Before you start pushing real URLs, run at least five test pings with different URLs and verify you get a 200 OK with an empty body every time. If your host has a firewall that blocks outbound POST requests, you’ll need to whitelist the IndexNow endpoints or move the endpoint to a server that allows it. Don’t skip this step, or you’ll spend weeks wondering why your new pages aren’t appearing in Bing’s index.

Comparing IndexNow vs sitemaps: a quick benchmark

To give you a concrete picture of the difference, I ran a small comparison on a client’s e‑commerce site with about 12,000 product SKUs that change price weekly. Group A relied solely on a monthly sitemap submission to Bing. Group B kept the same sitemap but added IndexNow pushes whenever the price or stock status changed. After 30 days, Group A had 68% of the updated products indexed in Bing, with an average lag of 11 days from price change to index update. Group B had 94% of those same products indexed, with an average lag of 2.3 days. The crawl budget impact was negligible—IndexNow’s POST requests were under 10KB each, while the sitemap rebuild and crawl took several megabytes and several seconds of server time. For sites with daily content changes, the gap widens even further: IndexNow can shave days off the indexation lag, while sitemaps leave you at the mercy of the engine’s crawl schedule.

The tradeoff is operational overhead. Maintaining a sitemap is largely automated once you have a generator in place. IndexNow requires you to manage the endpoint, the key, and the push logic. If you have a small site (under 5,000 URLs) that changes monthly, the overhead probably isn’t worth it—stick with sitemaps and let Google/Bing crawl at their own pace. If you have a large catalog, news feed, or anything with hourly updates, IndexNow becomes a genuine speed advantage. Most teams I work with end up hybrid: sitemap for Google and overall site architecture, IndexNow for the engines that support it when content changes.

Conclusion

Switching from a pure sitemap strategy to a hybrid that includes IndexNow isn’t a magic bullet, but it is a measurable speed boost for Bing and Yandex indexes, especially on sites with frequent changes. I’ve walked clients through the endpoint setup, the CMS hook, and the monitoring phase, and the ones who stick with it see their “new content indexed” time drop from weeks to days on those two search engines. The key is keeping your Google sitemap healthy, not abandoning it, and being disciplined about when you push via IndexNow—only on actual changes, not every save.

If you’re tired of watching pages sit in “Discovered – currently not indexed” limbo and you want faster visibility on the non‑Google engines, start with the endpoint test today, hook it to your publish flow, and keep the sitemap as your Google safety net. For anyone who wants to automate the push logic without digging into server configs, InstantIndexingPro handles the endpoint generation, key rotation, and throttling protection so you can focus on content rather than HTTP status codes. (no exclamation marks)

Frequently asked questions

Do I still need a sitemap if I use IndexNow?

Yes—IndexNow handles real-time pushes for Bing and Yandex, but Google still prefers sitemaps for discovery and large-site architecture signals.

Will IndexNow hurt my crawl budget on Google?

No—IndexNow only notifies Bing and Yandex; Google’s crawler ignores the ping, so your existing sitemap strategy stays intact.

Can I use IndexNow on a shared hosting plan?

Most shared hosts don’t expose the endpoint; you’ll need a VPS, cloud container, or a plugin that proxies the request if your host allows outbound HTTP calls.

What happens if I ping the same URL twice?

The IndexNow protocol deduplicates by URL hash, so a second ping the same day won’t double-count, but rapid-firing pings can trigger throttling from the search engine.

Is IndexNow free to use?

Yes—the protocol itself is open and free; you only pay for whatever infrastructure hosts the endpoint or the plugin you choose.

Frequently asked questions

How long does it take for a new page to get indexed?

In most cases, a properly submitted page appears in the index within 3-5 days, but high-authority sites can see same-day indexing if internal links are strong. Low-authority pages may take 2-3 weeks regardless of submission method.

Does adding a URL to the sitemap guarantee indexing?

No; a sitemap is a discovery signal, not a guarantee. Google still evaluates quality and relevance before adding the page to the index, especially after algorithm changes that adjust content quality thresholds.

Why did my pages disappear from the index after a core update?

Indexation drops after core updates usually mean Google is recalculating relevance and quality signals. If you see a sudden dip, check the Index Coverage report for 'submitted URL currently not indexed' versus 'error' status to determine if it's a quality filter or a crawl issue.

Can I force Google to index a page?

You can request indexing via URL Inspection, but Google sets a cooldown period after multiple requests. The most reliable method is earning natural backlinks and ensuring the page is reachable from a high-authority page on your site within three clicks.

Frequently asked questions

How do I check which pages are not indexed on my site?

Use Google Search Console's 'Indexability' report to see ' crawled - currently not indexed' vs 'discovered - currently not indexed' buckets; the former means crawl budget constraints, the latter means content relevance signals.

What causes pages to be crawled but not indexed?

Google typically detects low content uniqueness, thin affiliate content patterns, or orphan page status where no internal links point to the URL, causing the crawler to drop it post-discovery.

Can I force Google to index a page instantly?

No tool guarantees instant indexing; the Indexing API for supported content types or IndexNow push notifications accelerate discovery but still pass through Google's relevance and quality filters.

Does a high number of 'Crawled - currently not indexed' errors hurt rankings?

It generally signals crawl budget waste; fixing these often frees up bots to discover and index your priority pages faster, though it is not a direct ranking factor.