Noindex

Noindex is a directive that instructs search engines not to include a specific page in their index, which means the page will not appear in search results. It is one of the most direct tools a site owner has for controlling visibility. While many SEO signals nudge or suggest, noindex is an explicit command that reputable search engines honor. When a crawler encounters it and is permitted to read the page, it removes that page from, or keeps it out of, the pool of results shown to searchers.

The directive can be delivered in two main ways. The most common is a meta robots tag in the head of an HTML page, with its content attribute set to noindex. The second is an HTTP response header, often called the X-Robots-Tag, which is applied at the server level and is especially useful for non-HTML files such as PDFs or images where you cannot place a meta tag. In both cases, noindex is frequently paired with a follow value. That combination tells the search engine to keep the page out of the index while still following its links, so link discovery and the flow of authority through the page are preserved. Used alone, noindex defaults to also allowing links to be followed unless nofollow is explicitly added.

The name is a plain compound: the prefix no attached to index, the searchable database that search engines build of the web's pages. The directive emerged as part of the meta robots standard as site owners needed a way to publish pages for human visitors while keeping certain ones out of public search. Over time it became a cornerstone of how large sites manage which content competes for rankings.

For a business, noindex matters because not every page deserves to be found through search, and some pages actively harm performance if they are indexed. Thin content, duplicate pages, internal search results, filtered category views that create near-identical URLs, order confirmation pages, and gated or private content are all candidates for noindex. By removing these from the index, a site presents search engines with a cleaner, more focused set of pages, which can improve how the overall domain is understood and prevent low-quality URLs from diluting its presence.

The central nuance, and the source of the most common mistake, is the interaction between noindex and crawlability. For a search engine to obey a noindex directive, it must be able to crawl the page and read the instruction. If the page is also blocked in robots.txt, the crawler never fetches it, never sees the noindex, and the page can remain in the index, sometimes appearing with no description. The correct sequence for removing a page is to leave it crawlable, apply noindex, and wait for the engine to recrawl and drop it. Only after it has been deindexed should you consider blocking it in robots.txt. Another subtlety is that a noindexed page kept in place for a long time may eventually have its links treated as nofollow by some engines. Understood correctly, noindex is a precise and reliable way to shape exactly which pages a business puts in front of searchers.