What is robots meta tag generator?
A robots meta tag tells search engines what they may do with a page. The most common use is noindex, which keeps a page out of search results, such as thank you pages, thin tag pages and staging copies.
This generator builds the tag and the equivalent HTTP header, which is useful for files such as PDFs.
How to use the robots meta tag generator
- Choose which crawlers the tag applies to.
- Tick the directives you need.
- Copy the meta tag into the head or the header into your server.
How the robots meta tag generator works
The selected directives are joined with commas in the content value. If nothing is selected, the tag uses index and follow, which are the defaults. Optional values are added as max snippet, max image preview or unavailable after.
Worked example
Common uses of the robots meta tag generator
- Thank you and checkout pages.
- Staging and test pages.
- Duplicate filter pages.
- Private PDFs.
- Controlling snippets.
Tips and common mistakes
Do not block a page in robots.txt if you want a noindex tag to be seen.
Index and follow are defaults, so you rarely need to write them.
Background: what to know before you rely on it
Search engines treat robots meta directives as instructions, but only if they can read them. A common mistake is to add noindex to a page and also block it in robots.txt: the crawler never visits the page, so it never sees the noindex, and the URL may stay in results. Another mistake is leaving a noindex tag on a launch template, which can remove a whole new site from search. After any change, use the URL inspection tool in Search Console to confirm what Google sees.
Private, free and fast
This tool runs entirely in your browser. What you type or choose is not uploaded to a server and is not saved after you close the page, which keeps it fast and private. It is free to use as often as you like. See more in all seo tools, or browse the full list of tools.
Frequently asked questions
What is the difference between noindex and robots.txt?
Noindex keeps a page out of results but lets crawlers read it. Robots.txt stops crawling but may still list the URL.
What does nofollow do?
It asks crawlers not to follow the links on the page.
What is X Robots Tag?
The same directives sent as an HTTP header, handy for non HTML files.
Will the page disappear at once?
No. It leaves results after the next crawl.
Related tools
Robots.txt Generator
Enter the paths you want to block, add your sitemap and download a ready robots.txt for the root of your...
SEO ToolsMeta Tag Generator
Enter your page title, description and URL and the generator writes the HTML meta tags, including Open...
SEO Tools.htaccess Redirect Generator
Choose the redirect type and fill in the paths. The generator writes the .htaccess rules for Apache...
SEO ToolsOn Page SEO Checker
Paste the HTML source of a page and the tool checks 13 on page SEO basics and shows a score with what to...
SEO ToolsUTM Link Builder
Enter your URL with a source and medium, plus optional campaign details. The tool returns a tagged link...
SEO ToolsFAQ Schema Generator
Write each question on one line and the answer on the next, with a blank line between pairs. The tool...
Results are for information and education. For legal, financial, medical or security decisions, check with a qualified professional. Validate markup with search engine testing tools before publishing.