Meta Robots
Robots directives, implemented via robots meta tag or the X-Robots-Tag HTTP header, provide explicit instructions to web crawlers and search engine robots regarding indexing, link-following, and caching preferences for a web page.
According to our data, Meta Robots is present on 46.1% of all websites.
- 🏠 Website
- 🔗 Links
Wikipedia
Google documentation📊 Rankings and Market Share
- Other
- Rank: 2
- Market share: 52.1%
⚡ Sites Using Meta Robots
We have data on 1,533,694 websites that use Meta Robots technology. Here is a list of some of the top ranked ones.
The highest rated site using Meta Robots is 
google.com.
| # | Website | Rank | Country | Language |
|---|---|---|---|---|
| 1 | google.com |
#1 | United States | English |
| 2 |  microsoft.com |
#3 | United States | American English |
| 3 |  instagram.com |
#5 | United States | English |
| 4 |  linkedin.com |
#9 | United States | English |
| 5 |  cloudflare.com |
#20 | United States | American English |
| 6 |  vimeo.com |
#23 | United States | English |
| 7 |  yahoo.co.jp |
#31 | Japan | Japanese |
| 8 |  dropbox.com |
#35 | United States | English |
| 9 | #36 | Korea | Korean | |
| 10 |  twitch.tv |
#42 | United States | English |
| 11 |  paypal.com |
#45 | United States | American English |
| 12 |  whatsapp.com |
#48 | United States | English |
| 13 | #53 | United Kingdom | British English | |
| 14 | #55 | English | ||
| 15 | #56 | American English | ||
| 16 | #61 | United States | American English | |
| 17 | #63 | United States | English | |
| 18 | #65 | United Kingdom | British English | |
| 19 | ibm.com | #66 | English | |
| 20 | #68 | United States | English |
📈 Usage Statistics
Most of the sites that use Meta Robots:
- are located in the United States
- have content in English
- use the .com domain extension
- fall into the Business category.
Most of the sites using Meta Robots are from the United States, Germany, and the United Kingdom.
- United States 19.4%
- Germany 8.3%
- United Kingdom 5.9%
- Japan 5.2%
- France 4.4%
- Spain 3.8%
- Netherlands 3.7%
- Italy 3.6%
- Australia 2.9%
- Other 42.8%
Most Meta Robots users speak English, German, or Spanish.
- English 49.4%
- German 7.7%
- Spanish 5.6%
- Japanese 4.6%
- French 4.2%
- Italian 2.9%
- Portuguese 2.8%
- Dutch 2.7%
- Russian 2.4%
- Other 17.7%
Meta Robots technology is especially popular on .com, .org, and .de top-level domains.
- .com 43.3%
- .org 6.4%
- .de 5.1%
- .net 3%
- .co.uk 2.2%
- .it 2.1%
- .nl 2%
- .com.au 1.8%
- .com.br 1.6%
- Other 32.5%
The primary market segments for websites utilizing Meta Robots include business, blogs and wiki, and online shopping.
- Business 17.5%
- Blogs/Wiki 8.1%
- Online Shopping 7.4%
- Education/Reference 5.9%
- Internet Services 5.2%
- Marketing/Merchandising 4.7%
- Entertainment 4.4%
- Health 3.4%
- General News 3.3%
- Other 40.1%
🔢 Meta Robots Values
The most popular value of Meta Robots is max-image-preview, used by 72.7% of sites where values were detected. In addition, 64.6% of sites use Meta Robots index, and 64.5% use Meta Robots follow.
🕵️ Similar Technologies
These are some of the best Meta Robots alternatives.
🆚 Compare Alternatives
Compare Meta Robots to…
- 🕵️ Similar technologies
- 💡 Featured alternatives
- 🔎 All options
Gravatar💬 Frequently Asked Questions
Which country uses Meta Robots the most?
The majority of Meta Robots users are from the United States.
Who uses Meta Robots?
According to our data, Meta Robots is used on millions of sites, including google.com, microsoft.com, and instagram.com.
Is Meta Robots used on government websites?
In total, we found Meta Robots on 846 government sites in the United States.
Do academic institutions use Meta Robots?
Yes, quite a few! In total, we know of 2,063 academic websites in the United States that use Meta Robots.
How does Meta Robots stack up against its competitors?
Meta Robots is one of the most popular other technologies, second only to 
Charset.
What are the alternatives to Meta Robots?
Alternatives and possible competitors to Meta Robots may include Charset, Multi-language, and JavaScript required.