It appears you are attempting to actualize a representation of a `robots.txt` book for Blogger application HTML `` tags, as Blogger itself does not abutment a acceptable `robots.txt` book that you can adapt directly. While HTML `` tags can access chase agent ample and indexing behavior to some extent, they do not accommodate the aforementioned akin of ascendancy as a accepted `robots.txt` file.
```Here's how you can represent the directives you mentioned application HTML `<meta>` tags aural the `<head>` area of your Blogger theme's HTML:
<!-- For Mediapartners-Google (Google AdSense crawler) -->
<meta name="googlebot" content="noindex" />
<!-- For all other user-agents --><meta name="robots" content="noindex, nofollow" />
<!-- Specific directives --><meta name="robots" content="noindex" /><meta name="robots" content="nofollow" />
<!-- Sitemap directive --><link rel="sitemap" type="application/xml" href="your_sitemap_url_here.xml" />```
Explanation of each directive:
- **`<meta name="googlebot" content="noindex">`**:
This instructs the Google AdSense crawler (Mediapartners-Google) not to basis the content.
- **`<meta name="robots" content="noindex, nofollow">`**:
This applies to all added user-agents (crawlers). It tells them not to basis (`noindex`) and not to chase (`nofollow`) any links on the page.
- **`<link rel="sitemap" type="application/xml" href="your_sitemap_url_here.xml" />`**:
This specifies the area of your XML sitemap. Replace `"your_sitemap_url_here.xml"` with the URL of your absolute sitemap file.
Please agenda that application HTML `<meta>` tags for `robots.txt`-like directives has limitations and may not accept the aforementioned appulse as a accepted `robots.txt` file
0 Comments