Tệp rotbot.txt chuẩn SEO cho blogger

Tệp robot.txt chuẩn cho blogspot 2018 được chia sẻ bởi anh Nguyễn Tuấn của blogthuthuatwindows10.com
Tệp robots.txt cho mọi người tham khảo, tệp này chặn một số link không đẹp trên Google tìm kiếm.

Tệp robot.txt cho blog dưới 500 bài

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500



Code chuẩn

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500


robot.txt Với những blog trên 500 bài



User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Allow: /search/label/
Disallow: *max-results=*
Disallow: *archive.html
Disallow: *?m=0
Disallow: /search?*
Disallow: *?showComment=*
Disallow: *?spref=fb
Disallow: *?spref=tw
Disallow: *?spref=gp
Disallow: *?utm_source=*
Sitemap: ĐỊA CHỈ BLOG/feeds/posts/default?orderby=UPDATED
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1&max-results=500

Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=501&max-results=500
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1001&max-results=500
Sitemap: ĐỊA CHỈ BLOG/atom.xml?redirect=false&start-index=1501&max-results=500