How block only Yandex bot
9,664
There are many "Yandex bots". If you want to block all the Yandex bots then:
User-agent: Yandex
Disallow: /
However, if you only want to block the main indexing "YandexBot" then:
User-agent: YandexBot
Disallow: /
Source:
https://yandex.com/support/webmaster/controlling-robot/robots-txt.xml
You don't need to do anything for Googlebot (or any other bot) if you want the other bots to crawl your site, since allow (crawling) is the default action.
Related videos on Youtube
06 : 09
Block Bad Bots from Accessing Your Website or Network!
17 : 07
Bot View YTB - Tăng View,Like,subscribe ... You To Be Change Mac , IP , browser
03 : 22
How To block DMCA Bots from accessing your site, using CloudFlare Firewall Rules
05 : 31
Discord: How to stop bots seeing channels | Manage premade bot roles
06 : 50
How to Block Website on Yandex Browser?
04 : 28
DevOps & SysAdmins: Blocking yandex.ru bot (6 Solutions!!)
01 : 31
Webmasters: How block only Yandex bot?
Author by
whereisrysmind
Updated on September 18, 2022Comments
-
whereisrysmind over 1 year
Can you show me how will look robots.txt when I block only yandex bot, allow Google bot and block Yandex bot.
-
Goyllo about 7 yearsYeah, I generally use robots.txt to prevent something, because by default all bots are allowed to crawl. For example wikipedia site blocking Google-ads bot(Mediapartners-Google*), because they are not using any ads. So it helps them to save some bandwidth. -
whereisrysmind about 7 yearsok so if i want block all yandex bot, i need add in robots.txt this: User-agent: Yandex Disallow: / ?
-
MrWhite about 7 years@nikola99 Yes, that should do it.
