搜索引擎蜘蛛UA标识
| 蜘蛛名称 | 搜索引擎名称 | UA标识 |
| Googlebot | 谷歌 | compatible;Googlebot/2.1;+http://www.google.com/bot.html |
| Baiduspider | 百度 | compatible;Baiduspider/2.0;+http://www.baidu.com/search/spider.html |
| Bingbot | 微软bing | compatible;bingbot/2.0;+http://www.bing.com/bingbot.htm |
| 360Spider | 360搜索 | Mozilla/5.0(Windows NT 10.0;Win64;x64)AppleWebKit/537.36(KHTML,like Gecko)Chrome/71.0.3578.98 Safari/5 37.36;360Spider |
| Sogou web spider | 搜狗搜索 | Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07 |
| YisouSpider | 神马搜索 | Mozilla/5.0(Windows NT 6.1;Win64;x64)AppleWebKit/537.36(KHTML,like Gecko)Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36 |
| yandexBot | Yandex | compatible;YandexBot/3.0;+http://yandex.com/bots |
| DuckDuckGo | DuckDuckGo | Mozilla/5.0(Linux;Android 10)AppleWebK it/537.36(KHTML,like Gecko)Version/4.0 Chrome/81.0.4044.138 Mobile Safari/537.36 DuckDuckGo/5 |
| YoudaoBot | 有道 | Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; ) |
| msnbot | MSN | *msnbot/1.0 (+http://search.msn.com/msnbot.htm”) |
| Yahoo | 雅虎 | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html) |
| Bytespider | 头条 | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |