一堆User-agent蜘蛛爬虫的标识
以下是一堆蜘蛛爬虫的User-agent标识，送给大家。虽然不是最权威的，但肯定是最全的。
| User-agent:bingbot |
| User-agent:Googlebot |
| User-agent:Slurp |
| User-agent:SlurpChina |
| User-agent:Sogoublog |
| User-agent:yisouspider |
| User-agent:YoudaoBot |
| User-agent:008 |
| User-agent:293net |
| User-agent:360Spider |
| User-agent:Abonti |
| User-agent:ADmantX |
| User-Agent:Adsbot |
| User-agent:Adsbot-Googl |
| User-Agent:AdsBot-Google |
| User-agent:AhrefsBo |
| User-agent:AhrefsBot |
| User-agent:aibang.com |
| User-agent:Applebo |
| User-agent:Applebot |
| User-agent:archive.org_bot |
| User-agent:babbar |
| User-agent:BacklinkCrawler |
| User-agent:Baidu |
| User-agent:Baidusp |
| User-agent:baiduspider |
| User-agent:Baiduspider-cpro |
| User-agent:Baiduspider-favo |
| User-agent:Baiduspider-image |
| User-agent:Baiduspider-mobile |
| User-agent:Baiduspider-news |
| User-agent:Baiduspider-sfkr |
| User-agent:Baiduspider-video |
| User-Agent:Barkrowler |
| User-agent:BLEXBot |
| User-agent:BlogBeatbot |
| User-agent:BLP_bbot |
| User-agent:bot-pge.chlooe.com |
| User-agent:BPImageWalker |
| User-agent:BUbiNG |
| User-agent:Bytedancespider |
| User-agent:Bytespider |
| User-agent:CatchBot |
| User-agent:CCBot |
| User-agent:check_http |
| User-agent:ChinasoSpider |
| User-agent:Custo |
| User-agent:daqi |
| User-agent:DeuSu |
| User-agent:DotBot |
| User-agent:EasouSpider |
| User-agent:EtaoSpider |
| User-agent:exabot |
| User-Agent:ezooms.bot |
| User-agent:Facebot |
| User-agent:FemtosearchBot |
| User-agent:FISPIDER |
| User-agent:Gigabot |
| User-agent:Go |
| User-agent:Google |
| User-agent:googlebot-image |
| User-agent:Googlebot-Mobile |
| User-agent:grapeshot |
| User-agent:GwdangSpider |
| User-agent:HaosouSpider |
| User-agent:hl_ftien_spider |
| User-agent:HuaweiSymantecSpider |
| User-agent:HuihuiSpider |
| User-Agent:ia_archiver |
| User-agent:iaskspider |
| User-agent:ICC-Crawler |
| User-agent:Jakart |
| User-agent:JikeSpider |
| User-agent:Jobuispider |
| User-Agent:Linguee |
| user-agent:LinkChecker |
| User-Agent:MagiBot |
| User-agent:Mail.Ru |
| User-agent:MauiBot |
| User-agent:Mediapar |
| User-Agent:Mediapartners-Google |
| User-agent:MegaIndex |
| User-agent:MegaIndex.ru |
| User-agent:MJ12bot |
| User-agent:MSNBot |
| User-agent:msnbot-media |
| User-agent:oBot |
| User-agent:pepo |
| User-agent:PetalBot |
| User-agent:psbot |
| User-agent:Purebot |
| User-agent:Riddler |
| User-agent:Robozilla |
| User-agent:rogerbo |
| User-agent:Scooter |
| User-agent:Scrubby |
| User-agent:SeekerBot |
| User-agent:semrush |
| User-agent:SemrushBot |
| User-agent:SemrushBot-BM |
| User-agent:SemrushBot-CT |
| User-agent:SemrushBot-SA |
| User-agent:SemrushBot-SWA |
| User-agent:SeoHuntBot |
| User-agent:Seznam |
| User-agent:SeznamBot |
| User-agent:SeznamBot/3.2 |
| User-Agent:SiteSnagger |
| User-agent:Sogou |
| User-agent:Sogouinstspider |
| User-agent:SogouNewsSpider |
| User-agent:sogouspider |
| User-agent:Sogouspider2 |
| User-agent:Sogouwebspi |
| User-agent:Sogouwebspider |
| User-Agent:Sogouwebspider |
| User-agent:Sosospider |
| User-agent:SplitSignalBot |
| User-agent:Teoma |
| user-agent:TestBot |
| User-agent:TheKnowledgeAI |
| User-agent:ToutiaoSpider |
| User-Agent:trendictionbot |
| User-agent:twiceler |
| User-agent:Twitterbot |
| User-agent:UbiCrawler |
| User-agent:User-agent:Slurp |
| User-agent:W3Crobot/1 |
| User-agent:WandoujiaSpide |
| User-agent:WandoujiaSpider |
| User-Agent:WebCopier |
| User-Agent:WebStripper |
| User-agent:WochachaSpider |
| User-agent:WordupInfoSearch |
| User-agent:wotbox |
| User-agent:WukongSpider |
| User-agent:Yahoo |
| User-agent:Yahoo!-AdCrawler |
| User-agent:Yahoo!Slurp |
| User-agent:Yahoo!SlurpChina |
| User-agent:yahoo-blogs/ |
| User-agent:yahoo-mmcrawler |
| User-agent:Yahoo-Slurp |
| User-agent:YahooSlurpChina |
| User-agent:Yan |
| User-agent:Yandex |
| User-Agent:YandexBot |
| User-agent:YidianBot |
| user-agent:YisouS |
| User-agent:YodaoBot |
| User-agent:YoudaoB |
| User-agent:YRSpider |
| User-agent:YYSp |
| User-agent:YYSpider |
| User-agent:Zao |
| User-Agent:Zealbot |
| User-agent:ZoominfoBot |
更多新鲜干货，欢迎关注小男孩网站 xiaoboy.cn
一堆User-agent蜘蛛爬虫的标识：等您坐沙发呢！