> 做站经验技巧 > 一堆User-agent蜘蛛爬虫的标识

一堆User-agent蜘蛛爬虫的标识

以下是一堆蜘蛛爬虫的User-agent标识,送给大家。虽然不是最权威的,但肯定是最全的。

User-agent:bingbot
User-agent:Googlebot
User-agent:Slurp
User-agent:SlurpChina
User-agent:Sogoublog
User-agent:yisouspider
User-agent:YoudaoBot
User-agent:008
User-agent:293net
User-agent:360Spider
User-agent:Abonti
User-agent:ADmantX
User-Agent:Adsbot
User-agent:Adsbot-Googl
User-Agent:AdsBot-Google
User-agent:AhrefsBo
User-agent:AhrefsBot
User-agent:aibang.com
User-agent:Applebo
User-agent:Applebot
User-agent:archive.org_bot
User-agent:babbar
User-agent:BacklinkCrawler
User-agent:Baidu
User-agent:Baidusp
User-agent:baiduspider
User-agent:Baiduspider-cpro
User-agent:Baiduspider-favo
User-agent:Baiduspider-image
User-agent:Baiduspider-mobile
User-agent:Baiduspider-news
User-agent:Baiduspider-sfkr
User-agent:Baiduspider-video
User-Agent:Barkrowler
User-agent:BLEXBot
User-agent:BlogBeatbot
User-agent:BLP_bbot
User-agent:bot-pge.chlooe.com
User-agent:BPImageWalker
User-agent:BUbiNG
User-agent:Bytedancespider
User-agent:Bytespider
User-agent:CatchBot
User-agent:CCBot
User-agent:check_http
User-agent:ChinasoSpider
User-agent:Custo
User-agent:daqi
User-agent:DeuSu
User-agent:DotBot
User-agent:EasouSpider
User-agent:EtaoSpider
User-agent:exabot
User-Agent:ezooms.bot
User-agent:Facebot
User-agent:FemtosearchBot
User-agent:FISPIDER
User-agent:Gigabot
User-agent:Go
User-agent:Google
User-agent:googlebot-image
User-agent:Googlebot-Mobile
User-agent:grapeshot
User-agent:GwdangSpider
User-agent:HaosouSpider
User-agent:hl_ftien_spider
User-agent:HuaweiSymantecSpider
User-agent:HuihuiSpider
User-Agent:ia_archiver
User-agent:iaskspider
User-agent:ICC-Crawler
User-agent:Jakart
User-agent:JikeSpider
User-agent:Jobuispider
User-Agent:Linguee
user-agent:LinkChecker
User-Agent:MagiBot
User-agent:Mail.Ru
User-agent:MauiBot
User-agent:Mediapar
User-Agent:Mediapartners-Google
User-agent:MegaIndex
User-agent:MegaIndex.ru
User-agent:MJ12bot
User-agent:MSNBot
User-agent:msnbot-media
User-agent:oBot
User-agent:pepo
User-agent:PetalBot
User-agent:psbot
User-agent:Purebot
User-agent:Riddler
User-agent:Robozilla
User-agent:rogerbo
User-agent:Scooter
User-agent:Scrubby
User-agent:SeekerBot
User-agent:semrush
User-agent:SemrushBot
User-agent:SemrushBot-BM
User-agent:SemrushBot-CT
User-agent:SemrushBot-SA
User-agent:SemrushBot-SWA
User-agent:SeoHuntBot
User-agent:Seznam
User-agent:SeznamBot
User-agent:SeznamBot/3.2
User-Agent:SiteSnagger
User-agent:Sogou
User-agent:Sogouinstspider
User-agent:SogouNewsSpider
User-agent:sogouspider
User-agent:Sogouspider2
User-agent:Sogouwebspi
User-agent:Sogouwebspider
User-Agent:Sogouwebspider
User-agent:Sosospider
User-agent:SplitSignalBot
User-agent:Teoma
user-agent:TestBot
User-agent:TheKnowledgeAI
User-agent:ToutiaoSpider
User-Agent:trendictionbot
User-agent:twiceler
User-agent:Twitterbot
User-agent:UbiCrawler
User-agent:User-agent:Slurp
User-agent:W3Crobot/1
User-agent:WandoujiaSpide
User-agent:WandoujiaSpider
User-Agent:WebCopier
User-Agent:WebStripper
User-agent:WochachaSpider
User-agent:WordupInfoSearch
User-agent:wotbox
User-agent:WukongSpider
User-agent:Yahoo
User-agent:Yahoo!-AdCrawler
User-agent:Yahoo!Slurp
User-agent:Yahoo!SlurpChina
User-agent:yahoo-blogs/
User-agent:yahoo-mmcrawler
User-agent:Yahoo-Slurp
User-agent:YahooSlurpChina
User-agent:Yan
User-agent:Yandex
User-Agent:YandexBot
User-agent:YidianBot
user-agent:YisouS
User-agent:YodaoBot
User-agent:YoudaoB
User-agent:YRSpider
User-agent:YYSp
User-agent:YYSpider
User-agent:Zao
User-Agent:Zealbot
User-agent:ZoominfoBot

更多新鲜干货,欢迎关注小男孩网站 xiaoboy.cn

一堆User-agent蜘蛛爬虫的标识:等您坐沙发呢!

发表评论

表情
还能输入210个字