分享830个蜘蛛IP段(分析1G日志得)

最近检测到单个蜘蛛最高30万每日爬行量，同是该日共40万次蜘蛛爬行；

封禁该IP段后成功将动不动就满载的服务器资源降回20%以下。

现提供根据十几个GB中的1GB日志得蜘蛛号段供参考（可能部分是普通IP伪造蜘蛛UA大量访问的耗能攻击）

（使用方法，你可以复制以下内容到excel查看，可按蜘蛛列排序/IP排序以更方便看）

IP段  蜘蛛
203.208.60.0/24 Googlebot
66.249.79.0/24  Googlebot
54.36.148.0/24  AhrefsBot
60.8.123.0/24   Bytespider
13.66.139.0/24  bingbot
110.249.201.0/24    Bytespider
111.225.148.0/24    Bytespider
111.225.149.0/24    Bytespider
110.249.202.0/24    Bytespider
220.191.231.0/24    Baiduspider
54.36.149.0/24  AhrefsBot
157.55.39.0/24  bingbot
40.77.167.0/24  bingbot
220.181.108.0/24    Baiduspider
116.179.32.0/24 Baiduspider
220.243.136.0/24    Bytespider
220.243.135.0/24    Bytespider
173.231.59.0/24 Adsbot
207.46.13.0/24  bingbot
66.249.68.0/24  Googlebot
144.76.72.0/24  serpstatbot
66.249.65.0/24  Googlebot
5.9.70.0/24 MJ12bot
192.99.10.0/24  MJ12bot
167.114.101.0/24    MJ12bot
66.249.72.0/24  Googlebot
122.228.19.0/24 Baiduspider
5.9.158.0/24    MJ12bot
192.99.13.0/24  MJ12bot
5.9.156.0/24    MJ12bot
92.220.10.0/24  MJ12bot
144.76.60.0/24  MJ12bot
167.114.158.0/24    MJ12bot
167.114.103.0/24    MJ12bot
192.99.37.0/24  MJ12bot
149.202.82.0/24 MJ12bot
111.6.78.0/24   Baiduspider
192.99.4.0/24   MJ12bot
144.76.38.0/24  MJ12bot
144.76.186.0/24 MJ12bot
66.249.69.0/24  Googlebot
5.9.108.0/24    MJ12bot
167.114.116.0/24    MJ12bot
5.9.88.0/24 MJ12bot
148.251.69.0/24 MJ12bot
158.69.245.0/24 MJ12bot
148.251.195.0/24    MJ12bot
178.151.245.0/24    MJ12bot
213.239.216.0/24    MJ12bot
144.76.118.0/24 MJ12bot
139.28.238.0/24 MJ12bot
144.76.3.0/24   MJ12bot
216.18.204.0/24 Adsbot
167.114.64.0/24 MJ12bot
5.9.112.0/24    MJ12bot
192.99.5.0/24   MJ12bot
192.99.7.0/24   MJ12bot
144.76.81.0/24  MJ12bot
144.76.200.0/24 MJ12bot
78.46.61.0/24   MJ12bot
148.251.120.0/24    MJ12bot
158.69.243.0/24 MJ12bot
88.198.33.0/24  MJ12bot
37.57.218.0/24  MJ12bot
78.46.149.0/24  MJ12bot
94.130.10.0/24  serpstatbot
192.99.14.0/24  MJ12bot
144.76.88.0/24  serpstatbot
192.99.160.0/24 MJ12bot
167.114.173.0/24    MJ12bot
167.114.209.0/24    MJ12bot
144.76.96.0/24  MJ12bot
148.251.9.0/24  MJ12bot
5.9.71.0/24 MJ12bot
78.46.63.0/24   MJ12bot
167.114.159.0/24    MJ12bot
144.76.29.0/24  MJ12bot
192.99.15.0/24  MJ12bot
5.9.154.0/24    MJ12bot
144.76.91.0/24  MJ12bot
204.12.197.0/24 MJ12bot
66.249.66.0/24  Googlebot
192.95.29.0/24  MJ12bot
119.3.173.0/24  Baiduspider
85.10.199.0/24  MJ12bot
46.4.60.0/24    MJ12bot
136.243.70.0/24 MJ12bot
178.150.14.0/24 MJ12bot
123.183.224.0/24    unkown
95.216.38.0/24  MJ12bot
5.9.155.0/24    MJ12bot
144.76.120.0/24 MJ12bot
5.9.61.0/24 MJ12bot
5.9.66.0/24 MJ12bot
144.76.176.0/24 MJ12bot
17.58.99.0/24   Applebot
192.99.36.0/24  MJ12bot
5.9.77.0/24 MJ12bot
66.249.70.0/24  Googlebot
49.7.20.0/24    unkown
178.63.87.0/24  MJ12bot
5.9.151.0/24    MJ12bot
95.91.76.0/24   MJ12bot
136.243.176.0/24    serpstatbot
66.249.73.0/24  Googlebot
5.9.98.0/24 MJ12bot
148.251.244.0/24    MJ12bot
148.251.8.0/24  MJ12bot
144.76.6.0/24   MJ12bot
5.9.97.0/24 MJ12bot
5.9.138.0/24    MJ12bot
173.212.247.0/24    MJ12bot
66.249.75.0/24  Googlebot
52.137.90.0/24  bingbot
144.76.14.0/24  MJ12bot
144.76.7.0/24   MJ12bot
106.38.241.0/24 unkown
81.109.86.0/24  MJ12bot
204.12.226.0/24 MJ12bot
173.212.215.0/24    MJ12bot
176.31.104.0/24 MJ12bot
114.228.56.0/24 Baiduspider
5.9.141.0/24    MJ12bot
94.154.239.0/24 MJ12bot
161.97.135.0/24 MJ12bot
49.7.21.0/24    unkown
167.86.85.0/24  MJ12bot
144.76.4.0/24   MJ12bot
95.91.107.0/24  MJ12bot
173.212.245.0/24    MJ12bot
5.9.107.0/24    MJ12bot
176.9.25.0/24   MJ12bot
161.97.92.0/24  MJ12bot
167.86.70.0/24  MJ12bot
95.91.60.0/24   MJ12bot
111.202.101.0/24    unkown
213.136.92.0/24 MJ12bot
161.97.91.0/24  MJ12bot
144.76.40.0/24  MJ12bot
173.212.241.0/24    MJ12bot
209.196.233.0/24    MJ12bot
5.189.152.0/24  MJ12bot
111.206.198.0/24    Baiduspider
78.46.176.0/24  MJ12bot
192.99.6.0/24   MJ12bot
114.228.49.0/24 Baiduspider
173.212.222.0/24    MJ12bot
111.206.221.0/24    Baiduspider
5.9.144.0/24    MJ12bot
213.136.75.0/24 MJ12bot
88.88.184.0/24  MJ12bot
144.76.71.0/24  MJ12bot
192.99.9.0/24   MJ12bot
51.91.253.0/24  MJ12bot
66.249.76.0/24  Googlebot
58.48.189.0/24  Baiduspider
173.249.16.0/24 MJ12bot
37.4.249.0/24   MJ12bot
168.119.122.0/24    MJ12bot
13.212.89.0/24  Googlebot
93.193.46.0/24  MJ12bot
114.228.63.0/24 Baiduspider
114.228.50.0/24 Baiduspider
134.195.89.0/24 MJ12bot
3.17.37.0/24    Googlebot
176.31.125.0/24 MJ12bot
58.250.125.0/24 unkown
167.114.211.0/24    MJ12bot
62.138.2.0/24   MJ12bot
54.87.60.0/24   Googlebot
91.137.17.0/24  MJ12bot
40.122.35.0/24  MJ12bot
173.208.206.0/24    MJ12bot
164.132.161.0/24    AhrefsBot
34.219.187.0/24 Googlebot
114.80.246.0/24 Baiduspider
3.0.104.0/24    Googlebot
3.101.132.0/24  Googlebot
111.202.100.0/24    unkown
85.10.207.0/24  MJ12bot
173.212.246.0/24    MJ12bot
167.86.71.0/24  MJ12bot
62.171.162.0/24 MJ12bot
125.82.28.0/24  Baiduspider
124.70.37.0/24  Baiduspider
103.145.13.0/24 Googlebot
69.30.226.0/24  MJ12bot
125.82.24.0/24  Baiduspider
119.45.32.0/24  Baiduspider
66.249.64.0/24  Googlebot
195.154.122.0/24    AhrefsBot
125.82.25.0/24  Baiduspider
76.120.139.0/24 MJ12bot
95.91.15.0/24   MJ12bot
164.68.96.0/24  MJ12bot
54.202.176.0/24 Googlebot
125.82.29.0/24  Baiduspider
144.76.137.0/24 MJ12bot
192.151.157.0/24    MJ12bot
164.68.119.0/24 MJ12bot
207.180.220.0/24    MJ12bot
81.69.254.0/24  TestBot
192.99.101.0/24 MJ12bot
54.212.152.0/24 Googlebot
69.30.221.0/24  MJ12bot
195.154.123.0/24    AhrefsBot
118.25.3.0/24   Baiduspider
119.29.65.0/24  Baiduspider
5.189.128.0/24  MJ12bot
66.249.74.0/24  Googlebot
173.208.130.0/24    MJ12bot
161.97.136.0/24 MJ12bot
173.212.224.0/24    MJ12bot
17.58.97.0/24   Applebot
103.85.84.0/24  Baiduspider
168.119.245.0/24    MJ12bot
136.175.112.0/24    MJ12bot
17.58.101.0/24  Applebot
183.136.225.0/24    Baiduspider
8.140.111.0/24  Baiduspider
144.91.125.0/24 MJ12bot
62.141.40.0/24  Googlebot
118.184.177.0/24    unkown
207.180.203.0/24    MJ12bot
178.63.26.0/24  MJ12bot
132.232.75.0/24 TestBot
18.141.158.0/24 Googlebot
124.70.82.0/24  Baiduspider
47.98.104.0/24  Baiduspider
17.58.100.0/24  Applebot
119.45.36.0/24  Baiduspider
116.179.37.0/24 Baiduspider
202.79.175.0/24 Baiduspider
106.52.240.0/24 TestBot
66.249.77.0/24  Googlebot
125.82.26.0/24  Baiduspider
173.212.194.0/24    MJ12bot
78.46.85.0/24   MJ12bot
81.71.118.0/24  TestBot
167.114.100.0/24    MJ12bot
95.217.160.0/24 MJ12bot
193.111.198.0/24    Googlebot
17.58.96.0/24   Applebot
17.58.103.0/24  Applebot
3.36.129.0/24   Googlebot
95.111.247.0/24 MJ12bot
118.25.45.0/24  Baiduspider
195.154.223.0/24    Googlebot
144.202.11.0/24 Googlebot
5.182.216.0/24  Baiduspider
47.98.103.0/24  Baiduspider
162.210.196.0/24    MJ12bot
47.101.40.0/24  Baiduspider
114.228.60.0/24 Baiduspider
219.129.216.0/24    Baiduspider
17.58.98.0/24   Applebot
207.99.15.0/24  Googlebot
34.204.189.0/24 Googlebot
47.98.105.0/24  Baiduspider
47.102.140.0/24 Baiduspider
42.194.204.0/24 TestBot
5.189.159.0/24  MJ12bot
125.82.31.0/24  Baiduspider
164.68.117.0/24 MJ12bot
47.101.52.0/24  Baiduspider
125.82.30.0/24  Baiduspider
47.102.115.0/24 Baiduspider
47.102.147.0/24 Baiduspider
47.101.47.0/24  Baiduspider
188.166.113.0/24    Googlebot
54.179.137.0/24 Googlebot
94.130.237.0/24 serpstatbot
5.189.172.0/24  MJ12bot
47.102.129.0/24 Baiduspider
47.101.43.0/24  Baiduspider
14.126.227.0/24 Facebot
47.101.45.0/24  Baiduspider
42.236.10.0/24  360spider
47.101.60.0/24  SogouSpider
111.177.18.0/24 Baiduspider
47.101.61.0/24  Baiduspider
47.102.44.0/24  Baiduspider
47.101.150.0/24 Baiduspider
17.58.102.0/24  Applebot
91.121.7.0/24   MJ12bot
47.101.159.0/24 Baiduspider
47.103.38.0/24  Baiduspider
101.132.70.0/24 Baiduspider
120.41.45.0/24  ThinkBot
114.228.14.0/24 Baiduspider
47.103.124.0/24 bingbot
47.101.56.0/24  Baiduspider
114.228.53.0/24 Baiduspider
223.210.17.0/24 Baiduspider
101.133.132.0/24    Baiduspider
47.103.125.0/24 Baiduspider
47.102.148.0/24 Baiduspider
47.103.0.0/24   Baiduspider
47.101.155.0/24 Baiduspider
101.133.153.0/24    Baiduspider
121.36.130.0/24 Baiduspider
199.58.86.0/24  MJ12bot
101.132.113.0/24    Baiduspider
47.101.152.0/24 SogouSpider
47.101.48.0/24  SogouSpider
108.59.8.0/24   MJ12bot
183.36.115.0/24 unkown
47.103.99.0/24  SogouSpider
47.102.139.0/24 Baiduspider
47.101.46.0/24  Baiduspider
101.132.68.0/24 bingbot
47.101.157.0/24 SogouSpider
47.103.22.0/24  Baiduspider
47.100.60.0/24  Baiduspider
47.103.4.0/24   bingbot
101.132.114.0/24    Baiduspider
47.103.5.0/24   Baiduspider
47.100.15.0/24  Baiduspider
47.102.127.0/24 Baiduspider
39.107.86.0/24  Baiduspider
112.32.114.0/24 Facebot
118.24.106.0/24 TestBot
106.15.176.0/24 Baiduspider
101.132.104.0/24    Baiduspider
47.103.106.0/24 SogouSpider
47.101.58.0/24  SogouSpider
47.102.137.0/24 bingbot
47.101.41.0/24  Baiduspider
168.119.68.0/24 AhrefsBot
47.102.102.0/24 Baiduspider
47.103.222.0/24 Baiduspider
101.132.169.0/24    Baiduspider
47.92.103.0/24  Baiduspider
47.101.63.0/24  Baiduspider
47.92.115.0/24  Baiduspider
106.14.141.0/24 Baiduspider
222.212.171.0/24    Baiduspider
47.92.29.0/24   SogouSpider
222.186.133.0/24    Baiduspider
164.68.111.0/24 MJ12bot
101.132.36.0/24 SogouSpider
47.102.41.0/24  SogouSpider
101.132.107.0/24    Baiduspider
106.14.190.0/24 Baiduspider
101.133.150.0/24    Baiduspider
139.196.77.0/24 Baiduspider
47.101.145.0/24 SogouSpider
101.133.149.0/24    bingbot
47.101.53.0/24  SogouSpider
39.107.116.0/24 Baiduspider
47.102.143.0/24 Baiduspider
47.102.126.0/24 Baiduspider
101.133.131.0/24    bingbot
168.119.65.0/24 AhrefsBot
47.102.36.0/24  Baiduspider
101.132.111.0/24    bingbot
47.92.100.0/24  Baiduspider
106.14.201.0/24 Baiduspider
47.102.145.0/24 bingbot
101.132.97.0/24 bingbot
129.226.49.0/24 Googlebot
47.103.107.0/24 bingbot
47.103.223.0/24 SogouSpider
17.121.113.0/24 Applebot
106.14.220.0/24 SogouSpider
60.180.250.0/24 Baiduspider
106.15.224.0/24 Baiduspider
60.180.248.0/24 Baiduspider
47.103.30.0/24  Baiduspider
47.103.196.0/24 Baiduspider
47.92.99.0/24   SogouSpider
47.101.162.0/24 Baiduspider
47.101.44.0/24  Baiduspider
47.102.45.0/24  Baiduspider
47.101.59.0/24  Baiduspider
101.133.148.0/24    Baiduspider
106.14.7.0/24   Baiduspider
47.102.142.0/24 SogouSpider
47.103.103.0/24 SogouSpider
101.132.186.0/24    SogouSpider
101.132.108.0/24    Baiduspider
47.92.124.0/24  SogouSpider
47.103.212.0/24 Baiduspider
47.103.127.0/24 SogouSpider
47.102.111.0/24 Baiduspider
47.102.158.0/24 bingbot
47.100.36.0/24  Baiduspider
47.100.34.0/24  Baiduspider
139.224.114.0/24    Baiduspider
106.15.203.0/24 Baiduspider
106.14.173.0/24 Baiduspider
101.132.175.0/24    bingbot
101.133.140.0/24    bingbot
47.92.116.0/24  Baiduspider
47.98.34.0/24   Baiduspider
47.98.102.0/24  Baiduspider
47.102.141.0/24 bingbot
47.92.39.0/24   bingbot
139.224.238.0/24    SogouSpider
47.102.119.0/24 bingbot
47.103.118.0/24 Baiduspider
47.102.132.0/24 Baiduspider
117.25.139.0/24 Baiduspider
47.103.139.0/24 SogouSpider
47.92.50.0/24   SogouSpider
61.146.178.0/24 Baiduspider
120.197.131.0/24    unkown
101.132.73.0/24 bingbot
47.103.102.0/24 Baiduspider
47.102.150.0/24 Baiduspider
47.101.133.0/24 Baiduspider
47.100.174.0/24 Baiduspider
47.92.141.0/24  Baiduspider
47.103.20.0/24  Baiduspider
47.102.112.0/24 Baiduspider
106.14.189.0/24 Baiduspider
47.101.136.0/24 Baiduspider
47.101.146.0/24 SogouSpider
207.180.218.0/24    MJ12bot
47.102.104.0/24 Baiduspider
120.79.217.0/24 Baiduspider
106.15.202.0/24 Baiduspider
62.210.172.0/24 Googlebot
47.102.216.0/24 Baiduspider
47.100.115.0/24 Baiduspider
95.216.11.0/24  MJ12bot
106.14.217.0/24 Baiduspider
106.14.167.0/24 SogouSpider
47.103.2.0/24   Baiduspider
47.92.130.0/24  Baiduspider
106.15.88.0/24  Baiduspider
82.193.102.0/24 MJ12bot
47.103.17.0/24  Baiduspider
47.101.164.0/24 Baiduspider
47.92.35.0/24   bingbot
47.92.138.0/24  Baiduspider
47.101.49.0/24  SogouSpider
47.101.140.0/24 Baiduspider
148.251.241.0/24    serpstatbot
101.132.166.0/24    bingbot
106.14.142.0/24 SogouSpider
60.180.254.0/24 Baiduspider
47.102.118.0/24 SogouSpider
47.100.51.0/24  SogouSpider
47.92.126.0/24  bingbot
101.132.149.0/24    SogouSpider
47.98.100.0/24  SogouSpider
47.102.43.0/24  bingbot
47.102.146.0/24 Baiduspider
47.102.117.0/24 Baiduspider
54.237.13.0/24  Amazonbot
47.102.131.0/24 SogouSpider
101.132.64.0/24 Baiduspider
47.92.31.0/24   SogouSpider
39.107.126.0/24 Baiduspider
106.15.95.0/24  Baiduspider
47.103.146.0/24 Baiduspider
47.103.11.0/24  Baiduspider
101.132.71.0/24 Baiduspider
47.101.57.0/24  bingbot
106.15.192.0/24 Baiduspider
17.121.115.0/24 Applebot
116.53.44.0/24  Facebot
139.196.89.0/24 SogouSpider
47.100.17.0/24  SogouSpider
47.103.121.0/24 bingbot
45.32.162.0/24  Googlebot
47.100.189.0/24 SogouSpider
47.101.34.0/24  Baiduspider
106.14.227.0/24 Baiduspider
112.90.93.0/24  Baiduspider
47.98.101.0/24  SogouSpider
106.15.200.0/24 Baiduspider
17.121.114.0/24 Applebot
47.103.142.0/24 bingbot
117.67.251.0/24 Facebot
173.212.216.0/24    MJ12bot
113.214.206.0/24    Facebot
47.92.71.0/24   Baiduspider
47.100.171.0/24 SogouSpider
37.49.229.0/24  Googlebot
138.201.194.0/24    serpstatbot
47.92.5.0/24    bingbot
101.132.102.0/24    SogouSpider
47.92.4.0/24    bingbot
39.107.127.0/24 bingbot
47.103.216.0/24 bingbot
101.133.145.0/24    Baiduspider
101.132.119.0/24    Baiduspider
47.102.124.0/24 bingbot
47.101.154.0/24 Baiduspider
106.15.191.0/24 Baiduspider
101.132.98.0/24 Baiduspider
36.110.147.0/24 unkown
47.100.124.0/24 bingbot
47.101.137.0/24 Baiduspider
47.92.146.0/24  Baiduspider
106.15.201.0/24 Baiduspider
101.132.110.0/24    Baiduspider
101.133.143.0/24    Baiduspider
47.101.50.0/24  Baiduspider
101.133.146.0/24    Baiduspider
47.102.149.0/24 Baiduspider
47.101.149.0/24 Baiduspider
106.55.36.0/24  TestBot
106.14.114.0/24 Baiduspider
47.102.205.0/24 Baiduspider
106.15.185.0/24 Baiduspider
106.14.6.0/24   Baiduspider
47.103.87.0/24  SogouSpider
47.102.37.0/24  Baiduspider
47.92.101.0/24  SogouSpider
47.101.141.0/24 Baiduspider
47.100.161.0/24 Baiduspider
139.155.16.0/24 TestBot
139.155.30.0/24 TkBot
139.155.54.0/24 TkBot
101.132.44.0/24 SogouSpider
47.101.55.0/24  Baiduspider
47.92.132.0/24  SogouSpider
101.133.139.0/24    bingbot
47.102.144.0/24 bingbot
47.102.135.0/24 bingbot
47.102.100.0/24 bingbot
47.102.134.0/24 bingbot
47.101.163.0/24 bingbot
118.184.173.0/24    unkown
182.100.67.0/24 Baiduspider
168.119.88.0/24 MTRobot
47.103.220.0/24 bingbot
47.103.202.0/24 bingbot
47.103.60.0/24  SogouSpider
47.100.2.0/24   bingbot
112.27.233.0/24 Facebot
112.12.136.0/24 Baiduspider
173.212.229.0/24    MJ12bot
111.229.222.0/24    Baiduspider
47.102.120.0/24 SogouSpider
139.224.116.0/24    Baiduspider
101.133.133.0/24    Baiduspider
101.133.154.0/24    Baiduspider
60.180.253.0/24 Baiduspider
47.103.49.0/24  SogouSpider
101.132.130.0/24    Baiduspider
47.92.95.0/24   bingbot
47.101.132.0/24 SogouSpider
144.76.151.0/24 serpstatbot
47.100.61.0/24  SogouSpider
47.103.113.0/24 Baiduspider
47.101.147.0/24 Baiduspider
47.101.142.0/24 Baiduspider
47.100.99.0/24  Baiduspider
47.100.27.0/24  Baiduspider
106.15.186.0/24 SogouSpider
124.70.179.0/24 Baiduspider
101.132.154.0/24    SogouSpider
47.102.136.0/24 Baiduspider
47.101.33.0/24  Baiduspider
139.224.9.0/24  Baiduspider
47.103.81.0/24  SogouSpider
47.103.6.0/24   Baiduspider
101.133.137.0/24    Baiduspider
47.101.62.0/24  SogouSpider
47.103.88.0/24  Baiduspider
47.103.112.0/24 bingbot
47.100.8.0/24   SogouSpider
101.133.141.0/24    bingbot
167.114.157.0/24    MJ12bot
47.102.151.0/24 bingbot
47.103.105.0/24 bingbot
47.101.38.0/24  bingbot
23.129.64.0/24  Baiduspider
138.201.185.0/24    MJ12bot
45.39.55.0/24   Baiduspider
101.132.159.0/24    bingbot
106.53.82.0/24  TestBot
101.132.151.0/24    SogouSpider
47.102.47.0/24  bingbot
47.102.108.0/24 bingbot
47.102.130.0/24 SogouSpider
101.132.109.0/24    Baiduspider
149.56.28.0/24  Googlebot
47.102.128.0/24 SogouSpider
47.103.157.0/24 Baiduspider
47.103.149.0/24 Baiduspider
47.102.202.0/24 Baiduspider
47.102.125.0/24 Baiduspider
47.102.123.0/24 Baiduspider
47.102.110.0/24 Baiduspider
47.101.129.0/24 Baiduspider
106.14.160.0/24 Baiduspider
101.133.129.0/24    Baiduspider
101.132.40.0/24 Baiduspider
101.132.156.0/24    Baiduspider
101.132.137.0/24    Baiduspider
101.132.134.0/24    Baiduspider
47.103.28.0/24  Baiduspider
47.101.200.0/24 Baiduspider
47.101.158.0/24 Baiduspider
106.15.187.0/24 Baiduspider
101.132.78.0/24 Baiduspider
101.132.35.0/24 Baiduspider
173.249.63.0/24 MJ12bot
47.103.74.0/24  Baiduspider
47.103.37.0/24  Baiduspider
47.100.29.0/24  Baiduspider
47.100.178.0/24 Baiduspider
47.102.122.0/24 SogouSpider
104.243.35.0/24 Googlebot
101.132.99.0/24 SogouSpider
101.132.126.0/24    Baiduspider
47.100.100.0/24 Baiduspider
101.132.37.0/24 SogouSpider
47.102.46.0/24  SogouSpider
47.103.132.0/24 Baiduspider
47.103.129.0/24 Baiduspider
106.14.115.0/24 SogouSpider
47.103.108.0/24 Baiduspider
47.100.7.0/24   Baiduspider
138.201.36.0/24 serpstatbot
47.102.157.0/24 Baiduspider
176.9.18.0/24   serpstatbot
173.64.77.0/24  MJ12bot
101.133.130.0/24    bingbot
101.132.101.0/24    Baiduspider
144.91.83.0/24  MJ12bot
47.103.130.0/24 bingbot
47.103.123.0/24 bingbot
47.103.95.0/24  bingbot
114.84.240.0/24 unkown
47.88.59.0/24   bingbot
47.103.86.0/24  bingbot
47.100.46.0/24  bingbot
220.181.51.0/24 Baiduspider
101.132.79.0/24 bingbot
47.102.153.0/24 bingbot
47.101.160.0/24 bingbot
173.212.220.0/24    MJ12bot
17.121.112.0/24 Applebot
106.14.177.0/24 bingbot
106.14.168.0/24 bingbot
47.102.156.0/24 bingbot
47.107.37.0/24  Baiduspider
117.67.250.0/24 Facebot
122.112.164.0/24    Baiduspider
207.180.224.0/24    Googlebot
183.36.114.0/24 unkown
183.8.204.0/24  Facebot
122.5.82.0/24   Baiduspider
47.103.70.0/24  SogouSpider
47.103.19.0/24  SogouSpider
93.158.90.0/24  bingbot
103.143.76.0/24 Googlebot
101.132.125.0/24    SogouSpider
47.103.204.0/24 SogouSpider
47.103.116.0/24 SogouSpider
106.14.133.0/24 SogouSpider
47.100.32.0/24  SogouSpider
47.103.43.0/24  SogouSpider
47.103.101.0/24 SogouSpider
47.103.134.0/24 Baiduspider
47.103.122.0/24 Baiduspider
47.102.154.0/24 Baiduspider
47.101.130.0/24 Baiduspider
101.132.43.0/24 Baiduspider
101.132.193.0/24    Baiduspider
47.102.220.0/24 Baiduspider
47.102.185.0/24 Baiduspider
106.14.187.0/24 Baiduspider
222.209.185.0/24    Baiduspider
106.15.190.0/24 SogouSpider
106.14.205.0/24 SogouSpider
42.192.37.0/24  TestBot
175.24.232.0/24 TestBot
132.232.81.0/24 TkBot
47.100.10.0/24  SogouSpider
101.132.103.0/24    SogouSpider
47.100.181.0/24 SogouSpider
101.132.128.0/24    SogouSpider
47.102.103.0/24 SogouSpider
47.101.151.0/24 SogouSpider
47.103.100.0/24 SogouSpider
106.15.189.0/24 Baiduspider
113.101.226.0/24    jrobot
47.254.66.0/24  Baiduspider
101.133.135.0/24    bingbot
42.236.131.0/24 jrobot
47.103.64.0/24  bingbot
47.103.214.0/24 bingbot
47.102.114.0/24 bingbot
139.196.98.0/24 bingbot
47.100.182.0/24 bingbot
47.98.37.0/24   bingbot
59.56.148.0/24  Baiduspider
47.100.108.0/24 bingbot
123.125.67.0/24 Baiduspider
95.91.16.0/24   MJ12bot
168.119.64.0/24 AhrefsBot
89.163.150.0/24 Baiduspider
123.126.68.0/24 unkown
45.154.35.0/24  Baiduspider
125.90.88.0/24  Baiduspider
120.26.4.0/24   Baiduspider
192.71.23.0/24  bingbot
165.227.165.0/24    Googlebot
104.248.182.0/24    Googlebot
106.15.180.0/24 SogouSpider
101.132.191.0/24    SogouSpider
107.175.35.0/24 Googlebot
47.100.33.0/24  SogouSpider
106.14.149.0/24 SogouSpider
47.103.50.0/24  SogouSpider
47.103.217.0/24 Baiduspider
139.224.233.0/24    Baiduspider
139.224.119.0/24    Baiduspider
106.15.181.0/24 Baiduspider
47.103.63.0/24  Baiduspider
47.103.41.0/24  Baiduspider
47.103.10.0/24  Baiduspider
47.100.47.0/24  SogouSpider
47.100.190.0/24 Baiduspider
106.14.152.0/24 Baiduspider
47.103.82.0/24  Baiduspider
47.103.8.0/24   Baiduspider
47.103.54.0/24  Baiduspider
47.103.111.0/24 Baiduspider
202.61.253.0/24 MJ12bot
42.236.106.0/24 360spider
154.86.128.0/24 Baiduspider
42.236.49.0/24  360spider
42.236.48.0/24  360spider
47.101.161.0/24 SogouSpider
101.132.121.0/24    bingbot
47.97.216.0/24  SogouSpider
47.103.117.0/24 Baiduspider
47.103.140.0/24 Baiduspider
47.102.116.0/24 bingbot
47.103.96.0/24  Baiduspider
47.102.98.0/24  SogouSpider
47.103.208.0/24 bingbot
47.103.195.0/24 bingbot
47.100.121.0/24 bingbot
114.220.129.0/24    unkown
120.0.24.0/24   unkown
222.70.85.0/24  unkown
47.103.24.0/24  bingbot
135.181.41.0/24 MJ12bot
223.104.212.0/24    Facebot
14.108.197.0/24 Facebot
42.51.192.0/24  Baiduspider
121.8.179.0/24  Baiduspider
121.57.224.0/24 Robot
94.130.102.0/24 MTRobot
88.198.48.0/24  MTRobot
113.237.151.0/24    unkown
144.76.68.0/24  serpstatbot
144.76.13.0/24  serpstatbot
183.210.200.0/24    Baiduspider
144.76.61.0/24  serpstatbot
183.148.247.0/24    unkown
182.148.16.0/24 Baiduspider
61.132.171.0/24 unkown
61.190.160.0/24 unkown
178.63.34.0/24  MJ12bot
117.57.23.0/24  unkown
156.238.203.0/24    Baiduspider
157.230.215.0/24    MJ12bot
195.154.126.0/24    AhrefsBot
157.230.61.0/24 MJ12bot
142.93.105.0/24 Googlebot
134.209.219.0/24    MJ12bot
211.154.132.0/24    Baiduspider
45.159.179.0/24 Baiduspider
194.124.227.0/24    Baiduspider
156.251.136.0/24    Baiduspider
112.29.170.0/24 Baiduspider
89.163.245.0/24 Baiduspider
45.154.14.0/24  Baiduspider
154.22.117.0/24 Baiduspider
103.56.55.0/24  Baiduspider
45.80.191.0/24  Baiduspider
45.113.1.0/24   Baiduspider
23.224.146.0/24 Baiduspider
111.229.204.0/24    unkown
103.85.25.0/24  Baiduspider
103.43.10.0/24  Baiduspider
45.35.43.0/24   Baiduspider
154.7.9.0/24    Baiduspider
107.172.206.0/24    Googlebot
107.173.137.0/24    Googlebot
165.22.104.0/24 Googlebot
107.174.59.0/24 Googlebot
104.248.155.0/24    Googlebot
54.255.207.0/24 Googlebot
192.71.3.0/24   bingbot
191.239.247.0/24    MJ12bot
107.175.61.0/24 Googlebot
165.22.221.0/24 Googlebot
143.198.205.0/24    Googlebot
143.110.252.0/24    Googlebot
107.175.17.0/24 Googlebot
107.172.2.0/24  Googlebot
62.171.159.0/24 MJ12bot
204.13.154.0/24 Googlebot
198.12.71.0/24  Googlebot
54.38.123.0/24  Googlebot
206.189.80.0/24 Googlebot
206.189.34.0/24 Googlebot
18.183.148.0/24 Googlebot
167.99.39.0/24  Googlebot
159.65.145.0/24 Googlebot
139.59.46.0/24  Googlebot
68.183.82.0/24  Googlebot
179.227.237.0/24    AhrefsBot
206.189.8.0/24  Googlebot
139.59.63.0/24  Googlebot
192.71.42.0/24  bingbot
35.189.169.0/24 Googlebot
181.84.194.0/24 AhrefsBot
101.133.152.0/24    SogouSpider
47.103.209.0/24 SogouSpider
47.102.138.0/24 SogouSpider
47.101.139.0/24 SogouSpider
47.101.148.0/24 SogouSpider
106.14.140.0/24 SogouSpider
47.103.7.0/24   SogouSpider
47.103.39.0/24  Baiduspider
47.103.18.0/24  Baiduspider
47.102.96.0/24  Baiduspider
47.103.53.0/24  Baiduspider
47.100.48.0/24  bingbot

分享830个蜘蛛IP段(分析1G日志得)相关推荐

百度,谷歌,360,搜狗,神马等蜘蛛IP段大全
百度蜘蛛(Baiduspider)爬取是搜索引擎获得页面内容的一个重要的途径,通过蜘蛛的抓取可以得到一个页面的最主要的内容从而收录百度数据库系统,每次抓取之后都会再与数据库原有的信息进行比对,来确定页 ...
搜索引擎UA和对应的蜘蛛IP段,百度,搜狗,so,360搜索,神马
众所周知,搜索引擎蜘蛛/爬虫在网站SEO收录排名扮演者至关重要的角色,今天放放SEO就按照国内常用的搜索引擎顺序说说百度搜索引擎user agent和对应的蜘蛛IP段.搜狗UA和对应的蜘蛛IP段.36 ...
百度蜘蛛ip段大全分析，百度每个ip都什么意思
以下都是百度的ip,总结了下,做SEO碰到的一些蜘蛛ip总结如下: 123.125.68.=123.125.68沙盒 220.181.68.=220.181.68沙盒 220.181.7.=220.1 ...
【深入蜘蛛】百度蜘蛛IP段详解
大家进行网站日志分析的时候,常见到很多不同IP段的百度蜘蛛,为了方便大家更好的进行日志分析,下面列举了百度不同IP段常见蜘蛛的一些详情情况,及所谓的降权蜘蛛,沙盒蜘蛛,高权重蜘蛛等等下面的百度蜘蛛I ...
php 屏蔽ip段,php禁止ip段的方法
php禁止ip段的方法发布时间:2020-10-09 14:51:52 来源:亿速云阅读:90 作者:小新小编给大家分享一下php禁止ip段的方法,相信大部分人都还不怎么了解,因此分享这篇文章给 ...
摄像头最多的ip段精品分享_逆冬：百度蜘蛛大全、识别百度蜘蛛小技巧分享！...
最近一直有兄弟问关于百度蜘蛛的技巧.下面整理了百度常见的蜘蛛分享给大家.希望可以帮助大家! 一.123开头IP段蜘蛛 123.125.66.* 代表百度蜘蛛预备抓取. 123.125.68.* 每天这 ...
常见的百度蜘蛛IP 日志分析
根据不同的IP我们可以分析网站是个怎样的状态, 以下常见的百度蜘蛛IP: 123.125.68.*这个蜘蛛经常来,别的来的少,表示网站可能要进入沙盒了,或被者降权. 220.181.68.*每天这个I ...
百度蜘蛛（BaiduSpider）IP段详细情况介绍
123.125.68.*这个蜘蛛经常来,别的来的少,表示网站可能要进入沙盒了,或被者降权. 220.181.68.*每天这个IP 段只增不减很有可能进沙盒或K站. 220.181.7.*.12 ...
php屏蔽ip时间段,php中限制ip段访问、禁止ip提交表单的代码分享/用PHP打印出前一天的时间格式：...
/加IP访问限制 if(getenv('HTTP_CLIENT_IP') && strcasecmp(getenv('HTTP_CLIENT_IP'), 'unknown')) { $ ...

分享830个蜘蛛IP段(分析1G日志得)

分享830个蜘蛛IP段(分析1G日志得)相关推荐

最新文章

热门文章