测试代理ip是否有效

(1)免费ip使用地址:www.xicidaili.com

(2)编写脚本测试ip是否有效

推荐大家看一下这个博客:https://blog.csdn.net/Oscer2016/article/details/75000148这

这篇博客很好地展示了免费ip的获取和测试是否能用的情况.

下面是我在别的博客上看到的,拿过来使用,发现很难用,有的时候还无法测试出结果.

方法一:使用requests进行测试

import requests
try:result = requests.get('https://blog.csdn.net/tingfenyijiu/article/details/77937481', proxies={"http":"http://118.135.217.7:80"})print resultprint result.text
except:print 'connect failed'
else:print 'success'

测试结果返回页面信息:

/usr/bin/python2.7 /home/gdzhang/下载/workspace/FirmCrawler/FirmCrawler/test_ip_by_request.py
/usr/local/lib/python2.7/dist-packages/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warningsSNIMissingWarning
/usr/local/lib/python2.7/dist-packages/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warningsInsecurePlatformWarning
<Response [200]>
<!DOCTYPE html>
<html lang="zh-CN">
<head><meta charset="UTF-8"><link rel="canonical" href="https://blog.csdn.net/tingfenyijiu/article/details/77937481"/><meta http-equiv="content-type" content="text/html; charset=utf-8"><meta name="renderer" content="webkit"/><meta name="force-rendering" content="webkit"/><meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"/><meta name="viewport" content="width=device-width, initial-scale=1.0, minimum-scale=1.0, maximum-scale=1.0, user-scalable=no"><meta name="apple-mobile-web-app-status-bar-style" content="black"><meta name="referrer" content="always"><meta name="description" content="验证代码Demo
# -*- coding: utf-8 -*-
import requests
def gitIp():ipList=[]with open(&quot;../../proxies.txt&quot;, &quot;r&quot;) as f:ipList=f.read().split(&quot;\n&quot;)# print ipList# print &quot;---" /><meta name="keywords" content="python,爬虫" /><meta http-equiv="Cache-Control" content="no-siteapp" /><link rel="alternate" media="handheld" href="#" /><meta name="shenma-site-verification" content="5a59773ab8077d4a62bf469ab966a63b_1497598848"><script src="https://csdnimg.cn/release/phoenix/vendor/tingyun/tingyun-rum-blog.js"></script><link href="https://csdnimg.cn/public/favicon.ico" rel="SHORTCUT ICON"><title>python学习之二    代理ip有效性验证 - CSDN博客</title><link rel="stylesheet" href="https://csdnimg.cn/release/phoenix/template/css/detail-bdc51faa7c.min.css"><link rel="stylesheet" href="https://csdnimg.cn/release/phoenix/themes/skin3-template/skin3-template-9b39979775.min.css"><script type="text/javascript">var username = "tingfenyijiu";var blog_address = "https://blog.csdn.net/tingfenyijiu";var static_host = "https://csdnimg.cn/release/phoenix/";var currentUserName = "";var isShowAds = true;var isOwner = false;var loginUrl = "https://passport.csdn.net/account/login?from=https://blog.csdn.net/tingfenyijiu/article/details/77937481"var blogUrl = "https://blog.csdn.net/";//页面皮肤样式var curSkin = "skin3-template";// 第四范式所需数据var articleTitles = "python学习之二    代理ip有效性验证";var articleID = "77937481";</script><script type="text/javascript">// Traffic Stats of the entire Web site By baiduvar _hmt = _hmt || [];(function() {var hm = document.createElement("script");hm.src = "https://hm.baidu.com/hm.js?6bcd52f51e9b3dce32bec4a3997715ac";var s = document.getElementsByTagName("script")[0];s.parentNode.insertBefore(hm, s);})();// Traffic Stats of the entire Web site By baidu end</script><script src="https://csdnimg.cn/public/common/libs/jquery/jquery-1.9.1.min.js" type="text/javascript"></script><script src="https://csdnimg.cn/rabbit/exposure-click/main-1.0.6.js"></script><!-- 新版上报 --><script src="//g.csdnimg.cn/track/1.1.1/track.js" type="text/javascript"></script><!-- 新版上报end --><link rel="stylesheet" href="https://csdnimg.cn/public/sandalstrap/1.3/css/sandalstrap.min.css"><style>.MathJax, .MathJax_Message, .MathJax_Preview{display: none}</style>
</head>
<!-- nodata 为 第四范式接口有问题时样式不变的处理 -->
<body class="nodata"> <link rel="stylesheet" href="https://csdnimg.cn/public/common/toolbar/content_toolbar_css/content_toolbar.css"><script id="toolbar-tpl-scriptId" src="https://csdnimg.cn/public/common/toolbar/js/content_toolbar.js" type="text/javascript" domain="https://blog.csdn.net/"></script>
<link rel="stylesheet" href="https://csdnimg.cn/release/phoenix/template/css/blog_code-c3a0c33d5c.css">
<link rel="stylesheet" href="https://csdnimg.cn/release/phoenix/vendor/pagination/paging.css">
<script type="text/javascript" src="//static.mediav.com/js/mvf_news_feed.js"></script>
<div style="display:none;"><img src="" onerror='setTimeout(function(){if(!/(csdn.net|iteye.com|baiducontent.com|googleusercontent.com|360webcache.com|sogoucdn.com|bingj.com|baidu.com)$/.test(window.location.hostname)){window.location.href="\x68\x74\x74\x70\x73\x3a\x2f\x2f\x77\x77\x77\x2e\x63\x73\x64\x6e\x2e\x6e\x65\x74"}},3000);'>
</div>
<link rel="stylesheet" href="https://csdnimg.cn/release/phoenix/template/css/chart-3456820cac.css" /><script src="https://dup.baidustatic.com/js/ds.js"></script>
<div class="container clearfix" id="mainBox"><!-- <div id="breadcrumbs"><span><a href="https://blog.csdn.net/">博客首页</a></span><i>></i><span><a href="https://blog.csdn.net/tingfenyijiu">袁军伟的博客...</a></span><i>></i><span>python学习之二    代理ip有效性验证</span></div> --><ul class="recommend-right">
</ul><main><div class="blog-content-box"><div class="article-header-box"><div class="article-header"><div class="article-title-box"><span class="article-type type-1 float-left">原</span>                <h1 class="title-article">python学习之二    代理ip有效性验证</h1></div><div class="article-info-box"><div class="article-bar-top"><span class="time">2017年09月11日 20:31:25</span><span class="read-count">阅读数：11793</span><span class="tags-box artic-tag-box"><span class="label">标签：</span><a data-track-click='{"mod":"popu_626","con":"python"}' data-track-view='{"mod":"popu_626","con":"python"}' class="tag-link" href="http://so.csdn.net/so/search/s.do?q=python&t=blog" target="_blank">python                                                             <a data-track-click='{"mod":"popu_626","con":"爬虫"}' data-track-view='{"mod":"popu_626","con":"爬虫"}' class="tag-link" href="http://so.csdn.net/so/search/s.do?q=爬虫&t=blog" target="_blank">爬虫                                                             </a></span><div class="tags-box space"><span class="label">个人分类：</span><a class="tag-link" href="https://blog.csdn.net/tingfenyijiu/article/category/7157134"  target="_blank">爬虫                                                             <a class="tag-link" href="https://blog.csdn.net/tingfenyijiu/article/category/7157133"  target="_blank">Python                                                               </a></div></div><div class="operating"></div></div></div></div><article><div id="article_content" class="article_content clearfix csdn-tracking-statistics" data-pid="blog"  data-mod=popu_307  data-dsm = "post" ><div class="article-copyright">版权声明：本文为博主原创文章，未经博主允许不得转载。                 https://blog.csdn.net/tingfenyijiu/article/details/77937481             </div><div class="markdown_views"><h5 id="python学习之二-代理ip有效性验证"><strong>python学习之二  代理ip有效性验证</strong></h5><blockquote><p>验证代码Demo</p>
</blockquote><pre class="prettyprint"><code class=" hljs python"><span class="hljs-comment"># -*- coding: utf-8 -*-</span>
<span class="hljs-keyword">import</span> requests
<span class="hljs-function"><span class="hljs-keyword">def</span> <span class="hljs-title">gitIp</span><span class="hljs-params">()</span>:</span>ipList=[]<span class="hljs-keyword">with</span> open(<span class="hljs-string">"../../proxies.txt"</span>, <span class="hljs-string">"r"</span>) <span class="hljs-keyword">as</span> f:ipList=f.read().split(<span class="hljs-string">"\n"</span>)<span class="hljs-comment"># print ipList</span><span class="hljs-comment"># print "----------------------"</span><span class="hljs-keyword">return</span> ipListipList=[<span class="hljs-string">'https://39.88.13.3:53281'</span>,<span class="hljs-string">'https://182.43.203.43:4306'</span>,<span class="hljs-string">'https://183.62.71.242:3128'</span>,<span class="hljs-string">'https://61.160.208.222:8080'</span>,<span class="hljs-string">'https://123.179.28.159:8080'</span>,<span class="hljs-string">'https://58.56.90.202:53281'</span>,<span class="hljs-string">'https://222.88.144.119:53281'</span>,<span class="hljs-string">'https://61.158.111.142:53281'</span>,<span class="hljs-string">'https://139.224.24.26:8888'</span>,<span class="hljs-string">'https://124.232.148.7:3128'</span>,<span class="hljs-string">'https://218.15.23.229:53281'</span>,<span class="hljs-string">'https://222.34.139.52:808'</span>,<span class="hljs-string">'https://218.18.10.11:9797'</span>,<span class="hljs-string">'https://119.136.113.49:9797'</span>]
<span class="hljs-function"><span class="hljs-keyword">def</span> <span class="hljs-title">valVer</span><span class="hljs-params">(proxys)</span>:</span>badNum = <span class="hljs-number">0</span>goodNum = <span class="hljs-number">0</span><span class="hljs-keyword">for</span> proxy <span class="hljs-keyword">in</span> proxys:<span class="hljs-keyword">try</span>:proxy_host = proxyprotocol = <span class="hljs-string">'https'</span> <span class="hljs-keyword">if</span> <span class="hljs-string">'https'</span> <span class="hljs-keyword">in</span> proxy_host <span class="hljs-keyword">else</span> <span class="hljs-string">'http'</span>proxies = {protocol: proxy_host}response = requests.get(<span class="hljs-string">'http://www.baidu.com'</span>, proxies=proxies, timeout=<span class="hljs-number">2</span>)<span class="hljs-keyword">if</span> response.status_code != <span class="hljs-number">200</span>:badNum += <span class="hljs-number">1</span><span class="hljs-keyword">print</span> proxy_host, <span class="hljs-string">'bad proxy'</span><span class="hljs-keyword">else</span>:goodNum += <span class="hljs-number">1</span><span class="hljs-keyword">print</span> proxy_host, <span class="hljs-string">'success proxy'</span><span class="hljs-keyword">except</span> Exception, e:<span class="hljs-keyword">print</span> e<span class="hljs-comment"># print proxy_host, 'bad proxy'</span>badNum += <span class="hljs-number">1</span><span class="hljs-keyword">continue</span><span class="hljs-keyword">print</span> <span class="hljs-string">'success proxy num : '</span>, goodNum<span class="hljs-keyword">print</span> <span class="hljs-string">'bad proxy num : '</span>, badNum<span class="hljs-comment"># valVer(gitIp())  #读取本地文件里的IP</span>
valVer(ipList)</code></pre>            </div><link rel="stylesheet" href="https://csdnimg.cn/release/phoenix/template/css/markdown_views-ea0013b516.css" /></div><div class="hide-article-box text-center"><a class="btn" id="btn-readmore" data-track-view='{"mod":"popu_376","con":",https://blog.csdn.net/tingfenyijiu/article/details/77937481,"}' data-track-click='{"mod":"popu_376","con":",https://blog.csdn.net/tingfenyijiu/article/details/77937481,"}'></a><a class="btn" href="https://passport.csdn.net/account/login?utm_source=csdn_blog_pc_more_login" target="_self" id="btn-lobinreadmore" data-track-view='{"mod":"popu_557","con":",https://blog.csdn.net/tingfenyijiu/article/details/77937481,"}' data-track-click='{"mod":"popu_557","con":",https://blog.csdn.net/tingfenyijiu/article/details/77937481,"}'>登录后自动展开</a></div></article></div>
<script>$(".MathJax").remove();
</script><!-- 博客详情页PC增加广告系统刷量代码 -->
<div id="a52b5334d" style="width: 1px; height: 1px; display: none;">
<script id="adJs52b5334"></script>
<script>document.getElementById("adJs52b5334").src = "https://ads.csdn.net/js/opt/52b5334.js?t=" + Math.random();</script>
</div><script>(function(){var btnReadmore = $("#btn-readmore");if(btnReadmore.length>0){var winH = $(window).height();var articleBox = $("div.article_content");var artH = articleBox.height();if(artH > winH*2){articleBox.css({'height':winH*2+'px','overflow':'hidden'})btnReadmore.click(function(){articleBox.removeAttr("style");$(this).parent().remove();})}else{btnReadmore.parent().remove();}}})()
</script><div class="t0 clearfix"><a href="https://blog.csdn.net/wy_97/article/details/79054599" target="_blank" data-track-view='{"mod":"popu_642","con": ",https://blog.csdn.net/wy_97/article/details/79054599,"}' data-track-click='{"mod":"popu_642","con": ",https://blog.csdn.net/wy_97/article/details/79054599,"}'><div class="text-content"><h4><em>Python</em>3.5抓取<em>代理IP</em>并<em>验证</em><em>有效性</em></h4><div class="description">网上有很多的免费代理IP网站,但不是所有的ip都能用，正好自己正在研究，记录一下如何爬取可用的代理IP。 这里以xici代理IP为例：http://www.xicidaili.com/nn/1 ...</div></div></a></div>        <a id="commentBox"></a>
<div class="comment-box"><div class="unlogin-box text-center">想对作者说点什么？<!-- $curl 当前地址 --><a href="https://passport.csdn.net/account/login?from=https://blog.csdn.net/tingfenyijiu/article/details/77937481#commentBox" class="btn btn-sm btn-red">我来说一句</a></div><div class="comment-list-container"><a id="comments"></a><div class="comment-list-box"></div><div id="commentPage" class="pagination-box d-none"></div><div class="opt-box text-center"><button class="btn btn-sm btn-link-blue" id="btnMoreComment"></button></div></div>
</div>        <div class="recommend-box"><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/Nlxfzx/article/details/77244117,BlogCommendFromBaidu_1"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/Nlxfzx/article/details/77244117,BlogCommendFromBaidu_1"}'><a href="https://blog.csdn.net/Nlxfzx/article/details/77244117" target="_blank" title="<em>python</em>:<em>代理ip</em>获取，<em>验证</em>，使用"><div class="content"><h4 class="text-truncate oneline"><em>python</em>:<em>代理ip</em>获取，<em>验证</em>，使用              </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/2/8/1/3_nlxfzx.jpg" alt="Nlxfzx" class="avatar-pic"><span class="namebox"><span class="name">Nlxfzx</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">08-16</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>1167</span></p></div><p class="content oneline">很多网站服务器都有反爬机制，作为一个用python爬取数据的人，必须掌握怎么破解反爬机制。
我们在不断爬取大量数据的时候，ip很可能被网站封住，这样我们就无法继续爬取数据，怎么解决？：代理ip
...                 </p></div></a></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/Oscer2016/article/details/75000148,BlogCommendFromBaidu_2"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/Oscer2016/article/details/75000148,BlogCommendFromBaidu_2"}'><a href="https://blog.csdn.net/Oscer2016/article/details/75000148" target="_blank" title="<em>Python</em>爬取西刺国内高匿<em>代理ip</em>并<em>验证</em>"><div class="content"><h4 class="text-truncate oneline"><em>Python</em>爬取西刺国内高匿<em>代理ip</em>并<em>验证</em>             </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/5/6/8/3_oscer2016.jpg" alt="Oscer2016" class="avatar-pic"><span class="namebox"><span class="name">Oscer2016</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">07-11</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>7450</span></p></div><p class="content oneline">1.抓取ip存入文件首先，我们访问西刺首页 http://www.xicidaili.com/，并点击国内高匿代理，如下图:按 F12 检查网页元素或者 ctrl+u查看网页源代码:我们需要提取的是 ...                   </p></div></a></div><div class="recommend-item-box recommend-ad-box clearfix"><script type="text/javascript" src="//rabc1.iteye.com/production/source/pc3553.js?pkcgstj=jm"></script></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/zhiaicq_r/article/details/79273915,BlogCommendFromBaidu_3"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/zhiaicq_r/article/details/79273915,BlogCommendFromBaidu_3"}'><a href="https://blog.csdn.net/zhiaicq_r/article/details/79273915" target="_blank" title="利用<em>python</em>爬虫批量获取<em>代理IP</em>并<em>验证</em>可用性"><div class="content"><h4 class="text-truncate oneline">利用<em>python</em>爬虫批量获取<em>代理IP</em>并<em>验证</em>可用性              </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/6/6/7/3_zhiaicq_r.jpg" alt="zhiaicq_r" class="avatar-pic"><span class="namebox"><span class="name">zhiaicq_r</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">02-06</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>434</span></p></div><p class="content oneline">随着反爬虫的严密，为上千个爬虫提供有效的代理，保证各个爬虫拿到的都是对应网站有效的代理IP，从而保证爬虫快速稳定的运行不过呢，闲暇时间手痒，所以就想利用一些免费的资源搞一个简单的代理池服务。下面是简单...                   </p></div></a></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/m0_37758017/article/details/78498915,BlogCommendFromBaidu_4"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/m0_37758017/article/details/78498915,BlogCommendFromBaidu_4"}'><a href="https://blog.csdn.net/m0_37758017/article/details/78498915" target="_blank" title="<em>验证</em>西刺<em>代理ip</em><em>有效性</em>"><div class="content"><h4 class="text-truncate oneline"><em>验证</em>西刺<em>代理ip</em><em>有效性</em>               </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/8/B/E/3_m0_37758017.jpg" alt="m0_37758017" class="avatar-pic"><span class="namebox"><span class="name">m0_37758017</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">11-10</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>170</span></p></div><p class="content oneline"># -*- coding: utf-8 -*-
&quot;&quot;&quot;
Created on Wed Nov  8 14:50:04 2017@author: markcheungcheck ip va...                   </p></div></a></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/kxw1994/article/details/78355791,BlogCommendFromBaidu_5"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/kxw1994/article/details/78355791,BlogCommendFromBaidu_5"}'><a href="https://blog.csdn.net/kxw1994/article/details/78355791" target="_blank" title="<em>python</em><em>验证</em>IP代理是否可用"><div class="content"><h4 class="text-truncate oneline"><em>python</em><em>验证</em>IP代理是否可用               </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/B/9/F/3_kxw1994.jpg" alt="kxw1994" class="avatar-pic"><span class="namebox"><span class="name">kxw1994</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">10-26</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>1781</span></p></div><p class="content oneline">网络爬虫往往会碰到IP被封的尴尬场面，但通过IP代理可以得到解决，但往往免费的IP不稳定，所以使用之前需要验证代理的可用性，现将自己查阅相关资料总结的方法及代码记录以备日后查阅，也供有需要的朋友参阅：...                 </p></div></a></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/lilongsy/article/details/76034209,BlogCommendFromBaidu_6"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/lilongsy/article/details/76034209,BlogCommendFromBaidu_6"}'><a href="https://blog.csdn.net/lilongsy/article/details/76034209" target="_blank" title="<em>Python</em>采集<em>代理ip</em>并判断是否可用和定时更新"><div class="content"><h4 class="text-truncate oneline"><em>Python</em>采集<em>代理ip</em>并判断是否可用和定时更新                </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/7/7/E/3_lilongsy.jpg" alt="lilongsy" class="avatar-pic"><span class="namebox"><span class="name">lilongsy</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">07-24</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>1600</span></p></div><p class="content oneline">网上有很多免费的ip地址，都是可以使用的，但是如果手动来获取太麻烦，这里通过Python自动抓取，可以批量获取。代码如下：# -*- coding: utf-8 -*-import re
import...                   </p></div></a></div><div class="recommend-item-box recommend-ad-box" id="a_d_feed_0"></div><script>var width = $("div.recommend-box").outerWidth() - 48;NEWS_FEED({w: width,h: 60,showid: 'Afihld',placeholderId: 'a_d_feed_0',inject: 'define',define: {imagePosition: 'left',imageBorderRadius: 0,imageWidth: 90,imageHeight: 60,imageFill: 'clip',displayImage: true,displayTitle: true,titleFontSize: 20,titleFontColor: '#333',titleFontFamily: 'Microsoft Yahei',titleFontWeight: 'bold',titlePaddingTop: 0,titlePaddingRight: 0,titlePaddingBottom: 10,titlePaddingLeft: 8,displayDesc: true,descFontSize: 14,descPaddingLeft: 14,descFontColor: '#6b6b6b',descFontFamily: 'Microsoft Yahei',paddingTop: 0,paddingRight: 0,paddingBottom: 0,paddingLeft: 0,backgroundColor: '#fff',hoverColor: '#ca0c16'}})</script><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/okm6666/article/details/79484784,BlogCommendFromBaidu_7"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/okm6666/article/details/79484784,BlogCommendFromBaidu_7"}'><a href="https://blog.csdn.net/okm6666/article/details/79484784" target="_blank" title="【爬虫】<em>Python</em>使用requests爬取<em>代理IP</em>并<em>验证</em>可用性"><div class="content"><h4 class="text-truncate oneline">【爬虫】<em>Python</em>使用requests爬取<em>代理IP</em>并<em>验证</em>可用性             </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/8/D/9/3_okm6666.jpg" alt="okm6666" class="avatar-pic"><span class="namebox"><span class="name">okm6666</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">03-08</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>1318</span></p></div><p class="content oneline">在编写爬虫的过程中为了避免IP地址被Ban掉，可以通过抓取IP代理后，通过代理IP进行对网页的访问。网络上有很多提供免费代理IP的网站，我们可以选择西刺进行代理IP的爬取并存储到csv文件中，并通过多...                   </p></div></a></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/eye_water/article/details/78864071,BlogCommendFromBaidu_8"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/eye_water/article/details/78864071,BlogCommendFromBaidu_8"}'><a href="https://blog.csdn.net/eye_water/article/details/78864071" target="_blank" title="判断使用的<em>代理IP</em>是否有用"><div class="content"><h4 class="text-truncate oneline">判断使用的<em>代理IP</em>是否有用             </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/0/C/3/3_eye_water.jpg" alt="eye_water" class="avatar-pic"><span class="namebox"><span class="name">eye_water</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">12-21</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>3624</span></p></div><p class="content oneline">IP地址查询网站要想判断所使用的代理IP是否有用，只需要通过代理IP访问IP地址查询网站抓取地址以及归属地信息并与不使用代理IP时的地址信息以及归属地信息进行比较即可。这是未使用代理IP时得到的IP信...                  </p></div></a></div><div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view='{"mod":"popu_387","con":",https://blog.csdn.net/Marksinoberg/article/details/54172773,BlogCommendFromBaidu_9"}' data-track-click='{"mod":"popu_387","con":",https://blog.csdn.net/Marksinoberg/article/details/54172773,BlogCommendFromBaidu_9"}'><a href="https://blog.csdn.net/Marksinoberg/article/details/54172773" target="_blank" title="<em>代理IP</em> <em>有效性</em>检测"><div class="content"><h4 class="text-truncate oneline"><em>代理IP</em> <em>有效性</em>检测                </h4><div class="info-box d-flex align-content-center"><p class="avatar"><img src="https://avatar.csdn.net/0/8/F/3_marksinoberg.jpg" alt="Marksinoberg" class="avatar-pic"><span class="namebox"><span class="name">Marksinoberg</span><span class="triangle"></span></span></p><p class="date-and-readNum"><span class="date hover-show">01-07</span><span class="read-num hover-hide"><svg class="icon csdnc-yuedushu" aria-hidden="true"><use xlink:href="#csdnc-yuedushu"></use></svg>2.8万</span></p></div><p class="content oneline">摘要
原理
服务器端
_SERVER
脚本
客户端
urllib2
requests
完整代码
演示
提示
清洗效果
总结摘要昨天下午的时候，真的是无语至极。本以为CSDN上博友们应都是与人为善类型的...                 </p></div></a></div><div class="recommend-loading-box"><img src='https://csdnimg.cn/release/phoenix/images/feedLoading.gif'></div><div class="recommend-end-box"><p class="text-center">没有更多推荐了，<a href="https://blog.csdn.net/" class="c-blue c-blue-hover c-blue-focus">返回首页</a></p></div></div></main><aside><div id="asideProfile" class="aside-box"><h3 class="aside-title">个人资料</h3><div class="profile-intro d-flex"><div class="avatar-box d-flex justify-content-center flex-column"><a href="https://blog.csdn.net/tingfenyijiu"><img src="https://avatar.csdn.net/A/A/2/3_tingfenyijiu.jpg" class="avatar_pic"></a></div><div class="user-info d-flex justify-content-center flex-column"><p class="name csdn-tracking-statistics tracking-click" data-mod="popu_379"><a href="https://blog.csdn.net/tingfenyijiu" target="_blank" class="text-truncate" id="uid">tingfenyijiu</a></p></div><div class="opt-box d-flex justify-content-center flex-column"><span  class="csdn-tracking-statistics tracking-click" data-mod="popu_379"><a class="btn btn-sm btn-red-hollow" href="https://passport.csdn.net/account/login?from=https://blog.csdn.net/tingfenyijiu/article/details/77937481" target="_self">关注</a></span></div></div><div class="data-info d-flex item-tiling"><dl class="text-center" title="12"><dt><a href="https://blog.csdn.net/tingfenyijiu?t=1">原创</a></dt><dd><a href="https://blog.csdn.net/tingfenyijiu?t=1"><span class="count">12</span></a></dd></dl><dl class="text-center" title="2"><dt>粉丝</dt><dd><span class="count" id="fan">2</span></dd></dl><dl class="text-center" title="1"><dt>喜欢</dt><dd><span class="count">1</span></dd></dl><dl class="text-center" title="2"><dt>评论</dt><dd><span class="count">2</span></dd></dl></div><div class="grade-box clearfix"><dl><dt>等级：</dt><dd><a href="https://blog.csdn.net/home/help.html#level" title="2级,点击查看等级说明" target="_blank"><svg class="icon icon-level" aria-hidden="true"><use xlink:href="#csdnc-bloglevel-2"></use></svg></a></dd></dl><dl><dt>访问：</dt><dd title="19725">1万+            </dd></dl><dl><dt>积分：</dt><dd title="328">328            </dd></dl><dl title="259450"><dt>排名：</dt><dd>25万+</dd></dl></div><div class="badge-box d-flex"><span>勋章：</span><a class="icon-badge" title="持之以恒"><svg class="icon" aria-hidden="true"><use xlink:href="#csdnc-m-lasting"></use></svg><div class="icon-arrow"></div><div class="grade-detail-box item2"><div class="pos-box"><div class="left-box d-flex justify-content-center align-items-center flex-column"><svg class="icon" aria-hidden="true"><use xlink:href="#csdnc-m-lasting"></use></svg><p>持之以恒</p></div><div class="right-box d-flex justify-content-center align-items-center">授予每个自然月内发布4篇或4篇以上原创或翻译IT博文的用户。不积跬步无以至千里，不积小流无以成江海，程序人生的精彩需要坚持不懈地积累！</div></div></div></a></div></div>          <div class="csdn-tracking-statistics mb8 box-shadow" data-pid="blog" data-mod="popu_4" style="height:250px;"><div class="aside-content text-center" id="cpro_u2734133"><!-- 广告位：PC-博客内页-百度联盟-300x250 --><script type="text/javascript" src="//rabc1.iteye.com/source/api/ymebi.js?bwoc=oltly"></script>    </div>
</div><div id="asideNewArticle" class="aside-box"><h3 class="aside-title">最新文章</h3><div class="aside-content"><ul class="inf_list clearfix csdn-tracking-statistics tracking-click" data-mod="popu_382"><li class="clearfix"><a href="https://blog.csdn.net/tingfenyijiu/article/details/82466021" target="_blank">工作问题记录</a></li><li class="clearfix"><a href="https://blog.csdn.net/tingfenyijiu/article/details/82054611" target="_blank">树莓派入门记录</a></li><li class="clearfix"><a href="https://blog.csdn.net/tingfenyijiu/article/details/79910616" target="_blank">130个免费 微信小程序源码分享</a></li><li class="clearfix"><a href="https://blog.csdn.net/tingfenyijiu/article/details/79910372" target="_blank">小程序大全</a></li><li class="clearfix"><a href="https://blog.csdn.net/tingfenyijiu/article/details/79788223" target="_blank">linux 下安装pm2后 报 pm2: command not found  解决方法</a></li></ul></div>
</div><div id="asideCategory" class="aside-box flexible-box"><h3 class="aside-title">个人分类</h3><div class="aside-content"><ul><li><a href="https://blog.csdn.net/tingfenyijiu/article/category/7157131">前端                    <span class="count float-right">7篇</span></a></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/category/7157133">Python                    <span class="count float-right">4篇</span></a></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/category/7157134">爬虫                    <span class="count float-right">6篇</span></a></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/category/7157137">MySql                    <span class="count float-right">1篇</span></a></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/category/7163389">建站                    <span class="count float-right">6篇</span></a></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/category/7969853">树莓派                    <span class="count float-right">1篇</span></a></li></ul></div><p class="text-center"><a class="btn btn-link-blue flexible-btn" data-fbox="aside-archive">展开</a></p></div><div id="asideArchive" class="aside-box flexible-box"><h3 class="aside-title">归档</h3><div class="aside-content"><ul class="archive-list"><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2018/09">2018年9月                    <span class="count float-right">1篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2018/08">2018年8月                    <span class="count float-right">1篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2018/04">2018年4月                    <span class="count float-right">3篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2018/03">2018年3月                    <span class="count float-right">1篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2018/01">2018年1月                    <span class="count float-right">2篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2017/12">2017年12月                    <span class="count float-right">1篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2017/11">2017年11月                    <span class="count float-right">3篇</span></a></li><!--归档统计--><li><a href="https://blog.csdn.net/tingfenyijiu/article/month/2017/09">2017年9月                    <span class="count float-right">9篇</span></a></li></ul></div><p class="text-center"><a class="btn btn-link-blue flexible-btn" data-fbox="aside-archive">展开</a></p></div><div id="asideHotArticle" class="aside-box"><h3 class="aside-title">热门文章</h3><div class="aside-content"><ul class="hotArticle-list csdn-tracking-statistics tracking-click" data-mod="popu_521"><li><a href="https://blog.csdn.net/tingfenyijiu/article/details/77937481">python学习之二    代理ip有效性验证</a><p class="read">阅读量：<span>11765</span></p></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/details/79788223">linux 下安装pm2后 报 pm2: command not found  解决方法</a><p class="read">阅读量：<span>1806</span></p></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/details/78009755">scrapy异常：http status code is not handled or allowed</a><p class="read">阅读量：<span>1699</span></p></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/details/79910616">130个免费 微信小程序源码分享</a><p class="read">阅读量：<span>1301</span></p></li><li><a href="https://blog.csdn.net/tingfenyijiu/article/details/78491775">监听vue.js中v-for全部渲染完成</a><p class="read">阅读量：<span>876</span></p></li></ul></div>
</div><div id="asideNewComments" class="aside-box"><h3 class="aside-title">最新评论</h3><div class="aside-content"><ul class="newcomment-list"><li><a class="title text-truncate" target="_blank" href="https://blog.csdn.net/tingfenyijiu/article/details/77937481#comments">python学习之二    代理i...</a><p class="comment"><a href="https://my.csdn.net/Message_lx" class="user-name" target="_blank">Message_lx</a>：照你这么验证，随便一个ip都是有效的，误人子弟！！！！                </p></li><li><a class="title text-truncate" target="_blank" href="https://blog.csdn.net/tingfenyijiu/article/details/77937481#comments">python学习之二    代理i...</a><p class="comment"><a href="https://my.csdn.net/fu254983303" class="user-name" target="_blank">fu254983303</a>：这样访问是不是太耗时？                </p></li></ul></div>
</div><div id="asideFooter"><div class="aside-box"><script type="text/javascript" src="//rabc1.iteye.com/source/res/yn6yz.js?ojylrgb=yk"></script></div><div class="aside-box"><div class="persion_article"></div></div></div>
</aside>
<script src="https://csdnimg.cn/pubfooter/js/publib_footer-1.0.3.js" data-isfootertrack="false" type="text/javascript"></script>
<script>$("a.flexible-btn").click(function(){$(this).parents('div.aside-box').removeClass('flexible-box');$(this).remove();})
</script>
</div>
<div class="mask-dark"></div>
<div class="pulllog-box" style="display: block;"><div class="pulllog clearfix"><span class="text float-left"><!-- 广告位：PC-博客内页底通 文字链位置 --><script>var mediav_ad_pub = 'cXt9eo_2313086';var mediav_ad_width = '500';var mediav_ad_height = '36';</script><script type="text/javascript" language="javascript" charset="utf-8" src="//static.mediav.com/js/mvf_g2.js"></script></span><div class="pulllog-btn float-right clearfix"><button class="pulllog-login float-left csdn-tracking-statistics tracking-click" data-mod="popu_557"><a href="https://passport.csdn.net/account/login?utm_source=csdn_blog_pc_login" target="_self">登录</a></button><div class="pulllog-sigin float-left csdn-tracking-statistics tracking-click" data-mod="popu_558"><a href="https://passport.csdn.net/account/mobileregister" target="_blank">注册</a></div><button class="btn-close"><svg class="icon" aria-hidden="true"><use xlink:href="#csdnc-times"></use></svg></button></div></div>
</div>
<div id="loginWrap" style="display:none"></div>
<div class="tool-box"><ul class="meau-list"><li class="btn-like-box "><button class=" low-height hover-box btn-like " title="点赞"><svg class="icon active hover-hide" aria-hidden="true"><use xlink:href="#csdnc-thumbsup-ok"></use></svg><svg class="icon no-active hover-hide" aria-hidden="true"><use xlink:href="#csdnc-thumbsup"></use></svg><span class="hover-show text-box text"><span class="no-active">点赞</span><span class="active">取消点赞</span></span><p>0</p></button></li><li class=""><a class="btn-comments long-height hover-box" title="写评论" href="#commentBox"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-comments"></use></svg><span class="hover-show text">评论</span><p class="">2               </p></a></li><li class="toc-container-box" id="liTocBox"><button class="btn-toc low-height hover-box" title="目录"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-contents"></use></svg><span class="hover-show text">目录</span></button><div class="toc-container"><div class="pos-box"><div class="icon-arrow"></div><div class="scroll-box"><div class="toc-box"></div></div></div><div class="opt-box"><button class="btn-opt prev nomore" title="向上"><svg class="icon" aria-hidden="true"><use xlink:href="#csdnc-chevronup"></use></svg></button><button class="btn-opt next"><svg class="icon" aria-hidden="true"><use xlink:href="#csdnc-chevrondown"></use></svg></button></div></div></li><li><button class="btn-bookmark low-height hover-box" title="收藏"><svg class="icon active hover-hide" aria-hidden="true"><use xlink:href="#csdnc-bookmark-ok"></use></svg><svg class="icon no-active hover-hide" aria-hidden="true"><use xlink:href="#csdnc-bookmark"></use></svg><span class="hover-show text">收藏</span><!-- <span class="hover-show text-box text"><span class="no-active">收藏</span><span class="active">取消收藏</span></span> --></button></li><li class="bdsharebuttonbox"><button class="btn-comments low-height hover-box" ><a href="#" class="bds_weixin clear-share-style" data-cmd="weixin" title="手机看"></a><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-wechat"></use></svg><span class="hover-show text text3">手机看</span></button></li><li class="widescreen-hide"><a class="btn-comments low-height hover-box" href="https://blog.csdn.net/tingfenyijiu/article/details/77933935" title="Markdown编辑器使用Demo"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-shangyiye"></use></svg><span class="hover-show text text3">上一篇</span></a></li><li class="widescreen-hide"><a class="btn-comments hover-box low-height" href="https://blog.csdn.net/tingfenyijiu/article/details/77942033" title="python学习之三 邮件发送"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-xiayiye"></use></svg><span class="hover-show text text3">下一篇</span></a></li><li class="bdsharebuttonbox _360_interactive"style="margin-top: 8px;"><script type="text/javascript" src="//cjhd.mediav.com/js/interactive_plugin.js"></script> <style>#_360_interactive > *{margin-left: -8px;}</style><div id="_360_interactive" > <script> INTERACTIVE_PLUGIN.render({ showid : 'N0ufqn', w: 60, h: 60, type: 'click', placeholderId: '_360_interactive' }); </script> </div><img src="//img-ads.csdn.net/2016/201608021757063065.png" style="margin: 0 auto;display: block;" alt=""></li><!-- 宽屏更多按钮 --><li class="widescreen-more"><a class="btn-comments chat-ask-button low-height hover-box" title="快问" href="#chatqa"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-more"></use></svg><span class="hover-show text">更多</span></a><ul class="widescreen-more-box"><li class="widescreen-more"><a class="btn-comments low-height hover-box" href="https://blog.csdn.net/tingfenyijiu/article/details/77933935" title="Markdown编辑器使用Demo"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-shangyiye"></use></svg><span class="hover-show text text3">上一篇</span></a></li><li class="widescreen-more"><a class="btn-comments hover-box low-height" href="https://blog.csdn.net/tingfenyijiu/article/details/77942033" title="python学习之三 邮件发送"><svg class="icon hover-hide" aria-hidden="true"><use xlink:href="#csdnc-xiayiye"></use></svg><span class="hover-show text text3">下一篇</span></a></li></ul></li></ul>
</div>
<script>window._bd_share_config = { "common": { "bdSnsKey": {}, "bdText": "", "bdMini": "1", "bdMiniList": false, "bdPic": "", "bdStyle": "0", "bdSize": "16" }, "share": {} }; with (document) 0[(getElementsByTagName('head')[0] || body).appendChild(createElement('script')).src = 'https://csdnimg.cn/static/api/js/share.js?v=89860594'];</script>
<script>var recommendCount = 9;recommendCount = recommendCount > 1 ? (recommendCount + (recommendCount>6 ? 2 : 1)) : recommendCount;var articleTit = "python学习之二    代理ip有效性验证";var ChannelId = 16;var articleId = "77937481";var commentscount = 2;var islock = false;var curentUrl = "https://blog.csdn.net/tingfenyijiu/article/details/77937481";var myUrl = "https://my.csdn.net/";//1禁止评论，2正常var commentAuth = 2;//百度搜索var baiduKey = "python%E6%A3%80%E6%B5%8B%E4%BB%A3%E7%90%86%E6%98%AF%E5%90%A6%E6%9C%89%E6%95%88";var needInsertBaidu = false;// 代码段样式var codeStyle = '';var highlight = ["python","\u5b66\u4e60","\u4e4b\u4e8c","\u4ee3\u7406ip","\u6709\u6548\u6027","\u9a8c\u8bc1"];//高亮数组
</script>
<script src="https://csdnimg.cn/public/sandalstrap/1.3/js/sandalstrap.min.js"></script>
<script src="https://csdnimg.cn/release/phoenix/vendor/pagination/paging.js"></script>
<script src='https://csdnimg.cn/public/common/gotop/js/goTop-v1.0.min.js?v201803151422'></script>
<script>GoTop({right: 8,hasReport: true,reportFun: function() {showReport(false,"python学习之二    代理ip有效性验证");}})
</script>
<script src="https://csdnimg.cn/release/phoenix/template/js/common-ffcd47990c.min.js"></script>
<script src="https://csdnimg.cn/release/phoenix/template/js/detail-48a698f2d8.min.js"></script>
<script src="https://csdnimg.cn/release/phoenix/themes/skin3-template/skin3-template-9376486353.min.js"></script>
<script src="https://csdnimg.cn/search/baidu_search-1.1.2.js?v=201802071056&autorun=true&install=true&keyword=python%E6%A3%80%E6%B5%8B%E4%BB%A3%E7%90%86%E6%98%AF%E5%90%A6%E6%9C%89%E6%95%88"  type="text/javascript"></script>
</body>
<!-- 第四范式SDK --><!-- 高亮未与 markdown兼容  -->
<script type="text/javascript" src="https://static-blog.csdn.net/mdeditor/public/res/bower-libs/MathJax/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"HTML-CSS": {linebreaks: { automatic: true, width: "94%container" },imageFont: null},tex2jax: {preview: "none"},mml2jax: {preview: 'none'}});
</script>
</html>
successProcess finished with exit code 0

方法二:

# _*_ coding:utf-8 _*_
__author__ = "zgd"
__time__ = "2018.09.08"# example1: https://www.jianshu.com/p/588241a313e7
# example2:https://blog.csdn.net/tingfenyijiu/article/details/77937481import urllib2
import reclass TestProxy(object):proxy_ip = ['61.32.159.46:808','181.135.217.7:80',]def __init__(self):self.ip = '181.135.217.7'self.port = '80'self.url = 'http://www.baidu.com'self.timeout = 3self.regex = re.compile(r'baidu.com')self.run()def run(self):self.linkWithProxy()def linkWithProxy(self):server = 'http://'+ self.ip + ':'+ self.portopener = urllib2.build_opener(urllib2.ProxyHandler({'http':server}))urllib2.install_opener(opener)try:response = urllib2.urlopen(self.url, timeout=self.timeout)except:print '%s connect failed' % serverreturnelse:try:str = response.read()except:print '%s connect failed' % serverreturnif self.regex.search(str):print '%s connect success .......' % serverprint self.ip + ':' + self.portif __name__ == '__main__':Tp = TestProxy()

测试结果:

/usr/bin/python2.7 /home/gdzhang/下载/workspace/FirmCrawler/FirmCrawler/test_ip.py
http://110.202.65.154:80 connect success .......Process finished with exit code 0

测试代理ip是否有效相关推荐

python测试代理IP地址
代码: # -*- coding: utf-8 -*-import urllib,urllib2,re from random import choice from scrapy.selector i ...
利用Flask写了一个代理IP提取接口，并附上电影下载站点刷分程序用于测试代理IP可用性
热烈庆祝失踪人口回归 2019-06-17 新增可以指定目标站点维护的一个代理池,而非通用的代理IP GITHUB地址:https://github.com/IMWoolei/FreeProxyPoo ...
测试代理ip是否可用的方法
import random import requests import re''' 利用访问http://icanhazip.com/返回的IP进行测试说明:利用的http://icanhazip ...
如何测试代理IP的质量？
由于因特网的快速发展,对代理IP的需求也在迅速增长.市场上的代理商,还有套餐类型,还层出不穷.因此,我们需要学会判断代理IP的质量,从而选择高质量的代理 1.IP高效:IP的有效性直接影响工作效率.连 ...
测试代理IP有效性的几种方式-芝麻ip
通常我们用的IP代理都是付费购买的,因为免费的IP代理有效性特别低,可用率也不高,而且使用之前需要检查IP地址是否可用,因此要如何检查IP代理是否有效呢?下面介绍几种检查IP代理有效性的方式. 1.T ...
python requests 代理ip_python requests 测试代理ip
{"moduleinfo":{"card_count":[{"count_phone":1,"count":1}],&q ...
网络爬虫测试代理IP
lxml openpyxl报错 C:\Users\1>pip3 install lxml Collecting lxml Downloading lxml-4.8.0-cp38-cp38-win ...
从零开始构建自己的爬虫代理IP数据库并定期检验IP有效性...
ProxyIPPool 从零开始构建自己的代理IP池:根据代理IP网址抓取新的代理IP:对历史代理IP有效性验证源码地址:https://github.com/TOMO-CAT/ProxyIPPoo ...
代理IP 有效性检测
分享一下我老师大神的人工智能教程!零基础,通俗易懂!http://blog.csdn.net/jiangjunshow 也欢迎大家转载本篇文章.分享知识,造福人民,实现我们中华民族伟大复兴! 摘要原 ...