关于Connection aborted等问题的解决

错误类型

在爬虫中报如下的错误：
requests.exceptions.ConnectionError: (‘Connection aborted.’, RemoteDisconnected(‘Remote end closed connection without response’,))

解决方法

（1）随机切换User-Agent：

 user_agent_list = ["Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36","Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36","Mozilla/5.0 (Windows NT 10.0; …) Gecko/20100101 Firefox/61.0","Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.186 Safari/537.36","Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.62 Safari/537.36","Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36","Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)","Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.5; en-US; rv:1.9.2.15) Gecko/20110303 Firefox/3.6.15",]headers['User-Agent'] = random.choice(user_agent_list)

（2）访问频率的设置：
time.sleep(6) #测试一下，如果是与访问频率有关可设置时间长一点
（3）使用代理ip:

self.proxies = {"http": ip,"https":ip,}

关于Connection aborted等问题的解决相关推荐

python requests 报错 Connection aborted ConnectionResetError RemoteDisconnected 解决方法
错误:requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end close ...
requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine('',))
这几天python脚本中使用requests模块发现如下错误: File "/usr/local/python2710/lib/python2.7/site-packages/request ...
ssh_exchange_identification: Connection closed by remote host 解决方法
ssh_exchange_identification: Connection closed by remote host 解决方法参考文章: (1)ssh_exchange_identificat ...
python3 Connection aborted.', RemoteDisconnected('Remote end closed connection without response'
在写爬虫的时候遇到了问题,网站是asp.net写的 requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconn ...
python requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine('HTTP/1.1 000\r\n'
requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine('HTTP/1.1 000\r\n')) 原因: ...
'Connection aborted.', BadStatusLine('\x15\x03\x01\x00\x02\x02\x16',)
通过代理来requests网页的时候,我在日志中发现这个错误 'Connection aborted.', BadStatusLine('\x15\x03\x01\x00\x02\x02\x16',) ...
Connection reset原因分析及解决思路
Connection reset原因分析及解决思路 - lwli - 博客园我们在开发过程中经常会出现Connection reset问题,包括http调用,数据库连接等场景.出现Connectio ...
绝地求生国际服请求超时服务器未响应,绝地求生connection timeout 3.6.7解决方法/游戏连接超时怎么办...
绝地求生游戏中有很多的玩家遇到了connection timeout 3.6.7,这是怎么回事呢?下面游戏吧小编为大家带来绝地求生connection timeout 3.6.7解决方法,感兴趣的小伙 ...
ab apr_socket_recv: Connection reset by peer 错误解决
来源:http://blog.csdn.net/largetalk/article/details/7337102 在ubuntu 11.04上的ab(apache-utils)有些问题, 在并发数稍 ...

关于Connection aborted等问题的解决

错误类型

解决方法

关于Connection aborted等问题的解决相关推荐

最新文章

热门文章