RequestConfig类

在构建网络爬虫时，经常需要配置很多信息，例如RequestTimeout（连接池获取到连接的超时时间）、ConnectTimeout（建立连接的超时）、SocketTimeout（获取数据的超时时间)、代理、是否允许重定向等信息。
在HttpClient，实现这些配置需要使用到RequestConfig类的一个内部类Builder。如下为Builder的源码：

    public static class Builder {private boolean expectContinueEnabled;private HttpHost proxy;private InetAddress localAddress;private boolean staleConnectionCheckEnabled;private String cookieSpec;private boolean redirectsEnabled;private boolean relativeRedirectsAllowed;private boolean circularRedirectsAllowed;private int maxRedirects;private boolean authenticationEnabled;private Collection<String> targetPreferredAuthSchemes;private Collection<String> proxyPreferredAuthSchemes;private int connectionRequestTimeout;private int connectTimeout;private int socketTimeout;private boolean contentCompressionEnabled;Builder() {super();this.staleConnectionCheckEnabled = false;this.redirectsEnabled = true;this.maxRedirects = 50;this.relativeRedirectsAllowed = true;this.authenticationEnabled = true;this.connectionRequestTimeout = -1;this.connectTimeout = -1;this.socketTimeout = -1;this.contentCompressionEnabled = true;}public Builder setExpectContinueEnabled(final boolean expectContinueEnabled) {this.expectContinueEnabled = expectContinueEnabled;return this;}public Builder setProxy(final HttpHost proxy) {this.proxy = proxy;return this;}public Builder setLocalAddress(final InetAddress localAddress) {this.localAddress = localAddress;return this;}/*** @deprecated (4.4) Use {@link*   org.apache.http.impl.conn.PoolingHttpClientConnectionManager#setValidateAfterInactivity(int)}*/@Deprecatedpublic Builder setStaleConnectionCheckEnabled(final boolean staleConnectionCheckEnabled) {this.staleConnectionCheckEnabled = staleConnectionCheckEnabled;return this;}public Builder setCookieSpec(final String cookieSpec) {this.cookieSpec = cookieSpec;return this;}public Builder setRedirectsEnabled(final boolean redirectsEnabled) {this.redirectsEnabled = redirectsEnabled;return this;}public Builder setRelativeRedirectsAllowed(final boolean relativeRedirectsAllowed) {this.relativeRedirectsAllowed = relativeRedirectsAllowed;return this;}public Builder setCircularRedirectsAllowed(final boolean circularRedirectsAllowed) {this.circularRedirectsAllowed = circularRedirectsAllowed;return this;}public Builder setMaxRedirects(final int maxRedirects) {this.maxRedirects = maxRedirects;return this;}public Builder setAuthenticationEnabled(final boolean authenticationEnabled) {this.authenticationEnabled = authenticationEnabled;return this;}public Builder setTargetPreferredAuthSchemes(final Collection<String> targetPreferredAuthSchemes) {this.targetPreferredAuthSchemes = targetPreferredAuthSchemes;return this;}public Builder setProxyPreferredAuthSchemes(final Collection<String> proxyPreferredAuthSchemes) {this.proxyPreferredAuthSchemes = proxyPreferredAuthSchemes;return this;}public Builder setConnectionRequestTimeout(final int connectionRequestTimeout) {this.connectionRequestTimeout = connectionRequestTimeout;return this;}public Builder setConnectTimeout(final int connectTimeout) {this.connectTimeout = connectTimeout;return this;}public Builder setSocketTimeout(final int socketTimeout) {this.socketTimeout = socketTimeout;return this;}/*** @deprecated (4.5) Set {@link #setContentCompressionEnabled(boolean)} to {@code false} and* add the {@code Accept-Encoding} request header.*/@Deprecatedpublic Builder setDecompressionEnabled(final boolean decompressionEnabled) {this.contentCompressionEnabled = decompressionEnabled;return this;}public Builder setContentCompressionEnabled(final boolean contentCompressionEnabled) {this.contentCompressionEnabled = contentCompressionEnabled;return this;}public RequestConfig build() {return new RequestConfig(expectContinueEnabled,proxy,localAddress,staleConnectionCheckEnabled,cookieSpec,redirectsEnabled,relativeRedirectsAllowed,circularRedirectsAllowed,maxRedirects,authenticationEnabled,targetPreferredAuthSchemes,proxyPreferredAuthSchemes,connectionRequestTimeout,connectTimeout,socketTimeout,contentCompressionEnabled);}}

超时相关配置

HttpClient中可设置三个超时：RequestTimeout（连接池获取到连接的超时时间）、ConnectTimeout（建立连接的超时）、SocketTimeout（获取数据的超时时间）。使用RequestConfig进行配置的示例程序如下：

     //全部设置为10秒RequestConfig requestConfig = RequestConfig.custom().setSocketTimeout(10000).setConnectTimeout(10000).setConnectionRequestTimeout(10000).build();//配置httpClientHttpClient httpClient = HttpClients.custom().setDefaultRequestConfig(requestConfig).build();

代理配置

     RequestConfig defaultRequestConfig = RequestConfig.custom().setProxy(new HttpHost("171.97.67.160", 3128, null)).build();   //添加代理HttpClient httpClient = HttpClients.custom().setDefaultRequestConfig(defaultRequestConfig).build();  //配置httpClient

HttpClient4.5使用RequestConfig配置连接信息相关推荐

mybatis使用拦截器显示sql,使用druid配置连接信息
mybatis使用拦截器显示sql,使用druid配置连接信息 mybatis sql Druid 1.显示出sql内容: 新建2个类: MybatisInterceptor :拦截sql,并获得输出 ...
Exchange企业实战技巧（16）发布SMTP、POP、IMAP连接信息设置
在Exchange2010的OWA中,默认不提供SMTP.POP及IMAP相关信息.如何才能将SMTP.POP.IMAP的连接信息发布到OWA中,方便使用POP.IMAP方式收发邮件的用户,可以根据提 ...
C#获得网络连接信息 IPGlobalProperties
C#获得网络连接信息 IPGlobalProperties 原文:C#获得网络连接信息 IPGlobalProperties IPGlobalProperties 提供有关本地计算机的网络连接的信息. ...
android wifi动画显示,android动态配置Wifi信息
我们找到 android.net.wifi.WifiConfiguration.java 看看如何配置Wifi信息. /**************************************SS ...
EnterpriseLibrary数据访问(3)加密连接信息
使用配置工具加密数据库的连接信息代码下载:http://dev.mjxy.cn/a-entlib-Encrypted-connection-information.aspx 1. App.Confi ...
ssm注解配置连接mysql_基于注解和配置类的SSM（Spring+SpringMVC+Mybatis）项目详细配置...
在上一篇文章中介绍了使用注解和xml配置文件对项目进行配置,在这篇文章中将xml配置文件中的配置信息都改成使用注解或者配置类的形式. 第一步.配置pom.xml 在一个ssm项目中,可能需要用到的依赖 ...
pycharm配置连接服务器+python环境设置
[pycharm配置连接服务器+python环境设置] 简要介绍 1. configuration 2. Deployment 3. SSH Configuration 配置 4. Mapping 5 ...
kali liunx使用心得之命令行模式下如何配置连接无线网络
kali liunx使用心得之命令行模式下如何配置连接无线网络最近在使用kali时出现了一点小小的问题,由于我安装的是win10和kali双系统,为了能够在kali界面下自由操作win10下的磁盘, ...
[arduino]ESP8266配置连接IoT阿里云平台（arduino D1 mini）
[arduino]ESP8266配置连接IoT阿里云平台(arduino D1 mini) 前言 ESP8266配置(基础) ESP8266头文件配置安装AliyunIoTSDK库安装Arduin ...

HttpClient4.5使用RequestConfig配置连接信息

文章目录

RequestConfig类

超时相关配置

代理配置

HttpClient4.5使用RequestConfig配置连接信息相关推荐

最新文章

热门文章