httpclient解析https网页

用httpclient解析https网页，基本代码测试通过。

import javax.net.ssl.SSLContext;  import javax.net.ssl.TrustManager;
import javax.net.ssl.X509TrustManager;import java.io.IOException;
import java.security.NoSuchAlgorithmException;
import java.security.cert.CertificateException;
import java.security.cert.X509Certificate;
import org.apache.http.client.ClientProtocolException;
import org.apache.http.client.HttpClient;
import org.apache.http.client.ResponseHandler;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.conn.ClientConnectionManager;  import org.apache.http.conn.scheme.Scheme;
import org.apache.http.conn.scheme.SchemeRegistry;
import org.apache.http.conn.scheme.SchemeSocketFactory;
import org.apache.http.conn.ssl.SSLSocketFactory;
import org.apache.http.impl.client.BasicResponseHandler;
import org.apache.http.impl.client.ClientParamsStack;
import org.apache.http.impl.client.DefaultHttpClient;
import org.apache.http.params.DefaultedHttpParams;
import org.apache.http.params.HttpParams;  public class HttpClientTest {  public static void main(String args[]) {  try {  HttpClient httpclient = new DefaultHttpClient();  //Secure Protocol implementation.  SSLContext ctx = SSLContext.getInstance("SSL");  //Implementation of a trust manager for X509 certificates  X509TrustManager tm = new X509TrustManager() {  public void checkClientTrusted(X509Certificate[] xcs,  String string) throws CertificateException {  }  public void checkServerTrusted(X509Certificate[] xcs,  String string) throws CertificateException {  }  public X509Certificate[] getAcceptedIssuers() {  return null;  }  };  ctx.init(null, new TrustManager[] { tm }, null);  SSLSocketFactory ssf = new SSLSocketFactory(ctx);  ClientConnectionManager ccm = httpclient.getConnectionManager();  //register https protocol in httpclient's scheme registry  SchemeRegistry sr = ccm.getSchemeRegistry();  sr.register(new Scheme("https", 443, ssf));  HttpGet httpget = new HttpGet("https://www.icbc-axa.com");  HttpParams params = httpclient.getParams();  params.setParameter("param1", "paramValue1");  httpget.setParams(params);  System.out.println("REQUEST:" + httpget.getURI());  ResponseHandler responseHandler = new BasicResponseHandler();  String responseBody;  responseBody = httpclient.execute(httpget, responseHandler);  System.out.println(responseBody);  // Create a response handler  } catch (NoSuchAlgorithmException e) {  // TODO Auto-generated catch block  e.printStackTrace();  } catch (ClientProtocolException e) {  // TODO Auto-generated catch block  e.printStackTrace();  } catch (IOException e) {  // TODO Auto-generated catch block  e.printStackTrace();  } catch (Exception ex) {  ex.printStackTrace();  }  }
}

httpclient解析https网页相关推荐

关于Jsoup解析https网页的问题
针对Jsoup解析https网页,网上的一段源码执行后并不能实现成功访问. import java.net.MalformedURLException; import java.net.URL; im ...
使用commons httpclient请求https协议的webservice
使commons httpclient支持https协议类,是commons httpclient import java.io.IOException; import java.net.InetAd ...
Python之HTML的解析（网页抓取一）
http://blog.csdn.net/my2010sam/article/details/14526223 --------------------- 对html的解析是网页抓取的基础,分析抓取的 ...
python动态页面元素爬取_Python开发爬虫之动态网页抓取篇：爬取博客评论数据——通过浏览器审查元素解析真实网页地址...
由于主流网站都使用JavaScript展示网页内容,和前面简单抓取静态网页不同的是,在使用JavaScript时,很多内容并不会出现在HTML源代码中,而是在HTML源码位置放上一段JavaScrip ...
Python开发爬虫之动态网页抓取篇：爬取博客评论数据——通过浏览器审查元素解析真实网页地址...
由于主流网站都使用JavaScript展示网页内容,和前面简单抓取静态网页不同的是,在使用JavaScript时,很多内容并不会出现在HTML源代码中,而是在HTML源码位置放上一段JavaScrip ...
HttpClient解析服务器返回的response出现乱码
引用处: [问题解决]HttpClient解析服务器返回的response出现乱码问题场景最近在用httpClient做网络爬虫的时候,遇到了一个不大不小的问题,当使用HttpGet向指定网址发送 ...
使用Eclipse+httpClient+Jsoup读取网页数据-初级
本人最近几天学习使用HttpClient包读取网页上的数据,运行博客http://ducaijun.iteye.com/blog/1335453上的例子: 1.首先打开Eclipse,File-> ...
HtmlUnit解析动态网页并采集网页列表到Excel
HtmlUnit可以解析动态网页,本文这里选取了一个网址(页面需js/ajax动态加载),模拟浏览器操作页面各元素,包括点击获取列表值,主要是掌握了HtmlUnit解析页面元素的主要用法,同时使用PO ...
Python爬虫项目，获取所有网站上的新闻，并保存到数据库中，解析html网页等(未完待续)
1.需求说明需求: 爬取虎嗅网站的所有新闻,并保存到数据库中. http://www.huxiu.com 技术: 1.爬虫获取服务器的资源(urllib) 解析html网页(BeautifulSo ...

httpclient解析https网页

httpclient解析https网页相关推荐

最新文章

热门文章