Android利用jsoup爬虫爬网页数据（二）

效果图太大了，我放到github上了，想看效果的点击以下链接：
效果图一
效果图二
效果图和上文是一样的，上文只是说了一下简单的，这里的稍微麻烦一点，因为上文的基本就是个列表，而且数据结构比较简单，这里就稍微麻烦一点，我先把html代码上传一下吧，这里截取有用的。

<div class="recipeCategory_sub_R clear"><ul><li><span class="category_s1"><b>猪蹄儿</b></span><span class="category_s2">两个</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/LiaoJiu/" title="料酒的做法"><b>料酒</b></a></span><span class="category_s2">一勺半</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/SHENGJIANG/" title="生姜的做法"><b>生姜</b></a></span><span class="category_s2">6g</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/DaSuan/" title="大蒜的做法"><b>大蒜</b></a></span><span class="category_s2">4g</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/GuiPi/" title="桂皮的做法"><b>桂皮</b></a></span><span class="category_s2">一块儿</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/XiangYe/" title="香叶的做法"><b>香叶</b></a></span><span class="category_s2">三四片儿</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/BaJiao/" title="八角的做法"><b>八角</b></a></span><span class="category_s2">两三个</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/DingXiang/" title="丁香的做法"><b>丁香</b></a></span><span class="category_s2">1g</span></li><li><span class="category_s1"><a target="_blank" href="http://www.meishichina.com/YuanLiao/DaCong/" title="大葱的做法"><b>大葱</b></a></span><span class="category_s2">一根</span></li><li><span class="category_s1"><b>小米辣</b></span><span class="category_s2">三四个</span></li></ul></div><div class="recipeCategory_sub_R mt30 clear"><ul><li><span class="category_s1"><a title="咸鲜" href="http://home.meishichina.com/recipe-type-do-cuisine-view-8.html" target="_blank">咸鲜</a></span><span class="category_s2">口味</span></li><li><span class="category_s1"><a title="煮" href="http://home.meishichina.com/recipe-type-do-technics-view-7.html" target="_blank">煮</a></span><span class="category_s2">工艺</span></li><li><span class="category_s1"><a title="一小时" href="http://home.meishichina.com/recipe-type-do-during-view-5.html" target="_blank">一小时</a></span><span class="category_s2">耗时</span></li><li><span class="category_s1"><a title="普通" href="http://home.meishichina.com/recipe-type-do-level-view-2.html" target="_blank">普通</a></span><span class="category_s2">难度</span></li></ul></div><div class="mo mt20"><h3>猪蹄冻----高逼格新年宴客菜的做法步骤</h3></div><div class="recipeStep"><ul><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109004407482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：1"></div><div class="recipeStep_word"><div class="recipeStep_num">1</div>准备两个猪蹄儿，上次做的猪蹄儿用的是肘子，今天用蹄儿记住对半切开成两半就可以，为啥捏不然剁碎了挑骨头渣子累死你，因为有碎骨头一切就碎了不好看明白了吧</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109099457482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：2"></div><div class="recipeStep_word"><div class="recipeStep_num">2</div>锅里上入适量水，放入猪蹄儿，一勺半料酒，三片生姜，煮开后后撇去浮沫再用温水洗净</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109139157482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：3"></div><div class="recipeStep_word"><div class="recipeStep_num">3</div>洗净后检查下猪蹄上面是否有毛毛，我是用刮眉毛的刀刀一下子就消灭的干干净净滴，哈哈</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109165297482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：4"></div><div class="recipeStep_word"><div class="recipeStep_num">4</div>来准备一些配料也不是绝对的: 桂皮，香叶，八角，大葱，丁香。。。。这些材料最好是用一个纱布包起来，我家用完了，就木有用</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109206797482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：5"></div><div class="recipeStep_word"><div class="recipeStep_num">5</div>我一直觉得电压力锅煮方便又快当然高压力锅也是可以的，电压力锅不费水，超过一点点就可以加入少许香料，和大葱段，生姜片，少许食盐</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109245617482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：6"></div><div class="recipeStep_word"><div class="recipeStep_num">6</div>我大概煮了一个来小时高压锅上汽后大概半小时后左右就可以了</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109358907482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：7"></div><div class="recipeStep_word"><div class="recipeStep_num">7</div>舀去上面的浮沫</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109399577482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：8"></div><div class="recipeStep_word"><div class="recipeStep_num">8</div>把猪蹄捞起来凉凉，在用豆浆的漏勺舀取所有的香料和碎沫渣子所以用细一点的漏勺会弄得比较彻底</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109429647482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：9"></div><div class="recipeStep_word"><div class="recipeStep_num">9</div>汤稍凉后舀去最上面的油脂</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109457347482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：10"></div><div class="recipeStep_word"><div class="recipeStep_num">10</div>稍凉后用手带上一次性手套脱去骨头，这是一个细致的活儿，一个个慢慢来全部脱掉后再仔细的确认有木有碎骨头小渣子之类的最后用刀切成小段</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109709027482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：11"></div><div class="recipeStep_word"><div class="recipeStep_num">11</div>加入刚刚的汤里，，如果还是怕里面有骨头渣子再用漏勺捞起来用筷子在仔细挑挑，免得切的时候碎掉就欲哭无泪啦这个时候转到小汤锅里中小火慢慢煮</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109607987482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：12"></div><div class="recipeStep_word"><div class="recipeStep_num">12</div>直到煮到三分之一的时候就可以熄火啦，记住哦剩下的汤多一点就会软汤少一点就会硬一些</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109644707482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：13"></div><div class="recipeStep_word"><div class="recipeStep_num">13</div>稍凉后放入一个你觉得切起来形状会好看的容器里，没有热气后盖上密封的盖子放入冰箱冷藏室【不是冷冻室哦】</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816109969587482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：14"></div><div class="recipeStep_word"><div class="recipeStep_num">14</div>第二天就可以开吃啦，很美有木有，超级的满足感啊</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816110026397482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：15"></div><div class="recipeStep_word"><div class="recipeStep_num">15</div>用刀切成均匀的片儿就可以啦</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816110079187482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：16"></div><div class="recipeStep_word"><div class="recipeStep_num">16</div>一片片的摆好就可以上桌了，清爽不腻，对于女人懂得，满满的胶原蛋白</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816110125747482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：17"></div><div class="recipeStep_word"><div class="recipeStep_num">17</div>人生也像坐火车一样，过去的景色那样美，让你流连不舍，可是你总是需要前进，会离开， 然后你告诉自己，没关系，我以后一定还会再来看，可其实，往往你再也不会回去。流逝的 时间，退后的风景，邂逅的人，终究是渐行渐远。</div></li><li><div class="recipeStep_img"><img src="http://i3.meishichina.com/attachment/recipe/2016/12/13/2016121314816110199097482619.jpg@!p320" alt="猪蹄冻----高逼格新年宴客菜的做法步骤：18"></div><div class="recipeStep_word"><div class="recipeStep_num">18</div>我就知道你们会问这个蘸料的做法:少许生姜末大蒜末，葱末，少许辣椒油，香醋，生抽，蒸鱼鼓油，香芝麻 ，少许鸡粉，小米辣碎，搅匀就可以啦</div></li></ul></div>

这里需要注意的是div并不是根的div而是嵌套好多层的div，上文是根的div，获取数据也比较简单，这里稍微麻烦一点。
核心代码：

try {Document document = Jsoup.connect("http://home.meishichina.com/recipe-304301.html").get();//菜名Elements recipeDeImgBox = document.getElementsByClass("recipe_De_imgBox");String title = recipeDeImgBox.select("a").attr("title");
//            Log.d("jsoup", title);//顶部大图String imgUrl = recipeDeImgBox.select("a").select("img").attr("src");
//            Log.d("jsoup", imgUrl);//食材明细Elements fodderElement = document.getElementsByClass("mo mt20");String fodderTitle = fodderElement.get(0).select("h3").text();
//            Log.d("jsoup", fodderTitle);//具体食材Elements fodderItemElement = document.getElementsByClass("recipeCategory_sub_R clear");int fodderSize = fodderItemElement.select(".category_s1").size();for (int i = 0; i < fodderSize; i++) {String fodderName = fodderItemElement.select(".category_s1").get(i).select("b").text();
//                Log.d("jsoup", fodderName);//食材名称String fodderMany = fodderItemElement.select(".category_s2").get(i).text();
//                Log.d("jsoup", fodderMany);//食材计量}//食材工艺Elements fodderArtElement = document.getElementsByClass("recipeCategory_sub_R mt30 clear");int fodderArtSize = fodderArtElement.select(".category_s1").size();for (int i = 0; i < fodderArtSize; i++) {String fodderArtTitle = fodderItemElement.select(".category_s1").get(i).select("a").attr("title");
//                Log.d("jsoup", fodderArtTitle);String fodderArtDetail = fodderItemElement.select(".category_s2").get(i).text();
//                Log.d("jsoup", fodderArtDetail);}//步骤讲解Elements recipeStepElement = document.getElementsByClass("recipeStep_word");Elements recipeStepImgElement = document.getElementsByClass("recipeStep_img");int recipeStepSize = recipeStepElement.size();for (int i = 0; i < recipeStepSize; i++) {String recipeImg = recipeStepImgElement.get(i).select("img").attr("src");
//                Log.d("jsoup", recipeImg);//步骤图片String recipeStep = recipeStepElement.get(i).text();
//                Log.d("jsoup", recipeStep);//步骤说明}} catch (Exception e) {e.printStackTrace();}

这里数据获取需要一定的规则，简单来说相应的键对应着相应的值，也就是我们常说的键值对，如果没有键只有值我就直接的totext了。
剩下的在代码里面都有注释，也写的很详细
activity：

package com.fanyafeng.recreation.activity;import android.os.Bundle;
import android.os.Handler;
import android.os.Message;
import android.support.design.widget.FloatingActionButton;
import android.support.design.widget.Snackbar;
import android.support.v7.app.AppCompatActivity;
import android.support.v7.widget.GridLayoutManager;
import android.support.v7.widget.RecyclerView;
import android.support.v7.widget.Toolbar;
import android.util.Log;
import android.view.LayoutInflater;
import android.view.View;
import android.widget.LinearLayout;
import android.widget.TextView;import com.facebook.drawee.view.SimpleDraweeView;
import com.fanyafeng.recreation.R;
import com.fanyafeng.recreation.BaseActivity;
import com.fanyafeng.recreation.adapter.MenuDetailAdapter;
import com.fanyafeng.recreation.bean.FodderArtBean;
import com.fanyafeng.recreation.bean.FodderBean;
import com.fanyafeng.recreation.bean.MenuDetailBean;
import com.fanyafeng.recreation.fragment.ThreeFragment;
import com.fanyafeng.recreation.util.ControllerListenerUtil;
import com.fanyafeng.recreation.util.DpPxConvert;
import com.fanyafeng.recreation.util.MyUtils;import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.select.Elements;import java.util.ArrayList;
import java.util.List;//需要搭配Baseactivity，这里默认为Baseactivity,并且默认BaseActivity为包名的根目录
public class MenuDetailActivity extends BaseActivity {private String url;private String myTitle;private RecyclerView rvMenuDetail;private List<MenuDetailBean> menuDetailBeanList = new ArrayList<>();private MenuDetailAdapter menuDetailAdapter;private View headerView;private SimpleDraweeView sdvMenuDetailHeader;private LinearLayout layoutFodder;private LinearLayout layoutFodderArt;private TextView tvRVTitle;private List<FodderBean> fodderBeanList = new ArrayList<>();private List<FodderArtBean> fodderArtBeanList = new ArrayList<>();@Overrideprotected void onCreate(Bundle savedInstanceState) {super.onCreate(savedInstanceState);setContentView(R.layout.activity_menu_detail);//这里默认使用的是toolbar的左上角标题，如果需要使用的标题为中心的采用下方注释的代码，将此注释掉即可title = getString(R.string.title_activity_menu_detail);url = getIntent().getStringExtra("url");Log.d("jsoup", url);initView();
//        initData();Thread thread = new Thread(new LoadThread());thread.start();}//初始化UI控件private void initView() {rvMenuDetail = (RecyclerView) findViewById(R.id.rvMenuDetail);rvMenuDetail.setLayoutManager(new GridLayoutManager(this, 1, GridLayoutManager.VERTICAL, false));menuDetailAdapter = new MenuDetailAdapter(this, menuDetailBeanList);headerView = menuDetailAdapter.setHeaderView(R.layout.header_menu_detail_layout, rvMenuDetail);layoutFodder = (LinearLayout) headerView.findViewById(R.id.layoutFodder);layoutFodderArt = (LinearLayout) headerView.findViewById(R.id.layoutFodderArt);tvRVTitle = (TextView) headerView.findViewById(R.id.tvRVTitle);sdvMenuDetailHeader = (SimpleDraweeView) headerView.findViewById(R.id.sdvMenuDetailHeader);rvMenuDetail.setAdapter(menuDetailAdapter);}private void initData() {try {Document document = Jsoup.connect(url).get();//菜名Elements recipeDeImgBox = document.getElementsByClass("recipe_De_imgBox");myTitle = recipeDeImgBox.select("a").attr("title");Message titleMessage = Message.obtain();titleMessage.what = 1;handler.sendMessage(titleMessage);//            Log.d("jsoup", title);//顶部大图String imgUrl = recipeDeImgBox.select("a").select("img").attr("src");
//            Log.d("jsoup", imgUrl);Message headerImgUrlMessage = Message.obtain();headerImgUrlMessage.what = 2;headerImgUrlMessage.obj = imgUrl;handler.sendMessage(headerImgUrlMessage);//食材明细Elements fodderElement = document.getElementsByClass("mo mt20");
//            String fodderTitle = fodderElement.get(0).select("h3").text();
//            Log.d("jsoup", fodderTitle);//具体食材Elements fodderItemElement = document.getElementsByClass("recipeCategory_sub_R clear");int fodderSize = fodderItemElement.select(".category_s1").size();for (int i = 0; i < fodderSize; i++) {String fodderName = fodderItemElement.select(".category_s1").get(i).select("b").text();
//                Log.d("jsoup", fodderName);//食材名称String fodderMany = fodderItemElement.select(".category_s2").get(i).text();
//                Log.d("jsoup", fodderMany);//食材计量FodderBean fodderBean = new FodderBean();fodderBean.setFooderName(fodderName);fodderBean.setFooderMany(fodderMany);fodderBeanList.add(fodderBean);}
//            Log.d("jsoup", fodderBeanList.toString());int weight = fodderSize % 3 == 0 ? fodderSize / 3 : fodderSize / 3 + 1;for (int i = 0; i < weight; i++) {LinearLayout linearLayout = new LinearLayout(MenuDetailActivity.this);linearLayout.setOrientation(LinearLayout.HORIZONTAL);linearLayout.setWeightSum(3);for (int j = 0; j < 3; j++) {View view = LayoutInflater.from(MenuDetailActivity.this).inflate(R.layout.item_fodder_layout, null);LinearLayout.LayoutParams layoutParams = new LinearLayout.LayoutParams(LinearLayout.LayoutParams.MATCH_PARENT, LinearLayout.LayoutParams.WRAP_CONTENT);layoutParams.weight = 1f;if ((3 * i + j + 1) <= fodderSize) {FodderBean fodderBean = fodderBeanList.get(3 * i + j);TextView tvFodderTitle = (TextView) view.findViewById(R.id.tvFodderTitle);tvFodderTitle.setText(fodderBean.getFooderName());TextView tvFodderNum = (TextView) view.findViewById(R.id.tvFodderNum);tvFodderNum.setText(fodderBean.getFooderMany());}linearLayout.addView(view, layoutParams);}Message message3 = Message.obtain();message3.obj = linearLayout;message3.what = 3;handler.sendMessage(message3);
//                layoutFodder.addView(linearLayout);子线程加载太多控件更新ui}//食材工艺Elements fodderArtElement = document.getElementsByClass("recipeCategory_sub_R mt30 clear");int fodderArtSize = fodderArtElement.select(".category_s1").size();for (int i = 0; i < fodderArtSize; i++) {String fodderArtTitle = fodderArtElement.select(".category_s1").get(i).select("a").attr("title");Log.d("jsoup", fodderArtTitle);String fodderArtDetail = fodderArtElement.select(".category_s2").get(i).text();Log.d("jsoup", fodderArtDetail);FodderArtBean fodderArtBean = new FodderArtBean();fodderArtBean.setFodderArtTitle(fodderArtTitle);fodderArtBean.setFodderArtDetail(fodderArtDetail);fodderArtBeanList.add(fodderArtBean);}Log.d("jsoup", fodderArtBeanList.toString());int Aweight = fodderArtSize % 3 == 0 ? fodderArtSize / 3 : fodderArtSize / 3 + 1;for (int i = 0; i < Aweight; i++) {LinearLayout linearLayout = new LinearLayout(MenuDetailActivity.this);linearLayout.setOrientation(LinearLayout.HORIZONTAL);linearLayout.setWeightSum(3);for (int j = 0; j < 3; j++) {View view = LayoutInflater.from(MenuDetailActivity.this).inflate(R.layout.item_fodder_layout, null);LinearLayout.LayoutParams layoutParams = new LinearLayout.LayoutParams(LinearLayout.LayoutParams.MATCH_PARENT, LinearLayout.LayoutParams.WRAP_CONTENT);layoutParams.weight = 1f;if ((3 * i + j + 1) <= fodderArtSize) {FodderArtBean fodderArtBean = fodderArtBeanList.get(3 * i + j);TextView tvFodderTitle = (TextView) view.findViewById(R.id.tvFodderTitle);tvFodderTitle.setText(fodderArtBean.getFodderArtTitle());TextView tvFodderNum = (TextView) view.findViewById(R.id.tvFodderNum);tvFodderNum.setText(fodderArtBean.getFodderArtDetail());}linearLayout.addView(view, layoutParams);}Message message4 = Message.obtain();message4.obj = linearLayout;message4.what = 4;handler.sendMessage(message4);
//                layoutFodder.addView(linearLayout);子线程加载太多控件更新ui}//步骤讲解Elements recipeStepElement = document.getElementsByClass("recipeStep_word");Elements recipeStepImgElement = document.getElementsByClass("recipeStep_img");int recipeStepSize = recipeStepElement.size();for (int i = 0; i < recipeStepSize; i++) {String recipeImg = recipeStepImgElement.get(i).select("img").attr("src");
//                Log.d("jsoup", recipeImg);//步骤图片String recipeStep = recipeStepElement.get(i).text();
//                Log.d("jsoup", recipeStep);//步骤说明MenuDetailBean menuDetailBean = new MenuDetailBean();menuDetailBean.setMenuDetailImg(recipeImg);menuDetailBean.setMenuDetail(recipeStep);menuDetailBeanList.add(menuDetailBean);Message message = Message.obtain();message.what = 0;handler.sendMessage(message);}} catch (Exception e) {e.printStackTrace();}}class LoadThread implements Runnable {@Overridepublic void run() {initData();}}Handler handler = new Handler() {@Overridepublic void handleMessage(Message msg) {super.handleMessage(msg);switch (msg.what) {case 0:menuDetailAdapter.notifyDataSetChanged();break;case 1:toolbar.setTitle(myTitle);tvRVTitle.setText(myTitle);break;case 2:ControllerListenerUtil.setControllerListener(sdvMenuDetailHeader, (String) msg.obj,MyUtils.getScreenWidth(MenuDetailActivity.this));break;case 3:LinearLayout linearLayout = (LinearLayout) msg.obj;layoutFodder.addView(linearLayout);break;case 4:LinearLayout linearLayout1 = (LinearLayout) msg.obj;layoutFodderArt.addView(linearLayout1);break;}}};}

xml就是个列表没有刷新，就不上了

Android利用jsoup爬虫爬网页数据（二）相关推荐

Android利用jsoup爬虫爬网页数据（一）
效果图太大了,我放到github上了,想看效果的点击以下链接: 效果图一效果图二首先这个jsoup只能对html爬取数据,js里面的东西爬不到,暂时先只爬html的数据,这里先说明一下,博主仅仅出 ...
Android 通过okhttp + jsoup 爬虫爬取网页小说
Android 通过okhttp + jsoup 爬虫爬取网页小说效果图 1.准备工作测试地址:http://www.tlxs.net 第三方依赖: implementation 'com.squ ...
【用Java爬取网页图片——爬虫爬取数据】
用Java爬取网页图片--爬虫爬取数据 1.在创建项目中导入jsoup 2.创建一个保存下载图片的路径 3.使用URL读取网页路径,jsoup读取网页内容 4.利用属性标签获取图片连接块 5.因为该路 ...
小白必看、手把手教你利用爬虫爬网页
接下来从网络爬虫的概念.用处与价值和结构等三个方面,让大家对网络爬虫有一个基本的了解. 网络爬虫及其应用随着网络的迅速发展,万维网成为大量信息的载体,如何有效地提取并利用这些信息成为一个巨大的挑战, ...
爬虫爬取数据时，网页响应码返回404问题的解决方法
爬虫报404问题: 在进行爬虫爬取数据的过程中,使用语句: r = requests.get(url, timeout=60, headers=headers, stream=True) # prin ...
网络爬虫入门：网络爬虫的目的，企业获取数据的方式，可以用于做爬虫的程序语言，爬虫爬取数据的步骤
目录爬取数据的目的: 1.获取大量数据,用于做数据分析 2.公司项目的测试数据,公司业务所需数据企业获取数据的方式 1.公司自有数据 2.第三方数据平台购买(数据堂,贵阳大数据交易所) 3.爬虫爬 ...
采用python爬虫爬取数据然后采用echarts数据可视化分析
前言:采用python爬虫爬取天气数据然后采用echarts数据可视化画图分析未来天气变化趋势从获取数据到可视化的流程 (熟悉爬虫爬取数据然后数据可视化这个过程) 一.python爬取未来8-15天 ...
python Chrome + selenium自动化测试与python爬虫获取网页数据
一.使用Python+selenium+Chrome 报错: selenium.common.exceptions.SessionNotCreatedException: Message: sessi ...
【爬虫】利用Python爬虫爬取小麦苗itpub博客的所有文章的连接地址并写入Excel中（2）...
[爬虫]利用Python爬虫爬取小麦苗itpub博客的所有文章的连接地址并写入Excel中(2) 第一篇( http://blog.itpub.net/26736162/viewspace-22865 ...

Android利用jsoup爬虫爬网页数据（二）

Android利用jsoup爬虫爬网页数据（二）相关推荐

最新文章

热门文章