Python 爬虫实战汽车某家(一) 品牌

文章目录

一、品牌爬取
- - 1、进入主页、测试待爬取内容是否为动态加载
  - 2、找到动态请求
  - 3、shell测试请求
- 附件：异步请求返回的品牌导航栏html

环境：
python3.6
scrapy1.5.1
采用scrapy创建项目，IDE为Pycharm

一、品牌爬取

1、进入主页、测试待爬取内容是否为动态加载

通过爬取产品库首页品牌列表爬取汽车品牌链接，产品库网址https://car.autohome.com.cn/，通过scrapy shell测试内容是否是动态加载的，动态加载的爬取不到

scrapy shell "https://car.autohome.com.cn/"

2、找到动态请求

shell访问后发现页面元素取不到，证明是动态加载，于是打开F12查看刷新页面，查看所有请求，挨个找到加载品牌列表的链接，发现是一个.net请求的品牌列表，返回html

https://car.autohome.com.cn/AsLeftMenu/As_LeftListNew.ashx?typeId=1%20&brandId=0%20&fctId=0%20&seriesId=0

3、shell测试请求

再次通过shell查看是否可以获取内容

scrapy shell "https://car.autohome.com.cn/AsLeftMenu/As_LeftListNew.ashx?typeId=1%20&brandId=0%20&fctId=0%20&seriesId=0"
In [2]: response.xpath("//h3")
Out[2]:
[<Selector xpath='//h3' data='<h3><a href="/price/brand-117.html"><i c'>,<Selector xpath='//h3' data='<h3><a href="/price/brand-276.html"><i c'>,<Selector xpath='//h3' data='<h3><a href="/price/brand-34.html"><i cl'>,<Selector xpath='//h3' data='<h3><a href="/price/brand-35.html"><i cl'>,<Selector xpath='//h3' data='<h3><a href="/price/brand-33.html"><i cl'>,

继续使用shell将提取所需的数据格式

In [17]: for i in a:...:     print(i.xpath("@href").extract_first()+","+i.xpath("text()").extrac...: t_first()+","+i.xpath("em/text()").extract_first().lstrip("(").rstrip("...: )"))/price/brand-117.html,AC Schnitzer,2
/price/brand-276.html,ALPINA,1
/price/brand-34.html,阿尔法·罗密欧,12
/price/brand-35.html,阿斯顿·马丁,74
/price/brand-33.html,奥迪,860
/price/brand-140.html,巴博斯,16
/price/brand-120.html,宝骏,180
/price/brand-15.html,宝马,918
/price/brand-231.html,宝沃,57
/price/brand-40.html,保时捷,234
/price/brand-27.html,北京,62
/price/brand-333.html,北京清行,2
/price/brand-79.html,北汽昌河,141

至此品牌爬取准备工作完成，开始编写爬取程序，并将爬取到的内容保存入库。
核心类代码：

#coding=utf-8import scrapy
from ..items import BrandItem
from ..mySqlUtils import MySqlUtilsclass QuotesSpider(scrapy.Spider):#爬虫名称name = "brandSpider"#构造图片链接头https = "https:%s"#构造品牌链接brandLinkModel="https://car.autohome.com.cn/price/brand-%s.html"# 定义数据库中已经爬取的品牌idbrandIdSet=set()# 爬取策略ruleId=1 # 1为只爬取有更新的 2为全部爬取全部更新#爬虫入口，请求品牌列表，爬取品牌数据def start_requests(self):# 查询已经存在于数据库中的品牌idres=MySqlUtils.queryBrandId()self.brandIdSet=MySqlUtils.parseBrandTupleListToBrandList(res)# self.log("===============================>")# self.log(res)urls = ["https://car.autohome.com.cn/AsLeftMenu/As_LeftListNew.ashx?typeId=1&brandId=0&fctId=0&seriesId=0"]for url in urls:yield scrapy.Request(url=url, callback=self.parse)#解析品牌数据def parse(self, response):# 提取数据body = response.xpath("//body")#brandSeriesLink = "https://car.autohome.com.cn/AsLeftMenu/As_LeftListNew.ashx?typeId=1&brandId=%s&fctId=0&seriesId=0" #爬取车系链接letter=""for item in body.xpath("*"):if item.xpath("name()").extract_first() == "div":letter = item.xpath("text()").extract_first()continueli = item.xpath("li")for liData in li:brandItem=BrandItem()href = liData.xpath("h3/a/@href").extract_first()brandId = href[href.find("-") + 1:href.find(".")]brandName = liData.xpath("h3/a/text()").extract_first()brandLink=self.brandLinkModel % brandIdbrandItem['pingpaiID']=brandIdbrandItem['szm']=letterbrandItem['name']=brandNamebrandItem['url']=brandLink#self.log(letter + "," + brandId + "," + brandName)# self.log("-------------------------------------->brandIdSet")# self.log(self.brandIdSet)# 如果数据库中已经存在该品牌ID则不进行爬取if self.ruleId == 1:if brandId in self.brandIdSet:continue# 接着爬取品牌图标request = scrapy.Request(url=brandLink, callback=self.parseBrandImg)request.meta['brandItem']=brandItemyield request#解析品牌图片logo的urldef parseBrandImg(self,response):brandItem=response.meta['brandItem']brandImgUrl=response.css(".carbradn-pic").xpath("img/@src").extract_first()brandItem['imgUrl']=self.https % brandImgUrl#brandItem=(brandItem[0],brandItem[1],brandItem[2],self.https+brandImgUrl) #https是类变量，在构造函数中的为成员变量，都可以通过self来调用，也可以通过对象实例来调用self.log(brandItem)#保存到数据库yield brandItem

附件：异步请求返回的品牌导航栏html

<html><head></head><body><div class="cartree-letter">A</div><ul><li id="b117"><h3><a href="/price/brand-117.html"><i class="icon10 icon10-sjr"></i>AC Schnitzer<em>(2)</em></a></h3></li><li id="b276"><h3><a href="/price/brand-276.html"><i class="icon10 icon10-sjr"></i>ALPINA<em>(1)</em></a></h3></li><li id="b34"><h3><a href="/price/brand-34.html"><i class="icon10 icon10-sjr"></i>阿尔法&middot;罗密欧<em>(12)</em></a></h3></li><li id="b35"><h3><a href="/price/brand-35.html"><i class="icon10 icon10-sjr"></i>阿斯顿&middot;马丁<em>(74)</em></a></h3></li><li id="b33"><h3><a href="/price/brand-33.html"><i class="icon10 icon10-sjr"></i>奥迪<em>(860)</em></a></h3></li></ul><div class="cartree-letter">B</div><ul><li id="b140"><h3><a href="/price/brand-140.html"><i class="icon10 icon10-sjr"></i>巴博斯<em>(16)</em></a></h3></li><li id="b120"><h3><a href="/price/brand-120.html"><i class="icon10 icon10-sjr"></i>宝骏<em>(180)</em></a></h3></li><li id="b15"><h3><a href="/price/brand-15.html"><i class="icon10 icon10-sjr"></i>宝马<em>(918)</em></a></h3></li><li id="b231"><h3><a href="/price/brand-231.html"><i class="icon10 icon10-sjr"></i>宝沃<em>(57)</em></a></h3></li><li id="b40"><h3><a href="/price/brand-40.html"><i class="icon10 icon10-sjr"></i>保时捷<em>(234)</em></a></h3></li><li id="b27"><h3><a href="/price/brand-27.html"><i class="icon10 icon10-sjr"></i>北京<em>(62)</em></a></h3></li><li id="b333"><h3><a href="/price/brand-333.html"><i class="icon10 icon10-sjr"></i>北京清行<em>(2)</em></a></h3></li><li id="b79"><h3><a href="/price/brand-79.html"><i class="icon10 icon10-sjr"></i>北汽昌河<em>(141)</em></a></h3></li><li id="b301"><h3><a href="/price/brand-301.html"><i class="icon10 icon10-sjr"></i>北汽道达<em>(3)</em></a></h3></li><li id="b203"><h3><a href="/price/brand-203.html"><i class="icon10 icon10-sjr"></i>北汽幻速<em>(98)</em></a></h3></li><li id="b173"><h3><a href="/price/brand-173.html"><i class="icon10 icon10-sjr"></i>北汽绅宝<em>(97)</em></a></h3></li><li id="b143"><h3><a href="/price/brand-143.html"><i class="icon10 icon10-sjr"></i>北汽威旺<em>(134)</em></a></h3></li><li id="b208"><h3><a href="/price/brand-208.html"><i class="icon10 icon10-sjr"></i>北汽新能源<em>(35)</em></a></h3></li><li id="b154"><h3><a href="/price/brand-154.html"><i class="icon10 icon10-sjr"></i>北汽制造<em>(107)</em></a></h3></li><li id="b36"><h3><a href="/price/brand-36.html"><i class="icon10 icon10-sjr"></i>奔驰<em>(896)</em></a></h3></li><li id="b95"><h3><a href="/price/brand-95.html"><i class="icon10 icon10-sjr"></i>奔腾<em>(217)</em></a></h3></li><li id="b14"><h3><a href="/price/brand-14.html"><i class="icon10 icon10-sjr"></i>本田<em>(483)</em></a></h3></li><li id="b271"><h3><a href="/price/brand-271.html"><i class="icon10 icon10-sjr"></i>比速汽车<em>(20)</em></a></h3></li><li id="b75"><h3><a href="/price/brand-75.html"><i class="icon10 icon10-sjr"></i>比亚迪<em>(452)</em></a></h3></li><li id="b13"><h3><a href="/price/brand-13.html"><i class="icon10 icon10-sjr"></i>标致<em>(413)</em></a></h3></li><li id="b38"><h3><a href="/price/brand-38.html"><i class="icon10 icon10-sjr"></i>别克<em>(448)</em></a></h3></li><li id="b39"><h3><a href="/price/brand-39.html"><i class="icon10 icon10-sjr"></i>宾利<em>(85)</em></a></h3></li><li id="b37"><h3><a href="/price/brand-37.html"><i class="icon10 icon10-sjr"></i>布加迪<em>(3)</em></a></h3></li></ul><div class="cartree-letter">C</div><ul><li id="b76"><h3><a href="/price/brand-76.html"><i class="icon10 icon10-sjr"></i>长安<em>(511)</em></a></h3></li><li id="b299"><h3><a href="/price/brand-299.html"><i class="icon10 icon10-sjr"></i>长安跨越<em>(22)</em></a></h3></li><li id="b163"><h3><a href="/price/brand-163.html"><i class="icon10 icon10-sjr"></i>长安欧尚<em>(176)</em></a></h3></li><li id="b294"><h3><a href="/price/brand-294.html"><i class="icon10 icon10-sjr"></i>长安轻型车<em>(232)</em></a></h3></li><li id="b77"><h3><a href="/price/brand-77.html"><i class="icon10 icon10-sjr"></i>长城<em>(371)</em></a></h3></li><li id="b196"><h3><a href="/price/brand-196.html"><i class="icon10 icon10-sjr"></i>成功汽车<em>(32)</em></a></h3></li></ul><div class="cartree-letter">D</div><ul><li id="b169"><h3><a href="/price/brand-169.html"><i class="icon10 icon10-sjr"></i>DS<em>(98)</em></a></h3></li><li id="b92"><h3><a href="/price/brand-92.html"><i class="icon10 icon10-sjr"></i>大发<em>(13)</em></a></h3></li><li id="b1"><h3><a href="/price/brand-1.html"><i class="icon10 icon10-sjr"></i>大众<em>(1524)</em></a></h3></li><li id="b41"><h3><a href="/price/brand-41.html"><i class="icon10 icon10-sjr"></i>道奇<em>(25)</em></a></h3></li><li id="b280"><h3><a href="/price/brand-280.html"><i class="icon10 icon10-sjr"></i>电咖<em>(5)</em></a></h3></li><li id="b32"><h3><a href="/price/brand-32.html"><i class="icon10 icon10-sjr"></i>东风<em>(327)</em></a></h3></li><li id="b187"><h3><a href="/price/brand-187.html"><i class="icon10 icon10-sjr"></i>东风风度<em>(21)</em></a></h3></li><li id="b259"><h3><a href="/price/brand-259.html"><i class="icon10 icon10-sjr"></i>东风风光<em>(89)</em></a></h3></li><li id="b113"><h3><a href="/price/brand-113.html"><i class="icon10 icon10-sjr"></i>东风风神<em>(172)</em></a></h3></li><li id="b165"><h3><a href="/price/brand-165.html"><i class="icon10 icon10-sjr"></i>东风风行<em>(483)</em></a></h3></li><li id="b326"><h3><a href="/price/brand-326.html"><i class="icon10 icon10-sjr"></i>东风瑞泰特<em>(1)</em></a></h3></li><li id="b142"><h3><a href="/price/brand-142.html"><i class="icon10 icon10-sjr"></i>东风小康<em>(123)</em></a></h3></li><li id="b81"><h3><a href="/price/brand-81.html"><i class="icon10 icon10-sjr"></i>东南<em>(250)</em></a></h3></li></ul><div class="cartree-letter">F</div><ul><li id="b42"><h3><a href="/price/brand-42.html"><i class="icon10 icon10-sjr"></i>法拉利<em>(25)</em></a></h3></li><li id="b11"><h3><a href="/price/brand-11.html"><i class="icon10 icon10-sjr"></i>菲亚特<em>(109)</em></a></h3></li><li id="b3"><h3><a href="/price/brand-3.html"><i class="icon10 icon10-sjr"></i>丰田<em>(839)</em></a></h3></li><li id="b141"><h3><a href="/price/brand-141.html"><i class="icon10 icon10-sjr"></i>福迪<em>(96)</em></a></h3></li><li id="b197"><h3><a href="/price/brand-197.html"><i class="icon10 icon10-sjr"></i>福汽启腾<em>(22)</em></a></h3></li><li id="b8"><h3><a href="/price/brand-8.html"><i class="icon10 icon10-sjr"></i>福特<em>(703)</em></a></h3></li><li id="b96"><h3><a href="/price/brand-96.html"><i class="icon10 icon10-sjr"></i>福田<em>(514)</em></a></h3></li><li id="b282"><h3><a href="/price/brand-282.html"><i class="icon10 icon10-sjr"></i>福田乘用车<em>(356)</em></a></h3></li></ul><div class="cartree-letter">G</div><ul><li id="b112"><h3><a href="/price/brand-112.html"><i class="icon10 icon10-sjr"></i>GMC<em>(105)</em></a></h3></li><li id="b152"><h3><a href="/price/brand-152.html"><i class="icon10 icon10-sjr"></i>观致<em>(96)</em></a></h3></li><li id="b116"><h3><a href="/price/brand-116.html"><i class="icon10 icon10-sjr"></i>光冈<em>(3)</em></a></h3></li><li id="b82"><h3><a href="/price/brand-82.html"><i class="icon10 icon10-sjr"></i>广汽传祺<em>(205)</em></a></h3></li><li id="b108"><h3><a href="/price/brand-108.html"><i class="icon10 icon10-sjr"></i>广汽吉奥<em>(162)</em></a></h3></li><li id="b329"><h3><a href="/price/brand-329.html"><i class="icon10 icon10-sjr"></i>广汽集团<em>(4)</em></a></h3></li><li id="b313"><h3><a href="/price/brand-313.html"><i class="icon10 icon10-sjr"></i>广汽新能源<em>(7)</em></a></h3></li><li id="b304"><h3><a href="/price/brand-304.html"><i class="icon10 icon10-sjr"></i>国金汽车<em>(7)</em></a></h3></li></ul><div class="cartree-letter">H</div><ul><li id="b24"><h3><a href="/price/brand-24.html"><i class="icon10 icon10-sjr"></i>哈飞<em>(75)</em></a></h3></li><li id="b181"><h3><a href="/price/brand-181.html"><i class="icon10 icon10-sjr"></i>哈弗<em>(565)</em></a></h3></li><li id="b150"><h3><a href="/price/brand-150.html"><i class="icon10 icon10-sjr"></i>海格<em>(59)</em></a></h3></li><li id="b86"><h3><a href="/price/brand-86.html"><i class="icon10 icon10-sjr"></i>海马<em>(420)</em></a></h3></li><li id="b267"><h3><a href="/price/brand-267.html"><i class="icon10 icon10-sjr"></i>汉腾汽车<em>(31)</em></a></h3></li><li id="b43"><h3><a href="/price/brand-43.html"><i class="icon10 icon10-sjr"></i>悍马<em>(5)</em></a></h3></li><li id="b164"><h3><a href="/price/brand-164.html"><i class="icon10 icon10-sjr"></i>恒天<em>(15)</em></a></h3></li><li id="b91"><h3><a href="/price/brand-91.html"><i class="icon10 icon10-sjr"></i>红旗<em>(33)</em></a></h3></li><li id="b336"><h3><a href="/price/brand-336.html"><i class="icon10 icon10-sjr"></i>红星汽车<em>(4)</em></a></h3></li><li id="b245"><h3><a href="/price/brand-245.html"><i class="icon10 icon10-sjr"></i>华凯<em>(16)</em></a></h3></li><li id="b85"><h3><a href="/price/brand-85.html"><i class="icon10 icon10-sjr"></i>华普<em>(41)</em></a></h3></li><li id="b184"><h3><a href="/price/brand-184.html"><i class="icon10 icon10-sjr"></i>华骐<em>(1)</em></a></h3></li><li id="b220"><h3><a href="/price/brand-220.html"><i class="icon10 icon10-sjr"></i>华颂<em>(7)</em></a></h3></li><li id="b87"><h3><a href="/price/brand-87.html"><i class="icon10 icon10-sjr"></i>华泰<em>(145)</em></a></h3></li><li id="b260"><h3><a href="/price/brand-260.html"><i class="icon10 icon10-sjr"></i>华泰新能源<em>(14)</em></a></h3></li><li id="b97"><h3><a href="/price/brand-97.html"><i class="icon10 icon10-sjr"></i>黄海<em>(215)</em></a></h3></li></ul><div class="cartree-letter">I</div><ul><li id="b188"><h3><a href="/price/brand-188.html"><i class="icon10 icon10-sjr"></i>Icona<em>(1)</em></a></h3></li></ul><div class="cartree-letter">J</div><ul><li id="b46"><h3><a href="/price/brand-46.html"><i class="icon10 icon10-sjr"></i>Jeep<em>(280)</em></a></h3></li><li id="b25"><h3><a href="/price/brand-25.html"><i class="icon10 icon10-sjr"></i>吉利汽车<em>(712)</em></a></h3></li><li id="b84"><h3><a href="/price/brand-84.html"><i class="icon10 icon10-sjr"></i>江淮<em>(760)</em></a></h3></li><li id="b119"><h3><a href="/price/brand-119.html"><i class="icon10 icon10-sjr"></i>江铃<em>(136)</em></a></h3></li><li id="b210"><h3><a href="/price/brand-210.html"><i class="icon10 icon10-sjr"></i>江铃集团轻汽<em>(261)</em></a></h3></li><li id="b270"><h3><a href="/price/brand-270.html"><i class="icon10 icon10-sjr"></i>江铃集团新能源<em>(17)</em></a></h3></li><li id="b44"><h3><a href="/price/brand-44.html"><i class="icon10 icon10-sjr"></i>捷豹<em>(200)</em></a></h3></li><li id="b319"><h3><a href="/price/brand-319.html"><i class="icon10 icon10-sjr"></i>捷途<em>(8)</em></a></h3></li><li id="b83"><h3><a href="/price/brand-83.html"><i class="icon10 icon10-sjr"></i>金杯<em>(547)</em></a></h3></li><li id="b145"><h3><a href="/price/brand-145.html"><i class="icon10 icon10-sjr"></i>金龙<em>(114)</em></a></h3></li><li id="b175"><h3><a href="/price/brand-175.html"><i class="icon10 icon10-sjr"></i>金旅<em>(14)</em></a></h3></li><li id="b151"><h3><a href="/price/brand-151.html"><i class="icon10 icon10-sjr"></i>九龙<em>(50)</em></a></h3></li><li id="b297"><h3><a href="/price/brand-297.html"><i class="icon10 icon10-sjr"></i>君马汽车<em>(42)</em></a></h3></li></ul><div class="cartree-letter">K</div><ul><li id="b109"><h3><a href="/price/brand-109.html"><i class="icon10 icon10-sjr"></i>KTM<em>(1)</em></a></h3></li><li id="b156"><h3><a href="/price/brand-156.html"><i class="icon10 icon10-sjr"></i>卡尔森<em>(4)</em></a></h3></li><li id="b224"><h3><a href="/price/brand-224.html"><i class="icon10 icon10-sjr"></i>卡升<em>(12)</em></a></h3></li><li id="b199"><h3><a href="/price/brand-199.html"><i class="icon10 icon10-sjr"></i>卡威<em>(64)</em></a></h3></li><li id="b101"><h3><a href="/price/brand-101.html"><i class="icon10 icon10-sjr"></i>开瑞<em>(195)</em></a></h3></li><li id="b47"><h3><a href="/price/brand-47.html"><i class="icon10 icon10-sjr"></i>凯迪拉克<em>(182)</em></a></h3></li><li id="b214"><h3><a href="/price/brand-214.html"><i class="icon10 icon10-sjr"></i>凯翼<em>(65)</em></a></h3></li><li id="b100"><h3><a href="/price/brand-100.html"><i class="icon10 icon10-sjr"></i>科尼赛克<em>(4)</em></a></h3></li><li id="b9"><h3><a href="/price/brand-9.html"><i class="icon10 icon10-sjr"></i>克莱斯勒<em>(32)</em></a></h3></li></ul><div class="cartree-letter">L</div><ul><li id="b335"><h3><a href="/price/brand-335.html"><i class="icon10 icon10-sjr"></i>LITE<em>(4)</em></a></h3></li><li id="b241"><h3><a href="/price/brand-241.html"><i class="icon10 icon10-sjr"></i>LOCAL MOTORS<em>(1)</em></a></h3></li><li id="b118"><h3><a href="/price/brand-118.html"><i class="icon10 icon10-sjr"></i>Lorinser<em>(11)</em></a></h3></li><li id="b48"><h3><a href="/price/brand-48.html"><i class="icon10 icon10-sjr"></i>兰博基尼<em>(32)</em></a></h3></li><li id="b54"><h3><a href="/price/brand-54.html"><i class="icon10 icon10-sjr"></i>劳斯莱斯<em>(27)</em></a></h3></li><li id="b52"><h3><a href="/price/brand-52.html"><i class="icon10 icon10-sjr"></i>雷克萨斯<em>(274)</em></a></h3></li><li id="b10"><h3><a href="/price/brand-10.html"><i class="icon10 icon10-sjr"></i>雷诺<em>(162)</em></a></h3></li><li id="b124"><h3><a href="/price/brand-124.html"><i class="icon10 icon10-sjr"></i>理念<em>(15)</em></a></h3></li><li id="b80"><h3><a href="/price/brand-80.html"><i class="icon10 icon10-sjr"></i>力帆汽车<em>(232)</em></a></h3></li><li id="b89"><h3><a href="/price/brand-89.html"><i class="icon10 icon10-sjr"></i>莲花汽车<em>(64)</em></a></h3></li><li id="b78"><h3><a href="/price/brand-78.html"><i class="icon10 icon10-sjr"></i>猎豹汽车<em>(176)</em></a></h3></li><li id="b51"><h3><a href="/price/brand-51.html"><i class="icon10 icon10-sjr"></i>林肯<em>(78)</em></a></h3></li><li id="b53"><h3><a href="/price/brand-53.html"><i class="icon10 icon10-sjr"></i>铃木<em>(446)</em></a></h3></li><li id="b318"><h3><a href="/price/brand-318.html"><i class="icon10 icon10-sjr"></i>零跑汽车<em>(1)</em></a></h3></li><li id="b279"><h3><a href="/price/brand-279.html"><i class="icon10 icon10-sjr"></i>领克<em>(18)</em></a></h3></li><li id="b204"><h3><a href="/price/brand-204.html"><i class="icon10 icon10-sjr"></i>陆地方舟<em>(10)</em></a></h3></li><li id="b88"><h3><a href="/price/brand-88.html"><i class="icon10 icon10-sjr"></i>陆风<em>(207)</em></a></h3></li><li id="b49"><h3><a href="/price/brand-49.html"><i class="icon10 icon10-sjr"></i>路虎<em>(280)</em></a></h3></li><li id="b50"><h3><a href="/price/brand-50.html"><i class="icon10 icon10-sjr"></i>路特斯<em>(14)</em></a></h3></li></ul><div class="cartree-letter">M</div><ul><li id="b56"><h3><a href="/price/brand-56.html"><i class="icon10 icon10-sjr"></i>MINI<em>(195)</em></a></h3></li><li id="b58"><h3><a href="/price/brand-58.html"><i class="icon10 icon10-sjr"></i>马自达<em>(277)</em></a></h3></li><li id="b57"><h3><a href="/price/brand-57.html"><i class="icon10 icon10-sjr"></i>玛莎拉蒂<em>(57)</em></a></h3></li><li id="b55"><h3><a href="/price/brand-55.html"><i class="icon10 icon10-sjr"></i>迈巴赫<em>(4)</em></a></h3></li><li id="b129"><h3><a href="/price/brand-129.html"><i class="icon10 icon10-sjr"></i>迈凯伦<em>(21)</em></a></h3></li><li id="b20"><h3><a href="/price/brand-20.html"><i class="icon10 icon10-sjr"></i>名爵<em>(213)</em></a></h3></li><li id="b168"><h3><a href="/price/brand-168.html"><i class="icon10 icon10-sjr"></i>摩根<em>(13)</em></a></h3></li></ul><div class="cartree-letter">N</div><ul><li id="b130"><h3><a href="/price/brand-130.html"><i class="icon10 icon10-sjr"></i>纳智捷<em>(117)</em></a></h3></li><li id="b213"><h3><a href="/price/brand-213.html"><i class="icon10 icon10-sjr"></i>南京金龙<em>(25)</em></a></h3></li></ul><div class="cartree-letter">O</div><ul><li id="b60"><h3><a href="/price/brand-60.html"><i class="icon10 icon10-sjr"></i>讴歌<em>(53)</em></a></h3></li><li id="b59"><h3><a href="/price/brand-59.html"><i class="icon10 icon10-sjr"></i>欧宝<em>(48)</em></a></h3></li><li id="b146"><h3><a href="/price/brand-146.html"><i class="icon10 icon10-sjr"></i>欧朗<em>(10)</em></a></h3></li><li id="b332"><h3><a href="/price/brand-332.html"><i class="icon10 icon10-sjr"></i>欧尚汽车<em>(4)</em></a></h3></li></ul><div class="cartree-letter">P</div><ul><li id="b308"><h3><a href="/price/brand-308.html"><i class="icon10 icon10-sjr"></i>Polestar<em>(1)</em></a></h3></li><li id="b61"><h3><a href="/price/brand-61.html"><i class="icon10 icon10-sjr"></i>帕加尼<em>(1)</em></a></h3></li></ul><div class="cartree-letter">Q</div><ul><li id="b26"><h3><a href="/price/brand-26.html"><i class="icon10 icon10-sjr"></i>奇瑞<em>(675)</em></a></h3></li><li id="b122"><h3><a href="/price/brand-122.html"><i class="icon10 icon10-sjr"></i>启辰<em>(113)</em></a></h3></li><li id="b62"><h3><a href="/price/brand-62.html"><i class="icon10 icon10-sjr"></i>起亚<em>(672)</em></a></h3></li><li id="b235"><h3><a href="/price/brand-235.html"><i class="icon10 icon10-sjr"></i>前途<em>(1)</em></a></h3></li><li id="b222"><h3><a href="/price/brand-222.html"><i class="icon10 icon10-sjr"></i>乔治&middot;巴顿<em>(3)</em></a></h3></li><li id="b312"><h3><a href="/price/brand-312.html"><i class="icon10 icon10-sjr"></i>庆铃汽车<em>(5)</em></a></h3></li><li id="b219"><h3><a href="/price/brand-219.html"><i class="icon10 icon10-sjr"></i>全球鹰<em>(10)</em></a></h3></li></ul><div class="cartree-letter">R</div><ul><li id="b63"><h3><a href="/price/brand-63.html"><i class="icon10 icon10-sjr"></i>日产<em>(624)</em></a></h3></li><li id="b19"><h3><a href="/price/brand-19.html"><i class="icon10 icon10-sjr"></i>荣威<em>(245)</em></a></h3></li><li id="b337"><h3><a href="/price/brand-337.html"><i class="icon10 icon10-sjr"></i>容大智造<em>(2)</em></a></h3></li><li id="b174"><h3><a href="/price/brand-174.html"><i class="icon10 icon10-sjr"></i>如虎<em>(2)</em></a></h3></li><li id="b296"><h3><a href="/price/brand-296.html"><i class="icon10 icon10-sjr"></i>瑞驰新能源<em>(2)</em></a></h3></li><li id="b103"><h3><a href="/price/brand-103.html"><i class="icon10 icon10-sjr"></i>瑞麒<em>(50)</em></a></h3></li></ul><div class="cartree-letter">S</div><ul><li id="b45"><h3><a href="/price/brand-45.html"><i class="icon10 icon10-sjr"></i>smart<em>(104)</em></a></h3></li><li id="b269"><h3><a href="/price/brand-269.html"><i class="icon10 icon10-sjr"></i>SWM斯威汽车<em>(49)</em></a></h3></li><li id="b64"><h3><a href="/price/brand-64.html"><i class="icon10 icon10-sjr"></i>萨博<em>(15)</em></a></h3></li><li id="b205"><h3><a href="/price/brand-205.html"><i class="icon10 icon10-sjr"></i>赛麟<em>(14)</em></a></h3></li><li id="b68"><h3><a href="/price/brand-68.html"><i class="icon10 icon10-sjr"></i>三菱<em>(318)</em></a></h3></li><li id="b149"><h3><a href="/price/brand-149.html"><i class="icon10 icon10-sjr"></i>陕汽通家<em>(26)</em></a></h3></li><li id="b155"><h3><a href="/price/brand-155.html"><i class="icon10 icon10-sjr"></i>上汽大通<em>(438)</em></a></h3></li><li id="b66"><h3><a href="/price/brand-66.html"><i class="icon10 icon10-sjr"></i>世爵<em>(1)</em></a></h3></li><li id="b90"><h3><a href="/price/brand-90.html"><i class="icon10 icon10-sjr"></i>双环<em>(82)</em></a></h3></li><li id="b69"><h3><a href="/price/brand-69.html"><i class="icon10 icon10-sjr"></i>双龙<em>(139)</em></a></h3></li><li id="b162"><h3><a href="/price/brand-162.html"><i class="icon10 icon10-sjr"></i>思铭<em>(5)</em></a></h3></li><li id="b65"><h3><a href="/price/brand-65.html"><i class="icon10 icon10-sjr"></i>斯巴鲁<em>(246)</em></a></h3></li><li id="b238"><h3><a href="/price/brand-238.html"><i class="icon10 icon10-sjr"></i>斯达泰克<em>(13)</em></a></h3></li><li id="b67"><h3><a href="/price/brand-67.html"><i class="icon10 icon10-sjr"></i>斯柯达<em>(352)</em></a></h3></li></ul><div class="cartree-letter">T</div><ul><li id="b202"><h3><a href="/price/brand-202.html"><i class="icon10 icon10-sjr"></i>泰卡特<em>(7)</em></a></h3></li><li id="b133"><h3><a href="/price/brand-133.html"><i class="icon10 icon10-sjr"></i>特斯拉<em>(36)</em></a></h3></li><li id="b161"><h3><a href="/price/brand-161.html"><i class="icon10 icon10-sjr"></i>腾势<em>(7)</em></a></h3></li></ul><div class="cartree-letter">W</div><ul><li id="b283"><h3><a href="/price/brand-283.html"><i class="icon10 icon10-sjr"></i>WEY<em>(11)</em></a></h3></li><li id="b102"><h3><a href="/price/brand-102.html"><i class="icon10 icon10-sjr"></i>威麟<em>(36)</em></a></h3></li><li id="b291"><h3><a href="/price/brand-291.html"><i class="icon10 icon10-sjr"></i>威马汽车<em>(8)</em></a></h3></li><li id="b99"><h3><a href="/price/brand-99.html"><i class="icon10 icon10-sjr"></i>威兹曼<em>(7)</em></a></h3></li><li id="b192"><h3><a href="/price/brand-192.html"><i class="icon10 icon10-sjr"></i>潍柴英致<em>(40)</em></a></h3></li><li id="b284"><h3><a href="/price/brand-284.html"><i class="icon10 icon10-sjr"></i>蔚来<em>(3)</em></a></h3></li><li id="b70"><h3><a href="/price/brand-70.html"><i class="icon10 icon10-sjr"></i>沃尔沃<em>(401)</em></a></h3></li><li id="b114"><h3><a href="/price/brand-114.html"><i class="icon10 icon10-sjr"></i>五菱汽车<em>(127)</em></a></h3></li><li id="b167"><h3><a href="/price/brand-167.html"><i class="icon10 icon10-sjr"></i>五十铃<em>(129)</em></a></h3></li></ul><div class="cartree-letter">X</div><ul><li id="b98"><h3><a href="/price/brand-98.html"><i class="icon10 icon10-sjr"></i>西雅特<em>(13)</em></a></h3></li><li id="b12"><h3><a href="/price/brand-12.html"><i class="icon10 icon10-sjr"></i>现代<em>(643)</em></a></h3></li><li id="b275"><h3><a href="/price/brand-275.html"><i class="icon10 icon10-sjr"></i>小鹏汽车<em>(2)</em></a></h3></li><li id="b185"><h3><a href="/price/brand-185.html"><i class="icon10 icon10-sjr"></i>新凯<em>(8)</em></a></h3></li><li id="b324"><h3><a href="/price/brand-324.html"><i class="icon10 icon10-sjr"></i>新特汽车<em>(2)</em></a></h3></li><li id="b306"><h3><a href="/price/brand-306.html"><i class="icon10 icon10-sjr"></i>鑫源<em>(17)</em></a></h3></li><li id="b71"><h3><a href="/price/brand-71.html"><i class="icon10 icon10-sjr"></i>雪佛兰<em>(421)</em></a></h3></li><li id="b72"><h3><a href="/price/brand-72.html"><i class="icon10 icon10-sjr"></i>雪铁龙<em>(422)</em></a></h3></li></ul><div class="cartree-letter">Y</div><ul><li id="b111"><h3><a href="/price/brand-111.html"><i class="icon10 icon10-sjr"></i>野马汽车<em>(66)</em></a></h3></li><li id="b110"><h3><a href="/price/brand-110.html"><i class="icon10 icon10-sjr"></i>一汽<em>(335)</em></a></h3></li><li id="b144"><h3><a href="/price/brand-144.html"><i class="icon10 icon10-sjr"></i>依维柯<em>(149)</em></a></h3></li><li id="b73"><h3><a href="/price/brand-73.html"><i class="icon10 icon10-sjr"></i>英菲尼迪<em>(171)</em></a></h3></li><li id="b93"><h3><a href="/price/brand-93.html"><i class="icon10 icon10-sjr"></i>永源<em>(82)</em></a></h3></li><li id="b298"><h3><a href="/price/brand-298.html"><i class="icon10 icon10-sjr"></i>宇通客车<em>(6)</em></a></h3></li><li id="b263"><h3><a href="/price/brand-263.html"><i class="icon10 icon10-sjr"></i>驭胜<em>(87)</em></a></h3></li><li id="b232"><h3><a href="/price/brand-232.html"><i class="icon10 icon10-sjr"></i>御捷<em>(3)</em></a></h3></li><li id="b307"><h3><a href="/price/brand-307.html"><i class="icon10 icon10-sjr"></i>裕路<em>(2)</em></a></h3></li><li id="b286"><h3><a href="/price/brand-286.html"><i class="icon10 icon10-sjr"></i>云度<em>(15)</em></a></h3></li><li id="b317"><h3><a href="/price/brand-317.html"><i class="icon10 icon10-sjr"></i>云雀汽车<em>(4)</em></a></h3></li></ul><div class="cartree-letter">Z</div><ul><li id="b182"><h3><a href="/price/brand-182.html"><i class="icon10 icon10-sjr"></i>之诺<em>(2)</em></a></h3></li><li id="b206"><h3><a href="/price/brand-206.html"><i class="icon10 icon10-sjr"></i>知豆<em>(14)</em></a></h3></li><li id="b22"><h3><a href="/price/brand-22.html"><i class="icon10 icon10-sjr"></i>中华<em>(287)</em></a></h3></li><li id="b74"><h3><a href="/price/brand-74.html"><i class="icon10 icon10-sjr"></i>中兴<em>(169)</em></a></h3></li><li id="b94"><h3><a href="/price/brand-94.html"><i class="icon10 icon10-sjr"></i>众泰<em>(416)</em></a></h3></li></ul></body>
</html>

Python 爬虫实战汽车某家(一) 品牌相关推荐

Python 爬虫实战汽车某家(四) 车型配置
文章目录一.工具选择二.demo示例三.完整代码前言:汽车之家车型配置数据是js加载+js动态伪元素防爬加载,原始页面中不存在任何数据,因此通过scrapy显式爬取已经不太可能,通过查阅大量资 ...
Python 爬虫实战汽车某家(五) 口碑、评分
文章目录一.项目结构二.核心类代码爬取内容 1.用户口碑明细评分 2.口碑标题.发表日期.口碑推荐级别 3.购车目的 4.购车价格 5.购车经销商一.项目结构 point.txt 为断点保存文 ...
Python 爬虫实战汽车某家(三) 车型
文章目录一.爬取逻辑分析核心二.爬取页面销售状态分析三.爬取页面车型列表分析四.停售分页分析五.指导价和评分爬取 1.指导价html片段 2.有评分html片段 3.无评分html片段一 ...
python爬虫之汽车之家论坛帖子内容爬取
Datawhale爬虫第五期 Day7 实战项目:汽车之家车型论坛帖子信息作为国内目前第一大汽车论坛,反爬虫很恶心,中间很多坑. 新手,第一次搞这么复杂的爬虫,前期没有排查,都是遇到坑的时候再返回 ...
python爬虫进阶-汽车之家贴吧信息（字体反爬-动态映射）
目的获取汽车之家贴吧的内容信息详细需求汽车之家贴吧思路解析一.F12获取目标信息-进行分析二.字体反爬解析-根据上一篇的文章,直接搜索关键词就好三根据其后的链接,保存为ttf在本地,查 ...
python爬取汽车之家_python爬虫实战之爬取汽车之家网站上的图片
随着生活水平的提高和快节奏生活的发展.汽车开始慢慢成为人们的必需品,浏览各种汽车网站便成为购买合适.喜欢车辆的前提.例如汽车之家网站中就有最新的报价和图片以及汽车的相关内容,是提供信息最快最全的中国汽 ...
python爬虫（二十四）爬取汽车之家某品牌图片
爬取汽车之家某品牌图片需求爬取汽车之家某品牌的汽车图片目标url https://car.autohome.com.cn/photolist/series/52880/6957393.html# ...
Python爬虫实战爬取租房网站2w+数据-链家上海区域信息（超详细）
Python爬虫实战爬取租房网站-链家上海区域信息(过程超详细) 内容可能有点啰嗦大佬们请见谅后面会贴代码带火们有需求的话就用吧正好这几天做的实验报告就直接拿过来了,我想后面应该会有人用的到吧 ...
python爬虫项目-32个Python爬虫实战项目，满足你的项目慌
原标题:32个Python爬虫实战项目,满足你的项目慌爬虫项目名称及简介一些项目名称涉及企业名词,小编用拼写代替 1.[WechatSogou]- weixin公众号爬虫.基于weixin公众号爬 ...

Python 爬虫实战汽车某家(一) 品牌

文章目录

一、品牌爬取

1、进入主页、测试待爬取内容是否为动态加载

2、找到动态请求

3、shell测试请求

附件：异步请求返回的品牌导航栏html

Python 爬虫实战汽车某家(一) 品牌相关推荐

最新文章

热门文章

Python 爬虫实战 汽车某家(一) 品牌

文章目录

一、品牌爬取

1、进入主页、测试待爬取内容是否为动态加载

2、找到动态请求

3、shell测试请求

附件：异步请求返回的品牌导航栏html

Python 爬虫实战 汽车某家(一) 品牌相关推荐

最新文章

热门文章

Python 爬虫实战汽车某家(一) 品牌

Python 爬虫实战汽车某家(一) 品牌相关推荐