selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate elemen

selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {“method”:“xpath”,“selector”:".//div[contains(@class,“c-goods-item__market-price”)]/text()"}(Session info: chrome=99.0.4844.51)

抓取某购物网站页面内容，以“小皮鞋”字段为例，代码如图

from selenium import webdriver
import time,random
from pymongo import MongoClient
from selenium.common.exceptions import NoSuchElementExceptionclass Wp():def __init__(self):options = webdriver.ChromeOptions()options.add_argument('--disable-blink-features=AutomationControlled')self.browser = webdriver.Chrome(chrome_options=options)def base(self):# 访问网站self.browser.get('https://www.vip.com/')# 获取输入框input = self.browser.find_element_by_css_selector('div.c-search-form>input')time.sleep(2)# 发送参数input.send_keys('小皮鞋')# # 点击查询self.browser.find_element_by_css_selector('div.c-search-form>a').click()def spider(self):# 下拉翻页self.drop_down()time.sleep(0.5)# 定位数据区域li = self.browser.find_elements_by_xpath('//section[@id="J_searchCatList"]/div')for j in li:# 定位数据price = j.find_elements_by_xpath('.//div[contains(@class,"c-goods-item__sale-price")]/text()')oldprice = j.find_element_by_xpath('.//div[contains(@class,"c-goods-item__market-price")]/text()')discount = j.find_element_by_xpath('.//div[contains(@class,"c-goods-item__discount")]/text()')# 构造数据结构items = {'价钱':price.text,"原价": oldprice.text,"折扣":discount.text,}# 调用保存逻辑self.save_mongo(items)# 翻页self.page_next()def save_mongo(self,data):client = MongoClient()  # 建立连接col = client['python']['xx3']if isinstance(data, dict):res = col.insert_one(data)return reselse:return '单条数据必须是这种格式：{"name":"age"}，你传入的是%s' % type(data)def page_next(self):try:# 定位翻页next = self.browser.find_element_by_css_selector('a.cat-paging-next>i')if next:next.click()self.spider()else:self.browser.close()except Exception as e:print(e)def drop_down(self):for x in range(1, 10):j = x / 10js = f"document.documentElement.scrollTop = document.documentElement.scrollHeight * {j}"self.browser.execute_script(js)time.sleep(random.randint(600,1000)/1200)
if __name__ == '__main__':f = Wp()f.base()f.spider()

出现报错如图，不知道如何解决

selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {“method”:“xpath”,“selector”:".//div[contains(@class,“c-goods-item__market-price”)]/text()"}
(Session info: chrome=99.0.4844.51)
Stacktrace:
Backtrace:
Ordinal0 [0x00AB9943+2595139]
Ordinal0 [0x00A4C9F1+2148849]
Ordinal0 [0x00944528+1066280]
Ordinal0 [0x00970FD4+1249236]
Ordinal0 [0x009711CB+1249739]
Ordinal0 [0x009674F1+1209585]
Ordinal0 [0x0098BA34+1358388]
Ordinal0 [0x00967474+1209460]
Ordinal0 [0x0098BC04+1358852]
Ordinal0 [0x0099BAF2+1424114]
Ordinal0 [0x0098B806+1357830]
Ordinal0 [0x00966086+1204358]
Ordinal0 [0x00966F96+1208214]
GetHandleVerifier [0x00C5B232+1658114]
GetHandleVerifier [0x00D1312C+2411516]
GetHandleVerifier [0x00B4F261+560433]
GetHandleVerifier [0x00B4E366+556598]
Ordinal0 [0x00A5286B+2173035]
Ordinal0 [0x00A575F8+2192888]
Ordinal0 [0x00A576E5+2193125]
Ordinal0 [0x00A611FC+2232828]
BaseThreadInitThunk [0x7506FA29+25]
RtlGetAppContainerNamedObjectPath [0x771F7A9E+286]
RtlGetAppContainerNamedObjectPath [0x771F7A6E+238]

解决

进行数据定位的修改

内容数据定位同样进行修改更加具体

爬取结果—monogoDB库中保存