获取网页链接,比正则表达式更灵活更大众化.

今天终于写好了不用正则表达式获取网页内需要的链接信息,比正则表达式更灵活,更大众化,通常正则表达式是写死的,正则表达式也不为普通使用者所熟知和使用,而我设计完成的方法,采用普通字符串,可以任意添加,灵活性强,且为大众所熟知.

下面用实例说明,下面是获取网址文件:

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=GB2312">
<title>中药材名称大全 - 中药查询</title>
<meta name="Keywords" content="中药材,药材,中药名,中药名称,药材名称" />
<meta name="Description" content="常用的中药材名称，冷门的中药材名称，你都可以在这里找到，你还可以按分类来寻找你需要的中药材，按中草药药用部位、拼音首字母及功效等，点击还可以查看药材图片..." />
<link href="http://www.zhongyoo.com/img/css/39base.css" rel="stylesheet" type="text/css">
<link href="http://www.zhongyoo.com/img/css/jbk_nav12_2.css" rel="stylesheet" type="text/css">
<link href="http://www.zhongyoo.com/img/css/jbk_style.css" rel="stylesheet" type="text/css">
<link href="http://www.zhongyoo.com/img/css/index.css" type="text/css" rel="stylesheet">
<link href="/img/css/on_new.css" type="text/css" rel="stylesheet">
<script language="javascript" type="text/javascript" src="http://www.zhongyoo.com/img/js/toptongji.js"></script>
<base target="_blank" />
</head>
.........
<div class="copyrightbox">
<div> <span> 本站所有内容均是来源于互联网、正规药学专著、杂志及文摘，内容如果有错误之处，也恳请批评指正。您如果转载本站内容请注明来源地址。</span> </div> <script>show_view_02();</script>
</div>
<div class="bottominfo" id="bottominfo" style="padding-top:10px;">
<hr style="width:970px;color:#bbb;" size="1">
<a href="http://www.zhongyoo.com/" title="中药">中药</a> | <a href="http://www.zhongyoo.com/sitemap.html" rel="nofollow">网站地图</a> | <a href="http://www.zhongyoo.com/name/" title="中药材名称大全">中药材名称大全</a> | <a href="javascript:myhomepage()" name="homepage" target="_self" rel="nofollow">设为首页</a> | <a href="javascript:addfavorite()" target="_self" rel="nofollow">加入收藏</a> | <a href="http://www.zhongyoo.com/adpage.html" rel="nofollow">广告合作</a><br>
Copyright © 2016　www.zhongyoo.com All Rights Reserved.　中药查询 京ICP备13004469号-1 <script language="javascript" type="text/javascript" src="http://www.zhongyoo.com/img/js/tongji.js"></script></div>
<script type="text/javascript" id='speedup_test' src="https://idm-su.baidu.com/su.js"></script>
</body>
</html>

需要获取"<a href="", """, "<option value='", "'>"之间网址信息:

<!DOCTYPE html PUBLIC
-//W3C//DTD XHTML 1.0 Transitional//ENhttp://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd
>
<html xmlns=
http://www.w3.org/1999/xhtml
>
<head>
<meta http-equiv=
Content-Typecontent=
text/html; charset=GB2312
>
<title>中药材名称大全 - 中药查询</title>
<meta name=
Keywordscontent=
中药材,药材,中药名,中药名称,药材名称/>
<meta name=
.........<div class=
new_zt_navi
>
http://www.zhongyoo.com/name/dengzhanxixin_1942.htmltitle=
灯盏细辛
>灯盏细辛</a>|http://www.zhongyoo.com/name/tujingpi_744.htmltitle=
土荆皮
>土荆皮</a>|http://www.zhongyoo.com/name/hailong_1763.htmltitle=
海龙
>海龙</a>|http://www.zhongyoo.com/name/langdu_3606.htmltitle=
狼毒
>狼毒</a>|http://www.zhongyoo.com/name/tufuling_90.htmltitle=
土茯苓
>土茯苓</a>|http://www.zhongyoo.com/name/anyeyou_4.htmltitle=
桉叶油
>桉叶油</a>|http://www.zhongyoo.com/name/dianqiecao_938.htmltitle=
颠茄草
>颠茄草</a>|http://www.zhongyoo.com/name/bailanhua_1284.htmltitle=
白兰花
>白兰花</a>|http://www.zhongyoo.com/name/muhudie_214.htmltitle=
木蝴蝶
>木蝴蝶</a>|http://www.zhongyoo.com/name/wumei_899.htmltitle=
乌梅
>乌梅</a>|http://www.zhongyoo.com/name/tianma_232.htmltitle=
天麻
>天麻</a>|http://www.zhongyoo.com/name/chixiaodou_31.htmltitle=
赤小豆
>赤小豆</a>|http://www.zhongyoo.com/name/yuzhouloulu_722.htmltitle=
禹州漏芦
>禹州漏芦</a>|http://www.zhongyoo.com/name/mingdangcan_915.htmltitle=
明党参
>明党参</a>|http://www.zhongyoo.com/name/mujinpi_5961.htmltitle=
木槿皮
>木槿皮</a>|http://www.zhongyoo.com/name/meiguihua_1125.htmltitle=
玫瑰花
>玫瑰花</a>|http://www.zhongyoo.com/name/chunpi_668.htmltitle=
椿皮
>椿皮</a>|http://www.zhongyoo.com/name/chansu_1856.htmltitle=
蟾酥
>蟾酥</a>|http://www.zhongyoo.com/name/anxixiang_147.htmltitle=
安息香
>安息香</a>|/name/rencan_797.htmltitle=
人参
>人参</a></div>
.........>加入收藏</a> |
http://www.zhongyoo.com/adpage.htmlrel=
nofollow
>广告合作</a><br>
Copyright © 2016　www.zhongyoo.com All Rights Reserved.　中药查询 京ICP备13004469号-1 <script language=
javascripttype=
text/javascriptsrc=
http://www.zhongyoo.com/img/js/tongji.js
></script></div>
<script type=
text/javascriptid='speedup_test' src=
https://idm-su.baidu.com/su.js
></script>
</body>
</html>

保留包含"http:", "page_"字符串的信息:

http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd
http://www.w3.org/1999/xhtml
http://www.zhongyoo.com/img/css/39base.css
http://www.zhongyoo.com/img/css/jbk_nav12_2.css
http://www.zhongyoo.com/img/css/jbk_style.css
http://www.zhongyoo.com/img/css/index.css
http://www.zhongyoo.com/img/js/toptongji.js
http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/tiquwu/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/yaoshan/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/wenda/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/name/dengzhanxixin_1942.html
http://www.zhongyoo.com/name/tujingpi_744.html
http://www.zhongyoo.com/name/hailong_1763.html
http://www.zhongyoo.com/name/langdu_3606.html
http://www.zhongyoo.com/name/tufuling_90.html
http://www.zhongyoo.com/name/anyeyou_4.html
http://www.zhongyoo.com/name/dianqiecao_938.html
http://www.zhongyoo.com/name/bailanhua_1284.html
http://www.zhongyoo.com/name/muhudie_214.html
http://www.zhongyoo.com/name/wumei_899.html
http://www.zhongyoo.com/name/tianma_232.html
http://www.zhongyoo.com/name/chixiaodou_31.html
http://www.zhongyoo.com/name/yuzhouloulu_722.html
http://www.zhongyoo.com/name/mingdangcan_915.html
http://www.zhongyoo.com/name/mujinpi_5961.html
http://www.zhongyoo.com/name/meiguihua_1125.html
http://www.zhongyoo.com/name/chunpi_668.html
http://www.zhongyoo.com/name/chansu_1856.html
http://www.zhongyoo.com/name/anxixiang_147.html
http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/meirong/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/pianfang/yangwei/
http://www.zhongyoo.com/shuji/
http://www.zhongyoo.com/gx/
http://www.zhongyoo.com/guijing/
http://www.zhongyoo.com/pinyin/
http://www.zhongyoo.com/yx/
http://www.zhongyoo.com/yw/
http://www.zhongyoo.com/bw/
http://www.zhongyoo.com/sousuo/
http://www.zhongyoo.com/gx/jiebiaoyao/
http://www.zhongyoo.com/gx/qingreyao/
http://www.zhongyoo.com/gx/qufengshiyao/
http://www.zhongyoo.com/gx/xiexiayao/
http://www.zhongyoo.com/gx/lishuishenshiyao/
http://www.zhongyoo.com/gx/zhixueyao/
http://www.zhongyoo.com/gx/huoxuehuayuyao/
http://www.zhongyoo.com/gx/huatanzhikepingchuanyao/
http://www.zhongyoo.com/gx/anshenyao/
http://www.zhongyoo.com/gx/pingganxifengyao/
http://www.zhongyoo.com/gx/buxuyao/
http://www.zhongyoo.com/gx/shouseyao/
http://www.zhongyoo.com/gx/yongtuyao/
http://www.zhongyoo.com/gx/shachongzhiyangyao/
http://www.zhongyoo.com/gx/badushengjiyao/
http://www.zhongyoo.com/gx/huashiyao/
http://www.zhongyoo.com/gx/quchongyao/
http://www.zhongyoo.com/gx/xiaoshiyao/
http://www.zhongyoo.com/gx/wenliyao/
http://www.zhongyoo.com/gx/kaiqiaoyao/
http://www.zhongyoo.com/gx/liqiyao/
]}};with(document)0[(getElementsByTagName('head')[0]||body).appendChild(createElement('script')).src='http://bdimg.share.baidu.com/static/api/js/share.js?v=89860593.js?cdnversion='+~(-new Date()/36e5)];</script></div></span></div>
.........
page_2.html
page_3.html
page_4.html
page_5.html
page_6.html
page_7.html
page_8.html
page_9.html
page_10.html
page_11.html
page_12.html
page_13.html
page_14.html
page_15.html
page_16.html
page_17.html
page_18.html
page_19.html
page_20.html
page_21.html
page_22.html
page_23.html
page_24.html
page_25.html
page_26.html
page_27.html
page_28.html
page_29.html
page_30.html
page_31.html
page_32.html
page_33.html
page_34.html
page_35.html
page_36.html
page_37.html
page_38.html
page_39.html
page_40.html
page_41.html
page_42.html

移出包含"img", "<a href=", "</option>", ".dtd", "www.w3.org"不需要的信息:

http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/tiquwu/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/yaoshan/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/wenda/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/name/dengzhanxixin_1942.html
http://www.zhongyoo.com/name/tujingpi_744.html
http://www.zhongyoo.com/name/hailong_1763.html
http://www.zhongyoo.com/name/langdu_3606.html
http://www.zhongyoo.com/name/tufuling_90.html
http://www.zhongyoo.com/name/anyeyou_4.html
http://www.zhongyoo.com/name/dianqiecao_938.html
http://www.zhongyoo.com/name/bailanhua_1284.html
http://www.zhongyoo.com/name/muhudie_214.html
http://www.zhongyoo.com/name/wumei_899.html
http://www.zhongyoo.com/name/tianma_232.html
http://www.zhongyoo.com/name/chixiaodou_31.html
http://www.zhongyoo.com/name/yuzhouloulu_722.html
http://www.zhongyoo.com/name/mingdangcan_915.html
http://www.zhongyoo.com/name/mujinpi_5961.html
http://www.zhongyoo.com/name/meiguihua_1125.html
http://www.zhongyoo.com/name/chunpi_668.html
http://www.zhongyoo.com/name/chansu_1856.html
http://www.zhongyoo.com/name/anxixiang_147.html
http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/meirong/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/pianfang/yangwei/
http://www.zhongyoo.com/shuji/
http://www.zhongyoo.com/gx/
http://www.zhongyoo.com/guijing/
http://www.zhongyoo.com/pinyin/
http://www.zhongyoo.com/yx/
http://www.zhongyoo.com/yw/
http://www.zhongyoo.com/bw/
http://www.zhongyoo.com/sousuo/
http://www.zhongyoo.com/gx/jiebiaoyao/
http://www.zhongyoo.com/gx/qingreyao/
http://www.zhongyoo.com/gx/qufengshiyao/
http://www.zhongyoo.com/gx/xiexiayao/
http://www.zhongyoo.com/gx/lishuishenshiyao/
http://www.zhongyoo.com/gx/zhixueyao/
http://www.zhongyoo.com/gx/huoxuehuayuyao/
http://www.zhongyoo.com/gx/huatanzhikepingchuanyao/
http://www.zhongyoo.com/gx/anshenyao/
http://www.zhongyoo.com/gx/pingganxifengyao/
http://www.zhongyoo.com/gx/buxuyao/
http://www.zhongyoo.com/gx/shouseyao/
http://www.zhongyoo.com/gx/yongtuyao/
http://www.zhongyoo.com/gx/shachongzhiyangyao/
http://www.zhongyoo.com/gx/badushengjiyao/
http://www.zhongyoo.com/gx/huashiyao/
http://www.zhongyoo.com/gx/quchongyao/
http://www.zhongyoo.com/gx/xiaoshiyao/
http://www.zhongyoo.com/gx/wenliyao/
http://www.zhongyoo.com/gx/kaiqiaoyao/
http://www.zhongyoo.com/gx/liqiyao/
http://www.zhongyoo.com/name/duzhong_182.html
http://www.zhongyoo.com/name/hongcan_12445.html
http://www.zhongyoo.com/name/shudihuang_3106.html
http://www.zhongyoo.com/name/binglang_26.html
http://www.zhongyoo.com/name/zhihuangchi_6352.html
http://www.zhongyoo.com/name/banxia_984.html
http://www.zhongyoo.com/name/zhigancao_3267.html
http://www.zhongyoo.com/name/tiannanxing_718.html
http://www.zhongyoo.com/name/zheshi_3493.html
http://www.zhongyoo.com/name/qingmengshi_2132.html
http://www.zhongyoo.com/name/cishi_1846.html
http://www.zhongyoo.com/name/huashi_3279.html
http://www.zhongyoo.com/name/hupo_1506.html
http://www.zhongyoo.com/name/liuhuang_1443.html
http://www.zhongyoo.com/name/xionghuang_1665.html
http://www.zhongyoo.com/name/yuyuliang_1452.html
http://www.zhongyoo.com/name/zhongrushi_2139.html
http://www.zhongyoo.com/name/luganshi_2138.html
http://www.zhongyoo.com/name/huaruishi_2136.html
http://www.zhongyoo.com/name/yangqishi_1470.html
http://www.zhongyoo.com/
http://www.zhongyoo.com/sitemap.html
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/adpage.html
page_2.html
page_3.html
page_4.html
page_5.html
page_6.html
page_7.html
page_8.html
page_9.html
page_10.html
page_11.html
page_12.html
page_13.html
page_14.html
page_15.html
page_16.html
page_17.html
page_18.html
page_19.html
page_20.html
page_21.html
page_22.html
page_23.html
page_24.html
page_25.html
page_26.html
page_27.html
page_28.html
page_29.html
page_30.html
page_31.html
page_32.html
page_33.html
page_34.html
page_35.html
page_36.html
page_37.html
page_38.html
page_39.html
page_40.html
page_41.html
page_42.html

之上已经获得了想要的链接信息,1.分割数据;2.保留数据;3.移出数据;分三步完成,且三步都使用字符串,字符串直接从该文件中复制获取任意需要的数量,这样的方法,比正则表达式更大众化和灵活.

实现代码中应用了固定数组连接函数:

        string[] 获取网址集合(string 数据, string[] 多字符分割, string[] 移出筛选, string[] 保留筛选){string[] 保留集合 = new string[] {  };foreach (string 选 in 保留筛选) 保留集合 = 保留集合.Concat(数据.Split(多字符分割, StringSplitOptions.RemoveEmptyEntries).Where(值 => 值.Contains(选))).ToArray();foreach (string 选 in 移出筛选) 保留集合 = 保留集合.Where(值 => !值.Contains(选)).ToArray();return 保留集合.Distinct().ToArray();}

获取网页链接,比正则表达式更灵活更大众化.相关推荐

批量采集html软件,在线批量获取网页链接工具浏览器插件版-♚付涛纪实阁♚
这两天在弄网站蜜蜂采集的时候,发现原来收藏的一个[在线批量获取网页链接工具]工具对应的网站已经不知道什么原因打不开了:在百度里面通过这个词去一搜索,一初搜索,看到百度结果里面拥有大量的匹配信息,但是经 ...
获取网页链接里的视频原件
此篇文章故事发生的背景是:某教师想要提取某公众号的视频资源作为教学文件,一开始这位老师的需求是将她自己录好的视频进行页面裁剪(如下图,将录的视频裁剪成只有视频区域),着实难到我了,后面仔细发现录的视频 ...
python获取网页链接地址
python3 # coding:utf-8 import re import requests # 获取网页内容 r = requests.get('http://www.baidu.com') d ...
如何批量获取网页中的下载链接
tips:下载 chrome json 正则表达式如何批量获取网页中的下载链接前言打开你要下载的网页二.获取网页的json数据 1.获取网页的源码 2.选取json 3.获取json字符串 4 ...
HDD杭州站•ArkUI让开发更灵活
原文:HDD杭州站•ArkUI让开发更灵活,点击链接查看更多技术内容. 7月15日的HUAWEI Developer Day(简称HDD)杭州站活动中,HarmonyOS技术专家分享了ArkUI的多款 ...
【论文解读】让特征感受野更灵活，腾讯优图提出非对称卡通人脸检测，推理速度仅50ms...
该文是腾讯优图&东南大学联合提出一种的非对称卡通人脸检测算法,该方法取得了2020 iCartoon Face Challenge(Under 200MB)竞赛的冠军,推理速度仅为50ms且无 ...
WebSocket的故事（六）—— Springboot中，实现更灵活的WebSocket
概述 WebSocket的故事系列计划分五大篇六章,旨在由浅入深的介绍WebSocket以及在Springboot中如何快速构建和使用WebSocket提供的能力.本系列计划包含如下几篇文章: 第一篇 ...
组合设计会更灵活，速度更快。
组合设计会更灵活,速度更快. 例如发送消息处理. 可以在发送函数里检验玩家是否在线.但是这样,如果发送函数被其它也需检测是否在线的函数调用的, 那么是否在线的函数可能就被调用多次,导致效率下降. 所 ...
【SQL开发实战技巧】系列（八）：聊聊如何插入数据时比约束更灵活的限制数据插入以及怎么一个insert语句同时插入多张表
系列文章目录 [SQL开发实战技巧]系列(一):关于SQL不得不说的那些事 [SQL开发实战技巧]系列(二):简单单表查询 [SQL开发实战技巧]系列(三):SQL排序的那些事 [SQL开发实战技巧] ...

获取网页链接,比正则表达式更灵活更大众化.

获取网页链接,比正则表达式更灵活更大众化.相关推荐

最新文章

热门文章