首页 > 编程 > Python > 正文

Python爬虫之正则表达式的使用教程详解

2020-01-04 14:14:29
字体:
来源:转载
供稿:网友

正则表达式的使用

re.match(pattern,string,flags=0)

re.match尝试从字符串的起始位置匹配一个模式,如果不是起始位置匹配成功的话,match()就返回none

参数介绍:

pattern:正则表达式

string:匹配的目标字符串

flags:匹配模式

正则表达式的匹配模式:

Python,爬虫,正则表达式

最常规的匹配

import recontent ='hello 123456 World_This is a Regex Demo'print(len(content))result = re.match('^hello/s/d{6}/s/w{10}.*Demo$$',content)print(result)print(result.group()) #返回匹配结果print(result.span()) #返回匹配结果的范围

结果运行如下:

39
<_sre.SRE_Match object; span=(0, 39), match='hello 123456 World_This is a Regex Demo'>
hello 123456 World_This is a Regex Demo
(0, 39)

泛匹配

使用(.*)匹配更多内容

import recontent ='hello 123456 World_This is a Regex Demo'result = re.match('^hello.*Demo$',content)print(result)print(result.group())

 

结果运行如下:

<_sre.SRE_Match object; span=(0, 39), match='hello 123456 World_This is a Regex Demo'>
hello 123456 World_This is a Regex Demo

匹配目标

在正则表达式中使用()将要获取的内容括起来

使用group(1)获取第一处,group(2)获取第二处,如此可以提取我们想要获取的内容

import recontent ='hello 123456 World_This is a Regex Demo'result = re.match('^hello/s(/d{6})/s.*Demo$',content)print(result)print(result.group(1))#获取匹配目标

结果运行如下:

<_sre.SRE_Match object; span=(0, 39), match='hello 123456 World_This is a Regex Demo'>
123456

贪婪匹配

import recontent ='hello 123456 World_This is a Regex Demo'result = re.match('^he.*(/d+).*Demo$',content)print(result)print(result.group(1))

注意:.*会尽可能的多匹配字符

非贪婪匹配

import recontent ='hello 123456 World_This is a Regex Demo'result = re.match('^he.*?(/d+).*Demo$',content)print(result)print(result.group(1)) 

注意:.*?会尽可能匹配少的字符

使用匹配模式

在解析HTML代码时会有换行,这时我们就要使用re.S

import recontent ='hello 123456 World_This ' /'is a Regex Demo'result = re.match('^he.*?(/d+).*?Demo$',content,re.S)print(result)print(result.group(1))

运行结果如下:

<_sre.SRE_Match object; span=(0, 39), match='hello 123456 World_This is a Regex Demo'>
123456

转义

在解析过程中遇到特殊字符,就需要做转义,比如下面的$符号。

import recontent = 'price is $5.00'result = re.match('^price.*/$5/.00',content)print(result.group())

总结:尽量使用泛匹配,使用括号得到匹配目标,尽量使用非贪婪模式,有换行就用re.S

re.search(pattern,string,flags=0)

re.search扫描整个字符串并返回第一个成功的匹配。

比如我想要提取字符串中的123456,使用match方法无法提取,只能使用search方法。

import recontent ='hello 123456 World_This is a Regex Demo'result = re.match('/d{6}',content)print(result)import recontent ='hello 123456 World_This is a Regex Demo'result = re.search('/d{6}',content)print(result)print(result.group())

运行结果如下:

<_sre.SRE_Match object; span=(6, 12), match='123456'>

匹配演练

可以匹配代码里结构相同的部分,这样可以返回你需要的内容

import recontent = '<a style="margin: 0px; padding: 0px; outline: none; line-height: 25.2px; font-size: 14px; width: 660px; overflow: hidden; clear: both; font-family: tahoma, arial, "Microsoft YaHei";">	
import rehtml ='''<li><a  print(result[count])  count+=1网络歌曲2009年中信出版社出版图书re.sub( pattern,repl,string,count,flags)

re.sub共有五个参数

三个必选参数 pattern,repl,string

两个可选参数count,flags

替换字符串中每一个匹配的字符串后替换后的字符串

import recontent = 'hello 123456 World_This is a Regex Demo'content = re.sub('/d+','',content)print(content)

运行结果如下:

hello  World_This is a Regex Demo
import re
content = 'hello 123456 World_This is a Regex Demo'
content = re.sub('/d+','what',content)
print(content)

运行结果如下:

hello what World_This is a Regex Demo
import re
content = 'hello 123456 World_This is a Regex Demo'
content = re.sub('(/d+)',r'/1 789',content)
print(content)

运行结果如下:

hello 123456 789 World_This is a Regex Demo

注意:这里/1代表前面匹配的123456

演练

在这里我们替换li标签

import rehtml ='''<li><a style="margin: 0px; padding: 0px; outline: none; line-height: 25.2px; font-size: 14px; width: 660px; overflow: hidden; clear: both; font-family: tahoma, arial, "Microsoft YaHei";">	
<a style="margin: 0px; padding: 0px; outline: none; line-height: 25.2px; font-size: 14px; width: 660px; overflow: hidden; clear: both; font-family: tahoma, arial, "Microsoft YaHei";">	
import recontent = 'hello 123456 ' /'World_This is a Regex Demo'pattern = re.compile('hello.*?Demo',re.S)result = re.match(pattern,content)print(result.group()) 

运行结果如下:

hello 123456 World_This is a Regex Demo

综合使用

import rehtml = '''<div class="slide-page" style="width: 700px;" data-index="1">    <a class="item" target="_blank" href="https://movie.douban.com/subject/26725678/?tag=热门&from=gaia">      <div class="cover-wp" data-isnew="false" data-id="26725678">        <img src="https://img1.doubanio.com/view/photo/s_ratio_poster/public/p2525020357.jpg"      </div>      <p>        解除好友2:暗网          <strong>7.9</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/26916229/?tag=热门&from=gaia_video">      <div class="cover-wp" data-isnew="false" data-id="26916229">        <img src="https://img1.doubanio.com/view/photo/s_ratio_poster/public/p2532008868.jpg"      </div>      <p>        镰仓物语          <strong>6.9</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/26683421/?tag=热门&from=gaia">      <div class="cover-wp" data-isnew="false" data-id="26683421">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2528281606.jpg"      </div>      <p>        特工          <strong>8.3</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/27072795/?tag=热门&from=gaia">      <div class="cover-wp" data-isnew="false" data-id="27072795">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2521583093.jpg"      </div>      <p>        幸福的拉扎罗          <strong>8.6</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/27201353/?tag=热门&from=gaia_video">      <div class="cover-wp" data-isnew="false" data-id="27201353">        <img src="https://img1.doubanio.com/view/photo/s_ratio_poster/public/p2528842218.jpg"      </div>      <p>        大师兄          <strong>5.2</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/30146756/?tag=热门&from=gaia_video">      <div class="cover-wp" data-isnew="false" data-id="30146756">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2530872223.jpg"      </div>      <p>        风语咒          <strong>6.9</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/26630714/?tag=热门&from=gaia">      <div class="cover-wp" data-isnew="false" data-id="26630714">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2530591543.jpg"      </div>      <p>        精灵旅社3:疯狂假期          <strong>6.8</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/25882296/?tag=热门&from=gaia_video">      <div class="cover-wp" data-isnew="false" data-id="25882296">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2526405034.jpg"      </div>      <p>        狄仁杰之四大天王          <strong>6.2</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/26804147/?tag=热门&from=gaia_video">      <div class="cover-wp" data-isnew="false" data-id="26804147">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2527484082.jpg"      </div>      <p>        摩天营救          <strong>6.4</strong>      </p>    </a>    <a class="item" target="_blank" href="https://movie.douban.com/subject/24773958/?tag=热门&from=gaia_video">      <div class="cover-wp" data-isnew="false" data-id="24773958">        <img src="https://img3.doubanio.com/view/photo/s_ratio_poster/public/p2517753454.jpg"      </div>      <p>        复仇者联盟3:无限战争          <strong>8.1</strong>      </p>    </a>  </div>'''count = 0for list in result:  print(result[count])  count+=1

运行结果如下:

('解除好友2:暗网', '7.9')
('镰仓物语', '6.9')
('特工', '8.3')
('幸福的拉扎罗', '8.6')
('大师兄', '5.2')
('风语咒', '6.9')
('精灵旅社3:疯狂假期', '6.8')
('狄仁杰之四大天王', '6.2')
('摩天营救', '6.4')
('复仇者联盟3:无限战争', '8.1')

总结

以上所述是小编给大家介绍的Python爬虫之正则表达式的使用教程,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对VEVB武林网网站的支持!


注:相关教程知识阅读请移步到python教程频道。
发表评论 共有条评论
用户名: 密码:
验证码: 匿名发表