这段python代码通过urllib2抓取网页,然后通过简单的正则表达式分析网页上的全部url地址
import urllib2 import re #connect to a URL website = urllib2.urlopen(url) #read html code html = website.read() #use re.findall to get all the links links = re.findall('"((http|ftp)s?://.*?)"', html) print links