while doing some steps towards python with a parser i run into errors....
i get the following lines back
Code: Select all
import urllib from bs4 import BeautifulSoup import urlparse import mechanize # Set the startingpoint for the spider and initialize # the a mechanize browser object url = "http://sparkbrowser.com" br = mechanize.Browser() # create lists for the urls in que and visited urls urls = [url] visited = [url] # Since the amount of urls in the list is dynamic # we just let the spider go until some last url didn't # have new ones on the webpage while len(urls)>0: try: br.open(urls) urls.pop(0) for link in br.links(): newurl = urlparse.urljoin(link.base_url,link.url) #print newurl if newurl not in visited and url in newurl: visited.append(newurl) urls.append(newurl) print newurl except: print "error" urls.pop(0)
[email protected]:~/dev/python> python p1.py
Traceback (most recent call last):
File "p1.py", line 3, in <module>
from bs4 import BeautifulSoup
ImportError: No module named bs4
but wait - i have installed the bs4.
how to check if i set all atraigth?