Welcome Fanqiu Chen from Using Python to Access Web Data
We provide two files for this assignment. One is a sample file where we give you the sum for your testing and the other is the actual data you need to process for the assignment.
Actual data: http://py4e-data.dr-chuck.net/comments_67329.html (Sum ends with 38)
You do not need to save these files to your folder since your program will read the data directly from the URL.
Note: Each student will have a distinct data url for the assignment - so only use your own data url for analysis.
The file is a table of names and comment counts. You can ignore most of the data in the file except for lines like the following:
You are to find all the <span> tags in the file and pull out the numbers from the tag and sum the numbers.
Look at the sample code provided. It shows how to find all of a certain kind of tag, loop through the tags and extract the various aspects of the tags.
# Retrieve all of the anchor tags tags = soup('a')
for tag in tags:
# Look at the parts of a tag print 'TAG:',tag
print 'URL:',tag.get('href', None) print 'Contents:',tag.contents print 'Attrs:',tag.attrs
You need to adjust this code to look for span tags and pull out the text content of the span tag, convert them to integers and add them up to complete the assignment.
$ python3 solution.py
Enter - http://py4e-data.dr-chuck.net/comments_42.html Count 50
Turning in the Assignment
Enter the sum from the actual data and your Python code below:
Sum: (ends with 38) Submit Assignment Python code: