README.md

Author: Yangzhedi

58tongcheng/channel_extact.py

@@ -1,5 +1,5 @@
 import time
-from page_parsing import url_list
+from tc_itemInfo import url_list
 
 while True:
     print url_list.find().count()

58tongcheng/count.py

@@ -1,6 +1,6 @@
 # coding:utf-8
 from multiprocessing import Pool
-from channel_extact import channel_list
+from tc_urlLists import channel_list
 from page_parsing import get_links_from
 
 def get_all_links_from(channel):

58tongcheng/main.py

@@ -1,9 +1,14 @@
 # pythonSpider
-some python spiders with BeautifulSoup
+some python spiders with BeautifulSoup & requests
 
-## [githubSpider](github)
-- 爬取关注或粉丝列表 [followXXXList](github/github_followXXXList.py)
-- 爬取用户个人信息 [userInfo](github/github_userInfo.py)
+## [github](github)
+- 爬取关注或粉丝列表 [followXXXList.py](github/github_followXXXList.py)
+- 爬取用户个人信息 [userInfo.py](github/github_userInfo.py)
 
-## 58同城Spider
+## [58同城](58tongcheng)
+- 获取所有的二级菜单列表 [tc_urlLists.py](58tongcheng/tc_urlLists.py)
+- 获取每一个url下的具体信息 [tc_itemInfo.py](58tongcheng/tc_itemInfo.py)
 
+## [豆瓣](douban)
+- 获取单个电影的短评 [douban_comment.py](douban/douban_comment.py)
+- 获取单个电影的所有大图海报 [douban_photosR.py](douban/douban_photosR.py)