Skip to content

Commit 9da2e16

Browse files
committed
Updated readme
1 parent 3017da5 commit 9da2e16

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

README

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
PyCrawler is very simple to use. It takes 4 arguments:
2+
3+
1) database file name: The file that that will be used to store information as a sqlite database. If the filename given does not exist, it will be created.
4+
5+
2) start url: Crawlers need a place to start! This should be a valid url.
6+
ex. http://www.mysite.com/
7+
8+
3) crawl depth: This should be the number of pages deep the crawler should follow from the starting url before backing out.
9+
10+
4) verbose (optional): If you want PyCrawler to spit out the urls it is looking at, this should be "true" if it is missing, or has any other value, it will be ignored and considered false.

0 commit comments

Comments
 (0)