Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 11, 2012

• fixed struct.error on http compression middleware. closes #87

  pablohoffman

  committed
  900bf08

  Copy full SHA for 900bf08

Commits on Feb 7, 2012

• ajax crawling wasn't expanding for unicode urls

  dangra

  committed
  acf69da

  Copy full SHA for acf69da

Commits on Jan 27, 2012

• Catch start_requests iterator errors. refs #83

  dangra

  committed
  2e18f0d

  Copy full SHA for 2e18f0d

Commits on Jan 25, 2012

• Merge branch 'issue82'

  dangra

  committed
  7201d07

  Copy full SHA for 7201d07

• Add some comments and references to github issues. closes #82

  dangra

  committed
  eb8e984

  Copy full SHA for eb8e984

• Allow overriding ClientContextFactory and enable SSL bug workarounds by default. refs #82

  dangra

  committed
  2840865

  Copy full SHA for 2840865

Commits on Jan 16, 2012

• Merge pull request #80 from kalessin/master

  Show description for a0f41f1
  pablohoffman

  committed
  a0f41f1

  Copy full SHA for a0f41f1

• some minor improvements in autothrottle code style

  kalessin

  committed
  1c6a5a9

  Copy full SHA for 1c6a5a9

• allow to set minimal download delay for autothrottle extension. also

  Show description for 59cf9d9
  kalessin

  committed
  59cf9d9

  Copy full SHA for 59cf9d9

• Merge pull request #79 from seriyps/master

  Show description for fc52d8d
  pablohoffman

  committed
  fc52d8d

  Copy full SHA for fc52d8d

Commits on Jan 14, 2012

• Speed-up libxml2 XPathSelector

  seriyps

  committed
  a6a2120

  Copy full SHA for a6a2120

Commits on Jan 13, 2012

• make scrapyd debian package dependent on the same (or higher) version of scrapy package

  pablohoffman

  committed
  85e2b49

  Copy full SHA for 85e2b49

Commits on Jan 12, 2012

• scrapyd: added Items link to completed jobs table

  pablohoffman

  committed
  2ee523b

  Copy full SHA for 2ee523b

• scrapyd: fixed issue with ubuntu package: /var/lib/scrapyd/items dir not being created by default

  pablohoffman

  committed
  8a45dd1

  Copy full SHA for 8a45dd1

Commits on Jan 5, 2012

• updated versioning doc according to recent changes

  pablohoffman

  committed
  ea77342

  Copy full SHA for ea77342

• scrapyd: added cancel.json and listjobs.json api methods to documentation

  pablohoffman

  committed
  0b0bce7

  Copy full SHA for 0b0bce7

• scrapyd: added clarification about how to disable items feeds generation

  pablohoffman

  committed
  8f42633

  Copy full SHA for 8f42633

Commits on Jan 4, 2012

• scrapyd: removed redundant .scrapy component from paths when using scrapyd in 'scrapy server' mode

  pablohoffman

  committed
  531fa95

  Copy full SHA for 531fa95

• scrapyd: added support for storing items by default

  Show description for dbda33e
  pablohoffman

  committed
  dbda33e

  Copy full SHA for dbda33e

• scrapyd: fixed documentation link

  pablohoffman

  committed
  0693694

  Copy full SHA for 0693694

• scrapyd: improved web interface to also show pending and finished jobs

  pablohoffman

  committed
  485bc18

  Copy full SHA for 485bc18

• scrapyd: added new cancel.json api to cancel pending/running jobs

  pablohoffman

  committed
  f07e968

  Copy full SHA for f07e968

Commits on Jan 3, 2012

• SitemapSpider: added support for sitemap urls ending in .xml and .xml.gz, even if they have a wrong content type

  pablohoffman

  committed
  10ed28b

  Copy full SHA for 10ed28b

Commits on Jan 2, 2012

• extras/makedeb.py: no longer obtaining version from git

  pablohoffman

  committed
  fb44f30

  Copy full SHA for fb44f30

• bumped version to 0.15.1, mainly to avoid package upgrade issues with new versioning based on git describe

  pablohoffman

  committed
  db92bc8

  Copy full SHA for db92bc8

• use git describe for building version from git, and removed support for building version from hg

  pablohoffman

  committed
  b6220b8

  Copy full SHA for b6220b8

Commits on Jan 1, 2012

• Merge pull request #75 from darkrho/httpcache-stats

  Show description for 1f87d7f
  pablohoffman

  committed
  1f87d7f

  Copy full SHA for 1f87d7f

Commits on Dec 31, 2011

• tests: fixed httpcache testcase.

  rmax

  committed
  93eb5b3

  Copy full SHA for 93eb5b3

• Merge pull request #74 from darkrho/httpcache-stats

  Show description for a36c869
  pablohoffman

  committed
  a36c869

  Copy full SHA for a36c869

Commits on Dec 30, 2011

• httpcache: don't store already cached response.

  rmax

  committed
  503fdf3

  Copy full SHA for 503fdf3

• httpcache: keep stats of cache hit/miss/store.

  rmax

  committed
  f2966ee

  Copy full SHA for f2966ee

Commits on Dec 28, 2011

• removed unused import

  pablohoffman

  committed
  9064188

  Copy full SHA for 9064188

• some some changes to scrapyd listjobs.json api:

  Show description for 150f82e
  pablohoffman

  committed
  150f82e

  Copy full SHA for 150f82e

• scrapyd.webservice: relocate ListJobs resource for better consistency

  pablohoffman

  committed
  1dfbe5d

  Copy full SHA for 1dfbe5d

Commits on Dec 27, 2011

• CrawlSpider: don't follow links from non-HTML responses

  pablohoffman

  committed
  f214c94

  Copy full SHA for f214c94

Pagination

Previous

Next