Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 3, 2012

• SitemapSpider: added support for sitemap urls ending in .xml and .xml.gz, even if they have a wrong content type

  pablohoffman

  committed
  10ed28b

  Copy full SHA for 10ed28b

Commits on Jan 2, 2012

• extras/makedeb.py: no longer obtaining version from git

  pablohoffman

  committed
  fb44f30

  Copy full SHA for fb44f30

• bumped version to 0.15.1, mainly to avoid package upgrade issues with new versioning based on git describe

  pablohoffman

  committed
  db92bc8

  Copy full SHA for db92bc8

• use git describe for building version from git, and removed support for building version from hg

  pablohoffman

  committed
  b6220b8

  Copy full SHA for b6220b8

Commits on Jan 1, 2012

• Merge pull request #75 from darkrho/httpcache-stats

  Show description for 1f87d7f
  pablohoffman

  committed
  1f87d7f

  Copy full SHA for 1f87d7f

Commits on Dec 31, 2011

• tests: fixed httpcache testcase.

  rmax

  committed
  93eb5b3

  Copy full SHA for 93eb5b3

• Merge pull request #74 from darkrho/httpcache-stats

  Show description for a36c869
  pablohoffman

  committed
  a36c869

  Copy full SHA for a36c869

Commits on Dec 30, 2011

• httpcache: don't store already cached response.

  rmax

  committed
  503fdf3

  Copy full SHA for 503fdf3

• httpcache: keep stats of cache hit/miss/store.

  rmax

  committed
  f2966ee

  Copy full SHA for f2966ee

Commits on Dec 28, 2011

• removed unused import

  pablohoffman

  committed
  9064188

  Copy full SHA for 9064188

• some some changes to scrapyd listjobs.json api:

  Show description for 150f82e
  pablohoffman

  committed
  150f82e

  Copy full SHA for 150f82e

• scrapyd.webservice: relocate ListJobs resource for better consistency

  pablohoffman

  committed
  1dfbe5d

  Copy full SHA for 1dfbe5d

Commits on Dec 27, 2011

• CrawlSpider: don't follow links from non-HTML responses

  pablohoffman

  committed
  f214c94

  Copy full SHA for f214c94

Commits on Dec 23, 2011

• Merge pull request #48 from simonratner/delete-logs-by-mtime

  Show description for bda9c97
  pablohoffman

  committed
  bda9c97

  Copy full SHA for bda9c97

• fixed reference to tutorial directory

  pablohoffman

  committed
  0be421f

  Copy full SHA for 0be421f

• doc: removed duplicated callback argument from Request.replace()

  pablohoffman

  committed
  41fd3c4

  Copy full SHA for 41fd3c4

Commits on Dec 20, 2011

• fixed formatting of scrapyd doc

  pablohoffman

  committed
  0eeff76

  Copy full SHA for 0eeff76

Commits on Dec 15, 2011

• Dump stacks for all running threads and fix engine status dumped by StackTraceDump extension

  dangra

  committed
  64ba6e7

  Copy full SHA for 64ba6e7

• added comment about why we disable ssl on boto images upload

  pablohoffman

  committed
  023232f

  Copy full SHA for 023232f

Commits on Dec 14, 2011

• Merge branch '0.14'

  dangra

  committed
  aea060e

  Copy full SHA for aea060e

• SSL handshaking hangs when doing too many parallel connections to S3

  dangra

  committed
  63d583d

  Copy full SHA for 63d583d

• change tutorial to follow changes on dmoz site

  dangra

  committed
  bcb3198

  Copy full SHA for bcb3198

Commits on Dec 12, 2011

• Avoid _disconnectedDeferred AttributeError exception in Twisted>=11.1.0

  

  rmax

  authored and

  pablohoffman

  committed
  98f3f87

  Copy full SHA for 98f3f87

• Merge pull request #62 from darkrho/issue-58

  Show description for 9b84914
  pablohoffman

  committed
  9b84914

  Copy full SHA for 9b84914

Commits on Dec 5, 2011

• Avoid _disconnectedDeferred AttributeError exception in Twisted>=11.1.0

  rmax

  committed
  9c04945

  Copy full SHA for 9c04945

Commits on Dec 2, 2011

• allow spider to set autothrottle max concurrency

  

  kalessin

  authored and

  pablohoffman

  committed
  175a4b5

  Copy full SHA for 175a4b5

Commits on Dec 1, 2011

• Merge pull request #61 from kalessin/master

  Show description for 4fe42dc
  pablohoffman

  committed
  4fe42dc

  Copy full SHA for 4fe42dc

• allow spider to set autothrottle max concurrency

  kalessin

  committed
  7b0184e

  Copy full SHA for 7b0184e

Commits on Nov 17, 2011

• bumped version to 0.15

  pablohoffman

  committed
  e29f9e5

  Copy full SHA for e29f9e5

• bumped version to 0.14

  pablohoffman

  committed
  0f649f0

  Copy full SHA for 0f649f0

Commits on Nov 14, 2011

• fixed "No free spider slots" bug when calling fetch() from scrapy shell

  pablohoffman

  committed
  6d13de4

  Copy full SHA for 6d13de4

• improve handling of KeyError exception when creating spiders in spider manager. closes issue 49

  pablohoffman

  committed
  d37a788

  Copy full SHA for d37a788

• ignore meta-refresh redirects embedded in <script> tags. related to issue 18

  pablohoffman

  committed
  36df87b

  Copy full SHA for 36df87b

• ignore meta-refresh redirect when embedded inside <noscript> tag. closes issue 18

  pablohoffman

  committed
  ec1ef02

  Copy full SHA for ec1ef02

Commits on Nov 11, 2011

• Delete old logs based on file mtime.

  simonratner

  committed
  7232c31

  Copy full SHA for 7232c31

Pagination

Previous

Next