Skip to content

Releases: cldellow/datasette-scraper

0.5.3

04 Mar 22:11
@cldellow cldellow
0.5.3
25af45b

Choose a tag to compare

View all tags
0.5.3 Latest
Latest

Make the UI less daunting by hiding all tables except dss_crawl, and improving links from dss_crawl to dss_job, #51

Assets 2
Loading

0.5.2

01 Mar 03:33
@cldellow cldellow
0.5.2
d8bfa20

Choose a tag to compare

View all tags
0.5.2

Fix crawl status page when dss database is not the primary database (#49)

Loading

0.5.1

28 Feb 04:07
@cldellow cldellow
0.5.1
d049133

Choose a tag to compare

View all tags
0.5.1

Support installing datasette-scraper into a database with pre-existing tables (#48)

Loading

0.5

22 Jan 18:35
@cldellow cldellow
0.5
ec5b7de

Choose a tag to compare

View all tags
0.5
  • feature: generic support for extracting json+ld data
  • feature: specific support for extracting json+ld Product data
  • feature: add discover-allow to specify an allowlist of patterns to crawl
  • enhancement: seed-sitemaps only activates for seeds that are at the top-level of the domain
  • enhancement: extract_from_response can delete existing entries
  • enhancement: extract_from_response can add indexed entries with @ sigil
  • enhancement: extract_from_response skips doing writes that wouldn't change the database
  • enhancement: prune pages that exceed max depth/max page limit earlier
Loading

0.4

01 Jan 22:13
@cldellow cldellow
0.4
dbb8008

Choose a tag to compare

View all tags
0.4 
0.4
Loading

0.3

01 Jan 22:06
@cldellow cldellow
0.3
07d35ea

Choose a tag to compare

View all tags
0.3 
I don't know what I'm doing...

perhaps we need to explicitly say which packages we publish? Perhaps
spending a few hours trying random things will save me a few minutes
learning a new package management system.
Loading

0.2

01 Jan 21:55
@cldellow cldellow
0.2
4f621d3

Choose a tag to compare

View all tags
0.2 
0.2
Loading

0.1

01 Jan 21:45
@cldellow cldellow
0.1
38e9a94

Choose a tag to compare

View all tags
0.1 
--verbose
Loading