Skip to content

Releases: rappdw/fs-crawler

Add Reader that constructs graph using AbstractGraphBuilder

25 Feb 05:11
Compare
Choose a tag to compare
Add Class to read db and build graph using abstract graph builder

Add tests
Add gen-sql option to crawler

Implement Restart

07 Feb 23:13
Compare
Choose a tag to compare

Implement restart ability with Graph DB Implementation

DB Backed Graph Implementation

04 Feb 00:17
e001af5
Compare
Choose a tag to compare
Move from in memory representation of graph to SQLite backed represen…

…tation (#14)

* define Graph as ABC and provide an in memory impl
convert all code to use Graph ABC (except instantiation in cralwer)
convert from using in memory sets to using generators

* Create db backed implementation of graph using SQLite

Add keyring support

30 Jan 18:09
Compare
Choose a tag to compare

Password can now be retrieved via keyring. Service name is "fs-crawler"

Fix for pre 3.10 versions of python

30 Jan 14:02
Compare
Choose a tag to compare
v0.2.4

support pre 3.10 exception formatting

Validate graph before completing crawl

30 Jan 04:55
Compare
Choose a tag to compare

As the last step of a crawl, validate the graph and save .validated.x.csv files

Code Simplification, Prepare for checkpointing iterations

14 Jan 04:06
f544dc7
Compare
Choose a tag to compare

The code changes for this release are primarily for simplification and to prepare for implementing iteration checkpointing

Update to match FamilySearch API changes

09 Jan 15:43
Compare
Choose a tag to compare

The packages was updated to support FamilySearch API changes (resulted in HTTP 301 with old version).

Additionally, a few enhancements were made to reduce the number of calls made to the FamilySearch API

Restart/Continue Capable

02 Sep 15:00
345dc89
Compare
Choose a tag to compare

This release has fixed a few bugs in the resolution of relationships. The major enhancement enables restart/continue from a previous run.

Preserve preferred name

14 Apr 18:28
Compare
Choose a tag to compare
Preserve preferred name for an individual

Restructure crawler.py to allow for calling from another script