OCDS Kingfisher - Process 0.0.1

Build Status Coverage Status

Kingfisher Process stores and pre-processes OCDS data. An accompanying tool, Kingfisher Scrape, downloads OCDS data from sources, and optionally sends it to Kingfisher Process.

If you are viewing this on GitHub or PyPi, open the full documentation for additional details.

Typical usage

Kingfisher Process receives OCDS data either via the web API (used by Kingfisher Scrape) or the local-load command.

OCDS data are stored in a PostgreSQL database and organized into “collections”, as described in the Data Model and specified in the Database structure. Once incoming data are stored:

Once the data are stored, you can query the PostgreSQL database; refer to the Data Model and Database structure for an orientation to the database tables.

A Command-line tool allows you to list collections, add notes to collections, run schema checks, and transform collections.

You can run the web app to view metadata about collections and files.

And that’s it! In short, Kingfisher Process accepts “raw” OCDS data, and then checks and pre-processes it, so that your data analysis can be more predictable and repeatable.