Entities and their relationships

er diagram

An Org has Projects

An organization may have many projects they are collecting data for.

A Project has Collections

A collection is a group of sources that share the same output schema.

A Collection has a Schema

A Schema can be shared by many collections.

A Collection has Sources

A source is something that produces data, like an extractor.

A Source has Snapshots

A snapshot is a data snapshot adhering to the collection schema for a source - e.g. from a crawl run.

An Org has Destinations

A destination is where quality data is pushed to, e.g. an S3 bucket with a URI template.

A Collection pushes to multiple Destinations

A collection is pushed to zero or more destinations.