Data Catalog

Explore all tables Cybersyn offers through Snowflake Marketplace.

The Cybersyn Data Catalog is an index of all tables published across Cybersyn products on Snowflake Marketplace. CYBERSYN_DATA_CATALOG contains metadata about Cybersyn tables, including those from products you have not mounted, in one location to help you find the data you are looking for. You can start searching across datasets with our Streamlit dashboard or by accessing the table included in all Cybersyn data products.

Why is CYBERSYN_DATA_CATALOG useful?

  • You want a complete view of all Cybersyn datasets across all products.

  • You want to find datasets that Cybersyn recently added.

  • You want to understand how tables across products relate and can be joined.

  • You want more information about the sources that the data comes from.

Data Catalog Structure & Content

FieldDescription

table_name

Formal name of the table

table_name_proper

A human-readable version of the table name

data_source

Source(s) of the data. Note that a table may include numerous sources

data_source_url

URL to the underlying data source(s)

description

Description of the data that is included in the table

table_type

The classification of the data within the table. Examples of table types include index, timeseries, attributes, relationships, and characteristics

See Cybersyn Concepts: Unified Schema for more information

entities

Array of entities that are included in the table. These serve as an indication for the types or granularity of data included in the table

See Cybersyn Concepts: Unified Schema for more information

listing_name

Array of Snowflake Marketplace listing names (i.e. Cybersyn products) that the table appears in

listing_url

Array of Snowflake Marketplace listing (i.e. Cybersyn product) URLs that the table appears in

select_related_tables

A list of closely related tables that the data may be joined to. Note that this is not an exhaustive list of all tables that can possibly be joined

created_date

Date that the table was first created and published by Cybersyn

last_updated_timestamp

Timestamp of the tableโ€™s last update/modification

license_url

URL to the terms of service or license for each dataset in the table

Example Use Cases & Queries

Discover new tables that Cybersyn recently released

Sort tables by their original creation date to find the newest tables that Cybersyn recently added to Snowflake Marketplace.

SELECT *
FROM cybersyn.cybersyn_data_catalog
ORDER BY created_date DESC;

Filter to all tables that include a specific entity type

Find the tables and sources with company-level granularity by filtering to all tables using the company_id entity.

SELECT *
FROM cybersyn.cybersyn_data_catalog
WHERE ARRAY_CONTAINS('company_id'::VARIANT, entities);

Search for tables by source

Search the table description and the data source for a specific keyword or source. In the example below, search for data coming from or related to the Census Bureau.

SELECT *
FROM cybersyn.cybersyn_data_catalog
WHERE description ILIKE '%Census Bureau%'
  OR TO_VARCHAR(data_source) ILIKE '%Census Bureau%';

Last updated

Copyright ยฉ 2024 Cybersyn