US Securities and Exchange Commission (SEC)

Overview

The US Securities and Exchange Commission (SEC) is a government agency that has broad authority over all aspect of the US securities industry. EDGAR, the SEC's Electronic Data Gathering, Analysis, and Retrial system, is a public database that includes SEC filings by corporations, funds, and individuals. Both parsed (xbrl) and raw (plain) text from submitted filings as well as raw text from attached exhibits are included.

SEC filings are available in both our free and enterprise products. Coverage varies between tiers:

Key Attributes

Geographic Coverage	United States
Entity Level	Company, Report
Time Granularity	Varies, see chart above
Release Frequency	Enterprise: Daily Free: Monthly
History	Enterprise: Typically 2013* Free: Typically 2019

*Form 144 - limited history because SEC previously did not mandate the electronic filing of Form 144 *Form N-PORT - limited history because N-PORTs replaced Form N-Qs

As with all Public Domain datasets, Cybersyn aims to release data on Snowflake Marketplace as soon as the underlying source releases new data. We check periodically for changes to the underlying source and, upon detecting a change, propagate the data to Snowflake Marketplace immediately. See our release process for more details.

Description

All Cybersyn products follow the EAV (entity, attributes, value) model with a unified schema. Entities are tangible objects (e.g. geography, company) that Cybersyn provides data on. All timeseries' dates and values that refer to the entity are included in a timeseries table. Descriptors of the timeseries are included in an attributes table. Data is joinable across all Cybersyn products that have a GEO_ID. Refer to Cybersyn Concepts for more details.

SEC data revolves around Company and Report entities. A Central Index Key (CIK) identifies the Company entity and is a unique number that the SEC assigns to each registrant (e.g. company, individual, foreign government) submitting a filing. The Report entity is represented by an ADSH, an accession number assigned to each individual filing. The ADSH can be used to track all records from a single filing/report.

The SEC_CIK_INDEX table contains the distinct Company entities associated with SEC filings and provides a map between COMPANY_ID and SIC, along with geographic and SIC details. Fields include the company name, SIC (Standard Industrial Classification assigned by the SEC to classify the primary industry), SIC category, SIC description, EIN (Employee Identification Number assigned by the IRS), and location.

The SEC_REPORT_INDEX table contains each Report (e.g. 10-K, 10-Q, 8-K) identified by an ADSH that a Company submits. Each row represents a distinct Report submission type and date by Company. These filings are self-reported details on a company’s business, the risks it faces, and the operating and financial results for the fiscal year or quarter, as applicable. Reports can be joined to the SEC_CIK_INDEX table via the CIK identifier.

Attributes (the parsed XBRL line items from financial statements) associated with each Report can be found in the SEC_REPORT_ATTRIBUTES table. A Report’s full text can be found in the SEC_REPORT_TEXT_ATTRIBUTES table, and again, is joinable to the SEC_REPORT_INDEX via CIK and ADSH identifiers. Each Report in the SEC_REPORT_TEXT_ATTRIBUTES table also includes a SEC_DOCUEMNT_ID, which is a Cybersyn-created ID to uniquely identify report exhibits.

The SEC_HOLDING_FILING_INDEX table contains an overview of 13-F fund holding reports by ADSH with associated entities (CIK). Fields include the submission type, filing date, reporting period, filing manager, number of holdings, total holding value, and any additional information. Attributes associated with each report can be found in the SEC_HOLDING_FILING_ATTRIBUTES table. Attributes include security name, market value, number of shares, and OpenFIGI IDs.

SEC_METRICS_TIMESERIES includes parsed quarterly and annual segment revenues from 10-Qs and 10-Ks. Cybersyn translates raw XBRL data into a cleaned version of SEC revenue segments over time. The new table allows you to easily identify revenue trends across the specific segments (brand, category, location etc.) a company chooses to report on. Target, for example, reports revenue by category (Apparel & Accessories, Beauty & Household Essentials etc.) whereas Darden Restaurants reports by brand (Olive Garden, Longhorn Steakhouse etc.). This premium dataset is available in our Enterprise product.

Each company’s fiscal calendars can be found in the SEC_FISCAL_CALENDARS table. A fiscal calendar is a financial calendar year mapped to the company's quarterly and annual reporting period.

SEC data is also used in the reference spine Cybersyn is building out to support joining companies, subsidiaries, and their brands together in a hierarchy. Click here to learn about the COMPANY_INDEX table which aggregates commonly used Company identifiers (CIKs, EINs, LEIs) into a single COMPANY_ID.

Tables, Products, & Sources

Table Names	Product	Source
SEC_METRICS_TIMESERIES SEC_13F_ATTRIBUTES SEC_13F_INDEX SEC_CORPORATE_REPORT_ATTRIBUTES SEC_CORPORATE_REPORT_INDEX SEC_NPORT_FILING_INDEX SEC_NPORT_PARTC_INVESTMENTS_INDEX SEC_FORM4_REPORTING_OWNERS_INDEX SEC_FORM4_SECURITIES_INDEX SEC_FORM144_SECURITIES_INFO_INDEX SEC_FORM144_SECURITIES_TO_BE_SOLD_INDEX SEC_FORM144_SECURITIES_SOLD_INDEX	Enterprise Only	SEC
SEC_CIK_INDEX SEC_FISCAL_CALENDARS SEC_REPORT_TEXT_ATTRIBUTES	Enterprise SEC Filings LLM Training Essentials	SEC
SEC_HOLDING_FILING_ATTRIBUTES SEC_HOLDING_FILING_INDEX SEC_REPORT_ATTRIBUTES SEC_REPORT_INDEX	SEC Filings, LLM Training Essentials Only	SEC
COMPANY_INDEX COMPANY_CHARACTERISTICS	Enterprise SEC Filings LLM Training Essentials Consumer Spending	SEC, PermID, GLEIF

Notes & Methodology

Covered quarters

In the sec_report_attributes table, the covered_qtrs denotes how many periods the value covers. For example, a year-to-date measure for revenue from Q1-Q3 would be 3. A point-in-time measure that is “as of” a specific date has a 0 for covered_qtrs.

Text formatting

In the sec_report_text_attributes table, the raw text is pulled from the originally-filed reports. The raw text is stripped of HTML formatting and is presented as a single block of text. Note that this text includes both text-based sections of the reports (such as Management Discussions & Analysis) as well as non-formatted text of values from financial statements.

Geography mapping

Cybersyn mapped portions of companies’ addresses (city, state, country) to a unique geo_id that corresponds to that location. This is a feature of all Cybersyn datasets to allow for easy comparisons across datasets that use geographic identifiers. Learn more about Cybersyn's geography tables here.

Examples & Sample Queries

Find performance of a company's business segments over time

View Target's quarterly category mix over time

WITH target_category_segments AS (
    SELECT
        company_name,
        business_segment,
        date,
            value AS segment_value
    FROM cybersyn.sec_metrics_timeseries
    WHERE 
        cik = '0000027419'
        AND measure = 'REVENUE'
        AND frequency = 'QUARTERLY' 
        AND business_segment IN ('HARDLINES','HOME FURNISHINGS AND DECOR','APPAREL AND ACCESSORIES','BEAUTY AND HOUSEHOLD ESSENTIALS','FOOD AND BEVERAGE')
)

, quarterly_performance AS (
    SELECT
        company_name,
        date,
        SUM(segment_value) AS quarterly_total_value
    FROM target_category_segments
    GROUP BY 1,2
)

SELECT *, segment_value / quarterly_total_value AS category_mix
FROM target_category_segments
JOIN quarterly_performance
USING (company_name, date)
ORDER BY date, business_segment;

Find the performance of Darden Restaurants' brands over time

SELECT *
FROM cybersyn.sec_metrics_timeseries
WHERE 
    cik = '0000940944'
    AND frequency = 'QUARTERLY'
    AND business_segment IN ('OLIVE GARDEN','LONGHORN STEAKHOUSE','FINE DINING','ALL OTHER');

Aggregate company identifies and metadata about companies

Search for commonly-used corporate identifiers such as CIK and EIN as well as stock-specific identifiers like ticker symbol and OpenFIGI ID

SELECT
    idx.company_id,
    idx.company_name,
    idx.cik,
    idx.ein,
    idx.lei,
    openfigi.openfigi_share_class_id,
    openfigi.primary_ticker,
    idx.permid_company_id
FROM cybersyn.company_index AS idx
JOIN cybersyn.company_characteristics AS char
    ON (idx.company_id = char.company_id)
JOIN cybersyn.company_security_relationships AS rship
    ON (idx.company_id = rship.company_id)
JOIN cybersyn.openfigi_security_index AS openfigi
    ON ARRAY_CONTAINS(rship.security_id::VARIANT, openfigi.openfigi_share_class_id)
WHERE char.relationship_type = 'sic_description'
  AND char.value = 'Air transportation, scheduled';

Compare financial metrics across companies

Compare revenue numbers from for 2022 for different airline companies.

SELECT i.cik, i.company_name, r.period_start_date, r.period_end_date, r.measure_description, TO_NUMERIC(r.value) AS value
FROM cybersyn.sec_cik_index AS i
JOIN cybersyn.sec_report_attributes AS r ON (r.cik = i.cik)
WHERE i.sic_code_description = 'AIR TRANSPORTATION, SCHEDULED'
  AND r.statement = 'Income Statement'
  AND r.period_end_date = '2022-12-31'
  AND r.covered_qtrs = 4
  AND r.metadata IS NULL
  AND r.measure_description IN ('Total operating revenues', 'Total operating revenue');

View historical trends for companies

Measure Chipotle’s store count growth over time

SELECT i.cik, i.company_name, r.period_end_date, r.measure_description, MAX(TO_NUMBER(r.value)) AS value
FROM cybersyn.sec_cik_index AS i
JOIN cybersyn.sec_report_attributes AS r ON (r.cik = i.cik)
WHERE company_name = 'CHIPOTLE MEXICAN GRILL INC'
  AND r.measure_description = 'Number of restaurants'
GROUP BY i.cik, i.company_name, i.cik, r.period_end_date, r.measure_description;

Pull fiscal calendars for public companies

Pull Walmart’s fiscal calendar does not align with the calendar year. Pull their quarter start and end dates

SELECT company_name, fiscal_year, fiscal_period, period_start_date, period_end_date
FROM cybersyn.sec_fiscal_calendars
WHERE company_name = 'WALMART INC.'
ORDER BY period_end_date;

Track portfolios of fund managers

See Berkshire Hathaway’s most recent public holdings disclosure and join associated tickers under which each holding may be traded globally on all exchanges

WITH latest_filing AS (
    SELECT adsh
    FROM cybersyn.sec_holding_filing_index
    WHERE filing_manager_name = 'Berkshire Hathaway Inc'
    ORDER BY filing_date DESC
    LIMIT 1
)
SELECT att.*,
    securities.global_tickers,
    securities.permid_quote_id
FROM cybersyn.sec_holding_filing_attributes AS att
LEFT JOIN cybersyn.permid_security_index AS securities
    ON att.permid_security_id = securities.permid_security_id
WHERE att.adsh IN (SELECT * FROM latest_filing)
ORDER BY att.market_value DESC;

Disclaimers

The data in this product is sourced from the US Securities and Exchange Commission (SEC).

Cybersyn is not endorsed by or affiliated with any of these providers. Contact [e-mail] for questions.G