Source catalog

Every data source behind these databases

This page is the honesty layer. For every dataset the portal builds on — whether or not it has been shipped to the public portal yet — you see the publisher, the access method, and the known gaps.

Sources catalogued
54
Live on this portal right now
30
Awaiting a free API key
3
Dead or intermittent upstream
2
Total rows across all warehouse tables
5,138,041

Status badges — how to read this page

  • On portal — queryable right now via /db/portal/<table>
  • In warehouse — loaded in the investigation warehouse; public shipment comes in a later phase
  • Needs free API key — free to register; not yet configured
  • Dead upstream — endpoint broken; warehouse retains last-known-good copy
  • Intermittent — endpoint returns errors on some days / years; occasionally refreshes successfully

Territorial economics — USVI Bureau of Economic Research

  • BER Annual Economic Indicators

    U.S. Virgin Islands Bureau of Economic Research · usviber.org

    On portal Refresh: annual

    45 years of annual USVI economic indicators — GDP, unemployment, per-capita income, tax receipts, tourism, employment by sector.

    Access details + methodology

    41 distinct annual indicators spanning 1980-2023 (1,165 rows). Compiled from BER publications. Covers economic growth (GDP nominal + real), labor (civilian employment + labor force + jobs by sector), income + wages, fiscal (operating budget, revenues, major tax lines), tourism (arrivals, excursionists, visitors), and utilities (electricity sales, construction permits).

    Access

    Manual — no public API. See access notes.

    Access notes

    BER publishes annual PDF reports. Our extraction is manual; no BER API exists. Re-digitize when new reports publish.

    On this portal

    Browse economic_indicators →

    Last portal snapshot: 2026-11-22T01:23:34Z (1,163 rows)

  • BER Monthly Indicators

    U.S. Virgin Islands Bureau of Economic Research · usviber.org

    On portal Refresh: monthly

    Monthly time series from BER — unemployment rate, visitor arrivals, hotel occupancy, cruise passengers, CPI.

    Access details + methodology

    14 indicators across 1994-2026 (3,368 rows). Per-island breakdown (USVI / STT_STJ / STX) where the source distinguishes. Primary KPIs: monthly unemployment (1994+), hotel occupancy (1994+), cruise ship calls + cruise passengers (1994+), air arrivals, CPI components (food, housing, transport).

    Access

    Manual — no public API. See access notes.

    Access notes

    BER publishes monthly indicator tables. Manual extraction pipeline.

    On this portal

    Browse monthly_indicators →

    Last portal snapshot: 2026-11-22T01:23:34Z (3,368 rows)

Local finance — USVI Department of Finance and Tyler Technologies / Socrata

  • USVI Checkbook (Spending Transactions)

    USVI Department of Finance (via Tyler Technologies / Socrata) · usvi.spending.socrata.com

    In warehouse (325,432 rows) Refresh: weekly

    Every territorial government check issued since FY2019 — vendor, amount, department, fund, purpose. 325,432 rows.

    Access details + methodology

    The transactional spending ledger. FY2019-FY2026 (FY2023 retention-dropped at source — warehouse is canonical). ~44K rows/year, growing ~$12M/week for current FY2026. Dedup key: unique_id. Fields include vendor, amount, department, fund, fund_group, object, project, check_date, check_number, description, island.

    Primary endpoint

    https://usvi.spending.socrata.com/api/checkbook_data.csv?year={FY}

    Access notes

    Chunked transfer encoding — HEAD requests return Content-Length: 0 and mislead probes. Always use GET. FY2023 endpoint returns 2 bytes today (retention dropped upstream).

    In investigation warehouse

    Table checkbook (325,432 rows). Not published yet.

    Known issues + gaps

    • FY2023 retention-dropped at source — our warehouse is the canonical archive
    • FY2026 grows ~$12M/week during fiscal year
    • Portal shipment pending Phase 2 (volume + PII review required)
  • USVI Payroll (Employee Compensation)

    USVI Department of Finance (via Tyler Technologies / Socrata) · usvi.payroll.socrata.com

    In warehouse (4,139,879 rows) Refresh: weekly

    Every territorial payroll record — 4.14M rows across FY2023-FY2026. Employee name, department, job category, gross pay, fringe components.

    Access details + methodology

    Individual payment records per pay period. 4,139,879 rows. FY2024 is empty at source (returns 1 byte). Upstream field names are obfuscated (custom_checkbook_field0 → last_name, etc.) — our ingest normalizes.

    Primary endpoint

    https://usvi.payroll.socrata.com/api/checkbook_data.json?year={FY}&limit={n}&offset={n}

    Access notes

    Paginate at 50,000 per request. Also exposes an all_years.json list at /api/all_years.json. Obfuscated field names.

    In investigation warehouse

    Table payroll (4,139,879 rows). Not published yet.

    Known issues + gaps

    • FY2024 returns 1 byte — empty at source, no way to reconstruct
    • Field names obfuscated upstream; normalization happens at ingest
    • Portal shipment — Workbench tier only (PII — last name, department, job)
  • USVI Vendor Master Registry

    USVI Department of Finance (via Tyler Technologies / Socrata) · usvi.spending.socrata.com

    On portal Refresh: manual

    Vendor names, addresses, type (WMBE flag), contact info. 258,948 rows.

    Access details + methodology

    Not actually year-specific even though the API exposes per-FY URLs — all FY files are identical and represent the vendor master. Useful for entity resolution work against checkbook payments.

    Primary endpoint

    https://usvi.spending.socrata.com/api/vendor.csv?year={FY}

    Access notes

    Each per-year file is a duplicate of the full master registry.

    In investigation warehouse

    Table vendors (258,948 rows). Not published yet.

  • USVI Ledger (Budget vs. Actual)

    USVI Department of Finance (via Tyler Technologies / Socrata) · usvi.spending.socrata.com

    In warehouse (100,000 rows) Dead upstream Refresh: manual

    Transaction-level budget vs. actual. 100,000 rows (API-capped). Currently dead upstream.

    Access details + methodology

    Intended companion to checkbook — adds budget context per transaction. Endpoint has been returning Content-Length: 0 across all years since cataloguing. Warehouse retains last successful pull.

    Primary endpoint

    https://usvi.spending.socrata.com/api/ledger.csv?year={FY}

    Access notes

    Currently returns 0 bytes upstream. Warehouse is canonical until source repairs.

    In investigation warehouse

    Table ledger (100,000 rows). Not published yet.

    Known issues + gaps

    • DEAD at source since 2026-04 — warehouse is last-known-good copy
  • USVI Budget (Appropriations)

    USVI Department of Finance (via Tyler Technologies / Socrata) · usvi.budget.socrata.com

    In warehouse (190,666 rows) Intermittent Refresh: manual

    Operating + revenue budgets by department, fund, object. 190,666 rows. Intermittent at source.

    Access details + methodology

    Two surfaces (operating and revenue budgets) per fiscal year. Fields include original budget, revised budget, obligated, encumbrance, unencumbered balance per account line.

    Primary endpoint

    https://usvi.budget.socrata.com/api/operating_budget_fy{FY}.csv

    Access notes

    FY2023 + FY2026 work reliably. FY2024 + FY2025 intermittently return 503 (cold cache). Revenue-budget variant exposed at /api/revenue_budget_fy{FY}.csv.

    In investigation warehouse

    Table budget (190,666 rows). Not published yet.

    Known issues + gaps

    • FY2024/FY2025 return intermittent 503s (cold cache)

Local procurement — contracts, RFPs, and property

  • DPP Contract Register — Department of Property and Procurement

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    The register of contract PDFs dpp.vi.gov publishes. Contract amount, effective date and expiration date are empty on every row — our broken scraper, not DPP withholding, and nothing is published from an empty column.

    Access details + methodology

    100% contract numbers, 99% agencies, 94% PDF URLs. 151 contracts missing PDF URLs (DOE/DHS/BOE). Known gap: register doesn't expose dollar amounts or execution dates — those live only in the linked PDFs, requiring OCR to make structured.

    Primary endpoint

    https://dpp.vi.gov/wp-json/wp/v2/contracts?per_page=100&page={n}

    Access notes

    List via WP REST API. Agency + PDF URL come from scraping the individual HTML contract pages. Miles Partnership has 1 DPP contract on file vs. $39M paid via checkbook. MTNOC has 0 DPP contracts on file vs. $12.6M paid as FIDUCIARY SERVICES.

    On this portal

    Browse dpp_contracts →

    Last portal snapshot: 2026-11-22T01:23:37Z (2,596 rows)

    Known issues + gaps

    • contract_amount, effective_date and expiration_date are NULL on every row
    • dpp.vi.gov's contract pages DO publish start and end dates; our label pattern cannot match them
    • The amounts sit inside contract PDFs already downloaded to this machine that our parser has never been able to open
    • On some rows the contract id inside the PDF's filename disagrees with the register's contract number; both are DPP's own strings
  • GVIBuy Purchase Orders — Government of the Virgin Islands

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    Every purchase order GVIBuy's public search returns, on one walk on one day. The money column holds three different things and must not be summed.

    Access details + methodology

    One row per purchase-order document: number, description, vendor as recorded, department, buyer, status, Sent Date and the total exactly as printed plus its parsed value. total_usd is a contract ceiling on a master blanket, a unit-price schedule sum on some blankets, and the value of the order on a release, an open-market order or a payment authorization. DPP's own procedure (SOPP-DPP-PROC-002-2026 section 7.6) states that purchase orders are not funding documents in GVIBuy. Join procurement_po_classification for record_kind and is_transactional; the transactional basis is the only purchase-order total the portal publishes.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Public search, no login. Walked page by page at four-second spacing. GVIBuy's type-filtered searches return documents this unfiltered walk does not, so the row count is what one walk returned on one day.

    On this portal

    Browse gvibuy_purchase_orders →

    Last portal snapshot: 2026-11-22T01:23:43Z (4,393 rows)

  • GVIBuy Blanket Contracts — Government of the Virgin Islands

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    The master blanket contract register as GVIBuy returns it — a live list, so nothing in it has expired and contracts that ended earlier are absent.

    Access details + methodology

    Contract number, solicitation it cites, vendor, organisation, term dates, and Dollars Spent to Date. Dollars Spent to Date is the only column here that is spending; the purchase-order row for the same number carries a ceiling or a schedule sum. Not one contract in the register had expired at harvest, because the government's contract search returns only what is live — no history of ended contracts can be recovered from it, which is why every snapshot is kept from now on. GVIBuy's own purchase-order type filter separately calls more documents Blanket than this register contains.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Public contract search, no login. One walk, one day.

    On this portal

    Browse gvibuy_blankets →

    Last portal snapshot: 2026-11-22T01:23:42Z (854 rows)

  • GVIBuy Bid Solicitations — Government of the Virgin Islands

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    Solicitations with their planned opening dates, statuses and awarded-vendor column.

    Access details + methodology

    One row per solicitation. The opening date is a PLANNED date, not an event. blanket_number is a whitespace-separated LIST of purchase-order numbers rather than a reference, populated on a minority of the rows marked Bid to PO, and on the one case checked against documents it named a different purchase order from the one citing the bid — see gvibuy_bid_po_ref for it exploded token by token. awarded_vendors also carries three literal status strings that a 'non-empty means awarded' reading would count as vendors. Every in-flight status in the file exists only in FY2026, so no trend is drawn from these counts.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Public bid search, no login. One walk, one day.

    On this portal

    Browse gvibuy_bids →

    Last portal snapshot: 2026-11-22T01:23:43Z (2,689 rows)

  • GVIBuy Registered Vendors — Government of the Virgin Islands

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    GVIBuy's registered-vendor list, with the registry's contact name and phone removed on the way into this portal.

    Access details + methodology

    Vendor id, name, normalised name and address. The registry carries a business contact name and a phone number on every row; both columns are dropped when the data is copied here, so they are absent from the table, the CSV and the JSON rather than filtered on a page — a minority of registered vendors are sole proprietorships registered in a natural person's own name. GVIBuy vendor ids share nothing with the checkbook's: the two namespaces have zero overlap, so every link between the systems is a name match at a published rung.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Public vendor search, no login. One walk, one day.

    On this portal

    Browse gvibuy_vendors →

    Last portal snapshot: 2026-11-22T01:23:43Z (3,559 rows)

  • GVIBuy Purchase Orders — Type-Filtered Search Walks

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    What GVIBuy's own type filter calls each document — the government's classification, not ours.

    Access details + methodology

    One row per document returned by each of the type-filtered searches (Blanket, Open Market, Direct Open Market, punchout), with the page it was found on and whether it is present in the unfiltered purchase-order walk. Some documents the filtered searches return are absent from the unfiltered list, which is why present_in_po_table exists as a column and why the purchase-order row count carries a plus-or-minus qualification wherever it is used as a denominator.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Four type-filtered public searches, no login.

    On this portal

    Browse gvibuy_po_types →

    Last portal snapshot: 2026-11-22T01:23:43Z (15,943 rows)

  • GVIBuy Purchase Orders — Record Kind Classification

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    One row per purchase order: its record kind, and whether it is transactional. This is the table that makes the money column readable.

    Access details + methodology

    Assigns record_kind under the precedence payment authorization, then release, then GVIBuy's own type O and type D, then type B split by identifier form, and NULL where the identifier cannot be read at all rather than a guess. is_transactional marks the documents that actually order, encumber or authorise payment — the only basis over which this portal publishes a purchase-order total. Also carries the parent contract number for release rows, which is contained in the release's own number and is the chain's one zero-cost hard key.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Derived read-only from gvibuy_purchase_orders and gvibuy_po_types. No network access.

    On this portal

    Browse procurement_po_classification →

    Last portal snapshot: 2026-11-22T01:23:43Z (4,393 rows)

  • GVIBuy Purchase Orders — Detail Page Header Fields

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    Header fields that exist only on a document's own detail page: entered date, release authority, Dollar Limit. Held for a small number of documents.

    Access details + methodology

    The list view does not carry a document's real creation date, the department authorised to release against a contract, or the Dollar Limit that distinguishes a contract ceiling from the sum of a unit-price schedule. Each needs one HTTP request against a live government system. Where ceiling_basis reads 'not-fetched' the surface prints no dollar figure for that document at all — only the string GVIBuy shows. An absent row here means not yet fetched, never that the document has no such fields.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    One request per document, four-second spacing. Deliberately incomplete: the full crawl is about 1,900 requests.

    On this portal

    Browse gvibuy_po_header_detail →

    Last portal snapshot: 2026-11-22T01:23:43Z (4,391 rows)

  • GVIBuy Purchase Orders — Line Items

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    Line items with their NIGP commodity codes and the bid and requisition numbers printed on them. Empty until the detail crawl runs.

    Access details + methodology

    The NIGP commodity code the government itself assigns to each line is the only classification this portal will ever apply to a purchase order — keyword bucketing was measured and is wrong often enough to be useless. The bid number printed on an open-market order's line item is the chain's hard key from a purchase order to its solicitation, and it is readable only from the purchase-order side: solicitation pages contain no token naming what came after them. An empty table here means not yet fetched.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    One request per purchase order, four-second spacing. Not yet run.

    On this portal

    Browse gvibuy_po_items →

    Last portal snapshot: 2026-11-22T01:23:44Z (22,957 rows)

  • GVIBuy Bid Solicitations — Detail Page Header Fields

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    Solicitation header fields that live only on the solicitation's own page. Empty until that crawl runs.

    Access details + methodology

    Purchase method, informal-versus-formal flag, the fiscal year the page itself prints, department and location codes, and the amendment, attachment and item counts. The page's own printed fiscal year is the only check available on the identifier-prefix year. An empty table means not yet fetched.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    One request per solicitation, four-second spacing. Not yet run.

    On this portal

    Browse gvibuy_bid_detail →

    Last portal snapshot: 2026-11-22T01:23:44Z (396 rows)

  • GVIBuy Bid Solicitations — Quote Tabulation (Who Responded)

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    Which vendors responded to a solicitation, and when. Empty until the solicitation crawl runs.

    Access details + methodology

    The quote tabulation is published on each solicitation's own page and appears in no list view. An empty table here means not yet fetched — never that nobody responded.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    One request per solicitation, four-second spacing. Not yet run.

    On this portal

    Browse gvibuy_bid_quotes →

    Last portal snapshot: 2026-11-22T01:23:44Z (0 rows)

  • GVIBuy Bids — Blanket/PO Reference Tokens

    Government of the Virgin Islands · dpp.vi.gov

    On portal Refresh: weekly

    The solicitation list's blanket-number column exploded, one row per whitespace token, with whether each resolves.

    Access details + methodology

    gvibuy_bids.blanket_number is a whitespace-separated list, not a reference: some solicitations carry more than one token, because one solicitation can produce several awards. Each row records the token's ordinal, how many tokens sat on that bid, and whether the token resolves as a purchase-order number and as a blanket number. This is a SAMPLE of the bid-to-purchase-order edge, never the edge itself, and it is never labelled 'the resulting purchase order'.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Derived read-only from gvibuy_bids. No network access.

    On this portal

    Browse gvibuy_bid_po_ref →

    Last portal snapshot: 2026-11-22T01:23:43Z (314 rows)

  • Procurement Vendor Strings — Match Ladder to the Checkbook

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    The single denominator behind every vendor claim on this site: one row per distinct vendor string, with the rung at which it does or does not reach a checkbook payee.

    Access details + methodology

    Distinct vendor strings across GVIBuy's purchase orders, its blanket register, its awarded-vendor column and DPP's contract register. L1 means the raw string equals a checkbook payee name; L2 means it matches after the published normaliser; L4 means no published match at any rung and renders as 'no payment record found under this name', never hidden by an inner join. A third rung is measured and withheld — it needs a clustering table that is workbench-only here, and a handful of its strings name demonstrably different businesses — so it ships as a flag, never as a join. The normaliser's two known defects are recorded on the rows they touch. Comma-joined multi-vendor award lists and placeholder strings are marked as such and get no vendor page, because a page implies a party.

    Primary endpoint

    https://checkbook.vi.gov/

    Access notes

    Derived read-only from the GVIBuy tables, the DPP register and the checkbook. The clustering table is opened read-only for the withheld-rung flag and its content is never stored.

    On this portal

    Browse procurement_vendor_strings →

    Last portal snapshot: 2026-11-22T01:23:43Z (2,337 rows)

  • Procurement Vendor Strings — Checkbook Payment Totals

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    Pre-aggregated checkbook totals per vendor string at rung L1 or L2. Net sums debits and credits together and is allowed to be negative.

    Access details + methodology

    Gross debits, reversals and net are separate columns, with the paired and unpaired credit counts beside them; reversals are never identified by the invoice-status field, which does not work on this data. Rows under pooled placeholder payees that name nobody, and rows where a placeholder has been written over the real payee's name, are excluded at build time. Two vendor strings can reach the same checkbook payee name, so summing this table's rows double-counts — it is a per-vendor lookup, not a total. Pre-aggregation is not an optimisation: Datasette's SQL time limit is two seconds and a per-page-load join to the full payment file would time out, or worse, be cached wrong.

    Primary endpoint

    https://checkbook.vi.gov/

    Access notes

    Derived read-only from usvi_checkbook and procurement_vendor_strings.

    On this portal

    Browse procurement_vendor_payments →

    Last portal snapshot: 2026-11-22T01:23:43Z (928 rows)

  • Procurement Chain Edges — With Strength and Evidence

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    Every edge between procurement documents as a row, carrying a measured strength label — including the edges that do not exist.

    Access details + methodology

    HARD KEY means one document prints a literal identifier that resolves to another. SOURCE-DECLARED means a single-valued field the government prints on the record. SOFT / LIST means a field the source populates inconsistently or that holds a list. NAME-MATCH ONLY means two systems with no shared key. DOCUMENT-CORRECTED means a field a document we hold contradicts. ABSENT edges — payment to purchase order, purchase order to budget line, requisition to purchase order — ship as real rows carrying their evidence sentence, so a reader browsing the CSV sees the missing links rather than inferring them from silence.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Derived read-only. No network access.

    On this portal

    Browse procurement_edges →

    Last portal snapshot: 2026-11-22T01:23:43Z (11,228 rows)

  • Procurement Coverage Matrix — What Is Held, Per Source and Record Kind

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    The coverage matrix: one cell per source, record kind and fiscal year, each carrying its state, its count and the SQL that produced the count.

    Access details + methodology

    States are HELD, PARTIAL, NOT HELD and NOT MEASURABLE, and every PARTIAL names why it is partial. NOT HELD cells record whether the government's publication of that thing was probed at all, because 'we do not hold this' and 'the government does not publish this' are different sentences. Run a cell's stored evidence_sql read-only and it returns the count stored beside it. The cells are recomputed from live data on every refresh rather than transcribed, so a cell cannot drift away from its own query.

    Primary endpoint

    https://gvibuy.buyspeed.com/bso/

    Access notes

    Derived read-only on every refresh.

    On this portal

    Browse procurement_coverage_cells →

    Last portal snapshot: 2026-11-22T01:23:43Z (83 rows)

  • Procurement Coverage Exclusions — Sourced to DPP Policy

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: as published

    What sits outside GVIBuy by policy, each row quoting the sentence it rests on — including three things commonly assumed exempt that are not.

    Access details + methodology

    Judicial and legislative branch procurement, the straight-pay categories, p-card spending, Central Stores purchases on local funds, legacy purchase orders, school-construction work under a threshold, and the award side of disaster-recovery architect-and-engineer work. Three rows are marked REFUTED: federal and grant funds, emergency procurement and sole source are all commonly assumed exempt, and the policy text says they are not — the latter two are exemptions from formal ADVERTISING and run as informal solicitations inside GVIBuy. The exemption boundary itself moved in June 2026, which breaks any before-and-after comparison across that date.

    Primary endpoint

    https://dpp.vi.gov

    Access notes

    Transcribed from DPP policy documents held in the records archive, with the section and the quoted sentence on every row.

    On this portal

    Browse procurement_exclusions →

    Last portal snapshot: 2026-11-22T01:23:43Z (21 rows)

  • Procurement Identifiers Named in Archived Documents

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    Procurement identifiers found in the text of documents in the USVI Public Records archive, with the archive edition the sweep read.

    Access details + methodology

    One row per identifier and document, with the number of occurrences and a direct link to the archived document. The edition of the archive's full-text index is recorded before and after every sweep, and a sweep is discarded if the edition moved underneath it. A result here says what our archive holds and never what exists in the world. The sweep also finds purchase-order and solicitation numbers in our documents that GVIBuy's own list does not contain.

    Primary endpoint

    https://usvipublicrecords.com/

    Access notes

    One phrase query per identifier against the archive's full-text index, opened read-only. No network access.

    On this portal

    Browse procurement_identifier_mentions →

    Last portal snapshot: 2026-11-22T01:23:43Z (713 rows)

  • Procurement Identifiers — Archive Sweep Status

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    One row per identifier in exactly one of three states, including the short forms that are not safely searchable.

    Access details + methodology

    'Documents held', 'none held', or 'not safely searchable'. The last covers the short payment-authorization forms: one of them matched a 1923 newspaper page, so no result is offered for them at all rather than one that would be wrong. 'None held' is a statement about our archive, never about the world.

    Primary endpoint

    https://usvipublicrecords.com/

    Access notes

    Derived read-only from the sweep.

    On this portal

    Browse procurement_identifier_mention_status →

    Last portal snapshot: 2026-11-22T01:23:43Z (7,085 rows)

  • DPP Contract Register × GVIBuy — Adjudicated Vendor Comparison

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    Where DPP's register names a GVIBuy purchase order, with the vendor comparison and the evidence class it rests on.

    Access details + methodology

    The identifier match is a hard key: DPP's register contract number equals a GVIBuy purchase-order number. The VENDOR comparison on top of it is not one claim but two, and every row says which it is: adjudicated against an executed contract PDF held on disk, or resting on a name comparison alone. One row is document-proven different — GVIBuy prints one firm and the executed contract DPP published for that same number names another, with the first firm's name appearing zero times in nine pages. Where a document is held, the document's named party is what the surface shows.

    Primary endpoint

    https://dpp.vi.gov

    Access notes

    Derived read-only from dpp_contracts, gvibuy_purchase_orders and contract PDFs held on disk.

    On this portal

    Browse procurement_dpp_gvibuy →

    Last portal snapshot: 2026-11-22T01:23:43Z (45 rows)

  • DPP Contract Register × Records Archive — Document Manifest Join

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    DPP register rows resolved to a hosted archive copy by exact PDF URL match.

    Access details + methodology

    Modelled one-to-many: a register row can carry more than one document. The match is an exact string comparison of the register's PDF URL against the archive manifest's source URL — no fuzzy matching, no filename heuristics. Documents are mostly present even where structured data is not: the register's own amount and date columns are empty on every row, which is our broken scraper rather than DPP withholding, and nothing is published from an empty column.

    Primary endpoint

    https://dpp.vi.gov

    Access notes

    Derived read-only from dpp_contracts and the records archive manifest.

    On this portal

    Browse procurement_dpp_documents →

    Last portal snapshot: 2026-11-22T01:23:43Z (2,418 rows)

  • Procurement Surface — Refresh Ledger

    USVI Department of Property & Procurement · dpp.vi.gov

    On portal Refresh: weekly

    Every run of the weekly procurement refresh, including the runs that refused to start.

    Access details + methodology

    Each row records when the run was scheduled, when it started and finished, its status, the publish chain's fence verdict and the heartbeat records it saw, the window it ran in, requests made, rows written per table, the archive text-index edition it read before and after, the source observation instant it captured, and when the next run is due. Every 'last refreshed' and 'next expected' on the procurement pages is read from this table through a single view, so the claim is identical on all nine pages and cannot drift. A run that refuses is a row rather than silence, because an outcome that appears as silence cannot be audited.

    Access

    Manual — no public API. See access notes.

    Access notes

    Written by the weekly job itself. Not fetched from anywhere.

    On this portal

    Browse procurement_refresh_runs →

    Last portal snapshot: 2026-11-22T01:23:43Z (30 rows)

Local recovery — VIHFA CDBG-DR quarterly reports + supporting docs

  • VIHFA CDBG-DR Quarterly Performance Reports

    Virgin Islands Housing Finance Authority · cdbgdr.vihfa.gov

    In warehouse (42 rows) Refresh: monthly

    Quarterly performance reporting on $1.86B CDBG-DR disaster recovery allocation. Q4 2018 through Q3 2025 loaded (42 summaries, 698 activities, 277 subrecipients).

    Access details + methodology

    Covers CDBG-DR, CDBG-MIT, and EGRID programs. Source is manual PDF downloads from VIHFA's CDBG-DR portal, converted to markdown, then structured. Supporting docs (action plans, amendments, subrecipient agreements, program policies) comprise another 97 markdown files in the warehouse seed.

    Access

    Manual — no public API. See access notes.

    Access notes

    VIHFA portal is a JS SPA with soft-404s on later quarters — discovery is manual. No API.

    In investigation warehouse

    Table qpr_summary (42 rows). Not published yet.

    Known issues + gaps

    • Q3 2025 is latest loaded — Q4 2025 and Q1 2026 likely published but VIHFA SPA requires manual discovery
    • 97 supplementary markdown docs (action plans, amendments) in warehouse seed, not yet public

Local revenue — territorial taxation and special funds

  • TARF Accounting (Tourism Advertising Revolving Fund)

    USVI Legislature Post Audit Division (de facto) · legvi.org

    In warehouse (1 rows) Refresh: annual

    Annual accounting of the Tourism Advertising Revolving Fund. $111.4M balance as of FY2026; $92.1M available. Statutorily mandated at 33 V.I.C. § 3072(d) but no standalone DOF document exists.

    Access details + methodology

    No DOF-published TARF accounting exists despite the statute; the only ledger is the Legislature Post Audit Division's annual audit PDFs at legvi.org. Warehouse cross-references checkbook rows where fund_code='6068': 6,099 rows totalling $86.4M (FY23-26). Top TARF-paid vendors: Miles Partnership $39M, MTNOC $12.6M.

    Access

    Manual — no public API. See access notes.

    Access notes

    Manually extracted from Post Audit PDFs. Prior-year Post Audit URLs (FY2024, FY2025) currently return 404 on legvi.org — FY2026 snapshot is the only authoritative number we can load.

    In investigation warehouse

    Table tarf_accounting (1 rows). Not published yet.

    Known issues + gaps

    • No DOF-published TARF document despite statutory mandate — only source is Post Audit
    • Prior-year Post Audit URLs 404 on legvi.org
    • Checkbook fund 6068 rows had NULL department — migration backfilled to 'DEPARTMENT OF TOURISM'; re-ingest re-introduces NULLs

Federal spending — USAspending.gov prime and subawards

  • USAspending.gov — Prime Awards

    U.S. Treasury Bureau of the Fiscal Service · www.usaspending.gov

    In warehouse (9,503 rows) Refresh: monthly

    Every federal prime award (grant, contract, loan) to USVI recipients. 9,503 rows 2017-2026.

    Access details + methodology

    The authoritative federal spending feed. Filters: recipient state = VI, time_period 2017-01-01 through 2026-12-31. Covers agencies, program codes (CFDA / Assistance Listings), amounts, outlays, recipients (DUNS / UEI), descriptions.

    Primary endpoint

    https://api.usaspending.gov/api/v2/search/spending_by_award/

    Access notes

    POST-only. Filter JSON body required. Rate-limited: 429 with 10-60s backoff. Public endpoint.

    In investigation warehouse

    Table awards (9,503 rows). Not published yet.

  • USAspending.gov — Subawards

    U.S. Treasury Bureau of the Fiscal Service · www.usaspending.gov

    In warehouse (1,780 rows) Refresh: monthly

    First-tier subawards (pass-throughs) under prime awards. 1,780 rows.

    Access details + methodology

    Pass-through reporting from primes to first-tier recipients. Per-award pagination via POST /subawards/ keyed by award_id. Only first-tier — further pass-throughs are not in USAspending.

    Primary endpoint

    https://api.usaspending.gov/api/v2/subawards/

    Access notes

    Keyed by prime award_id — requires iterating the primes list first.

    In investigation warehouse

    Table subawards (1,780 rows). Not published yet.

    Known issues + gaps

    • First-tier only — deeper pass-throughs are invisible in USAspending
  • USAspending.gov — Transactions

    U.S. Treasury Bureau of the Fiscal Service · www.usaspending.gov

    Refresh: monthly

    Individual federal actions (modifications, obligations) per award. Not yet loaded — script ready.

    Access details + methodology

    Lower-granularity than awards — every action (obligation, deobligation, modification) recorded separately. Required for reconciliation work against Treasury's monthly Treasury Statements.

    Primary endpoint

    https://api.usaspending.gov/api/v2/transactions/

    Access notes

    Requires internal generated_unique_award_id resolved via /search/spending_by_award/. ~9.5K awards to page through — slow.

    In investigation warehouse

    Table transactions (0 rows). Not published yet.

    Known issues + gaps

    • Not yet loaded — script ready but needs ~9.5K award-ID resolution passes

Federal disaster — FEMA Public Assistance + Individual Assistance + NFIP

  • OpenFEMA — Disaster Declarations

    Federal Emergency Management Agency · www.fema.gov/about/openfema

    In warehouse (87 rows) Refresh: monthly

    FEMA disaster declarations affecting USVI. 87 rows. Key disasters: 4340 (Maria), 4335 (Irma), 4513 (COVID).

    Access details + methodology

    Roster of every FEMA-declared disaster in USVI since records began — type, date, declaration code. Anchors every downstream PA / IHP / NFIP record.

    Primary endpoint

    https://www.fema.gov/api/open/v2/DisasterDeclarationsSummaries

    Access notes

    Filter: $filter=state eq 'Virgin Islands'. OData-style API.

    In investigation warehouse

    Table fema_disasters (87 rows). Not published yet.

  • OpenFEMA — Public Assistance Projects

    Federal Emergency Management Agency · www.fema.gov/about/openfema

    In warehouse (2,007 rows) Refresh: monthly

    Public Assistance (PA) project-worksheet records. 2,007 USVI rows. Top project: St. Thomas Wastewater PW100216 at $2.19B.

    Access details + methodology

    Project-worksheet level FEMA PA obligations for USVI. Per-project damage category, amount, federal share obligated, total obligated. Cross-references to checkbook project descriptions via PW numbers.

    Primary endpoint

    https://www.fema.gov/api/open/v2/PublicAssistanceFundedProjectsDetails

    Access notes

    Filter: $filter=stateNumberCode eq '78'. Paginated via $skip.

    In investigation warehouse

    Table fema_pa_projects (2,007 rows). Not published yet.

  • OpenFEMA — Individual & Household Program

    Federal Emergency Management Agency · www.fema.gov/about/openfema

    In warehouse (38,963 rows) Refresh: monthly

    Individual Assistance program registrants — housing, assistance status, island. 38,963 USVI rows.

    Access details + methodology

    Per-registrant household-level records from FEMA Individual Assistance. Aggregated where raw record would be PII — portal shipment will be aggregate-only.

    Primary endpoint

    https://www.fema.gov/api/open/v2/IndividualAssistanceHousingRegistrantsLargeDisasters

    Access notes

    Filter: $filter=damagedStateAbbreviation eq 'VI'. Aggregate-safe for public shipment.

    In investigation warehouse

    Table fema_ihp (38,963 rows). Not published yet.

    Known issues + gaps

    • Individual records contain PII — public portal ships aggregate only
  • OpenFEMA — Public Assistance Funding Awards

    Federal Emergency Management Agency · www.fema.gov/about/openfema

    In warehouse (160 rows) Refresh: monthly

    PA program delivery — applicants and their funding totals. 160 rows.

    Access details + methodology

    Applicant-level PA summary: who received PA funds (typically territorial agencies and municipalities) and in what totals. Complements the project-level view.

    Primary endpoint

    https://www.fema.gov/api/open/v2/PublicAssistanceApplicantsProgramDeliveries

    Access notes

    Filter: $filter=stateCode eq 'VI'.

    In investigation warehouse

    Table fema_pa_awards (160 rows). Not published yet.

  • NFIP Policies

    FEMA National Flood Insurance Program · www.fema.gov/about/openfema

    In warehouse (22,412 rows) Refresh: monthly

    Active NFIP flood insurance policies in USVI. 22,412 records.

    Access details + methodology

    Per-policy coverage, premium, property characteristics. Geographic bucketing by property state + ZIP.

    Primary endpoint

    https://www.fema.gov/api/open/v2/FimaNfipPolicies

    Access notes

    Filter: $filter=propertyState eq 'VI'.

    In investigation warehouse

    Table nfip_policies (22,412 rows). Not published yet.

  • NFIP Claims

    FEMA National Flood Insurance Program · www.fema.gov/about/openfema

    In warehouse (3,504 rows) Refresh: monthly

    NFIP flood claim payments in USVI. 3,504 records.

    Access details + methodology

    Per-claim loss amount, date, damage characteristics. Useful for flood-exposure analysis alongside PA project geography.

    Primary endpoint

    https://www.fema.gov/api/open/v2/FimaNfipClaims

    Access notes

    Filter: $filter=state eq 'VI'.

    In investigation warehouse

    Table nfip_claims (3,504 rows). Not published yet.

Federal audit — Single Audit Act compliance, GSA SAM registry

  • Federal Audit Clearinghouse — Single Audits

    U.S. Census Bureau on behalf of OMB · api.fac.gov

    Needs API key Refresh: monthly

    Single Audit Act reports for USVI auditees — findings, federal expenditures, CFDA-level breakdown. The FAC bulk API remains key-gated, but the GVI's own Single Audits FY2013–FY2024 are parsed and served here as the gvi_findings database.

    Access details + methodology

    Required audit for any entity receiving $750K+ in federal funds. FAC exposes general audit records, findings, and per-program federal awards breakdowns. API key is free but required.

    Primary endpoint

    https://api.fac.gov/general?auditee_state=eq.VI&limit=1000&offset={n}&order=audit_year.desc

    Access notes

    Request header: X-Api-Key: {FAC_API_KEY}. Free registration at https://api.fac.gov/. Findings endpoint is /findings?report_id=eq.{id}; award detail at /federal_awards?report_id=eq.{id}.

    In investigation warehouse

    Table single_audits (0 rows). Not published yet.

    Known issues + gaps

    • Not yet run — free API key registration pending
  • SAM.gov — Entity Registry

    U.S. General Services Administration · sam.gov

    Needs API key Awaiting key Refresh: monthly

    Registered federal-contract-eligible entities based in USVI. Flags debarments + exclusions. Not yet loaded; needs free API key.

    Access details + methodology

    Authoritative federal vendor registry. For each entity: UEI, DUNS, physical + mailing addresses, business types, SBA certifications, debarment/exclusion status. Cross-referenced against checkbook + DPP contract vendors surfaces name mismatches.

    Primary endpoint

    https://api.sam.gov/entity-information/v3/entities

    Access notes

    Params: registrationStatus=A, physicalAddress.stateOrProvinceCode=VI, api_key={SAM_API_KEY}. Free registration at https://sam.gov/content/entity-information.

    In investigation warehouse

    Table sam_entities (0 rows). Not published yet.

    Known issues + gaps

    • Not yet run — free API key registration pending
  • GVI Audit Census — oversight corpus

    VI Update / Brian Louden (compiled from 12 issuer sweeps) · usvipublicrecords.com/library?col=Audits+%26+Oversight

    On portal Refresh: on census update

    1,243 audits, inspections, evaluations and oversight reports about the Government of the U.S. Virgin Islands — GAO, Federal Audit Clearinghouse, financial-statement audits, Legislature Post Audit, V.I. OIG, Interior OIG and other federal OIGs — full-text searchable.

    Access details + methodology

    No consolidated index of audits of the V.I. government existed, so one was built by sweeping twelve issuer families. This is the core oversight corpus of that census; tangential and noise-tier results are excluded. 897 documents carry extracted full text behind the search box. Where an archival copy is held, lf_id and records_url resolve to that document's permanent page on usvipublicrecords.com. Each row records how it was found, in the notes column — this is a compilation, and the issuer's own PDF remains the record.

    Access

    Manual — no public API. See access notes.

    Access notes

    Compiled corpus, not a single upstream feed. Rebuilt by export_ledger_dbs.py in the digital-investigation repo and shipped to R2 as an auxiliary Datasette database.

    On this portal

    Browse audit_census/docs →

    Known issues + gaps

    • 7
    • 3
    • l
    • f
    • _
    • i
    • d
    • s
    • a
    • r
    • e
    • s
    • h
    • a
    • r
    • e
    • d
    • b
    • y
    • m
    • o
    • r
    • e
    • t
    • h
    • a
    • n
    • o
    • n
    • e
    • c
    • a
    • t
    • a
    • l
    • o
    • g
    • r
    • o
    • w
    • —
    • t
    • h
    • e
    • c
    • e
    • n
    • s
    • u
    • s
    • '
    • s
    • d
    • o
    • c
    • u
    • m
    • e
    • n
    • t
    • e
    • d
    • d
    • u
    • p
    • l
    • i
    • c
    • a
    • t
    • e
    • -
    • g
    • r
    • o
    • u
    • p
    • s
    • t
    • r
    • u
    • c
    • t
    • u
    • r
    • e
    • ,
    • w
    • h
    • e
    • r
    • e
    • s
    • e
    • v
    • e
    • r
    • a
    • l
    • l
    • i
    • s
    • t
    • i
    • n
    • g
    • s
    • p
    • o
    • i
    • n
    • t
    • a
    • t
    • o
    • n
    • e
    • a
    • r
    • c
    • h
    • i
    • v
    • e
    • d
    • P
    • D
    • F
    • .
  • GVI Single Audit findings, FY2013–FY2024

    VI Update / Brian Louden (parsed from the audit PDFs) · usvipublicrecords.com/library?col=Audits+%26+Oversight

    On portal Refresh: annual, as each Single Audit is filed

    821 findings from twelve consecutive Government of the Virgin Islands Single Audits, plus 228 repeat-finding lineages, 1,111 corrective actions, program opinions and prior-finding statuses.

    Access details + methodology

    Every finding in the GVI's FY2013–FY2024 Single Audits, parsed from the audit PDFs into eight tables. SEFA totals reconcile dollar-exact with the Federal Audit Clearinghouse for all twelve years, and 15 finding lineages run 10 or more consecutive years. Severity is taken from the audit's own classification language. Every row links back to its source PDF on usvipublicrecords.com via records_url, with the page number the finding starts on.

    Access

    Manual — no public API. See access notes.

    Access notes

    Parsed corpus. Rebuilt by export_ledger_dbs.py and shipped to R2 as an auxiliary Datasette database.

    On this portal

    Browse gvi_findings/findings →

    Known issues + gaps

    • Q
    • u
    • e
    • s
    • t
    • i
    • o
    • n
    • e
    • d
    • -
    • c
    • o
    • s
    • t
    • d
    • o
    • l
    • l
    • a
    • r
    • a
    • m
    • o
    • u
    • n
    • t
    • s
    • a
    • r
    • e
    • d
    • e
    • l
    • i
    • b
    • e
    • r
    • a
    • t
    • e
    • l
    • y
    • w
    • i
    • t
    • h
    • h
    • e
    • l
    • d
    • :
    • t
    • h
    • e
    • e
    • x
    • t
    • r
    • a
    • c
    • t
    • e
    • d
    • f
    • i
    • g
    • u
    • r
    • e
    • s
    • a
    • r
    • e
    • u
    • n
    • v
    • e
    • r
    • i
    • f
    • i
    • e
    • d
    • a
    • g
    • a
    • i
    • n
    • s
    • t
    • t
    • h
    • e
    • P
    • D
    • F
    • s
    • (
    • q
    • c
    • _
    • v
    • e
    • r
    • i
    • f
    • i
    • e
    • d
    • =
    • 0
    • )
    • ,
    • s
    • o
    • q
    • u
    • o
    • t
    • e
    • d
    • o
    • l
    • l
    • a
    • r
    • s
    • f
    • r
    • o
    • m
    • t
    • h
    • e
    • a
    • u
    • d
    • i
    • t
    • i
    • t
    • s
    • e
    • l
    • f
    • ,
    • n
    • e
    • v
    • e
    • r
    • f
    • r
    • o
    • m
    • t
    • h
    • i
    • s
    • t
    • a
    • b
    • l
    • e
    • .

Federal nonprofit — IRS 990 filings and ProPublica registry

  • ProPublica Nonprofit Explorer — 990 Summaries

    ProPublica (aggregating IRS) · projects.propublica.org/nonprofits

    In warehouse (3,543 rows) Refresh: quarterly

    IRS 990 filing summaries for USVI nonprofits. 3,543 filings covering 264 orgs (2007-2024).

    Access details + methodology

    Per-filing summary: revenues, expenses, net assets, top officer compensation, program service accomplishments. 264 of 696 USVI nonprofits have filings — remaining 432 are 990-N e-postcard filers (too small / churches).

    Primary endpoint

    https://projects.propublica.org/nonprofits/api/v2/organizations/{ein}.json

    Access notes

    Search endpoint: /search.json?state[id]=VI&offset={n}. Per-org detail by EIN. Summary n_employees field is always 0 (not populated in API).

    In investigation warehouse

    Table nonprofit_990s (3,543 rows). Not published yet.

    Known issues + gaps

    • ProPublica summary n_employees always 0 — not populated in API
  • ProPublica Nonprofit Registry

    ProPublica · projects.propublica.org/nonprofits

    In warehouse (696 rows) Refresh: manual

    Registry of 696 USVI-registered nonprofits. EIN, name, city, NTEE code.

    Access details + methodology

    Index of every USVI-registered tax-exempt entity known to ProPublica. Used as the entry point for per-EIN 990-filing lookups.

    Primary endpoint

    https://projects.propublica.org/nonprofits/api/v2/search.json?state[id]=VI

    Access notes

    Seeded via load_seed.py.

    In investigation warehouse

    Table nonprofits (696 rows). Not published yet.

  • IRS 990 PDF Archive + OCR

    Internal Revenue Service · apps.irs.gov

    In warehouse (4,459 rows) Refresh: annual

    990 filing PDFs. 4,459 filings tracked; 847 PDFs downloaded; 8 OCR'd. Image-only scans — Tesseract OCR required.

    Access details + methodology

    The actual 990 forms as filed. ProPublica blocks direct PDF downloads (403 Forbidden) so filenames are resolved from ProPublica's download-filing path and hit directly at apps.irs.gov. Scanned paper filings — OCR via Tesseract + PyMuPDF is required to extract searchable text.

    Primary endpoint

    https://apps.irs.gov/pub/epostcard/cor/{filename}.pdf

    Access notes

    URL conversion: ProPublica path=IRS%2F{filename} → direct IRS URL. Older filings use path=2016_03_EO%2F{filename} — script extracts filename from any prefix. ~1,267 filings return 404 from IRS (no longer hosted).

    In investigation warehouse

    Table irs_990_pdfs (4,459 rows). Not published yet.

    Known issues + gaps

    • ~1,267 filings return 404 from IRS (no longer hosted)
    • All downloaded PDFs are image-only — OCR required for text search
    • Public file delivery deferred to Phase 5 (R2 archive)

Federal census — Decennial Census of Island Areas (USVI is not covered by ACS)

  • U.S. Census Bureau — Decennial Census of Island Areas (USVI)

    Census Bureau · api.census.gov

    On portal Needs optional API key Refresh: decennial

    Total population and total housing units for USVI from the 2000, 2010, and 2020 decennial enumerations. State (FIPS 78) + the three statistical counties (010 St. Croix, 020 St. John, 030 St. Thomas).

    Access details + methodology

    USVI is NOT covered by the American Community Survey — every state:78 query against acs5 returns 204 No Content. The Decennial Census of Island Areas is the only complete-enumeration source for USVI population. State-level trajectory: 108,612 (2000) → 106,405 (2010) → 87,146 (2020). The 19.8% drop from 2010 to 2020 is hurricane-driven outmigration after Irma + Maria. Decennial counts are full enumerations, not survey estimates — there is no margin of error to report. Inter-decennial years have no Census Bureau population estimate for USVI; do not interpolate.

    Primary endpoint

    https://api.census.gov/data/{year}/dec/{vi|dhcvi}?get={vars}&for=state:78

    Access notes

    Datasets: 2000/dec/vi (SF), 2010/dec/vi (SF), 2020/dec/dhcvi (Demographic and Housing Characteristics — Virgin Islands). Variable codes drift between decades: P001001 / H001001 in 2000+2010 SF; P1_001N / H1_001N in 2020 DHCVI. Schema stores both a normalized name and the raw Census code per row. 6 API requests for full backfill (state + counties × 3 decades). Anonymous quota is fine; CENSUS_API_KEY honored if set.

    On this portal

    Browse census →

    Known issues + gaps

    • USVI is not in ACS — inter-decennial years have no Census-published population estimate. Per-capita transforms must footnote which decennial they used.
    • Variable codes change between SF (2000/2010) and DHCVI (2020); ETL stores both normalized name and raw source code

Federal environment — EPA SDWIS + ECHO

  • EPA SDWIS — Water Systems

    Environmental Protection Agency · data.epa.gov

    In warehouse (1,079 rows) Refresh: manual

    Safe Drinking Water Information System — water systems serving USVI. 1,079 records.

    Access details + methodology

    Per-system ID, name, population served, system type, source water type, compliance status.

    Primary endpoint

    https://data.epa.gov/efservice/WATER_SYSTEM/STATE_CODE/VI/JSON

    Access notes

    Must append /JSON path suffix; Accept header alone returns XML.

    In investigation warehouse

    Table water_systems (1,079 rows). Not published yet.

    Known issues + gaps

    • Count mismatch: warehouse 1,079 vs upstream ~829 — filter difference, worth reconciling
  • EPA SDWIS — Violations

    Environmental Protection Agency · data.epa.gov

    In warehouse (2,095 rows) Refresh: manual

    Drinking-water violations reported by USVI systems. 2,095 records.

    Access details + methodology

    Per-violation code, category (MCL, reporting, treatment), severity, resolution status. Joined to water_systems via PWSID.

    Primary endpoint

    https://data.epa.gov/efservice/VIOLATION/PWSID/VI*/JSON

    Access notes

    PWSID filter with VI* wildcard.

    In investigation warehouse

    Table water_violations (2,095 rows). Not published yet.

  • EPA ECHO — Facilities

    Environmental Protection Agency · echodata.epa.gov

    In warehouse (615 rows) Refresh: manual

    Enforcement & Compliance History Online — USVI regulated facilities. 615 rows.

    Access details + methodology

    Per-facility location, program coverage (CWA, RCRA, CAA, TRI), enforcement status, penalty totals. Used for environmental justice mapping.

    Primary endpoint

    https://echodata.epa.gov/echo/dfr_rest_services.get_facility_info

    Access notes

    Params: p_st=VI&output=JSON. Two-step ECHO pattern: get_facilities → get_qid.

    In investigation warehouse

    Table epa_facilities (615 rows). Not published yet.

Manually curated — entities, investigations, findings

  • Seed — Entity Resolution

    Shadow Ledger editorial (Brian Louden)

    In warehouse (18 rows) Refresh: manual

    Canonical entity names + aliases — WAPA, VIHFA, MTNOC, and 15 more. Used for fuzzy matching across disparate source tables.

    Access details + methodology

    Hand-curated entity registry joining the ways the same organization appears across checkbook, vendors, DPP contracts, USAspending, and 990s (spelling variants, legal-name changes, DBAs). 18 rows today.

    Access

    Manual — no public API. See access notes.

    Access notes

    Seeded via warehouse/ingest/load_seed.py from warehouse/seed/entities.json.

    In investigation warehouse

    Table entities (18 rows). Not published yet.

    Known issues + gaps

    • Growing roster — 18 entities covered out of thousands appearing across sources

Federal labor — OSHA workplace-safety enforcement, including the V.I. State Plan (VIDOSH) for public-sector employees

  • OSHA Inspections — U.S. Virgin Islands

    Occupational Safety and Health Administration (U.S. Department of Labor) · www.osha.gov

    On portal Refresh: continuous

    938 OSHA inspections in the territory, 2017–2026, 518 of them carrying violations — federal OSHA for the private sector and VIDOSH for public employees.

    Access details + methodology

    Every OSHA inspection in the U.S. Virgin Islands that the agency's establishment search will serve: 938 between 2017-01-05 and 2026-08-26, of which 518 carry at least one violation. Joins to the citations table on activity_nr. THE TERRITORY HAS TWO ENFORCEMENT BODIES and the office_kind column is which. The Virgin Islands State Plan — VIDOSH, the V.I. Division of Occupational Safety and Health, approved 2003-07-23 at 68 FR 43457 — covers PUBLIC-SECTOR employees only: 434 inspections. Federal OSHA retains the private sector and runs the territory from the Puerto Rico Area Office: 504 inspections. Comparing the two caseloads without separating them compares a territorial regulator against a federal one. THE RECORD STARTS IN 2017 AND THAT IS THE PUBLISHER'S LIMIT, NOT A GAP IN COLLECTION. OSHA's search silently rewrites any earlier start date to 2016, so roughly fourteen years of State Plan enforcement since 2003 is not reachable by this route and is absent here — absent, not zero. The establishments inspected are overwhelmingly the territory's own agencies: Education 75, Human Services 32, Health 23, Planning and Natural Resources 22, Public Works 15, Police 13, Waste Management 10, Port Authority 9. Injured employees are anonymised by OSHA at source. Rows are copied as published.

    Primary endpoint

    https://www.osha.gov/ords/imis/establishment.html

    Access notes

    No key and no account. Two things make this harder than it looks and both are recorded in the harvester: the `state` parameter is a DEAD FILTER (state=VI returns exactly what a nonsense state returns), so inspections must be enumerated by OSHA office code; and the service rewrites the requested date range to the last ten years and echoes the rewrite back. Pre-2017 data requires the DOL bulk enforcement extracts and a free DOL API key, which we do not yet hold.

    On this portal

    Browse osha_inspections →

    Last portal snapshot: 2026-11-22T01:23:42Z (938 rows)

    Known issues + gaps

    • Coverage begins 2017; the 2003-2016 State Plan record is not on this route.
  • OSHA Citations — U.S. Virgin Islands

    Occupational Safety and Health Administration (U.S. Department of Labor) · www.osha.gov

    On portal Refresh: continuous

    One row per OSHA citation issued in the territory — the standard cited, its classification, penalties, abatement dates and contest status.

    Access details + methodology

    One row per CITATION, joining to the inspections table on activity_nr. This is the table that answers what an employer was actually cited for. standard_cited is OSHA's own compressed form, so '19100156 C01' is 29 CFR 1910.156(c)(1). citation_type is Serious, Willful, Repeat, Other or Unclassified. PENALTIES APPEAR TWICE ON PURPOSE. The initial_penalty / current_penalty / fta_penalty columns are the strings OSHA printed; the matching _usd columns are those parsed to numbers, and are left EMPTY rather than zero wherever the source recorded nothing. A citation issued with no fine and a citation whose penalty was never recorded are different facts, and a public-sector employer under a State Plan is routinely cited at $0. Sum the _usd columns and treat an empty one as unknown, never as zero.

    Primary endpoint

    https://www.osha.gov/ords/imis/establishment.html

    Access notes

    Collected alongside the inspections; same access notes apply.

    On this portal

    Browse osha_violations →

    Last portal snapshot: 2026-11-22T01:23:42Z (1,753 rows)

    Known issues + gaps

    • Coverage begins 2017, following the inspections table.