home / portal / procurement_refresh_runs

procurement_refresh_runs: 24

Every run of the weekly procurement refresh, including the runs that refused to start. Every 'last refreshed' and 'next expected' on the procurement pages is read from this table through vw_procurement_freshness.

This data as json

rowid run_id schedule_rule scheduled_for_utc started_utc finished_utc status fence_verdict fence_records_json window_verdict script_version source_observed_utc next_expected_utc requests_made rows_written_json tables_touched corpus_edition_start corpus_edition_end manifest_mtime notes error is_dry_run run_mode
24 2026-11-18T19:18:58Z weekly, Wednesday 10:40 America/St_Thomas 2026-11-18T14:40:00Z 2026-11-18T19:18:58Z 2026-11-18T19:21:51Z ok clear: no chain heartbeat is running or hung, nothing else on this machine is talking to GVIBuy, and no run artifact this job writes is another session's uncommitted work [{"name": "publish_run", "state": "done", "pid": 34908, "alive": null, "quiet_s": 28910, "note": "complete"}, {"name": "refresh_all", "state": "done", "pid": 44700, "alive": null, "quiet_s": 41837, "note": "complete"}, {"name": "build_index", "state": "done", "pid": 65588, "alive": null, "quiet_s": 42535, "note": "2 built, 4 current"}, {"name": "launch_publish", "state": "no heartbeat"}, {"name": "launch_index", "state": "no heartbeat"}, {"name": "runs-tree", "state": "clear", "paths": [], "note": "clear: this run writes no file into the git working tree (the harvest step, which does, is not in this run's step list)"}] allowed: schedule clock 2026-11-18 15:18 AST / machine clock 2026-11-18 15:18 Atlantic Standard Time — every one outside 01:00-05:00 procurement_weekly.py:a09dcba9407e procurement_weekly.ps1:a7d77d2e9d8a load_gvibuy.py:bd90ece9fa7e build_procurement_vendors.py:aa0c21b932bb build_procurement_edges.py:3c2ab7c8c3c6 build_dpp_links.py:60939432eff0 sweep_identifier_mentions.py:7fd5963d97de build_coverage_cells.py:fd75c00c3a6e 2026-11-18T14:57:12+00:00 2026-11-25T14:40:00Z   {"dry_run": false, "made_network_request": false, "run_mode": "load-only", "steps": [{"rc": 0, "seconds": 0.6, "step": "load-gvibuy"}, {"rc": 0, "seconds": 17.5, "step": "vendor-ladder"}, {"rc": 0, "seconds": 49.3, "step": "edges"}, {"rc": 0, "seconds": 1.2, "step": "dpp-links"}, {"rc": 0, "seconds": 83.7, "step": "mention-sweep"}, {"rc": 0, "seconds": 20.4, "step": "coverage-cells"}], "table_rows": {"gvibuy_attachments_staged": 3985, "gvibuy_bid_po_ref": 314, "gvibuy_bids": 2689, "gvibuy_blankets": 484, "gvibuy_po_header_detail": 1911, "gvibuy_po_items": 12342, "gvibuy_po_types": 15943, "gvibuy_purchase_orders": 4393, "gvibuy_vendors": 3559, "procurement_coverage_cells": 88, "procurement_dpp_documents": 2418, "procurement_dpp_gvibuy": 45, "procurement_edges": 5776, "procurement_exclusions": 21, "procurement_identifier_mention_status": 7084, "procurement_identifier_mentions": 711, "procurement_identifier_unlisted": 178, "procurement_po_classification": 4393, "procurement_refresh_runs": 24, "procurement_vendor_payments": 925, "procurement_vendor_strings": 2332}} gvibuy_vendors, gvibuy_purchase_orders, gvibuy_bids, gvibuy_blankets, gvibuy_po_types, gvibuy_bid_po_ref, gvibuy_po_header_detail, gvibuy_po_items, gvibuy_attachments_staged, procurement_po_classification, procurement_vendor_strings, procurement_vendor_payments, procurement_edges, procurement_coverage_cells, procurement_exclusions, procurement_dpp_gvibuy, procurement_dpp_documents, procurement_identifier_mentions, procurement_identifier_mention_status, procurement_identifier_unlisted, procurement_refresh_runs e75a70ff176e e75a70ff176e 2026-11-18T18:17:27Z trigger=manual; run_mode=load-only; timezone: fixed offset -04:00 (no tzdata on this interpreter; the USVI observes no daylight saving); requests_made is NULL: the fetcher reports rows and pages, not requests, and this job does not estimate a number nobody measured; LOAD-ONLY: this run DID rebuild the derived procurement tables from the harvest CSVs already on disk (load_gvibuy --derived-only, then the vendor ladder, the edges, the DPP links, the mention sweep and the coverage cells), so it moved data in the warehouse and the surface may date its data from it. It did NOT make a single network request, did NOT read GVIBuy, and did NOT touch the four list tables or their fetched_at: source_observed_utc on this row (2026-11-18T14:57:12+00:00) is the instant the earlier harvest read GVIBuy and is not this run's clock. Run mode load-only exists because the GVIBuy fence allows one session on that host and the detail crawl held it; the fence was not weakened to get this run.   0 load-only
Powered by Datasette · Queries took 1.673ms