home / portal / procurement_refresh_runs

procurement_refresh_runs: 11

Every run of the weekly procurement refresh, including the runs that refused to start. Every 'last refreshed' and 'next expected' on the procurement pages is read from this table through vw_procurement_freshness.

This data as json

rowid run_id schedule_rule scheduled_for_utc started_utc finished_utc status fence_verdict fence_records_json window_verdict script_version source_observed_utc next_expected_utc requests_made rows_written_json tables_touched corpus_edition_start corpus_edition_end manifest_mtime notes error is_dry_run run_mode
11 2026-09-02T22:39:53Z weekly, Wednesday 10:40 America/St_Thomas 2026-09-02T14:40:00Z 2026-09-02T22:39:53Z 2026-09-02T22:41:19Z ok clear for a run that makes no request: no chain heartbeat is running or hung. GVIBuy is busy (pid 4724: "C:\Users\Claude-server\AppData\Local\Programs\Python\Python314\python.exe" fetch_gvibuy_detail.py --type po --sleep 6.0) and would have blocked a fetching run [{"name": "publish_run", "state": "failed", "pid": 2924, "alive": null, "quiet_s": 55111, "note": "failed at step 4: push the per-document records"}, {"name": "refresh_all", "state": "done", "pid": 12972, "alive": null, "quiet_s": 55232, "note": "complete"}, {"name": "build_index", "state": "done", "pid": 6112, "alive": null, "quiet_s": 55264, "note": "1 built, 5 current"}, {"name": "launch_publish", "state": "no heartbeat"}, {"name": "launch_index", "state": "no heartbeat"}, {"name": "gvibuy-host", "state": "busy", "pid": "4724", "cmdline": "\"C:\\Users\\Claude-server\\AppData\\Local\\Programs\\Python\\Python314\\python.exe\" fetch_gvibuy_detail.py --type po --sleep 6.0"}] allowed: real clock 2026-09-02 18:39 AST is outside 01:00-05:00 procurement_weekly.py:0a65bc0774cb procurement_weekly.ps1:a7d77d2e9d8a load_gvibuy.py:bd90ece9fa7e build_procurement_vendors.py:d82d063491f8 build_procurement_edges.py:1f29d876448f build_dpp_links.py:6791d3ae4fd6 sweep_identifier_mentions.py:7fd5963d97de build_coverage_cells.py:c5799d5d2d6d 2026-09-02T12:44:45+00:00 2026-09-09T14:40:00Z   {"dry_run": false, "made_network_request": false, "run_mode": "load-only", "steps": [{"rc": 0, "seconds": 0.5, "step": "load-gvibuy"}, {"rc": 0, "seconds": 2.1, "step": "vendor-ladder"}, {"rc": 0, "seconds": 0.7, "step": "edges"}, {"rc": 0, "seconds": 0.1, "step": "dpp-links"}, {"rc": 0, "seconds": 81.8, "step": "mention-sweep"}, {"rc": 0, "seconds": 0.6, "step": "coverage-cells"}], "table_rows": {"gvibuy_attachments_staged": 0, "gvibuy_bid_detail": 0, "gvibuy_bid_po_ref": 268, "gvibuy_bid_quotes": 0, "gvibuy_bids": 1483, "gvibuy_blankets": 324, "gvibuy_po_header_detail": 32, "gvibuy_po_items": 0, "gvibuy_po_types": 965, "gvibuy_purchase_orders": 1912, "gvibuy_vendors": 3223, "procurement_coverage_cells": 70, "procurement_dpp_documents": 2418, "procurement_dpp_gvibuy": 45, "procurement_edges": 841, "procurement_exclusions": 21, "procurement_identifier_mention_status": 3395, "procurement_identifier_mentions": 625, "procurement_identifier_unlisted": 206, "procurement_po_classification": 1912, "procurement_refresh_runs": 11, "procurement_vendor_payments": 757, "procurement_vendor_strings": 1976}} gvibuy_vendors, gvibuy_purchase_orders, gvibuy_bids, gvibuy_blankets, gvibuy_po_types, gvibuy_bid_po_ref, gvibuy_po_header_detail, gvibuy_po_items, gvibuy_bid_detail, gvibuy_bid_quotes, gvibuy_attachments_staged, procurement_po_classification, procurement_vendor_strings, procurement_vendor_payments, procurement_edges, procurement_coverage_cells, procurement_exclusions, procurement_dpp_gvibuy, procurement_dpp_documents, procurement_identifier_mentions, procurement_identifier_mention_status, procurement_identifier_unlisted, procurement_refresh_runs 18b158473053 18b158473053 2026-09-02T07:03:00Z trigger=manual; run_mode=load-only; timezone: fixed offset -04:00 (no tzdata on this interpreter; the USVI observes no daylight saving); requests_made is NULL: the fetcher reports rows and pages, not requests, and this job does not estimate a number nobody measured; LOAD-ONLY: this run DID rebuild the derived procurement tables from the harvest CSVs already on disk (load_gvibuy --derived-only, then the vendor ladder, the edges, the DPP links, the mention sweep and the coverage cells), so it moved data in the warehouse and the surface may date its data from it. It did NOT make a single network request, did NOT read GVIBuy, and did NOT touch the four list tables or their fetched_at: source_observed_utc on this row (2026-09-02T12:44:45+00:00) is the instant the earlier harvest read GVIBuy and is not this run's clock. Run mode load-only exists because the GVIBuy fence allows one session on that host and the detail crawl held it; the fence was not weakened to get this run.   0 load-only
Powered by Datasette · Queries took 7.028ms