piker/tests
Gud Boi 81e8ba3ca8 Use IB schedules to reserve missing SHM history
Interrupted backfill can leave stored observations separated by
missing trading time. Query dated IB sessions before prepending
stored history and reserve synthetic samples only during covered
open sessions. Keep venue closures compressed and preserve the
indexes of already published rows.

Deats,
- Add `Client.history_schedule()` with UTC coverage, extended hours,
  bounded duration, timeout, and rejection of ambiguous DST times.
- Keep schedule normalization in `venues` and allocation in
  `.tsp._reserve`, with the project AGPL headers.
- Expose schedule and synthetic-range queries through `datad.ib`.
- Bound reservations by available SHM capacity and inspect only the
  newest 32 gaps by default via `newest_gaps`. Zero disables
  queries; leave unknown and oversized ranges unresolved.
- Record synthetic ranges separately from OHLCV. Automatic storage
  writes retain provider observations; placeholders copy close.
- Group the new tests under `tests/providers`.
- Cover request formatting, DST, failure and capacity cases, plus
  real SHM/NativeDB startup placement with a fake provider.
- Document a common CLI/chart segment-repair interface and defer
  coordinated insertion, repair execution, and reader integration.

Validation: 55 targeted tests passed in the working tree; live IB
schedule coverage remains unqualified. After the module moves,
33 affected tests passed again; the local review follow-up passed
18 affected cases, including four new request-budget cases.
The commit runner repeats
lint and isolated regression checks against this exact boundary.

Prompt-IO: ai/prompt-io/codex/20260924T185456Z_1da9b760_schedule_prompt_io.md

(this patch was generated in some part by `codex` using
`gpt-6` (`openai`))
2026-11-13 17:30:24 -05:00
..
_inputs Add first account cumsize test; known to fail Bo 2023-07-14 17:54:13 -04:00
providers Use IB schedules to reserve missing SHM history 2026-11-13 17:30:24 -05:00
conftest.py Clean test-owned SHM leaks in `pytest` 2026-11-11 11:24:45 -05:00
test_accounting.py Draft a gt-one-`.fqme`-in-txns/account-file test 2026-01-07 13:41:07 -05:00
test_backfill_audit_snippet.py Add `xonsh` backfill qualification workflow 2026-11-11 11:36:45 -05:00
test_binance.py Harden Binance USD-M feed startup 2026-11-06 15:40:58 -05:00
test_cli.py Skip CLI tests due to questrade dependency for now 2021-05-22 15:12:12 -04:00
test_docker_services.py Skip marketstore docker tests, we're gonna drop it.. 2023-06-27 13:42:08 -04:00
test_ems.py Port service+tests to latest `tractor` APIs 2026-10-07 03:10:41 -04:00
test_ems_broadcast.py .clearing: backport owned dark quote subscriptions 2026-10-23 11:36:02 -04:00
test_feed_broadcast.py .data: isolate cached feed stream consumers 2026-10-21 20:50:38 -04:00
test_feeds.py Update feed test fqmes to use `.<venue>` format 2026-10-07 03:10:41 -04:00
test_history_backfill.py Factor and bound synthetic SHM null repair 2026-11-13 17:29:30 -05:00
test_ib_broker.py Fix string errors in `.ib.broker` relay 2026-11-13 17:13:23 -05:00
test_ib_history.py Use IB UTC syntax for history `endDateTime` 2026-11-11 18:04:05 -05:00
test_ib_method_proxy.py Raise on IB socket disconnects in proxy and trades 2026-11-13 17:17:58 -05:00
test_ib_quote_restart.py .ib.feed: backport no-data request boundaries 2026-10-23 11:35:31 -04:00
test_ib_trade_events.py Raise on IB socket disconnects in proxy and trades 2026-11-13 17:17:58 -05:00
test_ldshm.py Simplify `store` series and SHM discovery 2026-11-12 09:48:09 -05:00
test_logging.py .data: expose websocket reconnect progress at INFO 2026-11-06 15:40:58 -05:00
test_questrade.py Spurious first-draft of EG collapsing 2026-01-06 22:27:58 -05:00
test_services.py .data: cut feed layer over to `datad` actors 2026-11-09 17:05:43 -05:00
test_shm_cleanup.py Clean test-owned SHM leaks in `pytest` 2026-11-11 11:24:45 -05:00
test_startup.py Fix endpoint config and daemon startup from PR94 review 2026-10-10 14:20:52 -04:00
test_storage_audit.py Repair first-slot OHLC sentinels in `NativeDB` 2026-11-11 18:04:16 -05:00
test_storage_nativedb.py Expose storage state through `piker store` 2026-11-12 09:48:06 -05:00
test_store_cli.py Simplify `store` series and SHM discovery 2026-11-12 09:48:09 -05:00
test_tsp_analysis.py .tsp: report non-positive timestamp steps 2026-11-10 14:32:23 -05:00
test_watchlists.py Capture the right logger 2019-02-10 17:29:08 -05:00
test_websocket.py Distinguish websocket receive and relay timeouts 2026-11-06 15:40:58 -05:00