gap_annotator: super fast (time-)gap detection API #75

Open

goodboy wants to merge 14 commits from gap_annotator into ib_venue_closures

Author	SHA1	Message	Date
Gud Boi	a06fe473cf	Drop `Flume.feed`, it's unused yet causes import cycles..	2026-02-24 16:06:53 -05:00
Gud Boi	01fc1d3887	Just warn on single-bar nulls instead of bping Replace the debug breakpoint with a warning-log when a single-bar null-segment is detected in `get_null_segs()`. This lets the gap analysis continue while still alerting about the anomaly. Deats, - extract the 3-bar window (before, null, after) and calculate a `gap: pendulum.Interval` for the warning msg. - comment-out the old breakpoint block for optional debugging as needed. (this commit msg was generated in some part by [`claude-code`][claude-code-gh]) [claude-code-gh]: https://github.com/anthropics/claude-code	2026-02-24 16:06:53 -05:00
Gud Boi	056128de0b	Lul, drop long unused poetry lock file	2026-02-24 16:06:53 -05:00
Gud Boi	69154f9ee2	Pin `pg` at latest official `0.14.0` release Keep in masked GH sources lines for easy hackin against upstream `master` branch when needed as well!	2026-02-24 16:06:53 -05:00
Gud Boi	2fa4ed969c	.ui._editors: log multiline styling and re-leveling	2026-02-24 16:06:53 -05:00
Gud Boi	49f75318be	.ui._lines: drop unused graphics-item import	2026-02-24 16:06:53 -05:00
Gud Boi	4a5096c78d	Add batch-submit API for gap annotations Introduce `AnnotCtl.add_batch()` and `serve_rc_annots()` batch handler to submit 1000s of gaps in single IPC msg instead of per-annot round-trips. Server builds `GapAnnotations` from specs and handles vectorized timestamp-to-index lookups. Deats, - add `'cmd': 'batch'` handler in `serve_rc_annots()` - vectorized timestamp lookup via `np.searchsorted()` + masking - build `gap_specs: list[dict]` from rect+arrow specs client-side - create single `GapAnnotations` item for all gaps server-side - handle `GapAnnotations.reposition()` in redraw handler - add profiling to batch path for perf measurement - support optional individual arrows for A/B comparison Also, - refactor `markup_gaps()` to collect specs + single batch call - add `no_qt_updates()` context mgr for batch render ops - add profiling to annotation teardown path - add `GapAnnotations` case to `rm_annot()` match block (this patch was generated in some part by [`claude-code`][claude-code-gh]) [claude-code-gh]: https://github.com/anthropics/claude-code	2026-02-24 16:06:53 -05:00
Gud Boi	6727cce1fc	Add a `GapAnnotations` path-renderer For a ~1000x perf gain says ol' claudy, our boi who wrote this entire patch! Bo Introduce `GapAnnotations` in `.ui._annotate` for batch-rendering gap rects/arrows instead of individual `QGraphicsItem` instances. Uses upstream's `pyqtgraph.Qt.internals.PrimitiveArray` for rects and a `QPainterPath` for arrows. This API-replicates our prior annotator's in view shape-graphics but now using (what we're dubbing) "single-array-multiple-graphics" tech much like our `.ui._curve` extensions to `pg` B) Impl deats, - batch draw ~1000 gaps in single paint call vs 1000 items - arrows render in scene coords to maintain pixel size on zoom - add vectorized timestamp-to-index lookup for repositioning - cache bounding rect, rebuild on `reposition()` calls - match `SelectRect` + `ArrowItem` visual style/colors - skip reposition when timeframe doesn't match gap's period Other, - fix typo in `LevelMarker` docstring: "graphich" -> "graphic" - reflow docstring in `qgo_draw_markers()` to 67 char limit (this patch was generated in some part by [`claude-code`][claude-code-gh]) [claude-code-gh]: https://github.com/anthropics/claude-code	2026-02-24 16:06:53 -05:00
Gud Boi	68f629d306	Add info log for shm processing in `ldshm` CLI cmd Log shm file name and detected period before null segment processing to aid debugging. (this patch was generated in some part by [`claude-code`][claude-code-gh]) [claude-code-gh]: https://github.com/anthropics/claude-code	2026-02-24 16:06:53 -05:00
Gud Boi	0fb47de4b5	Bump to latest official `pyqtgraph` release	2026-02-24 16:06:53 -05:00
Gud Boi	9e2af2838f	Ah right, we import types from `eventkit` (now `aeventkit`)..	2026-02-24 16:06:42 -05:00
Gud Boi	b1cb67d1bd	Port `.ib` backend from `ib_insync` to `ib_async` Migrate the IB broker backend to use `ib_async` (the actively maintained fork) instead of the now stale, original `ib_insync` lib. Deats, - update `pyproject.toml` dep: drop `ib-insync` pin, add `ib-async>=2.1.0`. - update lock file with `ib-async` and its new `aeventkit` dep (which i guess replaces `eventkit`). - obvi, change all `ib_insync` imports to `ib_async` across `.ib.*`. - update docs and select internal comments referencing the original lib. Also, - drop unused `ledger_dict` init in `_flex_reports.load_flex_trades()`. - fix union type annot style: `dict \| None` -> `dict\|None`. - strip `.tzinfo` from `lastTimeStamp` in `normalize()` to avoid IPC codec issues with `ib_async`'s `timezone.utc` injection. - pop `'defaults'` from ticker data dict in `normalize()` to avoid non-serializable `timezone` objects and warning-log in such cases. (this commit msg was generated in some part by [`claude-code`][claude-code-gh]) [claude-code-gh]: https://github.com/anthropics/claude-code	2026-02-24 15:13:28 -05:00
Gud Boi	196422433c	Capture `cons` in `Client.get_fute()` That is to be able to (eventually) introspect "ambiguous" contract sets once we move to `ib_async` and its `returnAll: bool` now offered by `IB.qualifyContractsAsync()`, https://github.com/ib-api-reloaded/ib_async/blob/main/ib_async/ib.py#L2115 Also, tweak some type type annots to multline style in sibling mods.	2026-02-24 12:31:43 -05:00
Gud Boi	9a720f8e21	Merge pull request 'ib_venue_closures: gap detection for "legacy mkts"' (#71 ) Reviewed-on: https://www.pikers.dev/pikers/piker/pulls/71	2026-02-24 17:31:13 +00:00