Commit Graph

3287 Commits (9e5170033be656d50cea1b91691bf807cab5b7dd)

Author SHA1 Message Date
Tyler Goodlet 47ffe60047 Rework display loop maxmin-ing with `Viz` pipelining
First, we rename what was `chart_maxmin()` -> `multi_maxmin()` and don't
`partial` it in to the `DisplayState`, just call it with correct `Viz`
ref inputs.

Second, as we've done with `ChartView.maybe_downsample_graphics()` use
the output from the main `Viz.update_graphics()` and feed it to the
`.maxmin()` calls for the ohlc and vlm chart but still deliver the same
output signature as prior. Also accept and use an optional profiler
input, drop `DisplayState.maxmin()` and add `.vlm_viz`.

Further perf related tweak to do with more efficient incremental
updates:
- only call `multi_maxmin()` if the main fast chart viz does a pixel
  column step.
- mask out hist viz and vlm viz and all linked fsp `._set_yrange()`
  calls for now until we figure out how to best optimize these updates
  when considering the new group-scaled-by-% style for multicharts.
- drop `.enable_auto_yrange()` calls during startup.
2023-02-02 16:22:39 -05:00
Tyler Goodlet e44b485bcb Adjust vlm fsp code to new `Viz.update_graphics()` output sig 2023-02-02 16:12:57 -05:00
Tyler Goodlet 7d404ed7ef Support read-slice input to `Viz.maxmin()`
Acts as short cut when pipe-lining from `Viz.update_graphics()` (which
now returns the needed in-view array-relative-read-slice as output) such
that `Viz.read()` and `.datums_range()` doesn't need to be called
internally multiple times. In this case where `i_read_range` is provided
we of course skip doing time index translations and consequently lookup
the appropriate (epoch-time) index indices for caching.
2023-02-02 16:12:57 -05:00
Tyler Goodlet b45c027db8 Backlink subchart views to "main chart" in `.add_plot()` 2023-02-02 16:12:57 -05:00
Tyler Goodlet 973902db43 Drop `ChartView._maxmin()` usage in `.ui._fsp`
Removes the multi-maxmin usage as well as ensures appropriate `Viz` refs
are passed into the view methods now requiring it. Also drops the "back
linking" of the vlm chart view to the source OHLC chart since we're
going to add this as a default to the charting API.
2023-02-02 16:12:57 -05:00
Tyler Goodlet 0ec1c8e85d Drop `ChartView._maxmin()` idea, use `Viz.maxmin()`
The max min for a given data range is defined on the lowest level
through the `Viz` api intermingling it with the view is a layering
issue. Instead make `._set_yrange()` call the appropriate view's viz
(since they should be one-to-one) directly and thus avoid any callback
monkey patching nonsense.

Requires that we now make `._set_yrange()` require either one of an
explicit `yrange: tuple[float, float]` min/max pair or the `Viz` ref (so
that maxmin can be called) as input. Adjust
`enable/disable_auto_yrange()` to bind in a new `._yranger()` partial
that's (solely) needed for signal reg/unreg which binds in the now
required input `Viz` to these methods.

Comment the `autoscale_overlays` block in `.maybe_downsample_graphics()`
for now until we figure out the most sane way to auto-range all linked
overlays and subplots (with their own overlays).
2023-02-02 16:12:57 -05:00
Tyler Goodlet 4866bdc460 More thoroughly profile the display loop 2023-02-02 16:12:57 -05:00
Tyler Goodlet 65434e2e67 Use `Viz.draw_last()` inside `.update_graphics()`
In an effort to ensure uniform and uppx-optimized last datum graphics
updates call this method directly instead of the equivalent graphics
object thus ensuring we only update the last pixel column according with
the appropriate max/min computed from the last uppx's worth of data.

Fixes / improvements to enable `.draw_last()` usage include,
- change `Viz._render_table` -> `._alt_r: tuple[Renderer, pg.GraphicsItem] | None`
  which holds an alternative (usually downsampled) render and graphics
  obj.
- extend the `.draw_last()` signature to include:
  - `last_read` to allow passing in the already read data from
    `.update_graphics()`, if it isn't passed then a manual read is done
    internally.
  - `reset_cache: bool` which is passed through to the graphics obj.
- use the new `Formatter.flat_index_ratio: float` when indexing into xy
  1d data to compute the max/min for that px column.

Other,
- drop `bars_range` input from `maxmin()` since it's unused.
2023-02-02 16:11:32 -05:00
Tyler Goodlet b762cf0456 Add cached refs to last 1d xy outputs
For the purposes of avoiding another full format call we can stash the
last rendered 1d xy pre-graphics formats as
`IncrementalFormatter.x/y_1d: np.ndarray`s and allow readers in the viz
and render machinery to use this data easily for things like "only
drawing the last uppx's worth of data as a line". Also add
a `.flat_index_ratio: float` which can be used similarly as a scalar
applied to indexes into the src array but instead when indexing
(flattened) 1d xy formatted outputs. Finally, this drops the way
overdone/noisy `.__repr__()` meth we had XD
2023-02-02 16:11:32 -05:00
Tyler Goodlet 3ec4c851cc Only draw up to 2nd last datum for OHLC bars paths 2023-02-02 16:11:32 -05:00
Tyler Goodlet 5ed4e5c945 Only update last datum graphic(s) on clear ticks
When a new tick comes in but no new time step / bar is yet needed (to be
appended) we can simply adjust **only** the last bar datum
lines-graphic(s) to avoid a redraw of the preceding `QPainterPath` on
every tick. Do this by calling `Viz.draw_last()` on the fast and slow
chart and adjusting the guards around calls to `Viz.update_graphics()`
(which *does* update paths) to only enter when there's a `do_px_step`
condition. We can stop calling `main_viz.plot.vb._set_yrange()` on view
treading cases since the range should have already been adjusted by the
clearing-tick processing mxmn updates.

Further this changes,
- the `chart_maxmin()` helper (which we should eventually just get rid
  of) to take bound in `Viz`s for the ohlc and vlm chart instead of the
  chart widget handles.
- extend the guard around hist viz yranging to only enter when not in
  "axis mode" - the same as for the fast viz.
2023-02-02 16:11:32 -05:00
Tyler Goodlet 84c48f17e2 Ensure full hist OHLC path is drawn on tread
Since we removed the `Viz.update_graphics()` call from the main rt loop
we have to be sure to call it in the history chart incr-loop to avoid
a gap between the  last bar and prior history since startup. We only
need to update on tread since that should be the only time a full redraw
is ever necessary, ow only the last datum is needed.

Further this moves the graphics cycle func's profiler init to the top in
an effort to get more correct latency measures.
2023-02-02 16:11:32 -05:00
Tyler Goodlet ee8e27f256 Use `Viz.update_graphics()` throughout remainder of graphics loop where possible 2023-02-02 16:11:32 -05:00
Tyler Goodlet e06a6c94eb Use `Viz` over charts where possible in display loop
Since `ChartPlotWidget.update_graphics_from_flow()` is more or less just
a call to `Viz.update_graphics()` try to call that directly where
possible.

Changes include:
- calling the viz in the display state specific `maxmin()`.
- passing a viz instance to each `ChartView._set_yrange()` call (in prep
  of explicit group auto-ranging); not that this input is unused in the
  method for now.
- drop `bars_range` var passing since we don't use it.
2023-02-02 16:11:32 -05:00
Tyler Goodlet fdda0c6f77 Set a `PlotItem.viz` for interaction lookup
Inside `._interaction` routines we need access to `Viz` instances.
Instead of doing `CharPlotWidget._vizs: dict` lookups this ensures each
plot can lookup it's (parent) viz without error.

Also, adjusts `Viz.maxmin()` output parsing to new signature.
2023-02-02 16:11:32 -05:00
Tyler Goodlet c9f7083b79 Always cache `read_slc` alongside y-mnmx values 2023-02-02 16:11:32 -05:00
Tyler Goodlet a91664e154 Add back coord-caching to ohlc graphic 2023-02-02 16:11:32 -05:00
Tyler Goodlet 3b773c667b Use (modern) literal type annots in view code 2023-02-02 16:11:32 -05:00
Tyler Goodlet aa4a48cb98 Drop x-range query from `ChartPlotWidget.maxmin()`
Move the `Viz.datums_range()` call into `Viz.maxmin()` itself thus
minimizing the chart `.maxmin()` method to an ultra light wrapper around
the viz call. Also move all profiling into the `Viz` method.

Adjust `Viz.maxmin()` to return both the (rounded) x-range values which
correspond to the range containing the y-domain min and max so that
it can be used for up and coming overlay group maxmin calcs.
2023-02-02 16:11:32 -05:00
Tyler Goodlet cec5ef1d26 Drop multi mxmn from display mod 2023-02-02 16:11:32 -05:00
Tyler Goodlet 1f6ec98790 Only handle hist discrepancies when market is open
We obviously don't want to be debugging a sample-index issue if/when the
market for the asset is closed (since we'll be guaranteed to have
a mismatch, lul). Pass in the `feed_is_live: trio.Event` throughout the
backfilling routines to allow first checking for the live feed being active
so as to avoid breakpointing on false +ves. Also, add a detailed warning
log message for when *actually* investigating a mismatch.
2023-02-02 16:11:31 -05:00
Tyler Goodlet 702a13a278 Passthrough `tractor` kwargs directly 2023-02-02 16:11:31 -05:00
Tyler Goodlet 1aa7b937b9 Fix `open_trade_ledger()` enter value type annot 2023-02-02 16:11:31 -05:00
Tyler Goodlet 81b6cb17de Comment bad x-range bp for now 2023-02-02 16:11:31 -05:00
Tyler Goodlet 36f1edead0 Breakpoint bad (-ve or too large) x-ranges to m4
This should never really happen but when it does it appears to be a race
with writing startup pre-graphics-formatter array data where we get
`x_end` epoch value subtracting some really small offset value (like
`-/+0.5`) or the opposite where the `x_start` is epoch and `x_end` is
small.

This adds a warning msg and `breakpoint()` as well as guards around the
entire code downsampling code path so that when resumed the downsampling
cycle should just be skipped and avoid a crash.
2023-02-02 16:11:31 -05:00
Tyler Goodlet e1e52e9130 Downthrottle to 16Hz on multi-feed charts 2023-02-02 16:11:31 -05:00
Tyler Goodlet 3b15e76285 Attempt to keep selected item highlighted
This attempt was unsuccessful since trying to (re)select the last
highlighted item on both an "enter" or "click" of that item causes
a hang and then segfault in `Qt`; no clue why..

Adds a `keep_current_item_selected: bool` flag to
`CompleterView.show_cache_entries()` but using it seems to always cause
a hang and crash; we keep all potential use spots commented for now
obviously to avoid this. Also included is a bunch of tidying to logic
blocks in the kb-control loop for readability.
2023-02-02 16:11:31 -05:00
Tyler Goodlet c15a2babc1 Lol, pull hist chart from the display state 2023-02-02 16:11:31 -05:00
Tyler Goodlet 171e5da9f9 Make (cache) search-results a `set` and avoid overlay duplicate entries 2023-02-02 16:11:31 -05:00
Tyler Goodlet 92a609275b Take outer-interval values in `Viz.datums_range()` 2023-02-02 16:11:31 -05:00
Tyler Goodlet 07ee244ca9 Clean a buncha cruft from render mod 2023-02-02 16:11:31 -05:00
Tyler Goodlet 2122c7cbd9 Handle last-in-view time slicing edge case
Whenever the last datum is in view `slice_from_time()` need to always
spec the final array index (i.e. the len - 1 value we set as
`read_i_max`) to avoid a uniform-step arithmetic error where gaps in the
underlying time series causes an index that's too low to be returned.
2023-02-02 16:11:31 -05:00
Tyler Goodlet 888ae26d82 Drop bp blocks from formatters mod 2023-02-02 16:11:31 -05:00
Tyler Goodlet 61d1dd3306 Fix query-mode cursor labels to work with epoch-indexing 2023-02-02 16:11:31 -05:00
Tyler Goodlet 73f1e362bc Use `open_sample_stream()` in display loop 2023-02-02 16:11:31 -05:00
Tyler Goodlet 7208b3a2d2 Drop `Flume.index_stream()`, `._sampling.open_sample_stream()` replaces it 2023-02-02 16:11:31 -05:00
Tyler Goodlet ba8284e73b Add back another panes resize during startup 2023-02-02 16:11:31 -05:00
Tyler Goodlet ad1c9d02fa Always zero-on-step $vlm 2023-02-02 16:11:31 -05:00
Tyler Goodlet bb2d451a37 Mouse interaction tweaks
- adjust zoom focal to be min of the view-right coord or the right-most
  point on the flow graphic in view and drop all the legacy l1-in-view
  focal point cruft.
- flip to not auto-scaling overlays by default.
- change the `._set_yrange()` margin to `0.09`.
- drop `use_vr: bool` usage.
2023-02-02 16:11:31 -05:00
Tyler Goodlet 36c93e8dfe Modernize optional path variable type annots 2023-02-02 16:11:31 -05:00
Tyler Goodlet d68fd8662c Use `Curve.x_last()` for zoom focal point 2023-02-02 16:11:31 -05:00
Tyler Goodlet 58a82e7a3f Make `PlotItemOverlay` add items inwards->out
Before this axes were being stacked from the outside in (for `'right'`
and 'bottom'` axes) which is somewhat non-intuitive for an `.append()`
operation. As such this change makes a symbol list stack a set of
`'right'` axes from left-to-right.

Details:
- rename `ComposeGridLayout.items` -> `.pitems`
- return `(int, list[AxisItem])` pairs from `.insert/append_plotitem()`
  and the down stream `PlotItemOverlay.add_plotitem()`.
- drop `PlotItemOverlay.overlays` and add it back as `@property` around
  the underlying `.layout.pitems`.
2023-02-02 16:11:31 -05:00
Tyler Goodlet 5f5843613e Drop the legacy `relayed_from` cruft from our view box 2023-02-02 16:11:31 -05:00
Tyler Goodlet 42810056c3 Do full marker width after line 2023-02-02 16:00:39 -05:00
Tyler Goodlet c46f0c4a0a Fix indent level 2023-02-02 16:00:39 -05:00
Tyler Goodlet a2b4276cdf Make $vlm axis color same as clears 2023-02-02 16:00:39 -05:00
Tyler Goodlet bf0810ef4f Correctly load order mode for first fqsn in overlay set 2023-02-02 16:00:39 -05:00
Tyler Goodlet 404a34a049 Move $vlm y-axis to LHS 2023-02-02 16:00:39 -05:00
Tyler Goodlet 6b35484bce Better index step value scanning by checking with our expected set 2023-02-02 16:00:39 -05:00
Tyler Goodlet 3e754342de Repair auto-y-ranging to always include L1 spread
Goes back to always adjusting the y-axis range to include the L1 spread
and clearing label in view whenever the last datum is also in view,
previously this was broken after reworking the display loop for
multi-feeds.

Drops a bunch of old commented tick looping cruft from before we started
using tick-type framing. Also adds more stringent guards for ignoring
but error logging quote values that are more then 25% out of range; it
seems particularly our `ib` feed has some issues with strange `price`
values that are way off here and there?
2023-02-02 16:00:39 -05:00