jc211
/
tractor
forked from goodboy/tractor
1
0
Fork 0
Code Pull Requests Activity
tractor/tractor/__init__.py

53 lines
1.0 KiB
Python
Raw Normal View History

Add a very rough, minimal actor model system I'm calling it `tractor` (as in trio-actor) for now. Lots of work to do still as per the many comments! Relates to #27
2018-06-07 04:26:49 +00:00
"""
More fixes to do cancellation correctly Here is a bunch of code tightening to make sure cancellation works even if recently spawned actors haven't fully started up and the parent is cancelled. The fixes include: - passing the arbiter socket address to each actor - ensure all spawned actors respect the spawner's log level - handle process versus final `portal.result()` teardown in multiple tasks such that if a proc dies before shipping a result we don't wait - more detailed debug logging in teardown code paths - don't store peer connected events in the same `dict` as the peer channels - if necessary fake main task results on peer channel disconnect - warn when a `trio.Cancelled` is what causes a nursery to bail otherwise error - store the subactor portal in the nursery for teardown purposes - add dedicated `Portal.cancel_actor()` which acts as a "hard cancel" and never blocks (indefinitely) - add `Arbiter.unregister_actor()` it's more explicit what's being requested
2018-07-10 19:06:42 +00:00
tractor: An actor model micro-framework built on
``trio`` and ``multiprocessing``.
Add a very rough, minimal actor model system I'm calling it `tractor` (as in trio-actor) for now. Lots of work to do still as per the many comments! Relates to #27
2018-06-07 04:26:49 +00:00
"""
Expose trio.MultiError publicly
2018-11-19 19:15:28 +00:00
from trio import MultiError
Add a very rough, minimal actor model system I'm calling it `tractor` (as in trio-actor) for now. Lots of work to do still as per the many comments! Relates to #27
2018-06-07 04:26:49 +00:00
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
from ._ipc import Channel
Expose msg stream types at top level
2021-05-12 03:41:26 +00:00
from ._streaming import (
Context,
ReceiveMsgStream,
MsgStream,
stream,
context,
)
Move discovery functions to their own module
2019-03-24 15:37:11 +00:00
from ._discovery import get_arbiter, find_actor, wait_for_actor
Reorg everything into private modules
2018-07-14 20:09:05 +00:00
from ._trionics import open_nursery
Allow passing function refs to `Portal.run()` This resolves and completes #69 allowing all RPC invocation APIs to pass function references directly instead of explicit `str` names for the target namespace and function (this is still done implicitly underneath). This brings us closer to `trio`'s task running API as well as acknowledges that any inter-host RPC system (and API) will likely need to be implemented on top of local RPC primitives anyway. Even if this ends up **not** being true we can always go to "function stubs" as part of our IAC protocol or, add a new method to do explicit namespace calls: `.run_from_module()` or whatever everyone votes on. Resolves #69 Further, this commit drops `Actor.statespace` from the entire system since a user can easily get this same functionality using module level variables. Fix docs to match all these changes (luckily mostly already done due to example scripts referencing).
2020-12-21 14:09:55 +00:00
from ._state import current_actor, is_root_process
Expose streaming components at top level
2021-06-13 22:02:27 +00:00
from ._exceptions import (
RemoteActorError,
ModuleNotExposed,
ContextCancelled,
)
Add support for "debug mode" When enabled a crashed actor will connect to the parent with `pdb` in post mortem mode.
2020-07-23 17:32:29 +00:00
from ._debug import breakpoint, post_mortem
Set _is_root runtime var in _main()
2020-10-16 02:47:11 +00:00
from . import msg
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
from ._root import run, run_daemon, open_root_actor
Reorg everything into private modules
2018-07-14 20:09:05 +00:00
__all__ = [
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'Channel',
'Context',
'ModuleNotExposed',
'MultiError',
'RemoteActorError',
Expose streaming components at top level
2021-06-13 22:02:27 +00:00
'ContextCancelled',
mypy fixes
2020-10-13 15:03:55 +00:00
'breakpoint',
Add `tractor.wait_for_actor()` helper Allows for waiting on another actor (by name) to register with the arbiter. This makes synchronized actor spawning and consecutive task coordination easier to accomplish from within sub-actors. Resolves #31
2018-08-13 03:59:19 +00:00
'current_actor',
'find_actor',
'get_arbiter',
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'is_root_process',
'msg',
Add `tractor.wait_for_actor()` helper Allows for waiting on another actor (by name) to register with the arbiter. This makes synchronized actor spawning and consecutive task coordination easier to accomplish from within sub-actors. Resolves #31
2018-08-13 03:59:19 +00:00
'open_nursery',
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'open_root_actor',
'post_mortem',
'run',
'run_daemon',
Require explicit marking of non async gen streaming funcs Add `@tractor.stream` which must be used to denote non async generator streaming functions which use the `tractor.Context` API to push values. This enforces a more explicit denotation as well as allows enforcing the declaration of the `ctx` argument in definitions.
2019-03-26 01:36:13 +00:00
'stream',
Expose `@context` decorator at top level
2021-05-02 18:12:35 +00:00
'context',
Expose streaming components at top level
2021-06-13 22:02:27 +00:00
'ReceiveMsgStream',
'MsgStream',
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'to_asyncio',
'wait_for_actor',
Reorg everything into private modules
2018-07-14 20:09:05 +00:00
]