jc211
/
tractor
forked from goodboy/tractor
1
0
Fork 0
Code Pull Requests Activity
tractor/tractor/__init__.py

46 lines
965 B
Python
Raw Normal View History

Add a very rough, minimal actor model system I'm calling it `tractor` (as in trio-actor) for now. Lots of work to do still as per the many comments! Relates to #27
2018-06-07 04:26:49 +00:00
"""
More fixes to do cancellation correctly Here is a bunch of code tightening to make sure cancellation works even if recently spawned actors haven't fully started up and the parent is cancelled. The fixes include: - passing the arbiter socket address to each actor - ensure all spawned actors respect the spawner's log level - handle process versus final `portal.result()` teardown in multiple tasks such that if a proc dies before shipping a result we don't wait - more detailed debug logging in teardown code paths - don't store peer connected events in the same `dict` as the peer channels - if necessary fake main task results on peer channel disconnect - warn when a `trio.Cancelled` is what causes a nursery to bail otherwise error - store the subactor portal in the nursery for teardown purposes - add dedicated `Portal.cancel_actor()` which acts as a "hard cancel" and never blocks (indefinitely) - add `Arbiter.unregister_actor()` it's more explicit what's being requested
2018-07-10 19:06:42 +00:00
tractor: An actor model micro-framework built on
``trio`` and ``multiprocessing``.
Add a very rough, minimal actor model system I'm calling it `tractor` (as in trio-actor) for now. Lots of work to do still as per the many comments! Relates to #27
2018-06-07 04:26:49 +00:00
"""
Expose trio.MultiError publicly
2018-11-19 19:15:28 +00:00
from trio import MultiError
Add a very rough, minimal actor model system I'm calling it `tractor` (as in trio-actor) for now. Lots of work to do still as per the many comments! Relates to #27
2018-06-07 04:26:49 +00:00
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
from ._ipc import Channel
Expose msg stream types at top level
2021-05-12 03:41:26 +00:00
from ._streaming import (
Context,
ReceiveMsgStream,
MsgStream,
stream,
context,
)
Move discovery functions to their own module
2019-03-24 15:37:11 +00:00
from ._discovery import get_arbiter, find_actor, wait_for_actor
Reorg everything into private modules
2018-07-14 20:09:05 +00:00
from ._trionics import open_nursery
Allow passing function refs to `Portal.run()` This resolves and completes #69 allowing all RPC invocation APIs to pass function references directly instead of explicit `str` names for the target namespace and function (this is still done implicitly underneath). This brings us closer to `trio`'s task running API as well as acknowledges that any inter-host RPC system (and API) will likely need to be implemented on top of local RPC primitives anyway. Even if this ends up **not** being true we can always go to "function stubs" as part of our IAC protocol or, add a new method to do explicit namespace calls: `.run_from_module()` or whatever everyone votes on. Resolves #69 Further, this commit drops `Actor.statespace` from the entire system since a user can easily get this same functionality using module level variables. Fix docs to match all these changes (luckily mostly already done due to example scripts referencing).
2020-12-21 14:09:55 +00:00
from ._state import current_actor, is_root_process
Propagate module import and func lookup errors RPC module/function lookups should not cause the target actor to crash. This change instead ships the error back to the calling actor allowing for the remote actor to continue running depending on the caller's error handling logic. Adds a new `ModuleNotExposed` error to accommodate.
2019-01-01 20:58:38 +00:00
from ._exceptions import RemoteActorError, ModuleNotExposed
Add support for "debug mode" When enabled a crashed actor will connect to the parent with `pdb` in post mortem mode.
2020-07-23 17:32:29 +00:00
from ._debug import breakpoint, post_mortem
Set _is_root runtime var in _main()
2020-10-16 02:47:11 +00:00
from . import msg
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
from ._root import run, run_daemon, open_root_actor
Reorg everything into private modules
2018-07-14 20:09:05 +00:00
__all__ = [
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'Channel',
'Context',
'ModuleNotExposed',
'MultiError',
'RemoteActorError',
mypy fixes
2020-10-13 15:03:55 +00:00
'breakpoint',
Add `tractor.wait_for_actor()` helper Allows for waiting on another actor (by name) to register with the arbiter. This makes synchronized actor spawning and consecutive task coordination easier to accomplish from within sub-actors. Resolves #31
2018-08-13 03:59:19 +00:00
'current_actor',
'find_actor',
'get_arbiter',
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'is_root_process',
'msg',
Add `tractor.wait_for_actor()` helper Allows for waiting on another actor (by name) to register with the arbiter. This makes synchronized actor spawning and consecutive task coordination easier to accomplish from within sub-actors. Resolves #31
2018-08-13 03:59:19 +00:00
'open_nursery',
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'open_root_actor',
'post_mortem',
'run',
'run_daemon',
Require explicit marking of non async gen streaming funcs Add `@tractor.stream` which must be used to denote non async generator streaming functions which use the `tractor.Context` API to push values. This enforces a more explicit denotation as well as allows enforcing the declaration of the `ctx` argument in definitions.
2019-03-26 01:36:13 +00:00
'stream',
Expose `@context` decorator at top level
2021-05-02 18:12:35 +00:00
'context',
Re-org root actor startup into context manager This begins the move to dropping support for `tractor.run()` which we don't really need since the runtime is started (as it always has been) from a new sub-task / nursery. Instead this introduces starting the actor tree through a `open_root_actor()` async context manager which we'll likely implicitly call (from the root) on the first use of an actor nursery. Drop `_actor._start_actor()` and factor its contents into this new api. Make `run()` and `run_daemon()` use `open_root_actor()` until we decide to remove them. Relates to #168 and #177
2020-12-27 15:55:00 +00:00
'to_asyncio',
'wait_for_actor',
Reorg everything into private modules
2018-07-14 20:09:05 +00:00
]