pub struct ParallelToolRunner {
pub max_concurrency: usize,
}Expand description
Executes tool calls concurrently with a bounded fan-out.
max_concurrency defaults to 4 — high enough to win on typical realtime
turns, low enough that unbounded fan-out into rate-limited APIs doesn’t
punish users.
Fields§
§max_concurrency: usizeImplementations§
Trait Implementations§
Source§impl Clone for ParallelToolRunner
impl Clone for ParallelToolRunner
Source§fn clone(&self) -> ParallelToolRunner
fn clone(&self) -> ParallelToolRunner
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ParallelToolRunner
impl Debug for ParallelToolRunner
Source§impl Default for ParallelToolRunner
impl Default for ParallelToolRunner
Source§impl ToolRunner for ParallelToolRunner
impl ToolRunner for ParallelToolRunner
fn run_batch<'life0, 'life1, 'life2, 'life3, 'async_trait>(
&'life0 self,
calls: &'life1 [ToolCallExecution],
tools: &'life2 [Box<dyn LlmTool>],
ctx: &'life3 ToolRunCtx,
) -> Pin<Box<dyn Future<Output = Vec<ToolCallOutcome>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
'life3: 'async_trait,
Auto Trait Implementations§
impl Freeze for ParallelToolRunner
impl RefUnwindSafe for ParallelToolRunner
impl Send for ParallelToolRunner
impl Sync for ParallelToolRunner
impl Unpin for ParallelToolRunner
impl UnsafeUnpin for ParallelToolRunner
impl UnwindSafe for ParallelToolRunner
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more