Back to Home
arXiv AI··Papers & Tech

Uncertainty-Aware Resource Orchestration for Agentic AI Systems

中文摘要

该研究提出针对智能体AI系统的资源编排方案,以应对LLM自主任务在运行时产生的不可预测的资源需求。

English Summary

This research proposes uncertainty-aware resource orchestration for agentic AI systems to manage unpredictable compute and latency demands emerging during autonomous LLM-driven execution.

Original Excerpt

arXiv:2611.05392v1 Announce Type: new Abstract: Agentic artificial intelligence (AI) systems powered by large language models (LLMs) execute as autonomous multi-step pipelines that dynamically invoke tools, integrate observations into memory, and iterate until a task is resolved or a resource budget is exhausted. Unlike classical workflows with fixed graphs, the aggregate compute, bandwidth, and end-to-end latency demands of such pipelines are unknown at dispatch time: they emerge at runtime from intermediate observations and stochastic token sampling, yielding heavy-tailed, multi-modal random variables. This unpredictability forces infrastructure orchestrators into a dilemma: under-provisioning risks mid-execution throttling and deadline violations, while over-provisioning wastes scarce edge or cloud capacity. Existing schedulers require a fully known pipeline graph, while edge resource-management methods rely on parametric or stationary demand models, and neither fits the unknown, non-stationary profiles of agentic pipelines. We formalize this setting as the uncertainty-aware agentic orchestration problem, where the goal is to reserve, at dispatch time, compute and bandwidth allo…