This taxonomy of failure modes for collaborative agents is super helpful when designing new types of AI-powered tools
Reposted from
Yijia Shao
[6/8] We conducted a detailed error analysis by having authors annotate 300 trajectories. Collaborative agents expose significant limitations in current LMs and agent scaffoldings, with communication and situational awareness failures occurring in 65% and 40% of real trajectories.
Comments