[1/8] While several HITL systems exist (e.g. OpenAI Canvas, our Collaborative STORM), what makes human-agent collab special? Agents need autonomy to be useful, yet the goal is empowering humans.
We start with three tasks: travel planning, surveying related work, and tabular analysis
We start with three tasks: travel planning, surveying related work, and tabular analysis
Comments
We define primitives for public/private components in the shared env, as well as collaboration actions and notification protocol.
This demands situational intelligence to take initiative, communicate, and adapt. Co-Gym offers an evaluation framework that assesses both collab outcomes and processes.
Experiments reveal human-like patterns: collaborative inertia, where poor communication hinders delivery; and collaborative advantage, where human-agent teams outperform autonomous agents.
Check out our arXiv paper first to learn more: https://arxiv.org/abs/2412.15701