Agents That Think Together: Cisco's Vijoy Pandey on Semantic Alignment, Scope, Accord & Concord

Hello, and welcome back to the Cognitive Revolution! My guest today is Vijoy Pandey, SVP and GM of Outshift by Cisco. When Vijoy was last here in March, he described the "Internet of Cognition" – the higher-order protocols AI agents need to share context, align on intent, and solve problems together – and he offered a prescient description of what the field, collectively, is building: "systems where agents come together and do net-new things that really make a difference." Today, with the OpenFace incident and Navier-Stokes in the rearview mirror, that's clearly now the reality, for better, and in at least some cases, for worse, and Cisco's efforts have accelerated with everything else. The AGNTCY project now belongs to the Linux Foundation, and Cisco has deployed multi-agent systems with partners including Swisscom, ServiceNow, SoftServe, and Webex. Naturally, they've seen how agents often miscommunicate and misunderstand one another, and how semantic and cognitive misalignments between agents can quickly compound into major performance degradation. To help others avoid similar issues, they've recently open-sourced a new suite of protocols designed to help agents think and work productively together. This includes projects called Scope – which builds knowledge graphs on top of agent traces and attempts to identify cognitive failures; Accord – which helps agents align on intent, scope, and key terms before work gets underway; and Concord, which helps agents negotiate an outcome every one of them can accept when they disagree. A highlight of this conversation, for me, was the opportunity to compare notes on our personal AI setups. Mine, as regular listeners will know, combines high-access, low-autonomy agents that I think of as "extensions of myself" and that run on my personal laptop, with lower-access, higher-autonomy agents that run on their own computer. Vijoy on the other hand, has a single agent for himself, which he calls Arnold Layne after a Pink Floyd song, and another for his wife – but, he reports, the two agents still often struggle to act effectively together on their humans' behalf. Meanwhile, in an effort to avoid lock-in to a single model provider and maintain choice and flexibility going forward, we both aim to separate our agents' identities, personas, and memory systems from both the model and the proprietary harnesses they run in. Toward the end, we get Vijoy's latest takes on such hot-button issues as latent space communication between agents, which he believes is inevitable, and perhaps required for certain use cases like drug discovery and weather modeling, and on the argument Yuval Noah Harari recently made that we humans will soon be governed by AI systems beyond our comprehension, much as cows are already ruled by markets and other structures they know nothing about. As you'll hear, Vijoy's perspective is that this is already the reality in many domains, and that with proper record keeping, monitoring, and other guardrails, the benefits should far exceed the costs. With that, I hope you enjoy this report from the frontier of multi-agent systems, in production, with Vijoy Pandey, SVP and GM of Outshift by Cisco. ****

Watch now!

Thank you for being part of The Cognitive Revolution,
Nathan Labenz