Coding agentArenaConfirmed
Story 10 of 12 in the Tuesday 27 October editionLMSYS Arena adds live tool Connectors to Agent Mode
Agent Mode expands beyond isolated environments with live integrations for Vercel, Linear, GitHub, Supabase and Google Workspace.
Edited by Ashutosh Shrivastava
28 Oct 2026, 10:05 IST · 1 min read
LMSYS Arena has expanded its Agent Mode evaluation suite with live Connectors for third-party developer and enterprise services, including Vercel, Linear, GitHub, Supabase, Notion, Gmail, Google Drive and Google Calendar.
The update allows researchers and developers to benchmark agentic models on realistic multi-step tasks across real software infrastructure rather than simulated mock environments. Models are evaluated on their ability to manage credentialed tool calls, resolve API errors and complete complex multi-system workflows without human intervention.
Connectors are configured through authenticated developer sessions, with sandboxed project workspaces ensuring safe execution during evaluation runs. Benchmark rankings for connected agents will appear on the public Arena leaderboard as evaluation volume expands across participating developer teams.
Sources
- PrimaryArena: Announcing Connectors in Agent Modex.com · Official announcement post
The rest of the day
Read the whole day
01ModelGoogle DeepMind
Google DeepMind unveils Genie 4 real-time interactive world model
Built on the Gemini family, Genie 4 generates interactive 3D simulations on the fly with natural-language steering, native audio and multi-agent dialogue.
02Open sourceLiquid AI
Liquid AI releases LFM3 open-weight model family with 256K context
Six 2B-class non-transformer models span text, vision, audio and decision tasks, pre-trained on 22T tokens and optimised for single-GPU fine-tuning.
03Open sourceinclusionAI
Ant Group’s inclusionAI releases Ling-3.1-flash-1019 under MIT licence
The 560B mixture-of-experts model activates 25B parameters per token, provides a 1M context window and scores 44 on the Artificial Analysis Index.
04Open sourceBaidu
Baidu open-sources Unlimited OCR 2 and MarathonDocBench under MIT licence
A 3B document vision model uses shifted recursive sliding window attention to parse multi-page manuscripts without truncation.
Spotted an error? Email aiforsuccess.in+compass@gmail.com or tag @ai_for_success on X