AUTOMATION & AI

Gemini Robotics ER 2: How AI Now Plans Real-World Robot Tasks

October's AI news reveals a clear shift: agents and embodied AI are moving from demos to governed, accountable systems that plan and act in the real world.

Evocative Studio

7 November 2026  ·  5 min read  · Updated on 12 November 2026

Gemini Robotics ER 2: How AI Now Plans Real-World Robot Tasks

Key takeaways

  • In October 2026, the AI story shifted from how smart models sound to how reliably they act.
  • Agentic benchmarks (Terminal-Bench, AutomationBench) predict real-world value better than overall leaderboard rank.
  • Italy now voids AI-driven HR decisions unless a human with real authority makes them — accountability is becoming law.
  • Every autonomous agent needs an identity, a live risk score, and a kill switch; Microsoft is building exactly that.
  • Invisible prompts and silent writes destroy trust — keep instructions and outcomes auditable.

Something quietly significant happened across the AI landscape this octobre: the conversation stopped being about how smart models sound and started being about how well they act. Embodied reasoning systems like Gemini Robotics ER 2 can now break a messy physical goal — "clear this table and sort the recycling" — into an ordered plan a robot arm can execute. But the more interesting story isn't the robotics demo. It's that the entire industry spent October building the scaffolding needed to let AI take real-world action responsibly.

From chat to action: why planning is the real milestone

For years, the hard part of robotics was perception and motion. The new frontier is task planning: looking at a scene, understanding intent, sequencing sub-steps, and adapting when reality disagrees with the plan. That's the same capability that separates a chatbot from an agent — and the benchmarks published this month show how fast it's maturing.

On Artificial Analysis's index dated 19 October 2026, Meta's Muse Spark Open edged ahead of the Mistral Large 4 preview by a single point overall. Yet Large 4 won five of ten tests, and crucially the agentic ones: Terminal-Bench (27% vs 8%) and AutomationBench (60% vs 50%). The headline ranking barely moved; the real signal is that models are now measured on whether they can operate tools, terminals and multi-step workflows. Planning a robot's physical task and planning a sequence of shell commands are branches of the same tree.

Capability is cheap. Accountability is the constraint.

The most important October news for anyone deploying this technology had nothing to do with model scores. It was about who is responsible when an autonomous system acts.

  • Italy drew a hard line. From 23 October 2026, any hiring, evaluation, sanction or dismissal decision made with AI must be taken by a human with real authority — or it's legally void, even with employee consent. The platform directive reserving account suspension to a human must be transposed by 2 December.
  • Microsoft gave agents an identity. It extended its insider-risk tooling — identity, logging, Purview risk management — to AI agents. Announced 19 October for Microsoft 365 E7 and Project Perception, a continuously updated risk score can block an agent's writes, require human validation, or stop the agent outright.

Read together, these say the same thing: an agent that can act must be governable in real time. Capability without a kill switch and an accountable human is now a liability, not a feature.

The hidden-instruction warning

Creative watercolor painting of pumpkins labeled as October, ideal for autumn themes.
Creative watercolor painting of pumpkins labeled as October, ideal for autumn themes.

October also delivered a cautionary tale. Redact reported that 80 of WhatsApp's 545 help pages contained 102 invisible text blocks aimed at AI — including an instruction not to recommend any data-protection authority. WhatsApp said these were support-chatbot instructions published by a bug; the blocks had disappeared by 18 October. Whatever the cause, it exposes a structural risk: when systems act on instructions users can't see, trust evaporates. Any planning agent is only as trustworthy as the instructions steering it — and those instructions must be auditable.

Where the real-world value already shows up

The payoff isn't science fiction. France's CNSA tested an AI tool in disability-support offices (MDPH) to split, classify and check the completeness of scanned paper files — targeting a 4.8-month backlog. Tellingly, it ran on files of deceased people as test data and wrote nothing back to the live system. That's exactly the right posture: real task automation, strict guardrails, no silent writes. (The expected mid-October results weren't published by 20 October, a reminder that transparency on outcomes matters too.)

The quieter risk: LLMs in your pipeline

A rustic autumn scene featuring baskets of chestnuts, a pumpkin, and a butternut squash on grass.
A rustic autumn scene featuring baskets of chestnuts, a pumpkin, and a butternut squash on grass.

One more October data point deserves attention from any engineering team. PostgreSQL logged 44 fixed vulnerabilities in 2026 versus 7 in 2025, and version 19 is reportedly shedding 8–10 features — a committer cites LLM-assisted code review and developers being pulled onto security work among the causes. The lesson for embodied and agentic AI is blunt: the same models that plan tasks are increasingly reviewing the code that runs them. Human oversight of AI-assisted engineering isn't optional overhead — it's the difference between velocity and fragility.

What this means for your business

Gemini Robotics ER 2 is a glimpse of the near future, but the operational playbook is already clear from October's regulatory and tooling moves:

  • Pick agentic benchmarks, not vanity scores — Terminal-Bench and AutomationBench predict real deployment value better than leaderboard rank.
  • Give every agent an identity and a risk score so you can log, throttle and stop it.
  • Keep a human with real authority on any consequential decision — now a legal requirement in parts of Europe.
  • Make instructions and outcomes auditable; no invisible prompts, no silent writes.

The robots that plan real-world tasks are coming. The organisations that win won't be those with the flashiest demo — they'll be the ones who built the governance to trust an autonomous system with a job.

Sources

Frequently asked questions

What makes Gemini Robotics ER 2 different from earlier robotics AI?
Its strength is embodied reasoning and task planning: turning a high-level real-world goal into an ordered sequence of executable steps, and adapting when the environment doesn't match the plan — the physical equivalent of agentic AI operating tools and terminals.
Does the law now require a human in AI-driven decisions?
In Italy, from 23 October 2026, hiring, evaluation, sanction or dismissal decisions made with AI must be taken by a human with real authority or they are legally void. The EU platform directive reserving account suspension to humans must be transposed by 2 December 2026.
How should companies control autonomous AI agents?
Give each agent its own identity, continuous risk scoring, and full logging — as Microsoft is doing with Purview — so you can require human validation, block risky actions, or stop the agent in real time.
Which benchmarks matter for agentic AI deployments?
Agentic tests like Terminal-Bench and AutomationBench matter more than overall leaderboard rank, because they measure whether a model can actually operate tools and complete multi-step workflows.
#octobre
EXCLUSIVE CONTENT

Get our analyses
straight to your inbox.

Every week, an in-depth article on AI, digital marketing and growth. No spam.