🤖 Robotics arXiv Digest

August 31, 2026
30 papers7 research areas Generated by Claude

Research Landscape

The largest cluster in today's batch — seven papers — is squarely about pushing vision-language-action and world-action models past naive behavior cloning by grafting on extra structure. Temporal Forcing diagnoses observation aliasing in long-horizon tasks and fixes it by aligning a history-aware latent to a pretrained 4D foundation model, lifting a physical hidden-placement task from 20.0% to 43.3% success. PAVE attacks a related pair of gaps — representations not modeling multi-horizon scene evolution, and mixed-quality trajectories being reused indiscriminately — with multi-horizon JEPA alignment plus a value-guided flow-matching actor. Zeva goes further still, proposing in-context causal learning so a frozen policy improves online from its own deployment experience without any gradient updates, while Motus2 unifies policy, simulator, and evaluator into one set of shared weights to close the decision-and-learning loop end to end. SUN/Kuafu and CometVLA both push structure earlier in the pipeline — SUN by compiling task semantics once into aligned MPC costs and RL rewards so learned behavior can't drift from what a controller verified, CometVLA by testing directly whether better physical-commonsense pretraining actually improves downstream manipulation (it finds a real correlation). Behavior-Skill closes the loop from the evaluation side, showing across pi0.5 and GR00T that failures in these long-horizon pipelines cluster overwhelmingly in contact-rich manipulation skills — a concrete signal for where the next round of "extra structure" should be aimed.

A similarly large navigation and perception cluster (seven papers) shares a notable throughline of benchmark self-scrutiny rather than pure capability gains. Driving on Memory and Failure or Drift? are both explicitly critical papers: the former shows that discarding a driving model's camera feed entirely and substituting location memory nearly matches NAVSIM leaderboard scores, implying the benchmark rewards location memorization as much as genuine reactivity; the latter shows that a common synthetic corruption proxy (illumination) can reorder SLAM systems differently than the real degraded condition it's meant to approximate, while structured rain/fog proxies preserve the real ranking. Against that backdrop, capability papers like LightNav-0 (eliciting a pretrained VLM's own spatial intelligence for a unified navigation interface across embodiments) and Scaffolding Foundation Models / NavMCP (coupling a VLM's evidence-seeking reasoning with a navigation foundation model's closed-loop execution via a persistent memory channel) report strong numbers — NavMCP's margin over baselines grows from 10 to 45 points as task horizon increases on a real Unitree Go2 — that the field would do well to stress-test with the same skepticism the critique papers apply to driving benchmarks. CanonNav contributes a clean architectural insight in the same space: disentangling navigation behavior from platform-specific camera geometry via canonicalization turns out to matter more than adding RGB-D sensing.

A third, smaller but coherent theme is sensing miniaturization paired with data-efficient learning under real-world constraints. SpectraTac (camera-free optical tactile sensing under $5 and 19mm across) and Proximity3D (shape reconstruction from a curved capacitive textile treated as a non-planar sensing manifold) both push tactile-adjacent sensing toward cheaper, lower-dimensional hardware rather than more cameras and compute. GAFT tackles the flip side of the same problem — learning reliably from very little data — by geometrically anchoring LoRA fine-tuning to fix off-road hazard detection despite having almost no labeled failure examples, roughly sextupling its benchmark F2 score. Rounding out the day, more traditional mechatronics and controls work — the shared-gas-spring humanoid ankle actuator from Tsagarakis's group (today's highest author h-index at 32), a hybrid physics-plus-Gaussian-Process quadcopter identification framework, decentralized contingency MPC under limited sensing, and a semi-passive velocity-field controller that relaxes strict passivity guarantees — shows the field's more established control-theory core continuing to make steady, less flashy progress alongside the foundation-model-driven majority of today's papers.

Papers by Research Area

VLA & Foundation Models

Vision-language-action and world-action models pushing beyond naive behavior cloning with temporal, causal, and physical grounding.

7 papers

  • #3 SUN: Persistent Programs For Language-Grounded Control-to-Le…
  • #10 Zeva: In-Context Causal Learning for Generalizable Embodied…
  • #16 Temporal Forcing: 4D Representation Alignment for Vision-Lan…
  • #17 Behavior-Skill: A Fine-Grained Benchmark for Evaluating Visi…
  • #21 PAVE: Predictive Alignment and Value-Guided Evolution for Wo…
  • #25 CometVLA: Co-Training on an Embodied Data Pyramid towards Ph…
  • #27 Motus2: A Self-Evolving General World Model for Dexterous Ma…

Navigation & Perception

Embodied navigation, autonomous driving, SLAM robustness, and multi-view perception, including two benchmark self-critique papers.

7 papers

  • #4 Driving on Memory
  • #5 DARP: A Calibrated Dual-Arm RGB-D-IR Dataset for Multi-View…
  • #7 LightNav-0: Eliciting VLM Spatial Intelligence for Generalis…
  • #14 Failure or Drift? Evaluating Monocular SLAM under Synthetic…
  • #19 HorizonNet for visual terrain navigation
  • #20 Scaffolding Foundation Models into Physical-World Agents Pus…
  • #26 CanonNav: Disentangling Navigation Behavior from Camera Geom…

Robot Learning & Manipulation

Skill acquisition via quality-diversity search, blind locomotion, whole-arm soft-robot inference, and rare-failure fine-tuning.

4 papers

  • #6 Autonomously Acquiring Robot Manipulation Skills with Langua…
  • #9 SleepWalking: Privileged Representation Shaping for End-to-E…
  • #12 GAFT: Geo-Anchored Fine-Tuning for Hazard Identification fro…
  • #13 Learning to infer and manipulate through distributed whole-a…

Tactile & Contact Sensing

Compact optical and capacitive sensing modalities for contact-rich perception, from industrial inspection to near-field shape sensing.

3 papers

  • #18 Anomaly Detection on Small Industrial Components via Vision-…
  • #22 SpectraTac: A Compact Camera-Free Optical Tactile Sensor wit…
  • #23 Proximity3D: Shape from Capacitive Proximity on Sensing Mani…

Hardware & Mechanical Design

Actuator, airframe, and interface hardware: a humanoid ankle PEA, a tilt-rotor bicopter, and a compact neuromotor decoding system.

3 papers

  • #1 A Dual-Cam Parallel Elastic Actuator with Shared Gas-Spring…
  • #24 Data-Centric Neuromotor Interfaces for Portable Human-Machin…
  • #28 Optimized Modular Design and Development of a Tilt-Rotor Bic…

Control Theory & Dynamics

System identification, aerodynamic characterization, decentralized multi-agent MPC, and passivity-based interaction control.

4 papers

  • #2 A Hybrid PEM-GP Framework for Uncertainty-Aware System Ident…
  • #8 The Structure of Merging Turbulent Jets Beneath a Small Quad…
  • #11 Provably Safe Decentralized Contingency MPC under State-Only…
  • #30 Robust Semi-passive Velocity Field Control with Boundedness…

Specialized Applications

Domain-specific deployments: hazardous gas source localization and contrast-free autonomous navigation of endovascular microrobots.

2 papers

  • #15 CIG-RL: Curiosity-Driven Information-Guided Reinforcement Le…
  • #29 Contrast-Free Autonomous Navigation of Untethered Endovascul…

Papers by Category

VLA & Foundation Models

7 papers
#3
h=0

SUN: Persistent Programs For Language-Grounded Control-to-Learning-to-Real Policies

2026-08-31cs.ROcs.AI
Weiqi Wang, Zhi Li, Yudong Lei, David Martinez, Xiaofeng Gao
Core Contributions
  • Core idea is compiling task semantics once into a typed SUN Program that simultaneously produces MPC costs, RL rewards, satisfaction predicates, and diagnostics — instead of hand-crafting rewards separately from the control spec, so a learned policy can't silently drift from what the controller already verified as feasible.
  • Kuafu uses large VLMs to auto-generate these programs from language and scene semantics, then screens candidates for MPC feasibility before ever running RL — filtering out infeasible task specs before burning simulation budget on them.
  • Reports 82.03% macro-success across nine tasks versus 35.67% for sparse-reward RL and 24.75% for Stage-BC, and generates 10.57x the successful-trajectory time per hour of human teleoperation at 8192-way parallel scale.
  • Sim-trained DP3 policies reach only 34.7% success on physical Franka/Kinova arms versus 46.0% in simulation — a reminder that strong simulation-screening numbers don't automatically close the harder sim-to-real half of the pipeline.
Show abstract

Bridging model-based control and learned policies in long-horizon manipulation has harbored a silent disagreement: control executes specified objectives, learning amortizes that behavior into a reactive policy, yet existing protocols discard task semantics, leaving rewards hand-crafted and behavior drifting from what control verified. We introduce Semantically UNified (SUN) Programs, typed executables where geometric and contact relations are defined once and compiled into aligned Model Predictive Control (MPC) costs, satisfaction predicates, RL rewards, transition guards, and diagnostics. Our system, Kuafu, driven by large vision language systems, automatically synthesizes SUN Programs from language and scene semantics, screens feasibility via MPC, and retains semantics while training stage-conditioned policies. Across nine tasks, Kuafu achieves 82.03% macro-success, outperforming sparse-reward (35.67%) and Stage-BC (24.75%) baselines. At 8192-way scale, it generates 10.57x the successful trajectory time per hour of human teleoperation. With 500 trajectories per task, Kuafu data trains DP3 policies to 46.0% simulation success (vs. 22.4% for alternatives) and 34.7% on physical Franka and Kinova robots. These results establish that simulation-screened task semantics can effectively amortize control into robust policies, without demonstrations or manual dense rewards, unifying symbolic planning and data-driven execution.

#10
h=0

Zeva: In-Context Causal Learning for Generalizable Embodied Manipulation

2026-08-31cs.RO
Fu Chen, Xin Ding, Bingjia Huang, Xiangyu Li, Mingju Wang
Core Contributions
  • Proposes in-context learning for manipulation with zero gradient updates: a frozen policy accumulates a 'causal memory' of past action-to-state-change pairs during deployment and retrieves relevant entries as context for future actions.
  • The Causal Interaction Extractor compresses each interaction into a compact causal signal rather than storing raw trajectories, keeping the dual-timescale memory tractable as deployment experience accumulates over time.
  • Reports a success rate that keeps climbing purely from accumulated deployment experience — the frozen policy improves online without retraining, unlike standard frozen VLAs or world-action models that plateau at their pretrained level.
  • Claims the learned causal-interaction knowledge transfers across tasks, suggesting the 'what happened when I did X' signal captures something more general than a single task's skill.
Show abstract

Generalizable embodied manipulation remains difficult to achieve through pretraining alone, due to unseen physical conditions in the real world. We argue that robots need to learn from their own physical interactions on the fly during real-world deployment and use this knowledge to inform subsequent actions. We present Zeva, the first framework that enables in-context learning from a robot's own physical interaction experience while keeping the policy model frozen. Zeva employs a Causal Interaction Extractor to encode an executed action and its induced state change into a causal interaction signal, which is stored in a dual-timescale causal memory. For subsequent actions, relevant causal interaction signals are retrieved from memory and injected into the frozen policy model as context. Experiments in simulation and real-world manipulation demonstrate that Zeva achieves the best performance among the compared frontier VLAs and WAMs and, more importantly, enables self-evolution during deployment without gradient updates. Its success rate continues to improve as the robot accumulates interaction experience. Furthermore, the acquired interaction experience can generalize across tasks.

#16
h=0

Temporal Forcing: 4D Representation Alignment for Vision-Language-Action Models

2026-08-31cs.RO
Xingyu Ding, Yuzhong Zhao, Chunhai Zhao, Yinghuan Shi, Chaoyang Zhao
Core Contributions
  • Diagnoses a specific VLA weakness: aligning representations to 3D geometry — a popular recent trick — only captures the current scene, so models still confuse visually similar states that differ only by history, a classic observation-aliasing problem in long-horizon tasks.
  • Fix is a history pathway that summarizes past observations into a temporally-aware latent, which is then aligned not to static 3D features but to a pretrained 4D foundation model's temporally-consistent geometric representations.
  • Reports 98.8% on LIBERO (+2.2 points over its base model) — a modest but real gain on an already near-saturated benchmark — versus a much larger real-world gain: full-task success on a physical hidden-placement task rises from 20.0% to 43.3%.
  • The gap between the small simulation gain and the large real-world gain suggests the temporal/4D alignment specifically helps with the long-horizon, partially-hidden-state scenarios that simulation benchmarks under-represent.
Show abstract

Recent vision-language-action (VLA) methods improve manipulation performance by aligning their representations with 3D scene geometry. However, these methods often struggle with long-horizon manipulation and observation aliasing between visually similar states due to a lack of temporal information: the 3D scene geometry captures only the current state, rather than how it has evolved over time. To resolve this, we present Temporal Forcing, a 4D representation alignment method for VLA models. Specifically, we first introduce a history pathway that enables a vanilla VLA model to summarize observation history into temporally aware latent representations. Then, the latent representations are aligned with the geometric features extracted by a pretrained 4D foundation model, which captures the evolving 3D world through temporally consistent geometric representations, enabling a deeper understanding of dynamic environments. Temporal Forcing reaches 98.8% on LIBERO, outperforming its base model by 2.2 points. On a physical hidden-placement task, it raises full-task success from 20.0% to 43.3%. Code will be publicly available.

#17
h=0

Behavior-Skill: A Fine-Grained Benchmark for Evaluating Vision-Language-Action Policies in Long-Horizon Tasks

2026-08-31cs.RO
Chunyun Ma, Lun Luo, Xingjian Luo, Xiexing Feng, Hang Zhang
Core Contributions
  • Reacts to a measurement gap: existing long-horizon manipulation benchmarks score only full-task rollouts, so when a policy fails partway through a 10-step task it's opaque which constituent skill actually broke.
  • Restructures evaluation around 235,492 individually-executable skill instances from 10,000 demonstrations across 50 household tasks and 34 skill categories, each with a restorable intermediate state so skills can be tested independently of what came before them.
  • Testing pi0.5 and GR00T across the full 50-task suite shows failures are highly non-uniform — contact-rich manipulation skills are the persistent bottleneck, not perception or navigation sub-skills — a concrete target for where the field should focus next.
  • Its trajectory-level and skill-level metrics let researchers separate 'policy fails immediately' from 'policy degrades late in a long chain,' a distinction that aggregate task-success numbers erase entirely.
Show abstract

Reliable execution of long-horizon mobile manipulation tasks remains challenging because overall task success depends on the successful completion of multiple constituent skills. Existing benchmarks, however, still rely primarily on full-task rollouts and aggregate task-level metrics, making intermediate failures difficult to observe and analyze. We present Behavior-Skill, a benchmark that reformulates the learning and evaluation of long-horizon tasks around executable constituent skills. It contains 235,492 skill instances from 10,000 demonstrations across 50 household tasks and 34 semantic skill categories. Each instance pairs a skill instruction with an aligned observation-action segment, and is further associated with a restorable intermediate state and a skill success condition to enable independent evaluation under valid preconditions. We further introduce trajectory-level and skill-level metrics to characterize policy capability beyond aggregate task success. Extensive experiments across representative VLA policies including pi0.5 and GR00T on the complete 50-task benchmark show that failures are highly non-uniform across skills, with contact-rich manipulation skills forming persistent bottlenecks. These results demonstrate that Behavior-Skill complements full-task evaluation by exposing intermediate capability profiles for analyzing and improving long-horizon VLA policies. Behavior-Skill is publicly available at https://github.com/nubot-nudt/Behavior-Skill.

#21
h=0

PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policies

2026-08-31cs.ROcs.AI
Botong Zhao, Fang Yu, Tim, Senhua Zhu, Xinyuan Chen
Core Contributions
  • Targets two behavior-cloning weaknesses at once: representations aren't required to model how the scene evolves over multiple horizons, and mixed-quality deployment trajectories get reused without distinguishing good dynamics from bad behavior.
  • Adds trajectory-relative multi-horizon transition alignment — predicting scene evolution at 25/50/75/100% of the remaining episode — as a training-only JEPA-style objective, so the representation captures longer-range task progress without an explicit future-token decoder at inference.
  • Separately trains a distributional value critic on cumulative deployment data, converts action-chunk advantages into positive/negative/null text conditions, and feeds those into a flow-matching actor — so every trajectory, even suboptimal ones, teaches the dynamics model while the actor trains only toward relatively-better actions.
  • Removes the predictor and critic at inference, so the richer training-time supervision costs nothing at deployment — a useful pattern for keeping direct-policy runtime cost low while still benefiting from offline signal.
Show abstract

Direct vision-language-action policies generate continuous robot actions efficiently, but standard behavior cloning leaves two complementary gaps: their representations are not explicitly required to describe how the scene evolves over multiple time scales, and deployment trajectories of unequal quality are often reused without separating useful dynamics from undesirable behavior. We introduce \method, a direct world-action policy that combines outcome-agnostic predictive learning with outcome-aware policy improvement. \method first retains a local fixed-offset JEPA objective and adds trajectory-relative multi-horizon transition alignment at 25%, 50%, 75%, and 100% of the remaining episode. These training-only targets require the current policy representation to preserve both local physical changes and longer-range task progress, without supplying explicit future tokens to the action head. \method then trains an independent distributional value critic on cumulative deployment trajectories, computes action-chunk-aligned $N$-step advantages, and converts them into positive, negative, or null text conditions for a flow-matching actor. Thus, every valid trajectory can teach what physically happened, while the actor is deployed only under the condition associated with relatively better actions. The multi-horizon predictor and critic are removed from online execution, preserving direct action generation from the current observation, language instruction, and proprioception. Across the three simulation benchmarks, the method achieves the strongest overall performance while preserving the direct actor's online execution path.

#25
h=0

CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding

2026-08-31cs.RO
Hanwen Wan, Dafeng Chi, Linbo Zhai, Tianao Shen, Yuzheng Zhuang
Core Contributions
  • Tests a specific hypothesis directly rather than assuming it: does giving a VLM better physical commonsense — not just better vision-language alignment — actually translate into better downstream action generation? Most physical-VQA work stops at the VLM level without checking this link.
  • Builds CometData/CometBench, a physical VQA corpus explicitly aligned to the robot's own action space and embodiment, addressing the common mismatch where physical-reasoning datasets are disembodied and don't match what the action head actually needs.
  • Introduces Global Action Prior (GAP) tokens as a compact bottleneck isolating task-agnostic motion regularities, letting the action head use physical-commonsense signal without corrupting the pretrained VLM backbone's existing representations.
  • Reports a direct correlation between CometBench VLM performance and downstream VLA success rate — this correlation, more than the raw benchmark numbers, is the real evidence that physical-understanding pretraining genuinely helps manipulation rather than being assumed to.
Show abstract

Vision-language-action (VLA) models remain brittle in manipulation tasks that require physical commonsense. Current physical VQA data is typically disembodied and misaligned with robot action domains. Egocentric videos are used only as auxiliary pre-training. It remains unclear whether improved VLM physical understanding actually benefits downstream action generation. Therefore, we present CometVLA to close this gap. We construct CometData and CometBench, an embodied physical VQA corpus and benchmark strictly aligned with the robot's action data and embodiment. We introduce Global Action Prior (GAP) tokens, a compact learnable bottleneck that isolates task-agnostic motion regularities and lets the action head consume physical commonsense without corrupting the pre-trained VLM backbone. We co-train CometVLA across the embodied data pyramid, spanning teleoperation, simulation, egocentric trajectories, and VQA layers. On real-world manipulation tasks and RoboTwin simulation, CometVLA consistently outperforms strong VLA baselines. Correlation analysis shows that stronger VLM performance on CometBench indicates higher VLA success rates. Results demonstrate that physical understanding pre-training genuinely benefits downstream manipulation.

#27
h=0

Motus2: A Self-Evolving General World Model for Dexterous Manipulation

2026-08-31cs.ROcs.AIcs.CVcs.LG
Hongzhe Bi, Zihao Zhou, Yihang Tang, Jingrui Pang, Shuhe Huang
Core Contributions
  • Pursues a genuinely unified world model: a single set of shared weights exposes three interfaces — a policy (proposes actions), a simulator (predicts visual consequences), and an evaluator (scores predicted outcomes) — closing a decision-and-learning loop that most 'world model plus action head' systems leave open.
  • Uses failed and suboptimal interactions productively, not just curated expert demos: expert data trains the policy, but any trajectory — good or bad — still teaches the dynamics model and value critic.
  • Data scaling is deliberately staged rather than one big mixed dataset: large-scale monocular egocentric video first, then synchronized stereo egocentric data, then robot-domain adaptation with real robot trajectories and human-robot alignment data.
  • Instantiated on a fully biomimetic platform (stereo vision, dual arms, dual dexterous hands, tactile sensing) with tactile feedback folded into contact-aware control, making it one of the more hardware-ambitious world-model papers in this batch.
Show abstract

General embodied agents should perceive, predict, act, evaluate, and improve within a unified system. World models have shown great promise in building such agents, yet existing models typically append an action output head to a world simulator, without coupling them into a closed decision-and-learning loop for policy improvement. We present Motus2, a self-evolving general world model for dexterous manipulation. Motus2 advances world modeling through model scaling and data scaling. For model scaling, a single model with shared weights exposes three control interfaces: a policy (world-action model), a simulator (action-conditioned world model), and an evaluator (value model). The policy proposes candidate action chunks, the simulator predicts their visual consequences, and the evaluator assesses the predicted outcomes. Their coupling forms a closed decision-and-learning loop for policy improvement. This formulation uses curated expert demonstrations for action learning, while failed and suboptimal interactions provide valuable evidence for dynamics modeling and value learning. For data scaling, Motus2 progresses from large-scale monocular egocentric data to synchronized stereo egocentric data, followed by robot-domain adaptation with robot trajectories and supplementary human-robot alignment data. Motus2 further studies global-autoregressive and hybrid-memory extensions of its sliding-window context, adds tactile feedback for contact-aware control, and is instantiated on a fully biomimetic platform with stereo vision, dual arms, dual dexterous hands, and tactile sensing. Together, egocentric data scaling and closed-loop general world model scaling provide a general path toward self-evolving dexterous manipulation.

Navigation & Perception

7 papers
#4
h=0

Driving on Memory

2026-08-31cs.CVcs.LGcs.RO
Christian Löwens, Thorben Funke, Alexandru Paul Condurache
Core Contributions
  • Provocative negative result: replacing the camera feed entirely with memories from prior drives at the same location — no view of current traffic at all — nearly matches or beats leading end-to-end planners on NAVSIM.
  • Directly challenges how the field reads benchmark leaderboards: a high NAVSIM score is shown to be largely achievable from static location priors (road layout, typical maneuvers there) rather than genuine perception-to-action reactivity.
  • The effect is benchmark-dependent — memory substitution causes far larger performance drops on Bench2Drive and RealEngine, suggesting those benchmarks better isolate real reactive-driving competence than NAVSIM does.
  • Practical takeaway for benchmark users: pair a route-memorization ablation with headline metrics, or risk over-crediting a driving model for memorizing locations rather than perceiving traffic.
Show abstract

End-to-end autonomous driving models plan future trajectories from raw sensor input. While earlier driving benchmarks often measured deviation from the human trajectory, current benchmarks such as NAVSIM and Bench2Drive evaluate models with richer simulation-based metrics intended to capture safe and compliant driving. A high benchmark score should reflect that a model can understand the scene in front of it and act accordingly. But how much of that score specifically comes from reacting to the dynamic part of that scene? To probe this, we remove a model's camera input and replace it with memories from prior drives at the same location. The retrieved memories can provide persistent scene information, including road layout and location-conditioned regularities, but not the current traffic state. Surprisingly, memory is nearly sufficient on NAVSIM, reaching or even exceeding the performance of leading end-to-end methods without actually observing the evaluated scene. Our results suggest that a high NAVSIM score does not require a planner to react to the current traffic scene and should be treated with caution. This effect is benchmark-dependent: driving from memory causes substantially larger performance drops on Bench2Drive and RealEngine. We provide our code at https://github.com/boschresearch/MemoryDrivoR .

#5
h=0

DARP: A Calibrated Dual-Arm RGB-D-IR Dataset for Multi-View Robotic Perception

2026-08-31cs.ROcs.CV
Manish Kansana, Mohammed Yusuf Mujawar, Sudip Mittal, Shahram Rahimi, Noorbakhsh Amiri Golilarz
Core Contributions
  • Fills a specific perception gap — single-viewpoint self-occlusion — with a calibrated dual-arm, eye-in-hand RGB-D-IR rig where two independently moving arms observe the same tabletop object from opposing angles at once.
  • Automates the tedious parts of multi-view dataset construction: localization, cross-arm confirmation, and adaptive viewpoint generation happen without manual pose annotation or fiducial markers.
  • Establishes a credible geometric ground truth using a deterministic (non-learned) fusion baseline: 2.13 mm median point-to-mesh distance and 96.56% of 1.56M query points within 10 mm of the reference mesh across 224 held-out keyframes.
  • Positioned as infrastructure rather than a new algorithm — its value is enabling downstream active-perception and collaborative multi-arm reconstruction research, not a novel method of its own.
Show abstract

Robotic perception from a single viewpoint is often limited by self-occlusion and incomplete surface visibility. This paper presents DARP(Dual-Arm Robotic Perception) https://doi.org/10.21227/rmv3-be47, a calibrated dual-arm RGB-D-IR dataset for object-centered robotic perception using two independently moving eye-in-hand manipulators positioned on opposite sides of a shared tabletop workspace. Each arm carries an Intel RealSense sensor that continuously records RGB, depth, and stereo infrared data while synchronized robot joint states are logged for pose recovery. Objects are placed without fixed poses or marked locations, and the acquisition procedure performs automatic localization, cross-arm confirmation, adaptive viewpoint generation, and continuous multimodal recording. DARP contains ten unique tabletop objects and preserves the original sensor recordings, robot-state logs, object-level metadata, and calibration information required to reconstruct camera trajectories in a shared metric frame. To evaluate the geometric consistency of the acquisition, we implement a deterministic multi-view fusion pipeline that converts calibrated RGB-D observations into complementary partial point clouds and measured surface meshes without using learned or generative completion methods. Evaluation on 224 held-out RGB-D keyframes comprising 1,563,466 three-dimensional query points yields a median point-to-mesh distance of 2.13~mm and an RMSE of 4.04~mm, with 96.56\% of points within 10~mm of the measured-surface mesh. DARP is intended as a reusable resource for multi-view reconstruction, collaborative robotic perception, multimodal fusion, active perception, and future learning-based reasoning over partial object observations.

#7
h=0

LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

2026-08-31cs.ROcs.AI
Shaoan Wang, Aocheng Luo, Fei Huang, Jingyi Xu, Xiaoyang Wang
Core Contributions
  • Elicits navigation behavior directly from a pretrained VLM's existing spatial-grounding and pointing abilities rather than bolting on task-specific prediction heads — one compact generalist model instead of a fragmented, per-task navigation stack.
  • Key mechanism: dual-channel pointing expresses task/scene/embodiment-agnostic spatial intent, and a residual vector-quantized action tokenizer converts that intent into embodiment-specific trajectories — a single interface driving many robot bodies.
  • Trained on 2K+ scenes and 4K+ hours of embodied navigation data through staged mid-training, SFT, and RL; the intermediate LightNav-ER checkpoint alone tops 8 embodied-reasoning benchmarks before navigation-specific training even begins.
  • Claims state-of-the-art monocular success across all 10 public navigation simulation settings plus zero-shot cross-embodiment transfer in real-world tests — a strong claim worth watching for independent replication since no head-to-head baseline numbers appear in the abstract.
Show abstract

Embodied navigation requires agents to translate heterogeneous goals and visual observations into actions across tasks, environments, and robot embodiments. Modern vision-language models (VLMs) already encode spatial priors for visual grounding, spatial reasoning, and pointing, but these capabilities are rarely elicited directly for robot control. Existing navigation systems instead rely on task- or embodiment-specific components, fragmenting perception, reasoning, and action while offering limited generalization. Here we present LightNav-0, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads. LightNav-0 represents diverse navigation tasks through a unified token interface: dual-channel pointing expresses task-, scene-, and embodiment-agnostic spatial intent, while a residual vector-quantized action tokenizer maps this intent to precise, embodiment-specific trajectories. Together with temporally aware visual history compression, ER mid-training, supervised fine-tuning, and reinforcement learning, this formulation supports instruction following, open-vocabulary object navigation, and visual tracking within a single model. The navigation training corpus spans 2K+ scenes and 4K+ hours of embodied navigation data. LightNav-ER, the embodied-reasoning checkpoint used to initialize LightNav-0, attains the highest complete-set average across 8 embodied-reasoning benchmarks, while LightNav-0 achieves state-of-the-art monocular success rates across all 10 public navigation simulation settings. Real-world evaluations further demonstrate zero-shot generalization across robot embodiments, diverse scenes, and static and dynamic targets. These results establish compact VLMs as a unified and transferable backbone for generalist embodied navigation.

#14
h=0

Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptions

2026-08-31cs.CVcs.RO
Abhay Skaria Thomas, Shashank Agnihotri, Margret Keuper
Core Contributions
  • Makes a methodological point that's easy to get wrong: a synthetic corruption benchmark for SLAM is only useful if failing on it predicts the same engineering conclusion as the real degraded condition it's meant to proxy — and the paper finds this doesn't always hold.
  • Separates two failure modes a single trajectory-error number conflates: explicit tracking loss versus quiet accumulated drift from a tracker that never declares failure — learned trackers mostly convert the former into the latter, arguably worse since there's no failure signal for downstream safety logic.
  • Finds structured corruption proxies (rain, fog) preserve the same relative ranking of learned trackers as real adverse conditions from 4Seasons, but a naive illumination-corruption proxy does not — some common synthetic stress tests can lead engineers to the wrong model choice.
  • Practical implication: benchmark designers should validate that a synthetic corruption reproduces the ranking of systems, not just degrade the headline metric, before using it to pick a production SLAM system.
Show abstract

Visual SLAM is commonly evaluated on clean trajectories, although deployment failures are often caused by adverse weather, illumination, blur, and sensor artifacts. Controlled corruptions are attractive because they isolate such factors, but a synthetic stress test is useful only when it leads to the same engineering conclusion as the condition it is intended to approximate. This work examines that question for monocular SLAM. We evaluate a classical feature-based system and two learned trackers under image-space, geometry-aware, and compound corruptions, and compare their behavior with adverse conditions from 4Seasons. Rather than reducing robustness to a single trajectory error, the evaluation separates explicit tracking failure from drift accumulated by methods that remain active. The results show that learned trackers largely replace catastrophic loss with sustained, and sometimes severe, drift. More importantly, the apparent ordering of the learned systems changes with the physical fidelity of the corruption: structured rain and fog proxies preserve the real-world ordering, whereas a simple illumination proxy does not. Code is available at: https://github.com/abhaythomas/master_thesis_vslamlab_robustness.

#19
h=0

HorizonNet for visual terrain navigation

2026-08-31cs.CVcs.RO
Bertil Grelsson, Andreas Robinson, Michael Felsberg, Fahad Shahbaz Khan
Core Contributions
  • Solves USV position estimation without GPS or an expensive INS, using the horizon line in a 360-degree panoramic image as the only signal — a cheap, camera-only approach.
  • Two-stage CNN pipeline: a first network estimates the approximate horizon line and implicitly recovers camera pitch/roll, then the image is re-warped to a level view before a second CNN extracts the precise pixelwise horizon.
  • Reduces 'where am I' to a template-matching problem by correlating the extracted horizon shape against digital elevation model (DEM) terrain data via Fourier-domain MOSSE correlation, rather than requiring explicit 3D reconstruction.
  • Field trials in an archipelago report GPS-level position accuracy from vision alone — meaningful for USVs operating in GPS-denied or GPS-unreliable coastal and archipelago environments.
Show abstract

This paper investigates the problem of position estimation of unmanned surface vessels (USVs) operating in coastal areas or in the archipelago. We propose a position estimation method where the horizon line is extracted in a 360 degree panoramic image around the USV. We design a CNN architecture to determine an approximate horizon line in the image and implicitly determine the camera orientation (the pitch and roll angles). The panoramic image is warped to compensate for the camera orientation and to generate an image from an approximately level camera. A second CNN architecture is designed to extract the pixelwise horizon line in the warped image. The extracted horizon line is correlated with digital elevation model (DEM) data in the Fourier domain using a MOSSE correlation filter. Finally, we determine the location of the maximum correlation score over the search area to estimate the position of the USV. Comprehensive experiments are performed in a field trial in the archipelago. Our approach provides promising results by achieving position estimates with GPS-level accuracy.

#20
h=0

Scaffolding Foundation Models into Physical-World Agents Pushes the Frontier of Long-Horizon Navigation

2026-08-31cs.AIcs.RO
Zixing Lei, Gengze Zhou, Xiong-Hui Chen, Jiazhao Zhang, Yiyang Huang
Core Contributions
  • Splits long-horizon navigation along foundation models' actual strengths: VLMs are good at deciding what evidence to seek and when to stop, navigation foundation models are good at executing one semantic sub-goal reliably — NavMCP couples them via explicit intent/observation/memory channels rather than retraining either.
  • The memory channel is the key structural idea: it accumulates findings, negative evidence, and unresolved goals across NFM calls, turning otherwise isolated bounded episodes into persistent task-level reasoning.
  • Achieves state-of-the-art results on HM-EQA, MT-HM3D, and EXPRESS-Bench, and under matched backbones beats an episodic (non-scaffolded) interface by 14.9 points on HM-EQA — direct evidence the scaffolding itself, not just model scale, drives the gain.
  • On a real Unitree Go2, reaches 78.3% success with the margin over the strongest baseline growing from 10 to 45 points as task horizon increases, meaning the persistent-memory approach pays off most on exactly the hardest, longest tasks.
Show abstract

Long-horizon physical-world agents must reason over distant goals while grounding decisions in reliable closed-loop behavior. Today's foundation models split these capabilities: vision-language models (VLMs) infer missing information and adapt high-level plans but remain brittle and inefficient at repeated navigation grounding, while navigation foundation models (NFMs) robustly execute semantic goals but operate as bounded episodes without persistent task-level reasoning. We introduce NavMCP, an agentic scaffolding framework that couples a VLM reasoning agent with an NFM executor for long-horizon exploration. The VLM decides what evidence to seek, where to search, and when to stop, while the NFM grounds each semantic sub-goal into closed-loop navigation. Three channels structure their collaboration: intent translates evidence needs into navigation calls, observation converts rollouts into source-grounded trajectory evidence, and memory accumulates findings, negative evidence, and unresolved goals across calls. This design turns isolated navigation rollouts into persistent embodied interaction without retraining either model. On Embodied Question Answering, NavMCP achieves state-of-the-art results on HM-EQA, MT-HM3D, and EXPRESS-Bench. Under matched agent and executor backbones, it outperforms an episodic interface by 14.9 percentage points on HM-EQA. On a Unitree Go2, NavMCP reaches 78.3% success, with its margin over the strongest baseline growing from 10 to 45 points as the task horizon increases. These results demonstrate the potential of scaffolding complementary foundation models into long-horizon physical-world agents.

#26
h=0

CanonNav: Disentangling Navigation Behavior from Camera Geometry in Cross-Platform Visual Navigation

2026-08-31cs.RO
Dong-Wook Kim, Ji-Hoon Hwang, E-In Son, Mintaek Oh, Seung-Woo Seo
Core Contributions
  • Identifies a subtle but important confound in cross-platform visual navigation imitation learning: training directly on image-trajectory pairs forces the policy to implicitly infer each platform's camera geometry from pixels alone, entangling 'how to navigate' with 'what camera am I behind' — an unnecessarily hard, ill-posed sub-problem.
  • Solves this with camera-geometry canonicalization, transforming both observations and trajectories into a shared camera-consistent representation space before learning navigation behavior at all.
  • Also addresses a second gap — imitation learning captures only the expert's chosen path, not the intermediate reasoning behind it — by adding safety and local-progress supervision derived from pseudo-labels of an offline traversability estimator.
  • Despite using only RGB at inference, outperforms RGB-based baselines and even surpasses some RGB-D methods in challenging scenarios — evidence that removing the camera-geometry confound, not adding more sensor modalities, was the higher-leverage fix.
Show abstract

While visual navigation has advanced through imitation learning from cross-platform demonstrations, fully leveraging such data remains challenging. First, directly learning from image-trajectory pairs entangles navigation behavior with platform-dependent camera geometry. This hinders consistent learning by forcing the policy to implicitly infer camera geometry from visual observations, an inherently ill-posed problem. Second, imitation learning from demonstrated trajectories captures the expert's chosen motion but leaves the intermediate decisions underlying that motion implicit. To address these issues, we propose CanonNav, a visual navigation framework that disentangles navigation behavior from camera geometry and incorporates complementary planning supervision into learning from cross-platform demonstrations. CanonNav introduces camera geometry canonicalization, which transforms visual observations and trajectories into a camera-consistent representation space. Building on this representation, we derive safety and local-progress supervision using pseudo-labels from an offline traversability estimator. Safety supervision penalizes unsafe trajectories, while local-progress supervision guides where the robot should advance. Experiments across diverse camera configurations and environments show that, despite using only RGB at inference, CanonNav consistently outperforms RGB-based baselines and even surpasses RGB-D-based methods in challenging scenarios.

Robot Learning & Manipulation

4 papers
#6
h=0

Autonomously Acquiring Robot Manipulation Skills with Language-Driven Quality-Diversity

2026-08-31cs.RO
Émiland Garrabé, Mahdi Khoramshahi, Stéphane Doncieux
Core Contributions
  • Attacks QD's core bottleneck — expert-authored fitness and diversity metrics — by having an LLM autonomously propose low-dimensional functional spaces to sample them from, using only a free-form task description and no task-specific prompts or fine-tuning.
  • Reframes 'what makes two behaviors different' as a functional-design search problem rather than a fixed hand-coded descriptor, letting the same pipeline generalize across manipulation tasks without redesign each time.
  • Adapts a multi-BD variant of MAP-Elites (MES) to consume the heterogeneous, LLM-sampled descriptor sets, outperforming classical QD with both inferred and hand-written parametrizations on four manipulation tasks in the Genesis simulator.
  • Matters for deployment-time adaptability: a diverse archive of motion primitives — rather than one optimized policy — lets a robot swap strategies zero-shot when new constraints appear, without retraining.
Show abstract

Quality-diversity (QD) algorithms have been gaining traction in robot learning, where diverse motion primitive libraries allow robots to adapt zero-shot to constraints at deployment time. However, such methods typically require expert designers to write the success condition, fitness and diversity metrics, and this strongly limits the robot's autonomy. On the other hand, existing LLM-based reward-shaping techniques allow robots to learn autonomously but only output single high-performing solutions, limiting the robot's adaptability. In this paper, we propose an approach designed to output diverse motion primitive archives by autonomously leveraging quality-diversity algorithms, only requiring a free-form description of the task in common language. To address the difficulty of designing relevant fitness and diversity metrics, we propose an autonomous exploration mechanism able to reliably output sets of functionals covering the fitness and behavior descriptor (BD) space. First, we pose policy exploration as a functional design problem, where the functional spaces are lower-dimensional than the full BD and fitness spaces, and propose an LLM-based exploration scheme to sample from these low-dimensional spaces without any task-specific prompts, fine-tuning or expert intervention. We adapt a multi-BD variant of the MAP-Elites success (MES) algorithm, designed to leverage the heterogeneous BD samples. Finally, through experiments based on the genesis simulator, we show that our method effectively generates archives of diverse motion primitives, outperforming classical QD algorithms with inferred and hand-written parametrizations on a set of $4$ robotic manipulation tasks.

#9
h=0

SleepWalking: Privileged Representation Shaping for End-to-End Blind Locomotion in Legged Robots

2026-08-31cs.RO
Zheng Pan, Tenghui Wang, Peilin Li, Shiyu Zhou, Hao Sun
Core Contributions
  • Reframes blind (non-exteroceptive) legged locomotion under partial observability as an information-retention problem: the question isn't how privileged terrain/physics info enters the network, but whether the recurrent state keeps it around for later use.
  • Trains with a 'sleepwalking' auxiliary objective — next-step privileged physical-variable reconstruction — that shapes what the history representation retains during training, while the deployed actor only ever uses the direct history-to-action path with no privileged input at test time.
  • Beats DWAQ, the strongest non-exteroceptive baseline, by 15.0% higher peak mean terrain level while using 44.4% fewer inference MACs per control step — better terrain performance at lower runtime cost, not a trade-off between them.
  • Backs the empirical result with layerwise probing (showing reconstructed variables stay linearly decodable through the policy head) and a theoretical bound linking privileged-variable recoverability to the return gap versus privileged-information policies.
Show abstract

Partially observable locomotion requires a policy to act when task-relevant properties of the robot--environment state are not fully specified by instantaneous observations. Existing approaches often address this challenge by explicitly estimating missing physical variables or processing extended observation histories through structured architectures. We take a different view: partial observability is fundamentally an information-retention problem. The decisive question is not how task-relevant information enters the network, but whether the policy's internal state retains it. Guided by this perspective, we propose SleepWalking for Robot Locomotion (SWAQ), a one-stage end-to-end framework that uses next-step privileged physical reconstruction to shape what a recurrent history representation retains during policy learning, while the deployed actor uses only a direct history-to-action pathway. Under aligned training settings, SWAQ achieves a 15.0\% higher peak mean terrain level than DWAQ, the strongest non-exteroceptive baseline, while using 44.4\% fewer inference MACs per control step. Layerwise probes further show that information associated with the reconstructed physical variables remains linearly decodable through the policy head up to the layer preceding the action output. Complementary theoretical analysis relates privileged-variable recoverability to the achievable-return gap between history-based and privileged-information policy classes. These results suggest that semantic objectives can structure learning without requiring a corresponding architectural decomposition of the deployed controller.

#12
h=0

GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures

2026-08-31cs.ROcs.CV
Yanran Xu, Chuanhang Qiu, Yue Wang, Wenbo Wu, Zhaoxing Li
Core Contributions
  • Targets a genuinely hard data problem: off-road hazard events (high-centering, entrapment) are rare, and even when logged the data records only the outcome, not which visual cue caused it — so naive fine-tuning latches onto spurious, scenario-specific features.
  • Solution is a parameter-efficient LoRA adaptation guided by a geometry-derived prior: it aligns the model's spatial attention-rollout map to that prior during fine-tuning, steering where the model looks rather than just what it outputs.
  • On an intervention-verified forest hazard benchmark, raises repeated leave-one-scenario-out mean F2 from 0.0607 (frozen DINOv2) to 0.3757 with statistical significance — roughly a 6x jump — with the best single adaptation reaching 0.570.
  • Demonstrates that injecting a weak geometric prior into attention, rather than just the loss function, can meaningfully fix generalization from a handful of rare failure examples — a pattern likely useful well beyond off-road hazard detection.
Show abstract

Off-road navigation can fail when physical structures induce irrecoverable states such as high-centering or entrapment, requiring human interventions. Identifying these structures is crucial, yet challenging. Such failure events are rare and costly to collect, resulting in limited training data. Moreover, the collected data associate frames with outcomes, but do not indicate the visual cues responsible for the failure. Learning directly from these data can therefore exploit scenario-specific visual cues, leading to poor generalization. We propose \textbf{Geo-Anchored Fine-Tuning (GAFT)}, a parameter-efficient method that adapts a vision foundation model with a geometry-derived prior. It guides LoRA adaptation by aligning a spatial attention-rollout map with the geometry prior, while preserving pretrained representations. On an intervention-verified forest hazard benchmark, across ten independently trained adaptations, GAFT consistently outperforms frozen DINOv2 and supervised PEFT baselines, improving the repeated leave-one-scenario-out mean $F_2$ from 0.0607 to 0.3757 with statistical significance under paired analysis. Within these independently trained models, the best-performing GAFT model achieves a repeated-LOSO $F_2$ of 0.570. Code and benchmark: https://github.com/Xu-Yanran/geo_anchored_fine_tuning

#13
h=0

Learning to infer and manipulate through distributed whole-arm interaction in a soft robot

2026-08-31cs.RO
Chuhan Zhang, Ebrahim Shahabi, Kseniia Khomenko, Wei Pan, Cosimo Della Santina
Core Contributions
  • Takes explicit inspiration from elephants and octopuses: instead of treating whole-arm contact as a disturbance to reject, it treats distributed compliant contact as the primary sensing channel for both localizing objects and inferring their properties.
  • Because no direct measurement of task-relevant properties exists — only IMUs embedded in the soft structure — the problem is inherently partially observable, solved via a memory-based recurrent RL policy trained end-to-end.
  • Three-part recipe drives the result: a pretrained exploration policy seeds broad workspace coverage, exploration and grasping objectives are jointly optimized in one recurrent policy rather than trained separately, and a two-stage sim-to-real step handles both observation mapping and policy fine-tuning.
  • Demonstrated blind whole-arm grasping on a hybrid rigid-soft arm using only embedded IMUs — no cameras, no external tactile skin — autonomously sequencing exploration, encounter, localization, and wrap-grasp.
Show abstract

In animals such as elephants and octopuses, acquiring non-visual information about an object and physically engaging with it are inseparable processes mediated by rich, large-area interactions between compliant appendages and the environment. Soft robots provide a natural platform for translating this principle into engineered systems. Yet current robotic intelligence makes limited use of physical interaction, treating it primarily as a disturbance to be rejected or, at best, as a means of compensating for object misalignment. Here, we introduce a physical intelligence framework in which distributed compliant interactions jointly reveal task-relevant information and organize manipulation behavior. This results in an intrinsically partially observable problem: key task-relevant information is never measured directly, but must instead be inferred from the history of physical interactions. We propose a reinforcement-learning architecture that addresses this challenge by learning a memory-based control policy end-to-end. The key innovations making this possible are (i) a pretrained exploration policy that provides a reference for broad workspace exploration, (ii) joint optimization that integrates exploration and grasping objectives within a single recurrent policy, and (iii) a two-stage sim-to-real adaptation including observation mapping and policy fine-tuning. We demonstrate this principle through blind whole-arm grasping with a hybrid rigid-soft robotic arm that we equip with IMUs embedded directly within its compliant structure, providing its only source of proprioceptive sensing. The learned policy successfully identifies and grasps various objects by autonomously coordinating workspace exploration, object encounter and localization, inference of grasp-relevant properties, and stable whole-arm wrapping.

Tactile & Contact Sensing

3 papers
#18
h=0

Anomaly Detection on Small Industrial Components via Vision-Based Tactile Sensing

2026-08-31cs.RO
G. F. Preziosa, M. Casiglia, M. Faroni, A. M. Zanchettin, P. Rocco
Core Contributions
  • Applies vision-based tactile sensing (GelSight Mini) to an under-explored niche: small, sub-centimeter industrial parts where defects are geometric and too fine for standard optical cameras to resolve reliably.
  • Systematically benchmarks four existing unsupervised anomaly-detection feature-embedding methods (SPADE, PaDiM, FAPM, InReaCh) rather than proposing a new one — valuable precisely because it establishes which existing techniques actually work on tactile data.
  • Runs three deployment-motivated validations: the minimum number of nominal contacts needed for stable performance (bounded by gel wear, since every touch degrades the sensor), generalization across different contact positions on the same defect pattern, and a cost-benefit comparison of low- vs. high-resolution tactile acquisition.
  • Positions vision-based tactile sensing as a practically viable alternative to optical inspection for industrial quality control — a modest but concrete applied result among a batch otherwise dominated by manipulation and navigation research.
Show abstract

Automated inspection of small industrial components, including sub-centimetre-scale parts where defects are geometry-driven and poorly resolved by standard optical cameras, calls for sensing modalities that can directly capture fine surface geometry. Vision-based tactile sensors address this need by converting contact imprints into high-resolution image-like data compatible with existing deep-learning pipelines, yet their effective use for industrial anomaly detection (AD) remains largely unexplored. This work systematically evaluates unsupervised AD methods on a real tactile dataset covering five genuine industrial components acquired with a GelSight Mini sensor mounted on a collaborative robot. Four feature-embedding methods, SPADE, PaDiM, FAPM, and InReaCh, are compared under three validations explicitly motivated by the deployment constraints of contact-based sensing: a Good Fraction analysis establishing the minimum number of nominal contacts for stable performance, directly bounded by gel wear since every acquisition degrades the soft interface; a cross-position evaluation assessing generalization across different contact locations observing the same recurring surface pattern; and a low- versus high-resolution comparison evaluating the cost-benefit of higher-resolution tactile acquisition. Overall, this systematic benchmarking study provides practical guidance for researchers and practitioners adopting vision-based tactile sensing for industrial AD and shows how this modality can serve as a viable alternative for industrial quality-control tasks.

#22
h=0

SpectraTac: A Compact Camera-Free Optical Tactile Sensor with Distributed Color Sensing

2026-08-31cs.RO
Hao Wu, Haotian Guo, Yu Feng, Yutong Wang, Yanzhe Wang
Core Contributions
  • Camera-free approach to optical tactile sensing: instead of imaging the deformed elastomer with a camera (the GelSight-style default), it uses active RGB illumination plus three distributed color sensors to capture low-dimensional spatio-spectral features directly — no imaging optics, no high-dimensional image processing pipeline.
  • Extremely compact and cheap for the modality: 19.2 mm diameter, 4 mm height, under $5 in materials — a very different size and cost point than typical camera-based tactile sensors.
  • Reports 3D force estimation MAEs of 0.161/0.164/0.429 N (x/y/z) and 99.9% accuracy on nine-region contact classification, competitive with much bulkier camera-based sensors.
  • Demonstrated in a real-time interactive human-machine control task, suggesting the low-dimensional signal is fast enough for closed-loop use, not just offline force estimation.
Show abstract

Tactile sensing is essential for physical interaction in robotics and human--machine systems. However, combining rich tactile information with compact hardware, low cost, and low computational overhead remains challenging. This work presents SpectraTac, a compact, camera-free optical tactile sensor that combines active red--green--blue (RGB) illumination with spatially distributed color sensing. Contact deforms a compliant transparent elastomer and modulates its internal light field, producing spatially differentiated changes in color and intensity. Three distributed color sensors capture these responses as low-dimensional spatio-spectral features, avoiding cameras, imaging optics, and high-dimensional image processing. The device measures 19.2 mm in diameter and 4 mm in height, with a material cost below USD~5. A data-driven decoding framework simultaneously estimates three-dimensional (3D) force and the contact region from the optical measurements. For 3D force prediction, the sensor achieved mean absolute errors (MAEs) of 0.161, 0.164, and 0.429 N along the x-, y-, and z-axes, respectively. The nine-region contact-classification accuracy was 99.9%. We further evaluated real-time 3D force tracking and contact-region-based human--machine interaction through an interactive control task. These results indicate that distributed color-resolved optical sensing offers a compact, low-cost alternative to camera-based tactile sensing for robotics, wearable sensing, and interactive systems.

#23
h=0

Proximity3D: Shape from Capacitive Proximity on Sensing Manifold

2026-08-31cs.CVcs.CGcs.GRcs.RO
Hao Chen, Chenming Wu, Chun Ping Lam, Xiangjia Chen, Guoxin Fang
Core Contributions
  • Unusual sensing substrate: a curved capacitive textile is treated as a non-planar 'sensing manifold,' and shape reconstruction is done directly from the resulting capacitive proximity field rather than converting it to an image-like format first.
  • Introduces a multi-view feedforward model that aggregates proximity fields across multiple known sensor viewpoints on the curved surface to recover 3D object shape — extending multi-view reconstruction ideas, usually applied to cameras or depth sensors, to non-contact capacitive fields.
  • Demonstrated on both simulated and physical setups, showing the approach generalizes beyond a purely synthetic proof of concept.
  • Points toward 'near-field geometric awareness' as a distinct sensing category between vision (far-field) and touch (contact) — useful for pre-contact object localization on soft or wearable robot surfaces.
Show abstract

Most shape reconstruction methods assume measurements defined over planar sensing domains, such as RGB images or depth maps. In this paper, we use a curved capacitive textile as a shape sensor, treating its surface as a non-planar sensing manifold. Each scan is represented as a capacitive proximity field on this manifold, induced by the interaction between the curved electrode layout and nearby object geometry. We introduce a multi-view feedforward reconstruction model that aggregates these fields across known sensor views and recovers the observed object shape. Simulated and physical experiments demonstrate robust reconstruction from capacitive proximity signals acquired on curved sensing surfaces, pointing toward a new route to robotic near-field geometric awareness via embodied sensing.

Hardware & Mechanical Design

3 papers
#1
h=32

A Dual-Cam Parallel Elastic Actuator with Shared Gas-Spring Compensation for Humanoid Ankles

2026-08-31cs.RON. Tsagarakis (h=32)
Jingcheng Jiang, Yifang Zhang, Nikos G. Tsagarakis
Core Contributions
  • Central novelty is compensating both pitch and roll ankle torque from a single shared gas-spring via a dual-cam layout, instead of the usual multi-element scheme with a separate spring per axis — a direct win for packaging in the tightest, highest-load joint on a bipedal leg.
  • Derives a coupled 2-DoF model that explicitly captures how the two compensation units interact through the shared spring, then inverts it into an optimization framework that synthesizes cam profiles directly from a prescribed torque curve — turning a task spec into cam geometry rather than hand-tuning by trial and error.
  • Validation is currently limited to static FEA and kinematic simulation with full lower-leg CAD integration; no physical prototype or bench torque test is reported yet, so the compactness and torque-relief claims still need hardware confirmation.
  • Matters because ankle actuators carry the largest torque demands in humanoid walking; a compact single-spring 2-DoF scheme could cut motor sizing and energy cost versus designs needing two full compensation modules.
Show abstract

To improve torque capacity and energy efficiency of humanoid ankles, this paper proposes a 2-DoF parallel elastic actuator (PEA). The main novelty of the proposed design lies in its dual-cam, single-gas-spring architecture, which enables torque compensation in both pitch and roll using a shared elastic element, thereby improving structural compactness compared with conventional multi-element compensation schemes. By leveraging parallel gas springs and customized cam modules, the proposed architecture provides dual-axis torque assistance tailored to specific task requirements. The second key contribution is the formulation of a coupled 2-DoF mathematical model that explicitly captures the interdependence between the two compensation units through the shared spring. Based on this model, an optimization-based design framework is developed to synthesize customized cam profiles from prescribed torque references, establishing a systematic link from task requirements to hardware realization. The complete lower-leg CAD integration is presented in detail. Static FEA and kinematic simulations confirm the design's feasibility and torque-relief effectiveness. The results highlight the proposed design as a compact, customizable solution for 2-DoF humanoid ankle torque compensation.

#24
h=0

Data-Centric Neuromotor Interfaces for Portable Human-Machine Interaction

2026-08-31cs.RO
Jiaxuan Li, Di Wu, Jianhua Liu, Yuxin Zhao, Jinnuo Li
Core Contributions
  • Argues for a data-centric rather than model-centric approach to gesture decoding: if the physiological features are inherently separable, a tiny model suffices — backed by a 2,210-parameter classifier hitting 94.36% accuracy across 34 gestures.
  • Combines a wireless high-bandwidth acquisition system for electrophysiological signals with muscle-specific electrodes to form a practical sEMG interface suited to constrained edge devices, rather than requiring a server-side model.
  • Frames the result as a new 'thousand-parameter' benchmark for dexterous gesture decoding — relevant for wearable, battery-constrained human-machine interfaces where large models simply aren't deployable.
  • The real contribution is the data-quality argument (why small models work when the underlying signal is already separable) more than a new architecture — running counter to the field's general bigger-model trend.
Show abstract

Dexterous human-machine interaction requires intuitive and expressive interfaces that can be efficiently deployed on constrained edge devices. Flexible material-based neuromotor interfaces hold considerable promise, as they decode human movement intention into natural control. Although emerging flexible electronic skins enable wearable high-fidelity data acquisition, practical deployment inevitably involves trade-offs between computational resources and portability. We present a data-centric paradigm where physiological features yield fundamental separability, providing sufficient discriminative cues for recognition. A wireless, high-bandwidth system developed for collecting various electrophysiological signals, when integrated with muscle-specific electrodes, forms a surface electromyography-based interface. Exploiting highly separable data, a 2,210-parameter model achieves 94.36% accuracy across 34 gestures and can be rapidly deployed on edge devices, establishing a new thousand-parameter benchmark for dexterous decoding. The underlying data-algorithm interactions in the data-centric paradigm are further clarified, demonstrating its feasibility in real-world scenarios. This study provides a principled and validated pathway for practical deployment of reliable neuromotor interfaces.

#28
h=0

Optimized Modular Design and Development of a Tilt-Rotor Bicopter Drone

2026-08-31cs.RO
Saideep Verma, Nimisha Tatapudi, Akshay Arjun, Danwada Sharanya Sukka, Abhishek Sarkar
Core Contributions
  • Straightforward but useful applied-engineering paper: combines fixed-wing endurance with rotary-wing VTOL via a tilt-rotor bicopter, working through the structural and aerodynamic design needed to keep it stable across both flight modes.
  • Explicitly manages Center of Gravity vs. Neutral Point placement — the classic aircraft-stability lever — to ensure both stable hover and positive forward-flight stability within one modular airframe.
  • Backs the design with structural FEA, aerodynamic simulation, thrust/power endurance analysis, and actual flight tests with a basic flight controller, giving the design real validation rather than simulation-only claims.
  • A useful data point for the many groups building small hybrid VTOL platforms, though it introduces no new algorithmic idea — the contribution is the validated modular design itself.
Show abstract

Hybrid systems like tilt-rotor bicopter drones combine the beneficial characteristics of both fixed-wing and rotary-wing technology, enabling long endurance and VTOL capability. However, such drones also require an optimum design to ensure both static and dynamic stability. The modular design of a traditional bicopter is developed in this paper based on extensive analysis and in-depth structural and aerodynamic simulations. The structural analysis has been performed to ensure that the aircraft's structure withstands the stresses encountered during different flight modes. Controlling the relative positions of the Center of Gravity (CG) and Neutral Point (NP) is an essential aspect of the design, ensuring stability during hover and positive stability during forward flight. The thrust and power analyses have been conducted to assess the flight performance and endurance. After analysis, the drone has been developed, and flight tests with a basic flight controller were conducted to validate the performance metrics obtained in the simulation.

Control Theory & Dynamics

4 papers
#2
h=13

A Hybrid PEM-GP Framework for Uncertainty-Aware System Identification of Quadcopters

2026-08-31cs.ROI. K. Bousserhane (h=13)
Abdallah Ghoul, Ismail Khalil Bousserhane, Kadri Boufeldja
Core Contributions
  • Splits system identification into an interpretable physics-based core, fit via classical Prediction Error Method, and a Gaussian Process that learns only the leftover residual dynamics — keeping physical interpretability while still catching nonlinear effects PEM alone misses.
  • Unlike a pure black-box LSTM, the hybrid ships with calibrated uncertainty estimates, so a downstream controller can tell when it's operating in a low-confidence flight regime rather than trusting a point prediction blindly.
  • Matches LSTM-level prediction accuracy on a Duckiedrone-like rig while retaining a physically structured core suitable for gain scheduling or model-based control redesign, which a black-box model does not offer.
  • Relevant specifically to small-scale UAVs, where nonlinear effects (blade flapping, motor saturation) are proportionally larger than on bigger platforms and classical linear system ID degrades faster.
Show abstract

Accurate dynamic models play a central role in achieving reliable control of quadcopters. Classical system identification methods remain widely used, mainly because of their interpretability. However, they often fail to capture important nonlinear effects, especially in small-scale aerial platforms where such effects become more pronounced. Data-driven approaches offer a different perspective. They can represent complex nonlinear dynamics more effectively, but this comes at the cost of reduced interpretability and the absence of well-calibrated uncertainty estimates. In this work, we propose a framework that combines physics-based modeling with data-driven learning, while explicitly accounting for uncertainty. A physics-based model is first identified using the Prediction Error Method (PEM), which captures the main structure of the system. The remaining dynamics are then modeled using a Gaussian Process (GP), allowing the residual behavior to be learned directly from data. This separation makes it possible to distinguish between known physical effects and unmodeled dynamics. The proposed framework is validated on a Duckiedrone-like experimental setup. The results show that the PEM-GP model achieves prediction accuracy comparable to that of a Long Short-Term Memory (LSTM) network, while additionally providing calibrated uncertainty estimates. This combination improves model reliability and supports uncertainty-aware decision-making.

#8
h=0

The Structure of Merging Turbulent Jets Beneath a Small Quadrotor

2026-08-31physics.flu-dyncs.RO
Anoop Kiran, Nora Ayanian, Kenneth Breuer
Core Contributions
  • Fills a gap left by prior quadrotor downwash studies, which mostly characterized mean flow only: here PIV measures the higher-order turbulent statistics of the merged wake, especially at small, low-Reynolds-number scale where they'd been unresolved.
  • Shows the four rotor jets of a Crazyflie 2.1 (46 mm arm) merge into a single column by z/l≈5 and converge to canonical self-similar round-jet scaling by z/l≈13, with an effective source diameter of 2.29× the arm length.
  • Finds the merged wake still carries a bimodal, cut-dependent turbulent-stress signature of the four discrete rotors even after the mean flow collapses to a generic jet profile — meaning downstream wake-hazard models can't simply treat it as one uniform jet.
  • Directly relevant to safe multi-rotor formation spacing and small-UAV downwash hazard prediction, an area where most existing jet-scaling laws were validated only at larger Reynolds numbers than small consumer/research drones operate at.
Show abstract

The downwash wake of a hovering quadrotor governs both the vehicle's own performance and the safe spacing of multi-rotor formations. Prior measurements have largely characterized the mean flow, using single-point anemometry, volumetric tracking, or planar cuts through part of the rotor system. Higher-order turbulent statistics of the merged wake, and how they relate to canonical jet scaling, have remained unresolved, particularly for small quadrotors at the low-Reynolds-number end of the size range. Here, we present a detailed particle image velocimetry (PIV) study of the downwash of a hovering Crazyflie 2.1 quadrotor (arm length, $l = 46$ mm), sampled along a diagonal cut, passing through rotors along the symmetry axis of the quadrotor, and a front-rotor cut, passing through adjacent rotors. The four rotor jets merge into a single column by $z/l \approx 5$, beyond which the mean velocity profiles progressively approach the canonical round-jet self-similar form, collapsing by $z/l \approx 13$ when scaled by the local centerline velocity and half-width. Centerline decay and half-width growth follow canonical scaling laws with an effective source diameter $D_\text{eff} = 2.29\,l$, effective Reynolds number $Re_{D_\text{eff}} = 3 \times 10^4$, at the low end of the range over which canonical jet scaling has been established, and spreading and decay constants nonetheless within the canonical round-jet range. Resolving both cuts shows that the turbulent normal stresses retain a bimodal, cut-dependent signature of the four-rotor source throughout the measurement domain.

#11
h=0

Provably Safe Decentralized Contingency MPC under State-Only Information and Limited Sensing for Nonlinear Multi-agent Systems

2026-08-31math.OCcs.MAcs.ROeess.SY
Max Studt, Georg Schildbach
Core Contributions
  • Targets a real gap between decentralized MPC theory and practice: most safety guarantees assume full neighbor-state knowledge, but this work assumes only state-only information with limited sensing range and no reconstructed neighbor geometry.
  • Introduces a new safe-set update rule that lets agents interact memory-free — no history of past neighbor states required — while still proving recursive feasibility, safety, and Lyapunov convergence, reducing the conservatism usually incurred by finite sensing ranges.
  • Retains the shared-first-input contingency MPC structure, meaning a feasible fallback maneuver is always available — important for plug-and-play fleets where agents join or leave without re-tuning the whole system.
  • Validated only in simulation on dense multi-agent scenarios; real hardware or networked-robot validation is the natural next step given the paper's specific claims about limited sensing.
Show abstract

This paper considers decentralized contingency MPC for multi-agent control under a state-only information pattern, with particular focus on limited sensing and plug-and-play operation. The objective is to retain recursive feasibility, safety, and Lyapunov-type convergence while reducing conservatism in local interaction handling. The framework relies on agent-wise fallback regions (safe sets) in which a feasible contingency maneuver to a safe equilibrium is always available. A novel safe-set update mechanism is introduced that supports less conservative decentralized interaction while preserving the underlying guarantees. This, in turn, enables memory-free local interaction and finite sensing ranges without requiring agents to reconstruct the exact neighbor geometry. The resulting scheme remains fully decentralized and preserves the shared-first-input contingency MPC structure. Theoretical guarantees and simulation results illustrate the effectiveness of the approach in dense multi-agent scenarios.

#30
h=0

Robust Semi-passive Velocity Field Control with Boundedness Guarantees for Safe Interaction between Mechanical Systems and Physical Environment

2026-08-31eess.SYcs.RO
Van Trong Dang, Sumitaka Honji, Takahiro Wada
Core Contributions
  • Relaxes a known limitation of strict energetic-passivity-based interaction control: always enforcing passivity is provably safe but often overly conservative — this method only enforces passivity once the system's energy level crosses a predefined threshold, permitting non-passive, higher-performance behavior otherwise.
  • Proves the energy level and system states stay within bounded domains even under unpredicted external disturbances — a robustness guarantee that a purely reactive passivity switch wouldn't necessarily provide on its own.
  • Adds an explicit mechanism to constrain power flow between the system and its environment, giving a tunable safety margin beyond a binary passive/non-passive switch.
  • Validated only via numerical simulation; the practical payoff — less conservative yet still-safe interaction control — would benefit from physical human-robot or robot-environment interaction experiments to confirm the theoretical bounds hold under real disturbances.
Show abstract

Controllers that guarantee energetic passivity with respect to the pair of external force and velocity realize safe interaction between the mechanical system and its physical environment. However, solely adhering to energetic passivity constraints may impose fundamental limitations on control performance and, in some cases, prevent the successful execution of controlled tasks. In addition, external disturbances from the physical environment can drive the system energy level and states beyond operational regions, thereby undermining task performance and safety. In this paper, we study a robust time-varying semi-passive velocity field control to aim to relax the inherently conservative nature of fully passive control methods in a controlled manner. Specifically, the proposed control method guarantees passivity of the closed-loop system with respect to the force-velocity input-output pair when the energy level exceeds a predefined level, while permitting non-passive behaviors to preserve task performance otherwise. Furthermore, the energy level and the states of the closed-loop system are proved to converge to bounded domains even in the presence of unpredicted disturbances. Additionally, the proposed method also enables constraining power flow between the closed-loop system and its physical environment to enhance safety in the interaction process. Numerical simulation examples demonstrate the effectiveness of the proposed method.

Specialized Applications

2 papers
#15
h=0

CIG-RL: Curiosity-Driven Information-Guided Reinforcement Learning for Source Term Estimation in Uncertain Environments

2026-08-31cs.RO
Junhee Lee, Seunghwan Kim, Hongro Jang, Hyungjin Kim, Hyoungho Park
Core Contributions
  • Targets a specific weakness in DRL-based gas source term estimation: existing methods explore randomly or chase belief-uncertainty reduction alone, without a dedicated exploration signal, which hurts robustness when sensor readings are noisy.
  • Adds curiosity-driven exploration aimed specifically at novel belief-state transitions the policy hasn't sufficiently sampled during training, plus an uncertainty-adaptive reward that actively guides search under noisy conditions.
  • Validated under both high-noise simulation and real-world experiments — a stronger evidentiary bar than the many simulation-only RL papers in this batch.
  • Relevant to hazardous-gas response scenarios where mobile sensor robots must localize a source quickly and reliably despite noisy, partial measurements — a safety-critical, low-tolerance-for-failure application.
Show abstract

Source term estimation (STE), which aims to estimate key properties of the gas source, is essential for identifying hazardous gas releases. Information-theoretic approaches have been adopted for autonomous STE using mobile sensors due to robustness in noisy environments, yet their online action selection incurs substantial computational cost. Deep reinforcement learning (DRL) provides a promising alternative with its fast decision-making capability. In DRL-based STE, the agent selects actions based on belief states of the source term updated from noisy measurement sequences. However, existing methods rely on random exploration or solely on belief uncertainty reduction without an effective exploration strategy in DRL, which can limit policy robustness in noisy environments. To address this, we propose a curiosity-driven information-guided reinforcement learning for robust and efficient STE. The proposed method promotes active exploration of novel belief state transitions that have not been sufficiently explored during training. We further introduce an uncertainty-adaptive active perception reward to guide efficient source search under uncertainty. Simulations under high-noise conditions and real-world experiments demonstrate the robustness and feasibility of the proposed framework, highlighting its potential for practical STE problems.

#29
h=0

Contrast-Free Autonomous Navigation of Untethered Endovascular Microrobots Using Single-Plane Fluoroscopy

2026-08-31cs.RO
Husnu Halid Alabay, Tuan-Anh Le, Ping Wang, Hakan Ceylan
Core Contributions
  • Solves a specific clinical imaging bottleneck: single-plane fluoroscopy is the real-time standard in endovascular procedures but gives only a 2D projection, and recovering 3D typically means biplane imaging or repeated contrast injections — both costly or risky.
  • VISTA sidesteps this with a digital-twin approach: reconstruct the vessel as a 3D model in advance, discretize its centerline into navigation milestones, then just snap each new 2D-detected robot position to the nearest milestone to infer local orientation and generate magnetic actuation commands — no live 3D reconstruction or contrast during navigation.
  • Demonstrated not just in phantoms but in vivo in a live rat's inferior vena cava — a real animal-model validation, uncommon in this batch of otherwise simulation- and benchmark-heavy papers.
  • Reports large practical gains over human-in-the-loop fluoroscopic control: up to 62% less navigation time, 98% fewer corrective actuation commands, and 57% less radiation exposure — the radiation reduction is a direct patient- and staff-safety benefit, not just a speed metric.
Show abstract

Reliable three-dimensional (3D) navigation of magnetically actuated untethered microrobots remains a major barrier to clinical translation. X-ray fluoroscopy is the standard real-time imaging modality for endovascular procedures, but single-plane fluoroscopy provides only a two-dimensional (2D) projection, eliminating depth information and complicating autonomous navigation. Recovering this information through biplane imaging or repeated contrast-enhanced angiography increases procedural complexity, radiation exposure, or contrast burden. Here, we introduce VISTA (Virtual Integration for Spatial Tracking and Autonomy), a digital twin framework enabling contrast-free autonomous navigation under single-plane fluoroscopy. VISTA reconstructs vascular anatomy as a 3D digital twin, discretizes the vessel centerline into navigation milestones, and assigns the detected 2D robot position to the nearest projected milestone. Consecutive milestones define the local vessel orientation used to generate magnetic actuation commands, converting single-plane fluoroscopic observations into topology-constrained navigation states without requiring contrast injection during navigation. VISTA is demonstrated across anatomically distinct vascular phantoms under continuous flow and within the inferior vena cava of a live rat in vivo. Compared with conventional fluoroscopic human-in-the-loop control, VISTA reduced navigation time by up to 62%, corrective actuation commands by up to 98%, and radiation exposure by up to 57%. These results establish VISTA as a digital twin-guided framework for contrast-free autonomous navigation of untethered endovascular microrobots using widely available single-plane fluoroscopy.