🤖 Robotics arXiv Digest

2026-09-02
30 papers
8 research areas
Generated by Claude
Research Landscape

Humanoid robotics dominates numerically — five of today's thirty papers — but the emphasis has shifted from "can it walk" to full-stack reliability. Safe-Stop reframes emergency stopping as a reachability problem instead of a fixed halt maneuver; FOCUS replaces binary foot-contact detection with a continuous, learned confidence signal for odometry; and the joint-offset calibration paper removes the need for external motion capture entirely, relying only on onboard sensors during a static stance. Read together with WM-LOCO's foothold-constrained locomotion and UMR's dense point-cloud motion retargeting, the cluster suggests the field is now investing as much in instrumentation, self-calibration, and safety infrastructure as in the headline capability of walking or manipulating.

A second, cross-cutting theme is methodological self-scrutiny. Rather than proposing new capabilities, ZETA, the LiDAR segmentation robustness study, the physics-consistent contact-rich HRI benchmark, and "Do Better Imagined Rollouts Mean Better Robot Control?" each interrogate whether existing evaluation practice measures what actually matters — respectively, that "zero-shot" claims conflate two genuinely different settings, that fine-grained benchmark rankings don't predict safety-relevant deployment performance, that task-success metrics can hide physically invalid contact, and that open-loop rollout error is a poor proxy for closed-loop control quality. Some results are genuinely uncomfortable for the field's current momentum: a zero-shot generalist policy (pi0.5) scoring just 0.7% success once contact is scored for physical validity, and feed-forward foundation models covering only 43% of ground-truth surgical geometry against 67% for classical multi-view optimization in MV-dVRK, both cut against the assumption that today's generalist models are ready to replace specialized methods.

On the manipulation and VLA side, the day's papers converge on making models more structured and inspectable rather than purely scaling them: HINT injects a human-inspired sparse-reasoning prior into VLA control, Sparse/Residual World Models argues explicitly against monolithic next-state prediction, and LAVLA opens up GR00T N1.5's internals to show how its latent space actually organizes spatiotemporal and kinematic information layer by layer. Autonomous-driving contributions (DiffuSearch, CrashDiffuser) show a parallel move toward decoupled architectures that separate semantic intent reasoning from continuous trajectory generation — echoing the manipulation cluster's separation of "what to do" from "how to move." Combined with TRACE's explicit push for auditable decision chains under EU AI Act-style transparency requirements, today's batch reads as a field consolidating around structure, evaluation rigor, and safety just as much as raw capability.

Papers by Research Area
Humanoid Robotics — Locomotion, Calibration & State Estimation
Full-stack humanoid reliability: safe stopping, motion retargeting, terrain-aware locomotion, self-calibration, and drift-resistant odometry.
  • #1. Humanoid Safe Stop via Learned Stoppability Value
  • #10. Unified Motion Retargeting for Humanoids with Learned Point Cloud Correspondence
  • #18. World-Model-Augmented Visual Locomotion for Humanoids on Foothold-Constrained Terrain
  • #21. Contact-Constrained Lower-Limb Joint-Offset Calibration for Humanoid Robots
  • #23. FOCUS: Foot Observation Confidence for Robust Humanoid Proprioceptive Odometry
Vision-Language-Action & Manipulation Learning
Structuring and interpreting VLA policies for long-horizon manipulation, uncertainty-aware mapping, and cross-embodiment transfer.
  • #8. HINT: Human-Intent Inception for Long-Horizon Robot Manipulation
  • #12. MS-MEM: Multi-Skill Manipulation-Enhanced Mapping via Uncertainty- and Disturbance-Aware Action Selection
  • #13. Latent Cluster Analysis for Vision-Language-Action Models
  • #15. ZETA: A Controlled Study of Zero-Shot Cross-Embodiment VLA Transfer for Tabletop Manipulation
  • #25. Modeling What Changes: Sparse, Residual World Models for Object-Centric Manipulation
Autonomous Driving & Traffic Safety
Trajectory planning, lane-change behavior, and safety-critical scenario generation for on-road autonomy.
  • #16. Pre-Lane-change Signal in Transitional Autonomous Vehicles: Results from Controlled Experiments
  • #22. DiffuSearch: How Hybrid Trajectory Planning Benefits from Aligned Objectives in Diffusion and Action Space
  • #28. CrashDiffuser: VLM-Guided Collision Intent Reasoning for Fine-Grained Safety-Critical Traffic Scenario Generation
Control Theory & Real-Time Control
Model-based and sampling-based control for terrain-adaptive navigation, uncertain measurements, and compliant force-aware manipulation.
  • #3. An Adaptive Control Architecture for Slope and Terrain Compensation in Autonomous Navigation in Mediterranean Greenhouses
  • #11. Koopman-Based Robust Model Predictive Control for Nonlinear Systems with Stochastic Intermittent Measurements
  • #26. Real-Time Dynamics-Based Torque-Sampling MPPI for Compliant and Force Aware Manipulation
Perception, Sensing & Navigation
Onboard panoramic vision, robustness-focused LiDAR segmentation evaluation, efficient vision-language navigation, and space-hardened instance segmentation.
  • #5. From Multi-Fisheye Sensing to Panoramic Perception: A Parallax-Aware Onboard Platform for Ultra-Low-Altitude UAVs
  • #6. Toward Robust LiDAR Semantic Segmentation for Real-World Deployment: Evaluation under Coarse Labels, Adverse Conditions, and Domain Shifts
  • #20. LookStep: Efficient Vision-Language Navigation with Linguistic Foresight and Event Driven Memory
  • #24. Hardware-Accelerated Instance Segmentation for Resource-Constrained Space Robotics with Criticality Analysis
Surgical & Assistive Robotics
Perception benchmarks and physically grounded evaluation for surgical manipulation and contact-rich assistive care.
  • #2. MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception
  • #9. MACAW: Reliable And Efficient Surgical Debridement Using Monocular Adaptive Compact Attention Windows
  • #19. A Physics-Consistent Benchmark for Contact-Rich Human-Robot Interaction in Assistive Care
Evaluation, Interpretability & Trustworthy AI
Rethinking how robot learning and world models should be evaluated, plus auditable decision-making for safety-critical autonomy.
  • #17. Recursive Value Learning for Long-Horizon Offline Goal-Conditioned RL
  • #27. Do Better Imagined Rollouts Mean Better Robot Control? A Controlled Study of World-Model Evaluation Under Feedback
  • #30. Towards Trustworthy Autonomous Robots: An Explainable AI-Based Decision Framework
Novel Hardware & Field Robotics
New physical platforms and fabrication pipelines: underwater vehicles, multi-axis 3D printing, powered prosthetics, and soft-robot computing.
  • #4. Advancing Accessible Underwater Robotics: The Mini-Girona I-AUV at RAMI 2025
  • #7. WildFab: Multi-Axis 3D Printing from Models in the Wild
  • #14. Design and Validation of a Lightweight, Low-Profile Powered Knee Prosthesis with Quasi-Direct Drive Actuation
  • #29. Towards Effective Physical Reservoir Computing with a Pneumatic Soft Robot
Papers
Humanoid Robotics — Locomotion, Calibration & State Estimation (5 papers)
#1
h=55
Humanoid Safe Stop via Learned Stoppability Value
2026-09-02 cs.RO cs.LG eess.SY K. Sreenath (h=55)
Junfeng Long, Pieter Abbeel, Koushil Sreenath, Roberto Horowitz, Guanya Shi
Core Contributions
  • ▸ Reframes emergency stopping as a reach-avoid problem instead of executing one fixed halt maneuver regardless of whether stopping is actually feasible from the current state.
  • ▸ Combines two independent learned signals — a stop-probability estimator trained on realized outcomes and a Hamilton-Jacobi reach-avoidance estimator — and only commits to stopping when both agree, otherwise handing off to a damping fallback.
  • ▸ Because the estimators are decoupled from the upstream task policy, they transfer to new behaviors without retraining, unlike stop maneuvers baked into a specific controller.
  • ▸ Signals growing investment in safety infrastructure for humanoids as they move toward real deployment, not just locomotion benchmarks.
Show abstract

Humanoid robots responding to emergency stop commands typically execute a fixed maneuver, without reasoning about whether a safe stop is actually feasible from the current state. We cast emergency stopping as a reach-avoid problem and propose Safe-Stop, a task-agnostic framework that pairs a learned stop policy with learned stoppability estimators. The estimators are complementary: a stop-probability estimator supervised by the actual outcomes of the fixed stop policy, and a reach-avoidance estimator supervised by a Hamilton-Jacobi backup over physical state. The first captures emergent stopping behavior of the learned controller; the second provides a complementary recoverability signal. Because the stop policy and estimators do not depend on the behavior policy that preceded the stop command, they transfer across diverse upstream tasks without retraining. At deployment, the two estimates are combined: Safe-Stop commits to the stop only when both estimators indicate that stopping remains feasible, otherwise it hands off to a fall policy, instantiated as a damping fallback. This agreement check yields decisions that are robust without sacrificing reactivity.

#10
h=13
Unified Motion Retargeting for Humanoids with Learned Point Cloud Correspondence
2026-09-02 cs.RO cs.GR Tae-Joung Kwon (h=13)
Hanyang Cao, Yuetong Fang, Taesoo Kwon, Runyi Yu, Ji Ma
Core Contributions
  • ▸ Replaces hand-crafted sparse keypoint/body-part correspondence (which requires manual redesign per robot) with a learned dense point-cloud correspondence, treating exterior point clouds as a robot-agnostic interface.
  • ▸ Because the correspondence is dense rather than sparse, it captures fine-grained pose and contact detail that keypoint-based retargeting misses, particularly for interaction tasks.
  • ▸ Decouples retargeting from both the motion source's skeletal semantics and the target robot's topology, so the same pipeline scales to new robots without redesigning correspondence rules.
  • ▸ Positioned as infrastructure for turning large human motion datasets into robot-ready training data at scale, not a one-off demo.
Show abstract

Humanoid learning increasingly relies on transforming vast and diverse human motion data into high-quality robot reference trajectories. However, retargeting human motion to humanoid robots is challenging due to substantial differences in morphology, degrees of freedom, joint ranges, and kinematic constraints between humans and robots. Existing retargeting methods typically address these differences by defining human-robot correspondence through hand-crafted sparse keypoints or body-part pairs. As a result, retargeting quality depends heavily on manual semantic design, limiting scalability across motion sources and robot morphologies and providing only sparse guidance for reproducing detailed poses and interactions. In this paper, we present Unified Motion Retargeting (UMR), a framework that learns dense point cloud correspondence without requiring manually designed human-robot mappings. By treating exterior point clouds as a unified interface between human motion and humanoid robots, UMR decouples retargeting from source-specific skeletal semantics and robot-specific topology. The learned dense correspondence provides fine-grained geometric anchors for constrained point cloud matching optimization, enabling surface-level pose alignment and direct transfer of interaction contacts. Experiments demonstrate that UMR unifies retargeting across heterogeneous motion sources, robot embodiments, and downstream scenarios ranging from locomotion to interaction, while achieving higher motion fidelity and plausibility than state-of-the-art methods. UMR therefore provides a scalable foundation for transforming large-scale human motion references into robot-ready training data.

#18
h=3
World-Model-Augmented Visual Locomotion for Humanoids on Foothold-Constrained Terrain
2026-09-02 cs.RO Wei Sui (h=3)
Yuxi Liu, Lijun Han, Ziming Wang, Ao Zhang, Cong Yang
Core Contributions
  • ▸ Targets foothold-constrained terrain (stepping stones, gaps, narrow stairs) where reactive, current-frame-only foot placement leaves little room to recover from a single misstep.
  • ▸ Jointly trains a recurrent world model with PPO so the policy conditions on a predicted near-future summary rather than only the current depth image — without ever using explicit foothold labels as supervision.
  • ▸ In simulation, succeeds completely on gaps/stepping-stones where a matched baseline fails outright, and matches baseline stair success while improving stride efficiency and reducing pelvis acceleration.
  • ▸ Deployed unmodified on a physical Unitree G1 across all three terrain types at 93.3% average success — a real sim-to-real result, not just a simulation ablation.
Show abstract

Foothold-constrained terrain is characterized by sparse, discontinuous, or geometrically restricted feasible foot contacts, as encountered on stepping stones, across gaps, and on narrow stair treads. On such terrain, a single misstep often leaves little room to recover, so policies that base foot-placement decisions primarily on the immediately visible terrain are prone to failure. We ask whether a learned predictive summary of near-future observations and rewards can provide the anticipatory information required in such settings. We present World-Model-Augmented Visual Locomotion (WM-LOCO), which jointly trains a recurrent world model and a PPO policy. Conditioned on proprioception and a single onboard depth image, the world model produces a predictive recurrent feature that guides the policy, without explicit foothold labels. In simulation, WM-LOCO succeeds on gaps and stepping stones where a matched baseline fails completely, and matches the baseline's success rate on stairs while improving stride efficiency and reducing pelvis acceleration. We deploy the same policy onboard a physical Unitree G1 humanoid using onboard proprioception and a single depth stream; it traverses all three terrain classes with an average success rate of 93.3%.

#21
h=3
Contact-Constrained Lower-Limb Joint-Offset Calibration for Humanoid Robots
2026-09-02 cs.RO Pei Lin (h=3)
Kaixiang Lu, Haiyu Lan, Chunxiao Qiao, You Li, Chengyuan Luo
Core Contributions
  • ▸ Removes the dependency on external motion-capture or fiducial markers for humanoid leg calibration, using only onboard joint encoders and a pelvis IMU during static double-support stance.
  • ▸ Frames calibration as minimizing the posture-dependent dispersion of the inter-foot transform, which should stay constant when both feet are planted — turning a physical invariant into an optimization objective.
  • ▸ Runs a genuine observability analysis (Hessian eigenstructure) to show why pitch-axis offsets are only partially recoverable from orientation residuals alone, and designs specific excitation motions to break that coupling.
  • ▸ Cuts foot-height RMS residual from 4.26mm to 2.20mm on one robot and 8.03mm to 1.43mm on another, cross-validated against an independent LiDAR-inertial trajectory reference.
Show abstract

Accurate joint encoder offsets are essential for kinematic consistency in humanoid lower limbs, yet existing calibration methods typically require external motion-capture systems or fiducial targets. We present a self-contained calibration framework exploiting only onboard joint encoders and a pelvis-mounted IMU during static double-support contact. The inter-foot transform from forward kinematics must stay constant when both feet are fixed; minimizing its posture-dependent dispersion yields a nonlinear least-squares problem over the 12-dimensional offset vector. A Hessian eigenstructure analysis shows that parallel pitch axes induce a rotational coupling. Orientation residuals then observe only the pitch-offset sum, while translation and posture diversity set the remaining numerical observability. For the A3 pitch-to-roll-to-yaw ordering, hip-roll and hip-yaw excitation reduce hip-pitch coupling. A standing-posture knee prior then anchors the remaining weak pitch-chain decomposition. Simulation and real-machine injection tests show consistent recovery, and on held-out recordings calibration reduces foot-height RMS residuals from 4.26 to 2.20 mm on A3 and from 8.03 to 1.43 mm on A2. An independent LiDAR-inertial reference checks the pitch-coupled channel. Removing an injected pitch offset moves the leg-odometry vertical drift back toward the LiDAR trajectory. A few static double-support stances thus provide contact-consistent corrections for well-excited directions. Individual offsets in the weak pitch chain remain prior-dependent.

#23
h=3
FOCUS: Foot Observation Confidence for Robust Humanoid Proprioceptive Odometry
2026-09-02 cs.RO Pei Lin (h=3)
Kaixin Feng, Angsong Li, Shaopeng Zhang, Enyu Li, Peiwen Lin
Core Contributions
  • ▸ Replaces binary foot-contact detection — the standard assumption in legged odometry — with a continuous, learned reliability weight, addressing the fact that "in contact" doesn't imply the forward-kinematics velocity estimate is actually trustworthy.
  • ▸ Blends this continuous confidence into an EKF by adapting observation covariance on the fly, rather than hard-switching which sensors to trust — smoother fusion instead of discrete mode changes.
  • ▸ Trains entirely from automatically generated simulation signals with no manual FK-reliability labels, using only IMU and joint kinematics at deployment — works on hardware without reliable torque sensing.
  • ▸ Reports large, consistent error reductions: 83.7% ATE reduction in simulated walking, 70.8% across 19 real walking segments, and 42.7% on real dynamic-motion routines.
Show abstract

Foot forward kinematics (FK) is widely used to improve proprioceptive legged odometry by providing reliable velocity constraints during foot support. Existing contact-aided estimators generally rely on binary contact decisions to determine whether the FK measurements of an entire foot should be trusted. However, contact does not necessarily imply FK reliability. Dynamic locomotion often involves partial support, toe dragging, and foot slip, causing binary contact decisions to accumulate significant drift over long trajectories. To address this limitation, we propose FOCUS (Foot Observation Confidence from Unannotated Simulation), which predicts a continuous FK reliability weight for each foot instead of estimating binary foot contact. Rather than replacing the model-based estimator, the predicted reliability weights are used to blend FK velocity observations with IMU-propagated body velocity and to adapt the observation covariance of an extended Kalman filter (EKF), enabling smooth reliability-aware fusion without hard contact switching. The network is trained from automatically generated simulation signals using an FK-weighted velocity consistency loss with lightweight simulator-contact regularization, without manually annotated continuous FK-reliability labels. The deployed model relies only on IMU and joint kinematic measurements, making it suitable for hardware platforms with unreliable torque sensing. Experiments demonstrate that FOCUS reduces absolute trajectory error (ATE) by 83.7% on simulated walking episodes, preserves simulated dynamic-motion fidelity in motion scale and spectral energy, reduces ATE by 70.8% across 19 real walking segments, and reduces mean ATE by 42.7% across four real dynamic-motion routines.

Vision-Language-Action & Manipulation Learning (5 papers)
#8
h=16
HINT: Human-Intent Inception for Long-Horizon Robot Manipulation
2026-09-02 cs.RO Hongjie Fang (h=16)
Mingyu Mei, Haojie Xu, Shihao Jin, Zibo Dai, Qihao Cheng
Core Contributions
  • ▸ Diagnoses a specific VLA failure mode: dense, evolving visual input drowns out sparse language instructions, so policies chase visual shortcuts instead of the actual human goal.
  • ▸ Argues semantic intent should only be re-reasoned at manipulation-pattern transitions (not every timestep), while continuous control tracks the evolving object-hand relationship — an inductive bias borrowed from how humans manipulate.
  • ▸ Delivers this via two lightweight visual interfaces (image-space highlighting, attention-prior injection) that add no new trainable parameters to the base VLA — a retrofit rather than a new foundation model.
  • ▸ Improves intent understanding, task progress, and end-to-end success across two different foundation policies and out-of-distribution task variants, without hurting control latency.
Show abstract

Humans can perform complex manipulations given a simple intent through an overall instruction, while continuously adapting to evolving visual observations. However, current vision-language action (VLA) models and other action policies struggle to realize this high-level intelligent behavior under dense, evolving visual inputs and sparse language guidance. Visual correlations can then dominate semantic intent, leading actions to follow visual shortcuts rather than human goals. We present HINT (Human-INTent INcepTion), an agentic framework inspired by the human manipulation principles: semantic intent changes sparsely at manipulation-pattern transitions, whereas continuous control primarily depends on the evolving object-hand relationship. HINT invokes semantic reasoning only at pattern transitions to resolve the current subtask and target, then maintains this commitment through multi-view grounding and visual tracking. We explore two visual interfaces-image-space semantic highlighting and attention-prior injection-to communicate the tracked intent to the action policy without introducing additional trainable parameters into the foundation action model. Experiments across three long-horizon tasks and out-of-distribution variants show that HINT substantially improves intent understanding, task progress, and end-to-end success across two foundation policies while preserving low-latency control.

#12
h=9
MS-MEM: Multi-Skill Manipulation-Enhanced Mapping via Uncertainty- and Disturbance-Aware Action Selection
2026-09-02 cs.RO Nils Dengler (h=9)
Yitian Shi, Jesper Mücke, Nils Dengler, Sicong Pan, Rania Rayyes
Core Contributions
  • ▸ Unifies three previously separate actions — active viewpoint selection, pushing, and grasping — into one evidential mapping framework rather than treating perception and manipulation-for-perception as separate subsystems.
  • ▸ Introduces a "collateral disturbance constraint" that explicitly penalizes actions disturbing already-confident parts of the scene belief — addressing the common failure of push/grasp exploration wrecking a partially built map.
  • ▸ Learns grasp affordance and orientation uncertainty jointly via a "full-evidential" grasp estimator, giving action selection a single information-gain criterion across perception and manipulation.
  • ▸ Shows a genuine trade-off improvement, not just an accuracy gain: higher mapping accuracy with substantially less scene disturbance than single-skill or unconstrained baselines.
Show abstract

Accurate scene understanding in confined, cluttered spaces such as shelves is essential for service robots, as many everyday tasks require them to locate and retrieve objects reliably. Yet, it remains challenging due to severe occlusions, restricted accessibility, and the need to avoid excessive scene changes. In this paper, we propose Multi-Skill Manipulation-Enhanced Mapping (MS-MEM), an evidential framework for uncertainty-aware mapping that integrates active viewpoint selection, object pushing, and grasping. MS-MEM combines scene-level metric-semantic evidential belief estimators with an uncertainty-aware grasp representation. This representation is learned using a novel full-evidential grasp estimator that models both grasp affordance and orientation uncertainty. In our framework, candidate perception and manipulation actions are evaluated within a unified action selection pipeline using a common information gain criterion. For manipulation actions, we further introduce a collateral disturbance constraint (CDC) that discourages excessive changes to confident regions of the scene belief. This enables MS-MEM to select actions that effectively reduce map uncertainty while limiting collateral scene changes. Experimental results show that, compared with single-skill and unconstrained baselines that ignore scene disturbance, MS-MEM achieves higher mapping accuracy while substantially reducing scene disturbance, highlighting the synergistic effects of active viewpoint selection, push, and grasp actions.

#13
h=8
Latent Cluster Analysis for Vision-Language-Action Models
2026-09-02 cs.RO Stefan Wermter (h=8)
Theodor Wulff, Sergio Lanza, Tamara Bila, Angelo Cangelosi, Stefan Wermter
Core Contributions
  • ▸ Directly opens the black box of GR00T N1.5's action decoder rather than proposing a new architecture — an interpretability study, unusual among the day's mostly capability-focused papers.
  • ▸ Introduces a cross-attention-based embedding-weighting scheme for clustering that amplifies task-relevant latent features, and shows it beats naive clustering baselines quantitatively.
  • ▸ Finds a layer-wise disentanglement story: spatiotemporal and kinematic features separate progressively through the network, sharpening in middle layers and stabilizing near the output.
  • ▸ Attaches human-interpretable concept labels to clusters, giving a first foothold for explaining what a diffusion-based VLA action head actually represents internally.
Show abstract

Vision-Language-Action (VLA) Models are increasingly used in robotics for their ability to ground language and perception into action, yet the internal representations driving their behaviour remain poorly understood. We propose LAVLA, a framework for latent cluster analysis of VLA models, and conduct a layer-wise study of the state-of-the-art GR00T N1.5 model, with particular focus on its action decoder. To better characterise the latent space during action diffusion, we introduce a cross-attention-based embedding-weighting method that amplifies relevant features while suppressing less informative ones. Quantitative evaluation shows that weighted clustering consistently outperforms the baseline. To improve interpretability, we extract human-interpretable concepts for each cluster, linking latent representations to semantic descriptions. Our analysis shows that latent clusters progressively disentangle spatiotemporal and kinematic features, with representations becoming more refined in the middle layers and stabilising toward the output. As such, LAVLA advances the interpretability of language-driven robotic systems.

#15
h=7
ZETA: A Controlled Study of Zero-Shot Cross-Embodiment VLA Transfer for Tabletop Manipulation
2026-09-02 cs.RO Jiangran Lyu (h=7)
Mi Yan, Wenhao Zhang, Zhiqi Zhang, Yu Peng, Tangxinyu Wang
Core Contributions
  • ▸ Fixes a definitional gap in the field: separates "strict zero-shot" (target embodiment never seen, even in pretraining) from "pretrain-exposed zero-shot" (seen only during pretraining), which prior work conflates.
  • ▸ Runs a controlled ablation across 14 held-out embodiments, isolating four factors (state-action representation, pretraining embodiment diversity, auxiliary co-training, target exposure) instead of comparing end-to-end systems.
  • ▸ Quantifies each factor separately: local end-effector representations, embodiment diversity, and co-training add roughly 15, 18, and 7 percentage points of transfer performance respectively.
  • ▸ Finds an asymmetry that matters for practitioners: adding just 5% target-embodiment data during pretraining buys 13.4 points of progress — "zero-shot" claims are highly sensitive to what counts as pretraining exposure.
Show abstract

Zero-shot generalization to unseen embodiments is important for generalizable vision-language-action (VLA) models as robot hardware evolves and task-specific data collection remains costly. However, a systematic understanding of this problem remains limited, in part because the literature lacks a unified zero-shot transfer definition and controlled evaluation settings that isolate embodiment changes from differences in tasks, scenes, or protocols. To address this gap, we first distinguish strict zero-shot transfer, where the target embodiment is absent from all training data, from pretrain-exposed zero-shot transfer, where it appears only during pretraining. We then introduce a controlled benchmark spanning 14 held-out target embodiments across simulation and real-world validation. Within this framework, we conduct a controlled analysis of four factors: state-action representations, pretraining embodiment diversity, auxiliary co-training objectives, and target-embodiment exposure. Experimental results show that local end-effector (EEF) state-action representations, the source embodiment diversity, and auxiliary co-training improve cross-embodiment transfer by around 15, 18, and 7 percentage points, respectively. We further find that adding only 5% target-embodiment data during pretraining improves average target-embodiment progress by 13.4 percentage points, showing that strict and pretrain-exposed zero-shot transfer are distinct and should be reported separately. Together, these findings provide practical guidance for evaluating and improving cross-embodiment VLA transfer in stationary tabletop manipulation with two-finger grippers, while motivating future investigation of broader settings including mobile-base control, dexterous hands, and long-horizon tasks.

#25
h=3
Modeling What Changes: Sparse, Residual World Models for Object-Centric Manipulation
2026-09-02 cs.RO cs.AI Param Thakkar (h=3)
Param Thakkar, Parsika Paresh Shah, Manisha Sushant Gote
Core Contributions
  • ▸ Directly challenges the default monolithic world-model design — predicting the entire next state every step — arguing this wastes capacity re-predicting the static majority of a scene and injects error into unchanged parts.
  • ▸ Uses a per-object change gate plus a residual delta head that only perturbs objects the gate flags, making the sparsity an explicit inductive bias rather than hoping a dense network learns it implicitly.
  • ▸ Wins on efficiency and accuracy together: 2.5–4.6x more accurate next-state prediction at 8.6–11.1x fewer parameters than a dense MLP baseline, with near-perfect zero-shot transfer across object counts (99.4% F1 retention).
  • ▸ Directly connects prediction quality to downstream planning: a prediction-only model fails inside a sampling-based planner even though a true-simulator oracle proves the planner itself works, but the sparse model, once trained on planner-visited states, begins to actually solve the task.
Show abstract

Monolithic world models predict the entire next state at every step, spending capacity re-predicting the static majority of a scene and injecting error into it. We ask whether explicitly modeling change (a per-object change gate plus a residual delta head that perturbs only the objects the gate flags) is a more effective and interpretable bias for physical prediction and control. On a MuJoCo tabletop pushing benchmark scaling from 3 to 8 objects, the sparse/residual model predicts next-state poses 2.5 to 4.6 times more accurately than a dense multilayer perceptron at 8.6 to 11.1 times fewer parameters, sustains change-detection F1 of 0.80 to 0.87 where the dense baseline is degenerate, transfers across object counts with zero retraining (99.4 percent F1 retention), and reaches about 90 percent of its full-data accuracy with a quarter of the data. In autoregressive rollout it compounds far less error, hugging the no-motion floor while the dense model drifts. Finally, inside a sampling-based planner, prediction-only models fail (though a true-simulator oracle solves the task with the identical planner, confirming the planner is sound), but once featurized and trained for the states a planner visits, the sparse model begins to plan (0.23 plus or minus 0.06 success over three seeds) while the dense monolith stays at zero at every seed. Modeling what changes, rather than re-predicting the whole world, is a simple, effective bias for object-centric physical AI; code, data generators, and all checkpoints will be released upon publication.

Autonomous Driving & Traffic Safety (3 papers)
#16
h=4
Pre-Lane-change Signal in Transitional Autonomous Vehicles: Results from Controlled Experiments
2026-09-02 cs.RO eess.SY Zeyu Mu (h=4)
Zeyu Mu, Danjue Chen, Abhinav Sharma, George F. List
Core Contributions
  • ▸ Studies a real production transitional autonomous vehicle's lane-change behavior using 150 controlled real-world maneuvers, not simulation.
  • ▸ Defines an operational "signal time" reference point and shows the vehicle's relative position/speed there already predicts, at 0.89 cross-validated accuracy, whether it will merge in front of or behind the target vehicle — before any lateral motion is visible.
  • ▸ Proposes a two-stage model of lane-changing (longitudinal preparation, then lateral execution) that could let planners separate "which gap" decisions from "when to steer" decisions.
  • ▸ A rare empirical/behavioral study of an already-deployed system rather than a new algorithm — a real look at what a production product actually does.
Show abstract

This paper investigates how a production transitional autonomous vehicle (tAV) develops and executes mandatory lane-change decisions. Using 150 controlled mandatory lane changes from the NC-tALC experiments, the study examines whether the eventual target gap is observable before lateral movement begins and how the tAV progresses longitudinally from that pre-lane-change state to lane-change start. Signal time (SigT) is defined as an operational pre-lane-change-start reference point. A Firth logistic regression predicts whether the tAV eventually merges in front of or behind its nearest target-lane vehicle using relative position and relative speed at SigT. Longitudinal progression from SigT to lane-change start is then examined separately for in-position and repositioning cases. The traffic state at SigT contains substantial information about eventual target-gap choice and provides meaningful lead time before lateral movement begins. The proposed formulation predicts whether the tAV remains with its current gap or repositions to a neighboring gap by moving forward or dropping back, including cases with longitudinal overlap and ambiguous current-gap geometry. The model achieves an average five-fold cross-validated accuracy of 0.89. Results also provide preliminary evidence that in-position and repositioning cases follow different longitudinal pathways from SigT to lane-change start. These findings support a two-stage conjecture of the observable lane-change process: longitudinal preparation from SigT to lane-change start, followed by lateral maneuver execution. The formulation applies to in-position, repositioning, and longitudinally overlapping cases, and can support lane-change models that distinguish target-gap choice from lateral-onset timing while representing longitudinal preparation before lateral movement begins.

#22
h=3
DiffuSearch: How Hybrid Trajectory Planning Benefits from Aligned Objectives in Diffusion and Action Space
2026-09-02 cs.RO cs.AI Steffen Hagedorn (h=3)
Steffen Hagedorn, Aron Distelzweig, Alexandru P. Condurache
Core Contributions
  • ▸ Diagnoses hybrid trajectory planners' core weakness as architectural incoherence — generation and refinement modules optimizing different, uncoordinated objectives, which drifts the refined trajectory from the initial proposal's intent.
  • ▸ Shares one objective set (collision avoidance, drivable-area compliance, comfort, progress) across both stages: a guided diffusion model uses them as differentiable guidance during denoising, and an MCTS refinement stage uses the identical objectives as its reward.
  • ▸ Ablations pin down where the gains come from: MCTS refinement is the primary driver, with objective-sharing between stages providing a smaller but consistent additional boost.
  • ▸ Achieves state-of-the-art or near state-of-the-art results on nuPlan and interPlan closed-loop benchmarks, with the largest wins in complex interactive scenarios where objective misalignment would matter most.
Show abstract

In trajectory planning for autonomous driving, hybrid planning architectures are often realized as a collection of disparate modules, each with its own objectives. This lack of a unifying principle can lead to inconsistencies between the initial and refined trajectory, resulting in suboptimal behavior. We address this by introducing DiffuSearch, a novel hybrid planner that uses a unified set of objectives across generation and refinement. Our model encourages all components to follow the same shared driving goals: collision avoidance, drivable area compliance, comfort, and progress. DiffuSearch employs a two-stage architecture. First, a guided diffusion model generates a scene-consistent, joint trajectory prediction, using our driving objectives as differentiable guidance functions to implicitly steer the denoising process. Second, a Monte Carlo Tree Search (MCTS) in a discretized action space performs an explicit, local refinement of this proposal, leveraging the same driving objectives as its reward function. This synergistic design leverages the diffusion model's strength in finding scene-consistent solutions combined with the explainable, constraint-aware refinement of MCTS. Experiments on nuPlan and interPlan reactive closed-loop benchmarks demonstrate that DiffuSearch achieves strong and often state-of-the-art performance, substantially reducing collisions and improving comfort, particularly in complex, interactive scenarios. Our ablation studies indicate that MCTS refinement is the main mechanism behind the gains, while sharing objectives between implicit guidance and explicit search provides further consistent improvements.

#28
h=2
CrashDiffuser: VLM-Guided Collision Intent Reasoning for Fine-Grained Safety-Critical Traffic Scenario Generation
2026-09-02 cs.RO cs.AI Muhammad Monjurul Karim (h=2)
Shucheng Zhang, Yuang Zhang, Bingzhang Wang, Muhammad Monjurul Karim, Kehua Chen
Core Contributions
  • ▸ Goes beyond just "cause a collision" scenario generation to fine-grained control over where on the target vehicle the collision occurs (head/rear/side) — a harder and more useful target for testing specific safety systems.
  • ▸ Decouples semantic reasoning from trajectory synthesis: a VLM handles high-level collision-intent reasoning (speed change, turning behavior, collision stage) while a diffusion model handles the continuous adversarial trajectory, conditioned on that intent.
  • ▸ Closes the loop with short-horizon replanning at each step so generated trajectories adapt to the target vehicle's actual evolving behavior rather than committing to an open-loop adversarial plan.
  • ▸ Reports the real difficulty of the fine-grained task honestly: 50.33% target-collision rate in one attempt (68% after three), but only 40.05% contact-region control success — hitting the right contact zone is markedly harder than causing a collision at all.
Show abstract

Generating safety-critical scenarios is essential for evaluating autonomous driving systems. However, existing generators primarily focus on inducing collisions and offer limited control over where contact occurs on the target vehicle. In this paper, we study fine-grained safety-critical scenario generation, where success requires both a target collision and a specified head, rear, or side contact region. We propose CrashDiffuser, a closed-loop VLM-guided diffusion framework that decouples semantic collision reasoning from continuous trajectory synthesis through a hierarchical collision-intent interface derived from the requested target contact region. At initialization, the VLM extracts reusable scene-level context; at each replanning step, it predicts a structured action tuple describing speed change, turning behavior, and collision stage. This intent conditions a diffusion model to generate executable adversarial trajectories, while collision-guided sampling, candidate selection, and short-horizon replanning adapt generation to the target vehicle's evolving behavior. On WOMD-derived closed-loop scenarios, CrashDiffuser achieves a target-collision rate of 50.33% in a single attempt and 67.98% after three attempts, together with a contact-region control success rate of 40.05% and competitive trajectory naturalness. Component ablations further support the proposed design.

Control Theory & Real-Time Control (3 papers)
#3
h=39
An Adaptive Control Architecture for Slope and Terrain Compensation in Autonomous Navigation in Mediterranean Greenhouses
2026-09-02 cs.RO D. Wollherr (h=39)
Fernando Cañadas-Aránega, Dirk Wollherr, José L. Guzmán, José C. Moreno, José L. Blanco-Claraco
Core Contributions
  • ▸ Ties terrain compensation to the physically measured combination of IMU-sensed slope angle and experimentally characterized soil type (concrete, sand, gravel), rather than a generic disturbance observer.
  • ▸ Cascades an MPC outer loop with a PI inner loop, then adds gain-scheduled feedforward keyed to the terrain/slope estimate so the controller anticipates disturbances instead of only rejecting them after the fact.
  • ▸ Targets a narrow but real deployment gap — Mediterranean greenhouse robots — where small terrain irregularities compound into meaningful trajectory error.
  • ▸ Validated only in simulation so far, leaving real greenhouse deployment as the open question.
Show abstract

The ability to move stably over terrain with varying slopes and textures is essential for mobile agricultural robots operating in complex and dynamic environments such as greenhouses, where small terrain irregularities can lead to significant navigation errors. This article presents a novel terrain-adaptation strategy based on the carried payload, ensuring accurate and robust trajectory tracking. The proposed approach is based on: (i) the experimental characterization of the most common types of greenhouse soil, concrete, compacted sand, and gravel, and (ii) the direct measurement of terrain slope using the IMU, in order to estimate the force with which this angle affects the motor input. Based on this information, a cascade trajectory-tracking scheme has been designed, consisting of a model-based predictive controller (MPC) in the outer loop and a PI controller in the inner loop. The system incorporates an adaptive feedforward control through gain scheduling approach, capable of adjusting to disturbances caused by variations in slope and terrain type. Simulation results demonstrate that the differential-drive robot achieves a significant improvement both in error indices and in control signal efficiency, highlighting the effectiveness and robustness of the proposed approach.

#11
h=13
Koopman-Based Robust Model Predictive Control for Nonlinear Systems with Stochastic Intermittent Measurements
2026-09-02 cs.RO eess.SY Minghao Han (h=13)
Guanhua Liu, Tong Wu, Lixian Zhang, Weifeng Du, Minghao Han
Core Contributions
  • ▸ Tackles a genuinely hard control problem — nonlinear systems where measurements arrive intermittently and stochastically, not just under bounded continuous noise.
  • ▸ Uses a Lipschitz-constrained deep Koopman model for a cheap-to-optimize linearized latent predictor, combined with a two-mode Markov chain model of the dropout process itself.
  • ▸ Provides a distribution-free, confidence-calibrated probabilistic error radius to size constraint tightening, rather than a fixed conservative margin, and proves recursive feasibility and mean-square ultimate boundedness.
  • ▸ Grounds the theory in a concrete visual-servoing tracking task, connecting the stability guarantees to a scenario robotics practitioners will recognize.
Show abstract

Intermittent state measurements pose fundamental challenges to model predictive control of constrained nonlinear systems because prediction uncertainty grows during feedback outages and measurement-triggered resets disrupt nominal state propagation, potentially compromising closed-loop stability and recursive feasibility. This paper develops a Koopman-based stochastic MPC framework with probabilistically truncated soft constraints. Specifically, a Lipschitz-constrained deep Koopman model provides a linear latent predictor, enabling computationally efficient online optimization. The intermittent measurement process is modeled as a two-mode discrete-time Markov chain, yielding a unified Markov jump error model for open-loop propagation and measurement-triggered resets. Under numerically verifiable sufficient conditions, the prediction error is shown to be mean-square ultimately bounded, and an explicit uniform second-moment bound is obtained. A distribution-free probabilistic error radius is then constructed for a prescribed confidence level and used to truncate dropout-dependent constraint tightening. An exact-penalty soft-constraint mechanism accommodates reset-induced jumps and prolonged dropouts. Under the stated terminal compatibility and bounded-disturbance conditions, recursive feasibility and mean-square ultimate boundedness of the closed-loop regulation error are established. Numerical simulations on a visual-servoing tracking task corroborate these theoretical results and demonstrate effective tracking under stochastic measurement unavailability.

#26
h=3
Real-Time Dynamics-Based Torque-Sampling MPPI for Compliant and Force Aware Manipulation
2026-09-02 cs.RO Yonghwan Oh (h=3)
Euncheol Im, Taehyun Kim, Yonghwan Oh, Myotaeg Lim, Yisoo Lee
Core Contributions
  • ▸ Solves rigid-body dynamics explicitly inside a real-time MPC loop rather than approximating them, specifically to get compliant, force-aware behavior for physical interaction — a harder ask than standard motion-only MPC.
  • ▸ Uses MPPI's sampling-based structure to sidestep the linearization/convexification that makes conventional MPC struggle with these nonlinear dynamics, pushing the sampling onto the GPU via a torque-space parameterization.
  • ▸ Achieves a genuinely fast solver update rate — over 166 Hz with a 0.18s horizon — on real hardware (7-DoF manipulator), fast enough for reactive compliant contact rather than only offline planning.
  • ▸ Positions compliance and force-awareness as a byproduct of accurate real-time dynamics rather than a separate impedance-control layer bolted on afterward.
Show abstract

This study proposes a novel Model Predictive Path Integral (MPPI)-based task-space control framework. The proposed framework explicitly solves rigid-body dynamics within a real-time MPC formulation and enforces safety constraints, enabling accurate motion and force control that yields compliant behaviors for safe and effective physical interaction of robotic manipulators in unstructured environments. By leveraging MPPI, the proposed framework efficiently handles nonlinear dynamics that are difficult to solve with conventional MPC approaches in real-time. Furthermore, we develop a torque-sampling-based control architecture that enables efficient exploitation of GPU-based parallelization, resulting in effective compliant and force-aware behaviors. As a result, the proposed framework achieves a solver update rate of over 166 Hz with a 0.18 s prediction horizon, and its performance is validated through real-world experiments on a 7-DoF manipulator.

Perception, Sensing & Navigation (4 papers)
#5
h=28
From Multi-Fisheye Sensing to Panoramic Perception: A Parallax-Aware Onboard Platform for Ultra-Low-Altitude UAVs
2026-09-02 cs.RO Q. Quan (h=28)
Dun Dai, Ze Lu, Cheng He, Yaowen Wang, Quan Quan
Core Contributions
  • ▸ Builds a full onboard pipeline — four synchronized fisheye cameras stitched into a real-time 1280×640 equirectangular panorama — rather than a post-hoc stitching algorithm evaluated offline.
  • ▸ Introduces a parallax-aware seam and depth-selection strategy that cuts far-field feature misalignment by 41.6% versus fixed-depth stitching.
  • ▸ Demonstrated at production-relevant scale: 50,000+ four-view groups across 18 field sequences, sustaining 19.99 fps at 13.29W on a Jetson Orin NX — a real power/latency budget for a UAV, not just offline accuracy.
  • ▸ Downstream payoff is concrete: 90.8% Recall@5 on daytime visual place recognition directly from the panorama, and the pipeline is open-sourced.
Show abstract

Ultra-low-altitude unmanned aerial vehicles (UAVs) require surround vision near buildings, vegetation, and other obstacles. We present a parallax-aware onboard platform that converts four synchronized fisheye streams into an open 1280x640 equirectangular panorama (ERP) interface. A purpose-built carbon-fiber airframe integrates the cameras, NVIDIA Jetson Orin NX, a flight controller, and a global navigation satellite system (GNSS) receiver. The formation pipeline selects projection depth per overlap and combines controlled seams and photometric fusion. Its accuracy profile adds content-adaptive seam search and a validation-gated residual mesh, whereas its deployed profile retains margin-gated Per-seam updates for sensor-rate operation. Evaluation uses more than 50,000 four-view groups from 18 field sequences. Relative to Fixed Depth, the accuracy profile reduces far-field P90 feature misalignment by 41.6%; the deployed Per-seam profile achieves the lowest aggregate geometric errors across held-out sites. Under a paced 20 Hz replay, the deployed profile sustains 19.99 frames/s at 13.29W mean module-input power. Eight-sector ERP sampling reaches 90.8% mean daytime visual-place-recognition Recall@5. Together, these results validate an integrated onboard panoramic-perception architecture that unifies parallax-aware formation, sensor-rate embedded execution, and reusable downstream vision interfaces for ultra-low-altitude UAVs. The project has been open-sourced at https://github.com/DUNDAI1998/parallax-aware-uav-panorama.

#6
h=19
Toward Robust LiDAR Semantic Segmentation for Real-World Deployment: Evaluation under Coarse Labels, Adverse Conditions, and Domain Shifts
2026-09-02 cs.RO Jean-Emmanuel Deschaud (h=19)
Samir Abou Haidar, Alexandre Chariot, Mehdi Darouich, Cyril Joly, Jean-Emmanuel Deschaud
Core Contributions
  • ▸ Argues existing LiDAR segmentation benchmarks measure the wrong thing: fine-grained label accuracy on clean, single-domain data, not what actually matters for deployment.
  • ▸ Introduces a three-axis protocol — coarse safety-relevant labels, eight synthetic corruption types, and cross-dataset domain shift — plus on-device latency on a Jetson AGX Orin.
  • ▸ Key finding: rankings under the standard fine-grained benchmark don't predict safety-relevant performance, and robustness under corruption is architecture-dependent rather than a simple function of benchmark accuracy.
  • ▸ A sobering result for a widely benchmarked task: current domain generalization is judged "insufficient for reliable deployment."
Show abstract

LiDAR-based semantic segmentation is a core perception module for autonomous vehicles and mobile robots. Despite the strong performance of recent state-of-the-art methods on standard benchmarks, existing evaluation protocols remain focused on clean, single-domain settings and fine-grained label taxonomies, leaving deployment readiness largely unassessed. Real-world systems must handle safety-critical label semantics, degraded sensing conditions, and cross-domain variability, yet no unified protocol currently addresses all three aspects together. In this paper, we propose a structured evaluation protocol that assesses the deployment readiness of LiDAR semantic segmentation models along three complementary dimensions: (i) coarse-label evaluation aligned with autonomous driving safety priorities, revealing how label granularity affects different methods; (ii) robustness under eight types of LiDAR corruptions designed to emulate real-world atmospheric, geometric, and sensor degradations; and (iii) domain generalization across datasets without adaptation. The evaluation includes inference speed measured on an embedded Jetson AGX Orin platform, directly reflecting deployment constraints. Our results show that fine-grained benchmark rankings do not always reflect safety-relevant performance, that all methods experience substantial degradation under corruptions with architecture-dependent robustness characteristics, and that current domain generalization remains insufficient for reliable deployment. These findings expose concrete gaps between benchmark performance and deployment readiness, and provide a reference protocol for more practically grounded evaluation of LiDAR semantic segmentation.

#20
h=3
LookStep: Efficient Vision-Language Navigation with Linguistic Foresight and Event Driven Memory
2026-09-02 cs.CV cs.RO Kun-Yang Yu (h=3)
Kun-Yang Yu, Yingzhe Li, Hongyu Xu, Shi-Yu Tian, Zhi Zhou
Core Contributions
  • ▸ Targets the resource cost of current MLLM-based vision-language navigation systems, which rely on accumulated historical frames, cognitive maps, or external 3D tools to track state.
  • ▸ Combines language-based future-state prediction per candidate action with an event-driven rolling memory that autonomously decides what's worth remembering, instead of storing everything.
  • ▸ Uses language supervision more efficiently than the standard next-step action prediction paradigm, which the paper argues needs large data volumes because it only supervises the single expert action.
  • ▸ Achieves 49.7% success on R2R-CE Val-Unseen while beating prior methods under matched training settings and with less data and memory — efficiency, not just raw accuracy, is the claimed contribution.
Show abstract

Vision-Language Navigation (VLN) requires an embodied agent to follow natural-language instructions in unseen environments. Recent progress has been largely driven by Multimodal Large Language Models (MLLMs). Existing methods follow a next-step action prediction paradigm, supervising only the expert action, which requires a high quantity of data for training. They also rely on cognitive maps, accumulated historical frames, or external 3D tools to maintain states, leading to high computational and memory overhead. To realize resource efficiency VLN, we propose LookStep, a unified end-to-end framework that combines Language Centric Future State Modeling and Event Driven Rolling Memory that uses language labels to generate coarse-grained navigation progress and future states for each candidate action, while autonomously deciding whether to write each observation into a bounded rolling memory with a semantic role. We validate LookStep empirically. On VLN-CE tasks, LookStep outperforms existing methods under the same training settings, achieving a 49.7\% success rate on R2R-CE Val-Unseen with better memory efficiency and less data usage. Code and model is available at https://github.com/kunyang-YU/LookStep.

#24
h=3
Hardware-Accelerated Instance Segmentation for Resource-Constrained Space Robotics with Criticality Analysis
2026-09-02 cs.RO cs.AR cs.CV cs.LG Udo Frese (h=3)
Siddhant Shete, Hilmi Dogu Kücüker, Udo Frese, Frank Kirchner
Core Contributions
  • ▸ Targets three constraints simultaneously — extreme low light, limited onboard compute, and radiation-induced silent hardware faults — rather than optimizing accuracy alone, the more common framing for space perception work.
  • ▸ Introduces Activation Variance Informative Sampling, a label-free quantization-calibration method, to recover accuracy lost when compressing a YOLO segmentation model for a DPU accelerator.
  • ▸ Adds a software-level criticality analysis specifically to estimate and mitigate radiation-induced fault exposure — an unusual, mission-hardening angle not typical of perception papers.
  • ▸ Concrete deployment numbers on an actual lunar micro-rover platform: 69.8% of quantization-induced accuracy loss recovered, 309ms latency, 5.7W power draw, and a 31.7% reduction in global fault criticality.
Show abstract

Autonomous lunar missions require real-time per- ception under three coupled constraints: extreme low-light conditions, limited onboard compute, and radiation-induced hardware faults that can silently corrupt inference. We present a deployment-oriented instance segmentation framework for resource-constrained lunar robotics that jointly addresses quan- tization calibration and system-level fault exposure under strict compute constraints. First, we introduce Activation Variance Informative Sampling (AVIS), a label-free calibration strategy that deterministically selects calibration samples based on activation variance statistics. Second, we deploy a YOLO-based segmentation model on a Deep Learning Processor Unit (DPU) with architectural modifications that reduce CPU fallback paths and enable statically compiled execution with bounded latency in low-lighting conditions. We further introduce a software-level criticality analysis to estimate fault exposure and guide mitigation under radiation-constrained operation. On a lunar micro-rover platform, AVIS with bias correction recovers 69.8% of quantization-induced accuracy loss while achieving 309 ms inference latency and 5.7 W power consumption. Targeted mitigation reduces global criticality by 31.7%. The results demonstrate an integrated approach and a blueprint for a reliable and safe AI perception framework under space deployment constraints.

Surgical & Assistive Robotics (3 papers)
#2
h=48
MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception
2026-09-02 cs.CV cs.RO K. Kuchenbecker (h=48)
Guido Caccianiga, Sergey Prokudin, Yutong Chen, Bernard Javot, Rachael L'Orsa
Core Contributions
  • ▸ First ex-vivo surgical dataset with multiple exposure-synchronized stereo viewpoints plus scanner-validated ground-truth geometry, addressing the fact that clinical telerobots only ever see a single stereo pair.
  • ▸ Benchmarks how reconstruction quality scales with viewpoint count: with a third viewpoint, optimization-based multi-view methods cover 67% of the surface within 1mm vs. only 43% for feed-forward foundation models.
  • ▸ Result undercuts the assumption that general-purpose feed-forward 3D reconstruction transfers cleanly to surgery — it lags heavily behind classic optimization once more views are available.
  • ▸ Includes ten dynamic sequences with tissue deformation, setting up a harder future benchmark beyond the static case.
Show abstract

Large-scale training and refined optimization techniques have greatly improved sparse multi-view 3D reconstruction. Despite their relevance to surgery, such methods have never before been rigorously evaluated on real endoscopic images. Current clinical telerobots deploy a single stereo camera inside the patient, making multi-viewpoint data extremely rare. This paper presents MV-dVRK, the first ex-vivo surgical dataset to combine multiple exposure-synchronized stereo viewpoints with accurate surface geometry and camera poses. The static subset of the benchmark provides dense SfM reference geometry, validated against an industrial 3D scanner, together with ground-truth camera poses and sparse-view test sets. We use MV-dVRK to systematically compare zero-shot monocular, stereo, multi-stereo, and multi-view 3D reconstruction methods as the number of viewpoints increases. With two endoscopes, multi-stereo reconstruction achieves the highest coverage. With a third viewpoint, optimization-based multi-view methods perform best, covering 67% of ground-truth surface points within a 1 mm tolerance and recovering highly accurate relative camera poses. By contrast, feed-forward foundation models cover only 43% of the ground-truth surface in the same setting. MV-dVRK also includes ten dynamic sequences spanning multiple surgical tasks, with increasing kinematic complexity and tissue deformation, providing a basis for future research in multi-viewpoint surgical perception. The project is available at: https://mv-dvrk.is.mpg.de.

#9
h=16
MACAW: Reliable And Efficient Surgical Debridement Using Monocular Adaptive Compact Attention Windows
2026-09-02 cs.RO O. Mohareri (h=16)
Ziyang Chen, Shutong Jin, Preethi Satish, Sareena Mann, Cael Magner
Core Contributions
  • ▸ Splits the depth-control problem out from visual servoing rather than solving full alignment at once — servoing handles image-plane alignment, MACAW's attention windows handle depth from a single monocular camera.
  • ▸ Reports a striking precision number: gripper offset drops from 37 to under 5 pixels within 4 optimization steps (0.39s), on real da Vinci hardware, not simulation.
  • ▸ Throughput is the real payoff: 93% success at 11s/fragment (304/hour) unimanual, 92% success at 7s/fragment (473/hour) bimanual — clearly beating procedural and learned VLA baselines rather than just matching them.
  • ▸ Shows a narrow, well-engineered monocular depth strategy can outperform more general learned approaches on a specific, high-stakes surgical subtask.
Show abstract

Augmenting the dexterity of human surgeons has the potential to free them from tedious subtasks. We consider debridement (removal of diseased or dead tissue fragments), which is challenging due to imprecision in spatial perception and cable actuation. We develop an augmented dexterity system for surgical debridement that uses visual servoing to align the cable-driven gripper with the target position in the image plane, and then introduces a novel approach to depth control, MACAW: Monocular Adaptive Compact Attention Windows. Across 100 physical trials using the da Vinci Research Kit (dVRK) robot, camera-frame servoing reduced average gripper position offset from 37 to fewer than 5 pixels within 4 optimization steps, taking an average of only 0.39s. MACAW significantly outperforms procedural and learned VLA baselines, achieving a 93% success rate at 11 seconds per fragment, yielding a throughput of 304 fragments per hour. Extending MACAW to a bimanual debridement setup maintains a 92% success rate at an average of 7 seconds per fragment, increasing the throughput to 473 fragments per hour.

#19
h=3
A Physics-Consistent Benchmark for Contact-Rich Human-Robot Interaction in Assistive Care
2026-09-02 cs.RO Liuqun Fan (h=3)
Chengxiao He, Shanghai Yuan, Liuqun Fan, Shenzhen Zhu
Core Contributions
  • ▸ Argues task-success metrics alone are dangerously insufficient for contact-rich assistive care, since a robot can "complete" a bathing task while making physically invalid or unsafe contact.
  • ▸ Builds a benchmark around a deformable, passively-responding simulated human calibrated against real force-indentation data from a manikin — physical realism grounded in measurement, not just a plausible-looking simulator.
  • ▸ The results are a genuine wake-up call: a state-machine baseline's 72.9% task success collapses to 56.4% once correct-region and force-safety screening is applied, and a zero-shot generalist policy (pi0.5) achieves just 0.7% success with zero safety-gated successes.
  • ▸ Uses a frozen, vision-only observer/scorer protocol specifically to prevent evaluation leakage — a methodological detail that matters for whether the benchmark numbers can be trusted at all.
Show abstract

Conventional task-level evaluation asks whether a robot policy completes a specified action, but can miss failures that emerge only during physical human contact. This limitation is critical in contact-rich assistive tasks, where meaningful evaluation requires a physically responsive human, interaction-quality assessment beyond task success, and a leak-free observer-scorer protocol. We introduce a physics-consistent benchmark for contact-rich human-robot interaction, instantiated in robot-assisted bathing. The benchmark combines a deformable, passively responding human, physics-aware scores alongside task-level success, and a frozen vision-only / scorer-only evaluation protocol. To establish physical validity, region-wise simulated responses are calibrated against force-indentation measurements from Franka impedance pushes on a medical-care manikin. Under a frozen T1-T7 protocol with 140 runs per method, an LLM-augmented state machine (State Machine) achieves 72.9% task success but drops to 56.4% after correct-region and force-safety screening; VoxPoser produces lighter and more stable contact but completes only 27.9% of trials; and zero-shot pi0.5 achieves 0.7% task success with no correct-region or safety-gated successes. These results show that task completion alone does not imply physically valid contact and motivate physics-aware screening before deployment of contact-rich assistive robot policies.

Evaluation, Interpretability & Trustworthy AI (3 papers)
#17
h=4
Recursive Value Learning for Long-Horizon Offline Goal-Conditioned RL
2026-09-02 cs.LG cs.RO Hyeonseong Jeon (h=4)
Hyeonseong Jeon, Youngwoon Lee
Core Contributions
  • ▸ Targets the two compounding failure modes of long-horizon offline goal-conditioned RL: individually unreliable short-range value estimates, and max-based backups that amplify that unreliability through repeated bootstrapping.
  • ▸ Restructures value learning as a balanced binary tree over trajectory segments, trained leaf-to-root with an exact factorization of the observed route — dropping worst-case bootstrap depth from linear to logarithmic in horizon length.
  • ▸ Still discovers shortcuts despite training on non-optimal demonstrated routes, by propagating values across trajectories rather than being locked to the exact demonstrated path.
  • ▸ On the five hardest long-horizon OGBench tasks, lifts the best prior average score from 55 to 64, beating both flat and hierarchical baselines.
Show abstract

Scaling offline goal-conditioned reinforcement learning (GCRL) to long-horizon tasks is difficult because (1) long-range value learning depends on shorter-range estimates that may still be inaccurate, and (2) max-based value backups can amplify overestimation through repeated propagation. We propose DCRL (Divide-and-Conquer RL), which recursively decomposes each trajectory segment into a balanced binary tree and trains the values from leaves to root. Each parent is therefore updated only after its children, using an exact factorization of the observed route rather than selecting among noisy alternatives. Since this objective learns values along demonstrated routes that are not necessarily optimal, DCRL jointly propagates values across trajectories to discover shorter routes. Thanks to the balanced binary tree, DCRL reduces worst-case bootstrap depth from linear to logarithmic, and this shorter dependency structure empirically corresponds to much slower error accumulation. Across diverse goal-reaching tasks, DCRL substantially outperforms prior flat offline GCRL methods, and on the five most challenging long-horizon OGBench tasks, it improves the best prior average score from 55 to 64, surpassing all flat and hierarchical baselines.

#27
h=2
Do Better Imagined Rollouts Mean Better Robot Control? A Controlled Study of World-Model Evaluation Under Feedback
2026-09-02 cs.RO Dharini Raghavan (h=2)
Dharini Raghavan, Amritpal Singh
Core Contributions
  • ▸ Directly tests an assumption the field mostly takes for granted — that lower open-loop rollout prediction error means a better state estimator/world model for closed-loop control — and finds it's often wrong.
  • ▸ Shows single-step replay error correlates far better with actual closed-loop tracking error (Spearman rho=0.923) than multi-step rollout error (rho=0.774), and rollout-based ranking picks the wrong best estimator in 18 of 24 sensing conditions vs. only 5 for replay.
  • ▸ Demonstrates the effect scales directly with correction frequency: rank agreement with closed-loop performance drops from 0.916 to 0.774 as measurement updates go from every step to none during the evaluated rollout.
  • ▸ Turns the critique into a training implication: training recurrent estimators specifically on long sensing outages improves EKF-anchored models under combined degradation (GRU-EKF cross-track RMSE 1.72m to 1.06m), though not consistently across all outage types.
Show abstract

Predictive models are increasingly used in robotics for state estimation, planning, control, and policy evaluation, yet they are often judged by open-loop prediction accuracy over a fixed horizon. In closed-loop operation, a robot repeatedly acts, receives new measurements, updates its state estimate, and recomputes control. We study this difference in a differential-drive path-tracking task with biased odometry and intermittent landmark sensing. Six state estimators are evaluated across 24 sensing conditions using trajectory replay, a 20-step measurement-free rollout, and closed-loop tracking. Replay position RMSE correlates more strongly with closed-loop cross-track RMSE than rollout error (Spearman rho = 0.923 vs. 0.774) and selects a different estimator from the closed-loop optimum in 5/24 conditions, compared with 18/24 for the rollout metric. We then vary rollout horizon and measurement-update interval. With H=20, rank agreement decreases from rho = 0.916 with measurements at every step to rho = 0.774 with no measurements. A horizon-update grid shows that long prediction horizons remain informative when regular corrections are retained, whereas long rollouts without correction can produce rankings that differ substantially from closed-loop behavior. We also test recurrent estimators trained on longer sensing outages. This improves the EKF-anchored models under combined sensing degradation, reducing GRU-EKF cross-track RMSE from 1.72 m to 1.06 m, but the gain is not consistent across isolated outages or estimator architectures. These results show that predictive-model evaluation in robotics should specify both prediction horizon and measurement-update schedule. For models used in feedback, offline rollouts are most informative when their sensing and correction pattern reflects closed-loop operation. Code is available at https://github.com/rdharini2001/Robot_World_Model

#30
h=1
Towards Trustworthy Autonomous Robots: An Explainable AI-Based Decision Framework
2026-09-02 cs.RO cs.AI Çağrı Temel (h=1)
Cagri Temel
Core Contributions
  • ▸ Targets the auditability gap directly: when an autonomous robot incident occurs, investigators currently often cannot reconstruct why the system made a specific decision.
  • ▸ Organizes the decision pipeline into four explicitly auditable layers (semantic perception, belief reasoning with causal graphs, action synthesis with counterfactual documentation, execution verification) rather than treating explainability as a post-hoc add-on.
  • ▸ Designed to be model-agnostic — wraps around existing learned perception modules (CNNs, transformers) rather than requiring a specific architecture, which matters for retrofitting onto already-deployed systems.
  • ▸ Reports strong numbers on its own audit-quality metrics (98.6% evidence traceability, 99.0% temporal continuity, 98.1% decision reconstructability across 500 cycles) and explicitly frames the motivation around EU AI Act transparency requirements — regulation-driven design, not an academic exercise.
Show abstract

Autonomous robots powered by deep learning face a fundamental auditability challenge: when incidents occur, investigators cannot reconstruct why the system made specific decisions. This paper presents TRACE (Transparent Reasoning Architecture for Credible Execution), a decision framework that ensures every autonomous action can be traced back to sensor evidence through documented causal chains. The framework organizes decision-making into four auditable layers: Semantic Perception for evidence-grounded entity recognition, Belief Reasoning for probabilistic state estimation with causal graphs, Action Synthesis for constraint-aware planning with counterfactual documentation, and Execution Verification for compliance monitoring. TRACE is model-agnostic yet designed to integrate learning-based perception modules (CNNs, transformers) while preserving decision-level auditability. We evaluate the framework using three objective metrics: Evidence Traceability (sensor-to-decision linkage), Decision Reconstructability (post-hoc analysis capability), and Temporal Continuity (audit trail completeness). Experimental evaluation on warehouse robot navigation demonstrates that TRACE achieves 98.6% evidence traceability, 99.0% temporal continuity, and 98.1% decision reconstructability across 500 simulated decision cycles. Post-hoc methods like LIME provide feature attributions but lack the artifact structure needed for decision-level reconstruction. The framework addresses EU AI Act requirements for high-risk system transparency and contributes to Explainable AI for safety-critical autonomous systems.

Novel Hardware & Field Robotics (4 papers)
#4
h=34
Advancing Accessible Underwater Robotics: The Mini-Girona I-AUV at RAMI 2025
2026-09-02 cs.RO N. Gracias (h=34)
Taqi Hamoda, Bilal Ahmed, Deborah Ele-Ojo, Thi Tran Ha Bao, Adel Saidani
Core Contributions
  • ▸ Positions itself explicitly between costly research AUVs and bare ROVs, targeting a roughly $50,000 price point with a 5-DOF manipulator, stereo vision, and onboard AI.
  • ▸ Field-tested through competition (RAMI 2025) rather than lab benchmarks — a second-place finish despite thermal management problems and restricted team access is a real-world stress test, not a curated demo.
  • ▸ Strength was specifically vision-based perception and intervention, suggesting the affordability tradeoffs didn't compromise the core autonomy stack.
  • ▸ Positioned as an education/research platform aimed at lowering the barrier to entry for underwater robotics research.
Show abstract

The Mini-Girona Intervention Autonomous Underwater Vehicle (I-AUV) represents an advancement in accessible underwater robotics, designed to bridge the gap between costly, specialized research AUVs and basic Remotely Operated Vehicles (ROVs). Developed with a focus on affordability and usability, the Mini-Girona, priced at approximately $50,000, integrates advanced components such as a 5-DOF manipulator arm, stereo vision, and AI-driven processing for autonomous navigation and intervention tasks. This paper presents the design and development of the Mini-Girona, detailing its performance during the RAMI 2025 student competition. Despite challenges such as thermal management issues and restricted team access, the Mini-Girona achieved second place overall, excelling in vision-based perception and intervention tasks. This work highlights the platform's potential as a tool for underwater robotics research and education, fostering innovation in real-world underwater applications.

#7
h=19
WildFab: Multi-Axis 3D Printing from Models in the Wild
2026-09-02 cs.GR cs.RO Guoxin Fang (h=19)
Jiasheng Qu, Zhikai Shen, Chenyu Xu, Hailin Sun, Chengkai Dai
Core Contributions
  • ▸ Targets a practical failure mode of multi-axis 3D printing pipelines: real-world models (scans, topology-optimized meshes, non-manifold CAD) that existing toolpath planners choke on without manual repair.
  • ▸ Combines a neural unsigned distance field with a regularized generalized winding number field to get both differentiable surface queries and a reliable solid/void indicator without watertight-mesh assumptions.
  • ▸ Uses this hybrid representation for both toolpath computation (projecting along guidance-field level sets) and collision-free motion planning (coarse UDF rejection, fine reg-GWN verification).
  • ▸ Validated across genuinely varied "in the wild" inputs — voxelized topology optimization, raw scans, non-watertight meshes — rather than a single clean CAD benchmark.
Show abstract

Multi-axis 3D printing enables support-free fabrication and improved part quality, but robustly processing real-world geometries remains challenging. Models from design workflows or direct data acquisition often contain solid--shell combinations and non-manifold structures. Handling such models in the wild typically requires time-consuming geometry repair, which may alter the intended geometry. In this work, we present WildFab, a computational framework for multi-axis 3D printing that directly computes spatial toolpath and global collision-free motion from input models. Our pipeline builds on a hybrid query representation that combines a neural unsigned distance field (UDF) with a regularized generalized winding number field (reg-GWN). The UDF supplies differentiable surface-distance and direction queries, while the reg-GWN resolves near-surface ambiguity in the fitted UDF by providing reliable surface localization and a solid-void indicator. Based on this representation, we introduce a high-precision spatial toolpath computation algorithm that iteratively projects points between optimized guidance-field level sets and reg-GWN gradient-magnitude ridges. Subsequently, we develop an efficient and robust coarse-to-fine collision checking scheme for motion planning: UDF-based rejection first identifies potential collisions, while time-varying reg-GWN verification accurately resolves collision pairs for both solid and shell components. We validate WildFab on diverse inputs, demonstrating successful computation from non-manifold parametric surfaces, voxelized topology-optimization results, implicit models, raw scanned point clouds, and non-watertight meshes. The fabrication results highlight our method's ability to advance end-to-end design-to-3DP workflows.

#14
h=8
Design and Validation of a Lightweight, Low-Profile Powered Knee Prosthesis with Quasi-Direct Drive Actuation
2026-09-02 cs.RO Robert D. Gregg (h=8)
Ross J. Cortino, Ryan Posh, Emily G. Keller, Robert D. Gregg
Core Contributions
  • ▸ Directly targets why quasi-direct-drive knee prostheses haven't reached the clinic: prior QDD prototypes were too heavy and bulky, even though QDD gives better torque control and backdrivability than geared designs.
  • ▸ Achieves 2.6 kg and 24.5 cm build height while still hitting 145 Nm peak torque and just 1 Nm backdrive torque, via an optimized 18:1 two-stage transmission plus thermal/structural FEA — an engineering optimization, not just a bigger motor.
  • ▸ Validated with three transfemoral amputee participants across walking and sit-stand transitions, with knee extension torques within one standard deviation of able-bodied reference data.
  • ▸ Claims to meet or beat a leading commercial device on mass, build height, torque, and acoustic noise simultaneously — the multi-objective win is the actual contribution.
Show abstract

Fully-powered knee prostheses, unlike traditional passive knees, can perform controlled positive work, reducing the need for compensatory behaviors by users during energy-intensive activities. While quasi-direct drive (QDD) actuators provide superior torque control, backdrivability, and acoustic noise properties compared to traditional highly-geared actuators, prior QDD prototypes have been too heavy and bulky for commercial translation. In this work, we present the design and validation of a new lightweight (2.6 kg) and low-profile (24.5 cm tip-to-tip build height) QDD knee prosthesis. By optimizing an 18 to 1 two-stage transmission alongside thermal and structural finite-element analyses, we significantly reduce device mass while enabling a peak torque of 145 Nm. Through benchtop tests, we validate the device's high output torque, low backdrive torque (1 Nm), and its precision position and torque control capabilities. We also demonstrate biomimetic kinematics and peak knee extension torques (within one standard deviation of able-bodied references) during both level-ground walking and sit-stand transitions performed by three participants with transfemoral amputation and varying K-levels. By meeting or improving upon the mass, build height, peak torque, and acoustic noise of a leading commercial powered knee, this work establishes the clinical viability of emerging QDD prostheses that promise improved dynamic performance for their users.

#29
h=2
Towards Effective Physical Reservoir Computing with a Pneumatic Soft Robot
2026-09-02 cs.RO Wenlong Zhang (h=2)
Jeevan Hebbal Manjunath, Jun Wang, Suyi Li, Wenlong Zhang
Core Contributions
  • ▸ Moves physical reservoir computing from "does it work" demos to an actual design-rule study — testing how pouch interconnection topology, robot stiffness, and sensor count independently affect estimation performance on a pneumatic soft arm.
  • ▸ Finds a specific, actionable structural rule: independently sealed pouches preserve far richer observable state than a shared pneumatic manifold, meaning topology alone can make or break the computation.
  • ▸ Shows diminishing returns quantitatively — two well-placed sensors already recover most of the benefit, three capture essentially all of it — arguing against simply adding more sensors as a default strategy.
  • ▸ Key takeaway is a design philosophy: stronger actuation/excitation cannot compensate for a poorly chosen topology that has already destroyed the diversity of the physical signal.
Show abstract

Physical reservoir computing (PRC) refers to the use of a physical dynamical system as a computational resource for tasks such as state estimation and control, but there has been a lack of formal study of design rules towards more effective design of such physical reservoirs. Using a pneumatic soft arm with a five-pouch sensing column, this work studies how the pouch interconnection topology, robot stiffness, and the number of instrumented sensors affect bending-angle estimation performance. Across 36 matched trials spanning waveform, baseline pressure of the sensing column, and actuation range, all designs are evaluated under the same-time bending-angle estimation benchmark using 0.2 s of pressure history and a fixed ridge estimator. Our analysis of the experimental results leads to three design guidelines. First, independently sealed pouches preserve a much richer observable state than a shared manifold. Second, increasing the baseline pressure of the sensing column makes the pouch responses more redundant and increases estimation error most strongly in the coupled topology. Third, in the sealed topology, two strategically placed sensors already recover most of the attainable benefit, three capture essentially all of it, and additional sensors provide little or no additional value. In summary, the results suggest that topology, stiffness, and number of instrumented sensors should be co-designed for accurate PRC of soft robot states; stronger excitation alone cannot recover the diversity that poor design choices have already removed.