Skip to content
RobotWorld
Back to Papers

PAPER DEEP DIVE

Paper人形Humanoid

FARO: Feasibility-Aware Robot Motion Optimization

Fast planning of novel behaviors in unseen scenarios remains a fundamental challenge in robotics. The high-dimensional, hybrid, and underactuated nature of humanoid loco-manipulation continues to hinder the realization of this goal. In this paper, we address this challenge by proposing a nested kino-dynamic framework for rapid feasibility checking and dynamically consistent trajectory generation given a candidate contact sequence. By integrating this module with a feasibility-guided tree search and a Large Language Model (LLM)-based contact plan sampling strategy, we demonstrate that the proposed framework can substantially improve the search process. Furthermore, we show that the generated trajectories can be tracked using a reinforcement learning (RL)-based controller and show that the resulting trajectories are of sufficiently high quality for execution in real-world loco-manipulation scenarios. A supplementary video is available at: https://youtu.be/R6qCHoCormQ.

Michal Ciebielski, Shafeef Omar, Aaron Johnson, Majid KhadivJuly 20, 20268 min read
中文
Anonymous Authors · arXiv 2026
arXiv:2607.18362 · Demo Video
Code Status: No public code repository link provided in the paper

TL;DR

FARO (Feasibility-Aware Robot Motion Optimization) proposes a nested kino-dynamic framework that uses hierarchical feasibility checks (mode/edge feasibility → kinematic sequence optimization → full trajectory optimization) to rapidly prune infeasible contact sequences. In humanoid loco-manipulation, it finds 26.4 solutions within a 2-hour budget where the TO-only baseline finds 0 on hard tasks.

Figure 1. FARO motion optimization and real-world execution

Figure 1: Motion optimization and real-world execution with FARO. Top: snapshots of a trajectory produced by motion optimization. Bottom: snapshots from executing the optimized trajectory on the real robot.

1. Abstract

Fast planning of novel behaviors in unseen scenarios remains a fundamental challenge in robotics. The high-dimensional, hybrid, and underactuated nature of humanoid loco-manipulation continues to hinder the realization of this goal. In this paper, we address this challenge by proposing a nested kino-dynamic framework for rapid feasibility checking and dynamically consistent trajectory generation given a candidate contact sequence. By integrating this module with a feasibility-guided tree search and a Large Language Model (LLM)-based contact plan sampling strategy, we demonstrate that the proposed framework can substantially improve the search process. Furthermore, we show that the generated trajectories can be tracked using a reinforcement learning (RL)-based controller and show that the resulting trajectories are of sufficiently high quality for execution in real-world loco-manipulation scenarios.

2. Background & Motivation

Humanoid loco-manipulation involves searching over an extremely high-dimensional underactuated system over a long horizon, creating combinatorial explosion. Two paradigms each have limitations:

  • Trajectory Optimization (TO): Combines discrete contact sequence search with trajectory optimization as a relaxation of mixed-integer formulations. But combinatorial growth makes it computationally expensive, requiring simplification through simplified models, task-specific heuristics, or hand-designed high-level actions, limiting discoverable complex dynamic behaviors.
  • Reinforcement Learning (RL): Successful in locomotion due to cyclic task nature and extensive reward shaping, but ineffective for complex long-horizon loco-manipulation skills. Recent advances rely on tracking demonstrations or human-to-humanoid retargeting, bypassing the exploration problem but requiring suitable reference motions.

Exploration remains the central obstacle: restricted in TO to manage computational complexity and avoided in RL through imitation or retargeting. FARO directly addresses this through more efficient multi-contact motion exploration—rapidly pruning infeasible contact decisions to reduce combinatorial burden without relying on predefined behavioral abstractions or reference motions.

3. Core Method

3.1 Contact Mode Sequence

Let $\mathcal{I}$ be the set of all contact interfaces. Each interface $a\in\mathcal{I}$ has contact state pair $(a,b)$ where $b\in\mathcal{I}$ indicates unilateral contact with interface $b$, and $b=\varnothing$ indicates $a$ is free. A contact mode is the complete assignment over all interfaces:

$$c=\{(a,b):\forall a\in\mathcal{I}\ \exists!\;b\in\mathcal{I}\cup\{\varnothing\}\}$$

The mode must be consistent: $(a,b)\in c\Leftrightarrow(b,a)\in c$. A contact-mode time sequence $\mathcal{C}=(c_{0},\ldots,c_{K-1})$ where the mode at time $s$ is:

$$c_{s}=\{(a,b_{s}):a\in\mathcal{I}\},\qquad s=0,\ldots,K-1$$

3.2 State and Control Spaces

State and control variables combine robot ($r$) and object ($o_{\ell}$) components:

$$x:=(x^{r},x^{o_{1}},\ldots,x^{o_{n_{o}}})\in\mathcal{X},\quad u:=(u^{r},u^{o_{1}},\ldots,u^{o_{n_{o}}})\in\mathcal{U}$$

Robot state $x^{r}:=(q^{r},v^{r},h^{r})$ includes configuration $q^{r}\in\mathrm{SE}(3)\times\mathbb{R}^{n}$, generalized velocity $v^{r}\in\mathfrak{se}(3)\times\mathbb{R}^{n}$, and centroidal momentum $h^{r}\in\mathbb{R}^{6}$. Robot control $u^{r}:=(\dot{v}^{r},\lambda_{1}^{r},\ldots,\lambda_{n_{ee}}^{r})$ includes generalized acceleration and end-effector wrenches $\lambda_{e}^{r}\in\mathbb{R}^{6}$.

3.3 Constraint Definitions

All end-effectors and environment contact interfaces modeled as rectangular patches with patch-to-patch unilateral contact. Instantaneous constraints include: normal alignment and zero normal separation (7a), patches within admissible region (7b), unilateral contact and pyramidal Coulomb friction approximation (7c), torsional friction and center-of-pressure bounds (7d). For sticking contacts persisting across timesteps, a no-slip condition (8) applies.

Joint position, velocity, and torque-speed limits:

$$q^{r}_{\min}\leq q^{r}\leq q^{r}_{\max},\quad |v^{r}|\leq v^{r}_{\max},\quad |\tau_{i}|\leq\tau_{\max,i}-\frac{\tau_{\max,i}}{v_{\max,i}}|v_{i}|$$

The last inequality is a linear torque-speed envelope: available torque decreases affinely with joint speed, reaching zero at $v_{\max,i}$.

3.4 Hierarchical Feasibility Checks

Figure 3. FARO optimization problems

Figure 3: Graphical overview of FARO optimization problems. Mode/edge optimization finds a single configuration satisfying individual contact mode or transition constraints. Kinematic sequence optimization finds one configuration per transition plus initial and terminal. Trajectory optimization searches for dynamically feasible motion over discretized trajectory.

FARO's core is a four-level hierarchical feasibility check, from cheap to expensive:

LevelChecksFormulaSolver
1. Mode feasibility $M$Single contact mode kinematic feasibilityIK optimization (14)Ipopt
2. Edge feasibility $E$Transition between two modesIK optimization (14)Ipopt
3. Kinematic Sequence Opt. $K$Geometric consistency of full sequenceMultiple-shooting (15)acados SQP
4. Trajectory Optimization $T$Full dynamic feasibilityMultiple-shooting (17)Hippo SQP

Mode/Edge feasibility: IK optimization problem (14) checking if a single configuration satisfies contact constraints. Infeasible if NLP doesn't converge within max iterations.

Kinematic Sequence Optimization (KSO): Given a contact mode sequence, solves for robot-object configurations verifying geometric feasibility without imposing time-dependent dynamics. Decision variables reduced by 74.8% on average vs TO, with 70.0% constraint coverage.

Trajectory Optimization (TO): Beyond KSO's geometric consistency, additionally enforces full robot-object dynamics. Solves for state trajectory, control trajectory, and one time-scaling factor per contact-mode stage.

Figure 2. FARO overview

Figure 2: High-level overview of FARO. The scene defines robot, movable objects, environment geometry, and available contact interfaces. Candidate contact plans from search, user-specified, or LLM methods are evaluated by hierarchical feasibility checks with cached results.

3.5 Feasibility-Guided Tree Search

Tree search rooted at initial mode, node selection using cost-based UCT variant:

$$\mathrm{UCT}(n) = \mathrm{cost}(n) + c\frac{\ln N(n)}{N(n)}$$

Expansion controlled by progressive widening. Candidate sequences pass through cheaper filters first, terminating at first failure. Reusable results stored in feasible/infeasible caches. Four search variants use different filter sets: {KSO}, {M,E,KSO}, {M,E,KSO,TO}, {TO}.

graph TD
    SCENE[Scene Definition] --> GEN[Contact Sequence Generator]
    GEN -->|candidate plans| CHECK{Hierarchical Feasibility Checks}
    CHECK -->|1.Mode M| M[Mode Feasibility]
    M -->|pass| E[Edge Feasibility]
    E -->|pass| KSO[Kinematic Sequence Opt.]
    KSO -->|pass| TO[Trajectory Optimization]
    TO -->|feasible| FEAS[Feasible Plan → Execute]
    M -->|fail| CACHE_F[Infeasible Cache]
    E -->|fail| CACHE_F
    KSO -->|fail| CACHE_F
    CACHE_F -->|feedback| GEN
    FEAS --> RL[RL Trajectory Tracking Controller]
    RL --> ROBOT[Real Humanoid Robot Execution]

4. Key Experiments

4.1 Qualitative Analysis on Human-Defined Sequences

Eight contact-mode sequences with varying lengths and complexity designed. Each mode discretized with 20 optimization knots in TO. Asterisked sequences executed on real robot with RL trajectory-tracking controller.

Metric/TaskClimb1Climb2PickPlace1*PickPlace2*Toss*DoubleCatch*
Num. Modes61161148
TO time [s]50.59106.0121.3683.409.7391.53
KSO time [s]0.341.930.370.900.140.31
Dec-var reduction [%]74.974.474.974.974.974.9
Constraint coverage [%]70.270.670.271.370.269.1

Table I: Computational performance and constraint coverage on human-specified contact sequences. KSO is ~2 orders of magnitude faster than TO with 70.0% average constraint coverage. * = executed on real robot.

KSO is approximately two orders of magnitude faster than TO (avg 0.60s vs 64.70s) while retaining 70.0% of TO constraint types on average. The 74.8% average decision variable reduction makes KSO a fast yet expressive feasibility check. KSO omits dynamics-related constraints since it optimizes one configuration per mode transition rather than a fully discretized trajectory.

4.2 Feasibility-Guided Tree Search

Figure 4. Tree search evaluation scenes

Figure 4: Tree Search Evaluation Scenes. Two box-placement tasks with same contact-mode search space but different kinematic and dynamic difficulty. Objective: place white box on platform.

Evaluated on two box-placement task variants, 5 runs each (different seeds), 2-hour budget per run, max depth 5 switches. Baseline: TO-only. Maximum branching factor 108.

Key finding: On the hard task, TO-only baseline finds 0 solutions, expands only 12.8 nodes; while {KSO} variant expands 814.6 nodes and finds 26.4 solutions on average. Filters excluding TO explore substantially faster during node expansion, invoking TO only after reaching the discrete goal, indicating KSO serves as an effective proxy for guiding search. The hard task highlights the benefit of mode and edge filtering in addition to KSO—cached infeasibility results allow previously checked queries to be rejected without re-solving, substantially reducing redundant exploration.

4.3 LLM Contact-Plan Exploration

Figure 5. LLM contact-plan sampling scenes

Figure 5: LLM Contact-Plan Sampling Scenes. KSO feasibility filter evaluated on LLM-generated contact plans across four task scenarios. Each task's -b variant is more challenging than -a.

KSO evaluated as feasibility filter for LLM-generated contact plans across four task scenarios. KSO rapidly identifies infeasible sequences in LLM-generated plans, providing feedback for LLM to improve subsequent plans.

5. Limitations & Future Work

  • Planar contact interfaces (author-stated): Current formulation assumes planar contact interfaces; could be extended to richer geometries using differentiable signed-distance representations.
  • Nested feasible sets (author-stated): The optimization hierarchy is designed around increasingly restrictive feasibility conditions with expected nested feasible sets, but a formal proof is left to future work.
  • Long-horizon scaling (author-stated): Scaling to substantially longer-horizon tasks will likely require integrating FARO with higher-level task and motion planning or program search.
  • False negatives: The few observed false negatives are primarily associated with poor initialization or insufficient solver iterations in KSO.

6. Conclusion

FARO is a feasibility-aware framework for rapidly discovering dynamic humanoid loco-manipulation behaviors from candidate contact-mode sequences. It hierarchically filters candidates using contact mode, transition, kinematic sequence, and full trajectory optimization checks. Early pruning and cached feasibility results reduce expensive trajectory optimizations while preserving promising contact sequences. Experiments across feasibility-guided tree search, LLM-generated, and human-designed plans show that mode/edge and kinematic sequence optimizations capture most relevant constraints at substantially lower cost than full trajectory optimization, enabling faster and broader exploration of candidate contact plans and improving solution discovery in challenging scenarios while producing very few false-negative classifications. This work demonstrates that guiding search through hierarchical feasibility checks rather than full trajectory optimization is an effective approach to balancing efficiency and quality in humanoid multi-contact motion planning.

"Don't optimize every trajectory to discover infeasibility—prune fast with hierarchical checks, invest compute only where it matters."

Related Papers

Pre-training Visual Dexterity in Simulation

Pre-training Visual Dexterity in Simulation

Large-scale pre-training has made robot policy fine-tuning increasingly data-efficient, but this progress has largely been driven by datasets and embodiments built around simple parallel-jaw grippers. Dexterous, multi-fingered hands remain comparatively data-starved because real teleoperation is costly to scale, while human hand video is off-embodiment and requires lossy pose estimation and retargeting. We introduce Simulation Pre-training for Dexterity (SPD), a pre-training framework for dexterous manipulation that uses data entirely collected in simulation. In SPD, humans manipulate virtual objects inside a VR headset, enabling on-embodiment trajectories and robot-free collection. With the help of five operators, we collect 75 hours of multi-task dexterous manipulation over one week, and use it to pre-train a causal transformer on a sequence modeling objective. We study the benefits of simulation pre-training on real-world tasks by fine-tuning on 1-2 hours of physical demonstrations on a 56-DoF bimanual dexterous setup. We find that our approach outperforms training behavior cloning policies from scratch, showing that simulation teleoperation is a viable pre-training source for real-world dexterous manipulation. We perform ablation studies, measuring the benefits of history conditioning and short action chunks for reactive control.

灵巧操作灵巧手预训练Aug 16, 2026
FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation

FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation

In contact-rich manipulation, action multimodality and reactivity dominate different stages of a single episode. Before contact, multiple trajectories might be equally valid, making it important to preserve diverse action modes. After contact, geometric constraints and force limits narrow the solution space, while successful execution demands rapid responses to force feedback. However, standard diffusion policies use a fixed inference frequency and sampling steps throughout the episode, forcing a fundamental compromise: low-frequency, multi-step sampling better preserves pre-contact multimodality but responds slowly to force feedback, whereas high-frequency sampling improves reactivity but tends to collapse distinct pre-contact modes. To resolve this tradeoff, we present FA-RDP, a frequency-adaptive reactive diffusion policy. A shared multi-frequency visual-force Transformer predicts action chunks at both low and high frequencies, while a learned multimodality indicator dynamically selects multi-step low-frequency sampling before contact and one-step high-frequency sampling as action ambiguity decreases. We further introduce Manifold Consistency Distillation (MCD), which reparameterizes the diffusion network to predict actions on the robot action manifold while retaining DDPM-based residual supervision. Experiments on three contact-rich manipulation tasks show that FA-RDP achieves the highest success rate while preserving diverse pre-contact trajectory modes. Code and videos are available at https://fa-rdp.github.io.

PaperJul 30, 2026
PhiZero: A World Model Built Around Physical Language

PhiZero: A World Model Built Around Physical Language

We introduce PhiZero, a physical world model built around physical language, a compact discrete representation of world-state transitions. Existing physical world models typically predict future videos directly in pixel space, leaving the underlying world dynamics implicit within high-dimensional visual predictors. Motivated by humans' ability to abstract predictive structure from visual experience and organize it in natural language for explicit reasoning, we learn physical language from in-the-wild videos through self-supervision and use it to explicitly reason about how the physical world evolves. Accordingly, PhiZero adopts a reason-then-render paradigm: it first infers future world evolution as a physical-language sequence and then renders the inferred transitions into videos. Extensive experiments across generation and understanding benchmarks validate the ability of PhiZero to model physically coherent world evolution. We further show its potential for realistic and interactive world modeling, fine-grained action-conditioned simulation, and zero-shot motion transfer.

PaperJul 30, 2026
Booster Lab: A Data-Centric Pipeline for Learning Deployable Humanoid Locomotion Policies

Booster Lab: A Data-Centric Pipeline for Learning Deployable Humanoid Locomotion Policies

Humanoid robot motion learning requires not only task-oriented control policies but also physically feasible and natural behaviors that can be transferred to real robots. However, robot-feasible motion data are often scarce: raw human demonstrations may be incompatible with the robot morphology, open-source clips vary in quality, and simulation-collected robot trajectories still require feasibility checking. To address these challenges, we propose a data-centric training and deployment pipeline that integrates motion data curation, real-to-sim model adaptation, AMP-based reinforcement learning, and sim-to-real deployment. We validate the framework on the Booster T1 robot and further provide preliminary cross-platform validation on Booster K1.

步态优化人形机器人AMPJun 26, 2026