Microduck Balance and Push Recovery
- Python
- MuJoCo
- PyTorch
- ONNX
- Balance policy for a 25 cm, 14-servo open-source biped, PPO in CPU MuJoCo; the observation is only what the robot's sensors report
- Reward rebuilt after three of four penalties measured under 0.25% of the return; a KL stop fixed a runaway step size
- 全高25 cm・14サーボのオープンソース二足ロボットのバランスpolicy。CPU版MuJoCoでPPO学習。observationは実機センサーが出す値のみ
- 4つのpenaltyのうち3つがreturnの0.25%未満と計測されたためrewardを再設計。暴走したstep sizeはKL stopで修正
344.8 ± 2.9 vs PD 175.8 ± 0.2 of 500 after 50M steps; upright 73% vs 47% of the time(500点満点、50M steps)。直立時間 73% vs 47% · 100 episodes × 5 seeds
Domain randomisation, tested on two held-out physics models, made it worse: the policy learned to brace in a crouch (upright 28% vs 47%). Getting up after a fall is still unshown.
Domain randomisationは2つのheld-out物理モデルで検証した結果、悪化(しゃがんで踏ん張る挙動を学習、直立 28% vs 47%)。転倒後の起き上がりは未達成。