Bipedal Robots: A Systematic Review of Dynamical Models, Balance Control Strategies, and Locomotion Methods

Authors

DOI:

https://doi.org/10.18196/jrc.v6i3.25595

Keywords:

Bipedal Robots, Balance Control Strategies, Walking Control Methods, ZMP, CoP, LIPM, Push Recovery Control

Abstract

Bipedal robots, designed to replicate human locomotion, face significant balance challenges due to instability and high degrees of freedom. This study examines dynamical models, balance control strategies, and locomotion methodologies. Dynamical models are categorized into simplified, centroidal dynamics, and whole-body dynamics models. Simplified models, such as the Linear Inverted Pendulum Model (LIPM), approximate the robot as a point mass at the Center of Mass (CoM) but neglect upper-body dynamics and complex terrain interactions. Centroidal dynamics models incorporate CoM motion, contact forces, and angular momentum for improved disturbance rejection but require extensive computational resources. Whole-body models achieve high fidelity by integrating joint torques and external forces but are constrained by computational complexity. Balance control methods for standing bipedal robots are classified into joint-specific and whole-body approaches. Ankle and hip strategies address small perturbations but are insufficient for real-world disturbances. Whole-body control utilizes all body segments to modulate contact forces and regulate momentum, enhancing stability against external disturbances, though challenges remain in force modeling and state estimation. Locomotion control is divided into model-based and learning-based approaches. Model-based strategies include LIPM and its extensions-based methods, Zero Moment Point (ZMP)-based methods, which ensure dynamic stability by maintaining moments within the support polygon; Capture Point (CP)-based methods, which predict foot placement to prevent falls; and Divergent Component of Motion (DCM)-based approaches, which adjust footsteps based on CoM divergence. While learning-based methods leverage Reinforcement Learning (RL) and human motion data for adaptive and energy-efficient gait generation. This study highlights challenges in energy efficiency, terrain adaptation, and scalability, proposing sensor fusion, energy-aware RL reward functions, and hierarchical control architectures as potential solutions.

Author Biography

Ibrahim Al-Tameemi, University of Baghdad

I am a researcher and educator specializing in robotics and mechatronics engineering, with a bachelor’s degree from the University of Baghdad and a master’s degree in Robotics Engineering from Worcester Polytechnic Institute (WPI), completed as a Fulbright Scholar in 2023. At WPI, I contributed to developing the bipedal robot HURON by implementing sliding mode control to regulate momentum and enhance stability under disturbances. My current research focuses on reinforcement learning for robust quadruped locomotion on uneven terrains, designing and manufacturing soft electromagnetic actuators, and developing robot-assisted techniques to improve lumbar puncture procedures. As a faculty member at the University of Baghdad, I teach courses in robotics, modeling, and mechatronics system design, fostering future innovators in engineering.

References

S. Kajita and K. Tani, “Study of dynamic biped locomotion on rugged terrain--Derivation and application of the linear inverted pendulum mode,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 1405-1411, 1991.

S. Kajita, F. Kanehiro, K. Kaneko, K. Yokoi, and H. Hirukawa, “The 3D linear inverted pendulum mode: A simple modeling for a biped walking pattern generation,” IEEE International Conference on Intelligent Robots and Systems, pp. 239–240, 2001.

J. E. Pratt and S. V. Drakunov, “Derivation and application of a conserved orbital energy for the inverted pendulum bipedal walking model,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 4653–4660, 2007.

H. Geyer, A. Seyfarth, and R. Blickhan, “Compliant leg behaviour explains basic dynamics of walking and running,” Proceedings of the Royal Society B: Biological Sciences, vol. 273, no. 1603, pp. 2861–2867, 2006.

S. Caron, A. Escande, L. Lanari, and B. Mallein, “Capturability-Based Pattern Generation for Walking with Variable Height,” IEEE Transactions on Robotics, vol. 36, no. 2, pp. 517–536, 2020.

X. Meng, Z. Yu, X. Chen, Z. Huang, C. Dong, and F. Meng, “Online Running-Gait Generation for Bipedal Robots with Smooth State Switching and Accurate Speed Tracking,” Biomimetics, vol. 8, no. 1, p. 114, 2023.

X. Xiong and A. D. Ames, "Orbit Characterization, Stabilization and Composition on 3D Underactuated Bipedal Walking via Hybrid Passive Linear Inverted Pendulum Model," 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4644-4651, 2019.

S. H. Lee and A. Goswami, “Reaction Mass Pendulum (RMP): An explicit model for centroidal angular momentum of humanoid robots,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 4667–4672, 2007.

A. Goswami, "Kinematic and dynamic analogies between planar biped robots and the reaction mass pendulum (RMP) model," Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots, pp. 182-188, 2008.

K. Guan, K. Yamamoto, and Y. Nakamura, “Virtual-mass-ellipsoid Inverted Pendulum Model and Its Applications to 3D Bipedal Locomotion on Uneven Terrains,” IEEE International Conference on Intelligent Robots and Systems, pp. 1401–1406, 2019.

K. Guan, K. Yamamoto, and Y. Nakamura, “Push recovery by angular momentum control during 3d bipedal walking based on virtual-mass-ellipsoid inverted pendulum model,” IEEE-RAS International Conference on Humanoid Robots, pp. 120–125, 2019.

J. Li, Z. Yuan, S. Dong, J. Zhang, and X. Sang, “External force observer aided push recovery for torque-controlled biped robots,” Autonomous Robots, vol. 46, no. 5, pp. 553–568, 2022.

R. Featherstone, Rigid Body Dynamics Algorithms, Springer Nature Link, 2008.

M. Vukobratovic and D. Juricic, "Contribution to the Synthesis of Biped Gait," IEEE Transactions on Biomedical Engineering, vol. BME-16, no. 1, pp. 1-6, 1969.

M. Vukobratović and B. Borovac, “Zero-Moment Point — Thirty Five Years of Its Life,” International Journal of Humanoid Robotics, vol. 1, no. 1, pp. 157–173, 2004.

M. Vukobratović and J. Stepanenko, “On the stability of anthropomorphic systems,” Mathematical Biosciences, vol. 15, no. 1–2, pp. 1–37, 1972.

J. H. Kim, “Multi-Axis Force-Torque Sensors for Measuring Zero-Moment Point in Humanoid Robots: A Review,” IEEE Sensors Journal, vol. 20, no. 3, pp. 1126–1141, 2020.

S. Kajita, H. Hirukawa, K. Harada, and K. Yokoi. Introduction. Introduction to Humanoid Robotics, pp. 1–17, 2014.

M. B. Popovic, A. Goswami, and H. Herr, “Ground reference points in legged locomotion: Definitions, biological trajectories and control implications,” The international journal of robotics research, vol. 24, no. 12, pp. 1013-1032, 2005.

T. Koolen, T. De Boer, J. Rebula, A. Goswami, and J. Pratt, “Capturability-based analysis and control of legged locomotion, Part 1: Theory and application to three simple gait models,” International Journal of Robotics Research, vol. 31, no. 9, pp. 1094–1113, 2012.

D. A. Winter, “Human balance and posture control during standing and walking,” Gait and Posture, vol. 3, no. 4, pp. 193–214, 1995.

B. Stephens, “Integral control of humanoid balance,” IEEE International Conference on Intelligent Robots and Systems, pp. 4020-4027, 2007.

C. Yang, K. Yuan, W. Merkt, T. Komura, S. Vijayakumar, and Z. Li, “Learning Whole-Body Motor Skills for Humanoids,” IEEE-RAS International Conference on Humanoid Robots, pp. 776–783, 2018.

F. B. Horak and L. M. Nashner, “Central programming of postural movements: Adaptation to altered support-surface configurations,” Journal of Neurophysiology, vol. 55, no. 6, pp. 1369–1381, 1986.

K. Yin, Y. Wang, P. Li, K. Dai, Y. Xue, and L. Yang, “Adaptive ankle impedance control for bipedal robotic upright balance,” Expert Systems, vol. 40, no. 5, p. e13168, 2023.

K. Yin, Y. Xue, Y. Yu, and S. Xie, “Variable Impedance Control for Bipedal Robot Standing Balance Based on Artificial Muscle Activation Model,” Journal of Robotics, vol. 2021, no. 1, p. 8142161, 2021.

C. Li, R. Xiong, Q. Guo Zhu, J. Wu, Y. Liang Wang, and Y. Ming Huang, “Push recovery for the standing under-actuated bipedal robot using the hip strategy,” Frontiers of Information Technology and Electronic Engineering, vol. 16, no. 7, pp. 579–593, 2015.

P. Morasso, “Integrating ankle and hip strategies for the stabilization of upright standing: An intermittent control model,” Frontiers in Computational Neuroscience, vol. 16, p. 956932, 2022.

B. Jalgha, D. Asmar, and I. Elhajj, “A hybrid ankle/hip preemptive falling scheme for humanoid robots,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 1256–1262, 2011.

M. Folgheraiter et al., “Computational Efficient Balance Control for a Lightweight Biped Robot with Sensor Based ZMP Estimation,” IEEE-RAS International Conference on Humanoid Robots, pp. 232–237, 2018.

E. C. Whitman, B. J. Stephens, and C. G. Atkeson, "Torso rotation for push recovery using a simple change of variables," 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012), pp. 50-56, 2012.

H. Song, W. Z. Peng, and J. H. Kim, “Partition-Aware Stability Control for Humanoid Robot Push Recovery,” Proceedings of the ASME Design Engineering Technical Conference, vol. 7, no. 1, p. 11005, 2022.

H. Li, R. J. Frei, and P. M. Wensing, “Model Hierarchy Predictive Control of Robotic Systems,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 3373–3380, 2021.

Y. Liu, J. Shen, J. Zhang, X. Zhang, T. Zhu, and D. Hong, “Design and Control of a Miniature Bipedal Robot with Proprioceptive Actuation for Dynamic Behaviors,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 8547–8553, 2022.

B. J. Stephens and C. G. Atkeson, "Dynamic Balance Force Control for compliant humanoid robots," 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1248-1255, 2010.

C. Ott, M. A. Roa, and G. Hirzinger, "Posture and balance control for biped robots based on contact force optimization," 2011 11th IEEE-RAS International Conference on Humanoid Robots, pp. 26-33, 2011.

R. Schuller, G. Mesesan, J. Englsberger, J. Lee, and C. Ott, “Online Centroidal Angular Momentum Reference Generation and Motion Optimization for Humanoid Push Recovery,” IEEE Robotics and Automation Letters, vol. 6, no. 3, pp. 5689–5696, 2021.

H. J. Lee and J. Y. Kim, “Balance Control Strategy of Biped Walking Robot SUBO-1 Based on Force-Position Hybrid Control,” International Journal of Precision Engineering and Manufacturing, vol. 22, no. 1, pp. 161–175, 2021.

S. Kajita et al., "Resolved momentum control: humanoid motion planning based on the linear and angular momentum," Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453), vol. 2, pp. 1644-1650, 2003.

M. Abdallah and A. Goswami, "A Biomechanically Motivated Two-Phase Strategy for Biped Upright Balance Control," Proceedings of the 2005 IEEE International Conference on Robotics and Automation, pp. 1996-2001, 2005.

A. MacChietto, V. Zordan, and C. R. Shelton, “Momentum control for balance,” ACM Transactions on Graphics, vol. 28, no. 3, pp. 1–8, 2009.

I. Al-Tameemi, D. Doan, A. Patanwala, and M. Agheli, “Momentum-Based Push Recovery Control of Bipedal Robots Using a New Variable Power Reaching Law for Sliding Mode Control,” Journal of Robotics and Control, vol. 5, no. 5, pp. 1570–1581, 2024.

S. H. Lee and A. Goswami, “A momentum-based balance controller for humanoid robots on non-level and non-stationary ground,” Autonomous Robots, vol. 33, no. 4, pp. 399–414, 2012.

B. Henze, M. A. Roa, and C. Ott, “Passivity-based whole-body balancing for torque-controlled humanoid robots in multi-contact scenarios,” International Journal of Robotics Research, vol. 35, no. 12, pp. 1522–1543, 2016.

G. Mesesan, J. Englsberger, G. Garofalo, C. Ott, and A. Albu-Schaffer, “Dynamic Walking on Compliant and Uneven Terrain using DCM and Passivity-based Whole-body Control,” IEEE-RAS International Conference on Humanoid Robots, pp. 25–32, 2019.

Z. Xie, L. Li, and X. Luo, “Three-dimensional aperiodic biped walking including the double support phase using LIPM and LPM,” Robotics and Autonomous Systems, vol. 143, p. 103831, 2021.

K. Imanishi and T. Sugihara, “Autonomous Biped Stepping Control Based on the LIPM Potential,” IEEE-RAS International Conference on Humanoid Robots, pp. 593–598, 2018.

A. H. Adiwahono, C.-M. Chew, W. Huang, and V. H. Dau, "Humanoid robot push recovery through walking phase modification," 2010 IEEE Conference on Robotics, Automation and Mechatronics, pp. 569-574, 2010.

S. Kajita, F. Kanehiro, K. Kaneko, K. Fujiwara, K. Yokoi, and H. Hirukawa, “A realtime pattern generator for biped walking,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 31–37, 2002.

L. F. Wu and T. H. S. Li, “Fuzzy dynamic gait pattern generation for real-time push recovery control of a teen-sized humanoid robot,” IEEE Access, vol. 8, pp. 36441–36453, 2020.

K. Erbatur and O. Kurt, "Humanoid Walking Robot Control with Natural ZMP References," IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics, pp. 4100-4106, 2006.

K. Erbatur and O. Kurt, “Natural ZMP trajectories for biped robot reference generation,” IEEE Transactions on Industrial Electronics, vol. 56, no. 3, pp. 835–845, 2009.

Y. Liu, P. M. Wensing, D. E. Orin, and Y. F. Zheng, “Dynamic walking in a humanoid robot based on a 3D Actuated Dual-SLIP model,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 5710–5717, 2015.

Y. Liu, P. M. Wensing, D. E. Orin, and Y. F. Zheng, “Trajectory generation for dynamic walking in a humanoid over uneven terrain using a 3D-actuated Dual-SLIP model,” IEEE International Conference on Intelligent Robots and Systems, pp. 374–380, 2015.

Y. Liu, P. M. Wensing, J. P. Schmiedeler, and D. E. Orin, “Terrain-Blind Humanoid Walking Based on a 3-D Actuated Dual-SLIP Model,” IEEE Robotics and Automation Letters, vol. 1, no. 2, pp. 1073–1080, 2016.

J. Pratt, J. Carff, S. Drakunov, and A. Goswami, “Capture Point: A Step toward Humanoid Push Recovery,” 2006 6th IEEE-RAS International Conference on Humanoid Robots, pp. 200–207, 2006.

L. C. Visser, S. Stramigioli, and R. Carloni, "Robust bipedal walking with variable leg stiffness," 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1626-1631, 2012.

M. M. Pelit, J. Chang, R. Takano, and M. Yamakita, "Bipedal Walking Based on Improved Spring Loaded Inverted Pendulum Model with Swing Leg (SLIP-SL)," 2020 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 72-77, 2020.

M. A. Sharbafi and A. Seyfarth, “FMCH: A new model for human-like postural control in walking,” IEEE International Conference on Intelligent Robots and Systems, pp. 5742–5747, 2015.

K. Wang, H. Fei, and P. Kormushev, “Fast Online Optimization for Terrain-Blind Bipedal Robot Walking With a Decoupled Actuated SLIP Model,” Frontiers in Robotics and AI, vol. 9, 2022.

S. Xie, X. Li, H. Zhong, C. Hu, and L. Gao, "Compliant Bipedal Walking Based on Variable Spring-Loaded Inverted Pendulum Model with Finite-sized Foot," 2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM), pp. 667-672, 2021.

X. Xiong and A. D. Ames, “Sequential motion planning for bipedal somersault via flywheel SLIP and momentum transmission with task space control,” IEEE International Conference on Intelligent Robots and Systems, pp. 3510–3517, 2020.

I.-S. Kim, Y.-J. Han, and Y.-D. Hong, “Stability Control for Dynamic Walking of Bipedal Robot with Real-time Capture Point Trajectory Optimization,” Journal of Intelligent & Robotic Systems, vol. 96, no. 3, pp. 345–361, 2019.

S. H. Kim and Y. D. Hong, “Dynamic Bipedal Walking Using Real-Time Optimization of Center of Mass Motion and Capture Point-Based Stability Controller,” Journal of Intelligent and Robotic Systems: Theory and Applications, vol. 103, no. 4, p. 58, 2021.

C. H. Chang, H. P. Huang, H. K. Hsu, and C. A. Cheng, “Humanoid robot push-recovery strategy based on CMP criterion and angular momentum regulation,” IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 761–766, 2015.

Y. Kojio et al., "Unified Balance Control for Biped Robots Including Modification of Footsteps with Angular Momentum and Falling Detection Based on Capturability," 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 497-504, 2019.

T. Sugihara and T. Yamamoto, “Foot-guided agile control of a biped robot through ZMP manipulation,” IEEE International Conference on Intelligent Robots and Systems, pp. 4546–4551, 2017.

T. Takenaka, T. Matsumoto, and T. Yoshiike, “Real time motion generation and control for biped robot -1st report: Walking gait pattern generation-,” 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1084–1091, 2009.

J. Englsberger, C. Ott, and A. Albu-Schäffer, “Three-Dimensional Bipedal Walking Control Based on Divergent Component of Motion,” IEEE Transactions on Robotics, vol. 31, no. 2, pp. 355–368, 2015.

M. Khadiv, A. Herzog, S. A. A. Moosavian, and L. Righetti, "Step timing adjustment: A step toward generating robust gaits," 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), pp. 35-42, 2016.

J. Shen, J. Zhang, Y. Liu, and D. Hong, “Implementation of a Robust Dynamic Walking Controller on a Miniature Bipedal Robot with Proprioceptive Actuation,” IEEE-RAS International Conference on Humanoid Robots, pp. 39–46, 2022.

M. Shafiee, G. Romualdi, S. Dafarra, F. J. A. Chavez, and D. Pucci, "Online DCM Trajectory Generation for Push Recovery of Torque-Controlled Humanoid Robots," 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids), pp. 671-678, 2019.

S. Kajita et al., “Biped walking pattern generation by using preview control of zero-moment point,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 1620–1626, 2003.

T. Katayama, T. Katayama, T. Kato, T. Ohki, and T. Inoue, “Design of an optimal controller for a discrete-time system subject to previewable demand,” International Journal of Control, vol. 41, no. 3, pp. 677–699, 1985.

A. H. Adiwahono, C. M. Chew, H. Weiwei, and Z. Yu, “Push recovery controller for bipedal robot walking,” IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 162–167, 2009.

R. C. Luo, C. W. Huang, and W. C. Hung, “Bipedal robot push recovery control mimicking human reaction,” 2016 IEEE 14th International Workshop on Advanced Motion Control, pp. 334–339, 2016.

S. Shimmyo, T. Sato, and K. Ohnishi, “Biped walking pattern generation by using preview control with virtual plane method,” International Workshop on Advanced Motion Control, pp. 414–419, 2010.

J. Park and Y. Youm, “General ZMP preview control for bipedal walking,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 2682–2687, 2007.

M. M. Williams, A. G. Loukianov, and E. Bayro-Corrochano, “ZMP based pattern generation for biped walking using Optimal Preview Integral Sliding Mode Control,” IEEE-RAS International Conference on Humanoid Robots, pp. 100–105, 2015.

S. M. Kasaei, N. Lau, A. Pereira, and E. Shahri, “A reliable model-based walking engine with push recovery capability,” 2017 IEEE International Conference on Autonomous Robot Systems and Competitions, pp. 122–127, 2017.

J. Li, L. Ye, Y. Cheng, H. Liu, and B. Liang, “Agile and versatile bipedal robot tracking control through reinforcement learning,” ArXiv, 2024.

R. Beranek, M. Karimi, and M. Ahmadi, “A Behavior-Based Reinforcement Learning Approach to Control Walking Bipedal Robots Under Unknown Disturbances,” IEEE/ASME Transactions on Mechatronics, vol. 27, no. 5, pp. 2710–2720, 2022.

B. Hengst, M. Lange, and B. White, “Learning ankle-tilt and foot-placement control for flat-footed bipedal balancing and walking,” IEEE-RAS International Conference on Humanoid Robots, pp. 288–293, 2011.

K. S. Hwang, J. S. Li, W. C. Jiang, and W. H. Wang, “Gait balance of biped robot based on reinforcement learning,” Proceedings of the SICE Annual Conference, pp. 435–439, 2013.

Z. Li et al., "Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots," 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 2811-2817, 2021.

J. W. Grizzle, C. Chevallereau, A. D. Ames, and R. W. Sinnet, “3D bipedal robotic walking: Models, feedback control, and open problems,” IFAC Proceedings Volumes, vol. 43, no. 14, pp. 505–532, 2010.

G. A. Castillo, B. Weng, W. Zhang, and A. Hereid, "Hybrid Zero Dynamics Inspired Feedback Control Policy Design for 3D Bipedal Locomotion using Reinforcement Learning," 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 8746-8752, 2020.

R. Vuga et al., “Motion capture and reinforcement learning of dynamically stable humanoid movement primitives,” Proceedings - IEEE International Conference on Robotics and Automation, pp. 5284-5290, 2013.

M. Taylor et al., "Learning Bipedal Robot Locomotion from Human Movement," 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 2797-2803, 2021.

X. Bin Peng, P. Abbeel, S. Levine, and M. Van De Panne, “DeepMimic: Example-guided deep reinforcement learning of physics-based character skills,” ACM Transactions on Graphics, vol. 37, no. 4, pp. 1-14, 2018.

K. S. Hwang, W. C. Jiang, Y. J. Chen, and H. Shi, “Motion Segmentation and Balancing for a Biped Robot’s Imitation Learning,” IEEE Transactions on Industrial Informatics, vol. 13, no. 3, pp. 1099–1108, 2017.

Downloads

Published

2025-05-13

Issue

Section

Articles