Legged robots often face challenges due to their high degrees of freedom and the difficulty of accurately modeling complex environments. These factors discourage the development of robust and stable controllers. However, by leveraging reinforcement learning(RL) techniques, we have successfully developed locomotion controllers that enable the quadrupedal robots to adapt and traverse through challenging terrains such as rough, slippery, and deformable surfaces. This learning-based approach not only improves robustness and stability but also reduces dependency on accruate and computationally intensive models, making our controllers well-suited for practical applications in dynamic and unpredictable environments.
Learning-based locomotion on various terrains
Through extensive experimentation, we have demonstrated the effectiveness of our RL-based locomotion controllers. The list of our work is shown below.
Contact model of deformable terrains
Concurrent training architeture
Gwanghyeon Ji et al., “Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotion,” in IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4630-4637, April 2022 paper_ji22 video_ji22
Whole body control for pushing objects (ongoing)
Dynamic locomotion for traversing stepping stones (ongoing)
Our Lab directly creates all the components to experiment with a controller to which the learning algorithm is applied.
Raibo, made by Railab, has hardware that can withstand shocks under various conditions and operate robustly regardless of the environment. We also design its own driving units, which are key components consisting of motors, motor reducers, encoders, and motor drivers. With its own form factor, it plays a major role in achieving high efficiency during operation.
Raibo driving units
Raibo Leg Design
Through various simulations, we demonstrate that we can operate robustly and efficiently in various situations. The list of our work is shown below.
Hwangbo, et al. “Cable-driven actuation for highly dynamic robotic systems.” 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2018. Paper3
We are rigorously pursuing research in the electronics sector for pushing hardware utilization to the extreme. Our research extends from designing power circuit, crucial for handling inrush currents and regenerative braking during impacts, to high-power, high-bandwidth motor drivers. The circuit design, artwork, SMT, and testing are all performed in-house.
Circuit drawing (Left), Component layout (Right) [Blurred image for security]
SMT assembly (Left), Testing (Right)
Leveraging our deep understanding of power electronics and robotic systems, we are not just enabling robots to utilize the extreme area of motor capabilities, but also contributing to bridging the sim-to-real gap. Furthermore, taking into account the characteristics of each electronics component, we can build high power and low noise motor driver in a small form factor and facilitate it into efficient locomotion.