SR

SCIENCE ROBOTICS · 2024–2026

The robot learning index.

GitHub

Research, organized by what robots do and how they learn.

68 papers / Updated Sep 9, 2026

6 papers featured on the journal cover

All papers 68

Newest first
· Research Article

BeyondMimic: From motion tracking to versatile humanoid control via guided diffusion

Qiayuan Liao, Takara E Truong, Xiaoyu Huang, Yuman Gao, Guy Tevet, Koushil Sreenath, C Karen Liu

Combines agile motion tracking with guided diffusion to compose humanoid skills for previously unseen objectives.

· Research Article

Robot in a crib: How a playing robot helps us understand sensorimotor contingency learning

Josua Spisak, Sergiu Tcaci Popescu, Lukas Rustler, Stefan Wermter, J Kevin O'Regan, Matej Hoffmann

Uses prediction and curiosity in an embodied humanoid to study how action–sensation relationships emerge.

· Review / Perspective

Evolution of humanoid locomotion control

Yan Gu, Guanya Shi, Fan Shi, I-Chia Chang, Yen-Jen Wang, Qilong Cheng, Zachary Olkin, Ivan Lopez-Sanchez, Yunchu Feng, Jian Zhang, Aaron D Ames, Hao Su, Koushil Sreenath

Reviews the evolution of humanoid locomotion from model-based control to learning and generative approaches.

· Research Article

Learning vision-driven reactive soccer skills for humanoid robots

Yushi Wang, Changsheng Luo, Penghui Chen, Jianran Liu, Weijian Sun, Tong Guo, Kechang Yang, Biao Hu, Yangang Zhang, Mingguo Zhao

Trains an onboard vision-driven soccer controller that remains reactive under perceptual noise and detection failures.

· Research Article

SONIC: Supersizing motion tracking for natural humanoid whole-body control

Zhengyi Luo, Ye Yuan, Tingwu Wang, Chenran Li, Fernando Castañeda, Sirui Chen, Zi-Ang Cao, Jiefeng Li, David Minor, Qingwei Ben, Jinhyung Park, David Sami, Zi Wang, Xingye Da, Runyu Ding, Cyrus Hogg, Lina Song, Edy Lim, Eugene Jeong, Tairan He, Haoru Xue, Wenli Xiao, Simon Yuen, Jan Kautz, Yan Chang, Umar Iqbal, Linxi Jim Fan, Yuke Zhu

Scales motion-tracking data, model capacity, and compute into a generalist humanoid whole-body controller.

· Research Article

ZEST: Zero-shot embodied skill transfer for athletic robot control

Jean Pierre Sleiman, He Li, Alphonsus Adu-Bredu, Robin Deits, Arun Kumar, Kevin Bergamin, Mohak Bhardwaj, Scott Biddlestone, Nicola Burger, Matthew A Estrada, Francesco Iacobelli, Twan Koolen, Alexander Lambert, Erica Lin, M Eva Mungai, Zach Nobles, Shane Rozen-Levy, Yuyao Shi, Jiashun Wang, Jakob Welner, Fangzhou Yu, Mike Zhang, Alfred Rizzi, Jessica Hodgins, Sylvain Bertrand, Yeuhi Abe, Scott Kuindersma, Farbod Farshidian

Transfers athletic motions from capture, video, and animation to different robot bodies without per-skill tuning.

· Review / Perspective

Advances, challenges, and opportunities for legged robots

Jonas Frey, Matías Mattamala, Hae-Won Park, Mayank Mittal, Georg Martius, Maike Osborne, Robert Sparrow, Marco Hutter

Reviews capabilities and open challenges in legged hardware, autonomy, data, and deployment.

· Research Article

Ultra-wideband radar to measure in vivo muscle forces

Christopher S Bird, Antonio P L Bo, Wei Lu, Taylor J M Dick

Combines radar measurements with learned estimators of muscle force for assistive sensing applications.

· Review / Perspective

Bioinspired multimodal robotics

Ziyu Ren, Youning Duo, Haoyuan Xu, Yihui Zhang, Xingjian Liu, Jamie Paik, Auke Ijspeert, Li Wen

Reviews multimodal robot design and the transition toward learned planning and motion control.

· Research Article

Performant robotic manipulation with real-world reinforcement learning

Kun Lei, Huanyu Li, Dongjie Yu, Zhenyu Wei, Lingxiao Guo, Zhennan Jiang, Ziyu Wang, Shiyu Liang, Huazhe Xu

Improves diffusion visuomotor policies through offline and online reinforcement learning, with fast one-step execution.

· Research Article Cover Paper

Agile perceptive multiskill locomotion for quadrupedal robots in the wild

Jun-Gill Kang, Jaehyun Park, Tae-Gyu Song, Joon-Ha Kim, Seungwoo Hong, Hae-Won Park

Pretrains locomotion skills from optimized motions and learns perceptive transitions across challenging outdoor terrain.

· Research Article

Precise aggressive aerial maneuvers with sensorimotor policies

Tianyue Wu, Guangtong Xu, Zihan Wang, Junxiao Lin, Tianyang Chen, Yuze Wu, Zhichao Han, Zhiyang Liu, Fei Gao

Learns vision-to-control policies for aggressive gap traversal, using planner initialization and simulation distillation.

· Research Article

A retrieval-augmented framework enabling VLM spatial awareness for object-centric robot manipulation

Kai Chen, Chengkun Li, Chang Tu, Jiahui Pan, Yiyao Ma, Wei Chen, Zhongxiang Zhou, Xuecheng Xu, Stephen James, Chi-Wing Fu, Rong Xiong, Pieter Abbeel, Yun-Hui Liu, Qi Dou

Grounds vision-language reasoning in object-centric geometry to execute spatially precise manipulation instructions.

· Research Article Cover Paper

A careful examination of large behavior models for multitask dexterous manipulation

Jose Barreiros, Andrew Beaulieu, Aditya Bhat, Rick Cory, Eric Cousineau, Hongkai Dai, Ching-Hsin Fang, Kunimatsu Hashimoto, Muhammad Zubair Irshad, Masha Itkina, Naveen Kuppuswamy, Kuan-Hui Lee, Katherine Liu, Dale McConachie, Ian McMahon, Haruki Nishimura, Calder Phillips-Grafflin, Charles Richter, Paarth Shah, Krishnan Srinivasan, Blake Wulfe, Chen Xu, Mengchao Zhang, Alex Alspach, Maya Angeles, Kushal Arora, Vitor Campagnolo Guizilini, Alejandro Castro, Dian Chen, Ting-Sheng Chu, Sam Creasey, Sean Curtis, Richard Denitto, Emma Dixon, Eric Dusel, Matthew Ferreira, Aimee Goncalves, Grant Gould, Damrong Guoy, Swati Gupta, Xuchen Han, Kyle Hatch, Brendan Hathaway, Allison Henry, Hillel Hochsztein, Phoebe Horgan, Shun Iwase, Donovon Jackson, Siddharth Karamcheti, Sedrick Keh, Joseph Masterjohn, Masayuki Masuda, Jean Mercat, Patrick Miller, Paul Mitiguy, Tony Nguyen, Jeremy Nimmer, Yuki Noguchi, Reko Ong, Aykut Onol, Owen Pfannenstiehl, Richard Poyner, Leticia Priebe Mendes Rocha, Gordon Richardson, Christopher Rodriguez, Derick Seale, Michael Sherman, Mariah Smith-Jones, David Tago, Pavel Tokmakov, Matthew Tran, Basile Van Hoorick, Igor Vasiljevic, Sergey Zakharov, Mark Zolotas, Rareș Ambruș, Kerri Fetzer-Borelli, Benjamin Burchfiel, Hadas Kress-Gazit, Siyuan Feng, Stacie Ford, Russ Tedrake

Evaluates multitask diffusion policies with controlled trials, showing benefits from pretraining scale and diversity.

· Research Article

Cross-robot behavior adaptation through intention alignment

Xi Chen, Yuan Gao, Hangxin Liu, Fangkai Yang, Ali Ghadirzadeh, Jun Yang, Bin Liang, Chongjie Zhang, Tin Lun Lam, Song-Chun Zhu

Aligns language-annotated intentions to transfer demonstrated behavior across heterogeneous robots and environments.

· Research Article

Visual-tactile pretraining and online multitask learning for humanlike manipulation dexterity

Qi Ye, Qingtao Liu, Siyun Wang, Jiaying Chen, Yu Cui, Ke Jin, Huajin Chen, Xuan Cai, Gaofeng Li, Jiming Chen

Combines human visual–tactile pretraining with online multitask learning for multifingered manipulation.

· Research Article Cover Paper

Learning realistic lip motions for humanoid face robots

Yuhang Hu, Jiong Lin, Judah Allen Goldfeder, Philippe M Wyder, Yifeng Cao, Steven Tian, Yunzhe Wang, Jingran Wang, Mengmeng Wang, Jie Zeng, Cameron Mehlman, Yingke Wang, Delin Zeng, Boyuan Chen, Hod Lipson

Learns audio-conditioned lip trajectories for an expressive robotic face without hand-coded mouth movements.

· Research Article

Resilient odometry via hierarchical adaptation

Shibo Zhao, Sifan Zhou, Yuchen Zhang, Ji Zhang, Chen Wang, Wenshan Wang, Sebastian Scherer

Integrates learned inertial odometry with hierarchical sensor adaptation for navigation under severe sensory degradation.

· Research Article

Deep domain adaptation eliminates costly data required for task-agnostic wearable robotic control

Keaton L Scherpereel, Matthew C Gombolay, Max K Shepherd, Carlos A Carrasquillo, Omer T Inan, Aaron J Young

Transfers accessible movement data into device-specific joint-moment estimators for task-agnostic exoskeleton assistance.

· Review / Perspective

Metamaterial robotics

Xiaoyang Zheng, Yuhao Jiang, Mustafa Mete, Jingjing Li, Ikumu Watanabe, Takayuki Yamada, Jamie Paik

Reviews metamaterial robotics, including AI-supported design, modeling, and adaptive control.

· Research Article Cover Paper

Learning a thousand tasks in a day

Kamil Dreczkowski, Pietro Vitiello, Vitalis Vosylius, Edward Johns

Separates alignment and interaction, using trajectory retrieval to teach a robot many tasks from few demonstrations.

· Review / Perspective

Accelerating discovery in natural science laboratories with AI and robotics: Perspectives and challenges

Andrew I Cooper, Patrick Courtney, Kourosh Darvish, Moritz Eckhoff, Hatem Fakhruldeen, Andrea Gabrielli, Animesh Garg, Sami Haddadin, Kanako Harada, Jason Hein, Maria Hübner, Dennis Knobbe, Gabriella Pizzuto, Florian Shkurti, Ruja Shrestha, Kerstin Thurow, Rafael Vescovi, Birgit Vogel-Heuser, Ádám Wolf, Naruki Yoshikawa, Yan Zeng, Zhengxue Zhou, Henning Zwirnmann

Examines autonomy, reproducibility, and human collaboration challenges in AI-enabled laboratory robotics.

· Review / Perspective

Extending robot minds through collective learning

Amanda Prorok

Argues for distributed robot learning through modular, interdependent systems rather than monolithic models.

· Review / Perspective

A review of learning-based dynamics models for robotic manipulation

Bo Ai, Stephen Tian, Haochen Shi, Yixuan Wang, Tobias Pfaff, Cheston Tan, Henrik I Christensen, Hao Su, Jiajun Wu, Yunzhu Li

Reviews learned interaction dynamics, state representations, uncertainty, and their use in manipulation planning.

· Research Article

RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning

Matthew Lai, Keegan Go, Zhibin Li, Torsten Kröger, Stefan Schaal, Kelsey Allen, Jonathan Scholz

Learns graph-based coordination that jointly allocates tasks, schedules actions, and plans collision-free multiarm motion.

· Review / Perspective

"Data will solve robotics and automation: True or false?": A debate

Nancy M Amato, Seth Hutchinson, Animesh Garg, Aude Billard, Daniela Rus, Russ Tedrake, Frank Park, Ken Goldberg

Presents a debate on whether scaling data alone can solve robotics and automation.

· Research Article

Learning contact-rich whole-body manipulation with example-guided reinforcement learning

Jose A Barreiros, Aykut Özgün Önol, Mengchao Zhang, Sam Creasey, Aimee Goncalves, Andrew Beaulieu, Aditya Bhat, Kate M Tsui, Alex Alspach

Learns contact-rich whole-body object handling from example motions using a compliant humanoid upper body.

· Research Article

Precise and dexterous robotic manipulation via human-in-the-loop reinforcement learning

Jianlan Luo, Charles Xu, Jeffrey Wu, Sergey Levine

Combines demonstrations and human corrections with sample-efficient real-world learning for precise manipulation.

· Review / Perspective

AI in therapeutic and assistive exoskeletons and exosuits: Influences on performance and autonomy

Herman van der Kooij, Edwin H F van Asseldonk, Massimo Sartori, Chiara Basla, Adrian Esser, Robert Riener

Reviews how machine learning supports intention recognition, assessment, and autonomous wearable assistance.

· Research Article

AI search, physician removal: Bronchoscopy robot bridges collaboration in foreign body aspiration

Lilu Liu, Jingyu Zhang, Fei Wang, Jiyu Yu, Yuxiang Cui, Zhibin Li, Jian Hu, Rong Xiong, Haojian Lu, Yue Wang

Combines learned perception and structured exploration for autonomous bronchial foreign-body search with remote physician removal.

· Research Article

Surgical embodied intelligence for generalized task autonomy in laparoscopic robot-assisted surgery

Yonghao Long, Anran Lin, Derek Hang Chun Kwok, Lin Zhang, Zhenya Yang, Kejian Shi, Lei Song, Jiawei Fu, Hongbin Lin, Wang Wei, Kai Chen, Xiangyu Chu, Yang Hu, Hon Chi Yip, Philip Wai Yan Chiu, Peter Kazanzides, Russell H Taylor, Yunhui Liu, Zihan Chen, Zerui Wang, Samuel Kwok Wai Au, Qi Dou

Provides a surgical simulation and learning pipeline that transfers trained task policies to real surgical robots.

· Research Article Cover Paper

SRT-H: A hierarchical framework for autonomous surgery via language-conditioned imitation learning

Ji Woong Brian Kim, Juo-Tung Chen, Pascal Hansen, Lucy Xiaoyang Shi, Antony Goldenberg, Samuel Schmidgall, Paul Maria Scheikl, Anton Deguet, Brandon M White, De Ru Tsai, Richard Jaepyeong Cha, Jeffrey Jopling, Chelsea Finn, Axel Krieger

Pairs a language-level planner with learned low-level trajectories to execute and recover during surgical steps.

· Research Article

Hierarchically depicting vehicle trajectory with stability in complex environments

Zhichao Han, Mengze Tian, Zaitian Gongye, Donglai Xue, Jiaxi Xing, Qianhao Wang, Yuman Gao, Jingping Wang, Chao Xu, Fei Gao

Combines learned path proposals with stable trajectory optimization to navigate complex environments efficiently.

· Research Article

High-speed control and navigation for quadrupedal robots on complex and discrete terrain

Hyeongjun Kim, Hyunsik Oh, Jeongsoo Park, Yunho Kim, Donghoon Youm, Moonkyu Jung, Minho Lee, Jemin Hwangbo

Combines optimized foothold planning with a learned tracker and an adaptive training terrain distribution.

· Research Article

Learning coordinated badminton skills for legged manipulators

Yuntao Ma, Andrei Cramariuc, Farbod Farshidian, Marco Hutter

Learns coordinated whole-body badminton skills while accounting for real-world visual perception uncertainty.

· Research Article

Bridging hard and soft: Mechanical metamaterials enable rigid torque transmission in soft robots

Molly Carton, Jakub F Kowalewski, Jiani Guo, Jacob F Alpert, Aman Garg, Daniel Revier, Jeffrey Ian Lipton

Pairs torque-transmitting metamaterials with learned inverse kinematics for forceful soft-arm manipulation.

· Research Article

Bioinspired design of a tissue-engineered ray with machine learning

John F Zimmerman, Daniel J Drennan, James Ikeda, Qianru Jin, Herdeline Ann M Ardoña, Sean L Kim, Ryoma Ishii, Kevin Kit Parker

Uses machine-learning-directed geometry optimization to improve a tissue-engineered swimming robot.

· Review / Perspective

The case against machine vision for the control of wearable robotics: Challenges for commercial adoption

Keya Ghonasgi, Kyle J Kaveny, David Langlois, Leifur D Sigurðarson, Tim A Swift, Jason Wheeler, Aaron J Young

Discusses practical barriers to deploying vision-based control in commercial wearable robots.

· Research Article

A neuromechanics solution for adjustable robot compliance and accuracy

Ignacio Abadía, Alice Bruel, Grégoire Courtine, Auke J Ijspeert, Eduardo Ros, Niceto R Luque

Combines a muscle-inspired impedance model and adaptive cerebellar network to tune robot compliance and accuracy.

· Research Article

Development of compositionality through interactive learning of language and action of robots

Prasanna Vijayaraghavan, Jeffrey Frederic Queißer, Sergio Verduzco Flores, Jun Tani

Integrates vision, proprioception, and language to learn compositional action–language representations.

· Research Article Cover Paper

NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation

Sudharshan Suresh, Haozhi Qi, Tingfan Wu, Taosha Fan, Luis Pineda, Mike Lambeta, Jitendra Malik, Mrinal Kalakrishnan, Roberto Calandra, Michael Kaess, Joseph Ortiz, Mustafa Mukadam

Fuses touch, vision, and proprioception to reconstruct and track previously unseen objects during in-hand manipulation.

· Research Article

Reinforcement learning-based framework for whale rendezvous via autonomous sensing robots

Ninad Jadhav, Sushmita Bhattacharya, Daniel Vogt, Yaniv Aluma, Pernille Tønnesen, Akarsh Prabhakara, Swarun Kumar, Shane Gero, Robert J Wood, Stephanie Gil

Couples multiagent routing with radio-based sensing to improve autonomous rendezvous with sperm whales.

· Research Article

Autonomous tracking of honey bee behaviors over long-term periods with cooperating robots

Jiří Ulrich, Martin Stefanec, Fatemeh Rekabi-Bana, Laurenz Alexander Fedotoff, Tomáš Rouček, Bilal Yağız Gündeğer, Mahmood Saadat, Jan Blaha, Jiří Janota, Daniel Nicolas Hofstadler, Kristina Žampachů, Erhan Ege Keyvan, Babür Erdem, Erol Şahin, Hande Alemdar, Ali Emre Turgut, Farshad Arvin, Thomas Schmickl, Tomáš Krajník

Combines autonomous robotic observation with behavioral analysis to track a honey-bee queen and colony interactions.

· Research Article

Intrinsic sense of touch for intuitive physical human-robot interaction

Maged Iskandar, Alin Albu-Schäffer, Alexander Dietrich

Recognizes touch trajectories on a robot body as symbolic instructions using manifold learning and neural networks.

· Research Article

SimPLE, a visuotactile method learned in simulation to precisely pick, localize, regrasp, and place objects

Maria Bauza, Antonia Bronars, Yifan Hou, Ian Taylor, Nikhil Chavan-Dafle, Alberto Rodriguez

Learns visuotactile pose estimation in simulation and combines it with grasp and regrasp planning for precise placement.

· Review / Perspective

Optimality principles in spacecraft neural guidance and control

Dario Izzo, Emmanuel Blazquez, Robin Ferede, Sebastien Origer, Christophe De Wagter, Guido C H E de Croon

Reviews neural guidance and control networks that learn optimal actions for spacecraft and drone tasks.

· Review / Perspective

Wearable robots for the real world need vision

Letizia Gionfrida, Daekyum Kim, Davide Scaramuzza, Dario Farina, Robert D Howe

Discusses how visual information can support wearable robots in real-world environments.

· Research Article

Fully neuromorphic vision and control for autonomous drone flight

F Paredes-Vallés, J J Hagenaars, J Dupeyroux, S Stroobants, Y Xu, G C H E de Croon

Trains an event-based spiking vision-to-control pipeline that transfers from simulation to onboard drone flight.

· Research Article

Real-world humanoid locomotion with reinforcement learning

Ilija Radosavovic, Tete Xiao, Bike Zhang, Trevor Darrell, Jitendra Malik, Koushil Sreenath

Trains a transformer locomotion controller that adapts from observation–action history during real-world humanoid walking.

· Research Article

Learning agile soccer skills for a bipedal robot with deep reinforcement learning

Tuomas Haarnoja, Ben Moran, Guy Lever, Sandy H Huang, Dhruva Tirumala, Jan Humplik, Markus Wulfmeier, Saran Tunyasuvunakool, Noah Y Siegel, Roland Hafner, Michael Bloesch, Kristian Hartikainen, Arunkumar Byravan, Leonard Hasenclever, Yuval Tassa, Fereshteh Sadeghi, Nathan Batchelor, Federico Casarini, Stefano Saliceti, Charles Game, Neil Sreendra, Kushal Patel, Marlon Gwira, Andrea Huber, Nicole Hurley, Francesco Nori, Raia Hadsell, Nicolas Heess

Learns agile bipedal soccer skills and tactical behaviors in simulation for zero-shot deployment on small humanoids.

· Research Article

Human-robot facial coexpression

Yuhang Hu, Boyuan Chen, Jiong Lin, Yunzhe Wang, Yingke Wang, Cameron Mehlman, Hod Lipson

Learns to anticipate human smiles and control a robotic facial model for simultaneous coexpression.

· Research Article

DTC: Deep Tracking Control

Fabian Jenelten, Junzhe He, Farbod Farshidian, Marco Hutter

Trains a robust tracking policy around optimized reference motions to improve precision on sparse footholds.