Journal Articles
1) Xingwei Pan, Song Xiang, Shilong Niu, Zheng Fang, Jun Wang, Guangliang Li*. Multi-task Learning for Underwater Robot via Progressive Neural Network. Robot Learning, 2025 (2): 0009.
2) Fang Zheng, Tianhao Chen, Tian Shen, Dong Jiang, Zheng Zhang, Guangliang Li*. Multi-Agent Generative Adversarial Interactive Self-Imitation Learning for AUV Formation Control and Obstacle Avoidance. IEEE Robotics and Automation Letters, 2025, 10(5): 4356-4363.
3) Jun Wang, Song Xiang, Tian Shen, Zheng Fang, Shilong Niu, Xingwei Pan, Guangliang Li*. Imitation Learning from Observation for ROV Path Tracking. Intelligent Marine Technology and Systems. 2025(3): 20.
4) Shilong Niu, Xingwei Pan, Jun Wang, Guangliang Li*. Deep Reinforcement Learning from Human Preferences for ROV Path Tracking. Ocean Engineering, 2025, 317:120036
5) Guangliang Li* and Randy Gomez. Realizing Full Body Control of Humanoid Robots, Nature Machine Intelligence, 2024(6):990-991.
6) Tianhao Chen, Zheng Zhang, Zheng Fang, Dong Jiang, Guangliang Li*. Imitation learning from imperfect demonstrations for AUV path tracking and obstacle avoidance. Ocean Engineering, 2024, 298:117287.
7) Wei Meng, Hao Ju, Tongxu Ai, Randy Gomez, Eric Nichols, Guangliang Li*. Transferring Meta-Policy from Simulation to Reality via Progressive Neural Network. IEEE Robotics and Automation Letters, 2024, 9(4): 3696-3703.
8) Hao Ju, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Transferring Policy of Deep Reinforcement Learning from Simulation to Reality for Robotics. Nature Machine Intelligence, 2022, 4:1077-1087
9) Zheng Fang, Dong Jiang, Jie Huang, Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Autonomous Underwater Vehicle Formation Control and Obstacle Avoidance Using Multi-Agent Generative Adversarial Imitation Learning.Ocean Engineering. 2022, 262:112182
10) Dong Jiang, Jie Huang, Zheng Fang, Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Generative Adversarial Interactive Imitation Learning for Path Following of Autonomous Underwater Vehicle. Ocean Engineering. 2022, 260(1):111971
11) Dianrui Wang, Yue Shen, Junhe Wan, Qixin Sha, Guangliang Li, Bo He. Sliding Mode Heading Control for AUV Based on Continuous Hybrid Model-free and Model-Based Reinforcement Learning. Applied Ocean Research, 2022, 118(4): 102960
12) Dianrui Wang, Bo He, Yue Shen, Guangliang Li, Guanzhong Chen. A Modified ALOS Method of Path Tracking for AUVs with Reinforcement Learning Accelerated by Dynamic Data-Driven AUV Model. Journal of Intelligent and Robotic Systems, 2022, 104(3)
13) Jianjun Wang, Chen Feng, Lingyu Wang, Guangliang Li, Bo He. Detection of Weak and Small Targets in Forward-Looking Sonar Image Using Multi-Branch Shuttle Neural Network. IEEE Sensors Journal, 22(7):1-1, 2022
14) Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Path Panning and Obstacle Avoidance for AUV: A Review.Ocean Engineering. 2021, 235:109355
15) Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson and Hayley Hung. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. Autonomous Agents and Multi-Agent Systems (AAMAS), 2020, 34:1-29.
16) Guangliang Li, Randy Gomez, Keisuke Nakamura, Bo He. Human-Centered Reinforcement Learning: A Survey. IEEE Transactions on Human-Machine Systems. 2019, 49(4):337-349.
17) Yan Song, Bo He, Ying Zhao, Guangliang Li, Qixin Sha, Yue Shen, Tianhong Yan, Rui Nian, Amaury Lendasse. Segmentation of Sidescan Sonar Imagery Using Markov Random Fields and Extreme Learning Machine. IEEE Journal of Oceanic Engineering, 2019. 44(2): 502-513.
18) Guangliang Li, Shimon Whiteson, W. Bradley Knox and Hayley Hung. Social Interaction for Effective Agent Learning from Human Reward. Autonomous Agents and Multi-Agent Systems. 2018, 32:1-25.
19) Guangliang Li, Shimon Whiteson, W. Bradley Knox and Hayley Hung. Using Informative Behavior to Increase Engagement While Learning from Human Reward. Autonomous Agents and Multi-Agent Systems, 2016, 30:826-848.
20) Christos Dimitrakakis, Guangliang Li* and Nikoalos Tziortziotis. The Reinforcement Learning Competition 2014. Artificial Intelligence (AI) Magazine, AAAI press. 2014 Fall, 35(3): 61-65. (SCI).
Conference Papers
1) Xuyang Li, Jianwu Fang, Lin Li, Boyuan Chen, Guangliang Li, Jianru Xue. Guided Distillation and Risk Adaptive Evolution for Multi-Robot Navigation. The Fortieth AAAI Conference on Artificial Intelligence (AAAI 2026).
2) Yang Chen, Mingyang Hu, Liu Tian, Eric Nichols, Randy Gomez, Guangliang Li*. Improving Social Robot Haru's Emotional Perception via Physiological Signal Recognition and Analysis. The 2025 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2025).
3) Tongxu Ai, Yohei Hayamizu, Pengyu Zhao, Shiqi Zhang, Eric Nichols, Randy Gomez, Guangliang Li*. Policy Generating and Value Shaping via Large Language Model for Long-Horizon Manipulation. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
4) Ke Zhang, Enqi Zhao, Zicheng Sun, Zheng Fang, Eric Nichols, Randy Gomez, Guangliang Li*. Model-based Imitation Learning with Sim-to-real Transfer for Mobile Robot Path Planning. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
5) Hongqi Yu, Liu Tian, Fanggeng Xiong, Yang Chen, Eric Nichols, Randy Gomez, Guangliang Li*. Shaping Embodied Chatbot Haru Emotional Intelligence with Human Implicit Feedback. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
6) Tian Shen, Zheng Fang, Song Xiang, Randy Gomez, Guangliang Li*. Multi-AUV Coordination via Large Language Model-in-the-Loop Generative Adversarial Interactive Self-Imitation Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025 (Late Breaking Results)
7) Fei Tang, Mingyang Hu, Yu Fang, Eric Nichols, Randy Gomez, Guangliang Li*. Social Robot Haru Assisting Dynamic Group Discussion with Autonomous Eye Gaze Behavior. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025
8) Liu Tian, Yang Chen, Mingyang Hu, Eric Nichols, Randy Gomez, Guangliang Li*. Social Robot Haru Imitating Human Gaze for Attention and Turn-taking Coordination in Multi-party Conversation. In Proceedings of the 17thInternational Conference on Social Robotics, 2025.
9) Hongqi Yu, Fei Tang, Lei Zhang, Randy Gomez, Eric Nichols, Guangliang Li*. Improving Perceived Emotional Intelligence of Embodied Chatbot Haru via Multi-Modal Interaction. The 2024 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2024).
10) Lei Zhang, Chuanxiong Zheng, Hui Wang, Randy Gomez, Eric Nichols, Guangliang Li*. Autonomous Storytelling with Social Robot Haru with Human-Centered Reinforcement Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
11) Zheng Zhang, Xingwei Pan, Tianhao Chen, Dong Jiang, Zheng Fang, Guangliang Li*. Deep Reinforcement Learning with Model Predictive Control for Path Following of Autonomous Underwater Vehicle. The 43rd Chinese Control Conference (CCC), 2024
12) Chuanxiong Zheng, Lei Zhang, Hui Wang, Randy Gomez, Eric Nichols, Guangliang Li*. Shaping Social Robot to Play Games with Human Demonstrations and Evaluative Feedback. International Conference on Robotics and Automation (ICRA), 2024
13) Fei Tang, Chuanxiong Zheng, Hongqi Yu, Lei Zhang, Eric Nichols, Randy Gomez, Guangliang Li*. Assisting Group Discussions Using Desktop Robot Haru. International Conference on Robotics and Automation (ICRA), 2024
14) Lei Zhang, Chuanxiong Zheng, Hui Wang, Eric Nichols, Randy Gomez, Guangliang Li*. Emotional Understanding for Social Robot Haru via Human-Centered Reinforcement Learning. In Proceedings of the 15th International Conference on Social Robotics, pp.1-12, 2023
15) Jie Huang, Jiangshan Hao, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Model-based Adversarial Imitation Learning from Demonstrations and Human Reward. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2023.
16) Rongshun Juan, Hao Ju, Jie Huang, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Sim-to-Real Policy and Reward Transfer with Adaptive Forward Dynamics Model. In Proceedings of the 2023 International Conference on Robotics and Automation (ICRA), pp. 7212-7218, IEEE, 2023
17) Jie Huang, Jiangshan Hao, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. In Proceedings of the 2023 International Conference on Robotics and Automation (ICRA), pp. 4991-4998, IEEE, 2023
18) Hui Wang, Jinying Lin, Zhen Ma, Yurii Vasylkiv, Heike Brock, Keisuke Nakamura, Randy Gomez, Bo He, Guangliang Li*. Affective Behavior Learning for Social Robot Haru with Implicit Evaluative Feedback. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3881-3888, 2022
19) Hui Wang, Guodong Chen, Randy Gomez, Keisuke Nakamura, Bo He, Guangliang Li*. Shaping Haru’s Affective Behavior with Valence and Arousal Based Implicit Facial Feedback. In Proceedings of the 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 769-776, 2022
20) Chuanxiong Zheng, Hui Wang, Lei Zhang, Jiang Shan Hao, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Imitating Human Strategy for Social Robot in Real-Time Two-Player Games. In Proceedings of the 14thInternational Conference on Social Robotics, pp.1-12, 2022
21) Hui Wang, Lei Zhang, Chuanxiong Zheng, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Personalized Storytelling with Social Robot Haru. In Proceedings of the 14th International Conference on Social Robotics, pp. 1-12, 2022
22) Qilei Zhang, Chunxi Cheng, Zheng Fang, Dong Jiang, Bo He, Guangliang Li*. Continuous Control for Autonomous Underwater Vehicle Path Following Using Deep Interactive Reinforcement Learning. In Proceedings of the 2022 International Conference on Machine Learning, Control, and Robotics, pp. 1-8, 2022
23) Dong Jiang, Zheng Fang, Chunxi Cheng, Bo He, Guangliang Li*. Action Guidance-Based Deep Interactive Reinforcement Learning for AUV Path Planning. In Proceedings of the 2022 International Conference on Machine Learning, Control, and Robotics, pp. 1-8, 2022
24) Yurii Vasylkiv, Zhen Ma, Guangliang Li*, Eleanor Sandry, Heike Brock, Keisuke Nakamura, Irani Pourang and Randy Gomez. Automating Behavior Selection for Affective Telepresence Robot. In Proceedings of the 2021 International Conference on Robotics and Automation (ICRA), pp. 2026-2032, IEEE, 2021
25) Rongshun Juan, Jie Huang, Randy Gomez, Keisuke Nakamura, Qixin Sha, Bo He, Guangliang Li*. Shaping Progressive Net of Reinforcement Learning for Policy Transfer with Human Evaluative Feedback. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1281-1288, IEEE, 2021
26) Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson, Hayley Hung. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. In Proceedings of the 20th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1735-1737, 2021(Extended abstract)
27) Yurii Vasylkiv, Zhen Ma, Guangliang Li*, Heike Brock, Keisuke Nakamura, Irani Pourang and Randy Gomez. Shaping Affective Robot Haru’s Reactive Response. In Proceedings of the 30th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 989-996, IEEE, 2021
28) Chao Yu, Tianpei Yang, Wenxuan Zhu, Dongyu Wang, Guangliang Li. Interactive RL via Online Human Demonstrations. In Proceedings of the 19th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 2065-2067, 2020. (Extended abstract)
29) Jinying Lin, Qilei Zhang, Randy Gomez, Keisuke Nakamura, Bo He, Guangliang Li*. Human Social Feedback for Efficient Interactive Reinforcement Agent Learning. In Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp.706-712, 2020
30) Guangliang Li, Randy Gomez, Keisuke Nakamura, Bo He. Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. In Proceedings of 27th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2018, pp. 1156-1162. (Nanjing City Prize, UBTech Prize)
31) Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson and Hayley Hung. Towards Learning from Implicit Human Reward. In Proceedings of the 15th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1353-1354, 2016 (Extended abstract)
32) Guangliang Li, Hayley Hung and Shimon Whiteson. A Large-Scale Study of Agents Learning from Human Reward.In Proceedings of the 14th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1771-1772, 2015 (Extended abstract)
33) Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Learning from Human Reward Benefits from Socio-competitive Feedback. In Proceedings of the 4th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), pp. 93-100, 2014.
34) Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Leveraging Social Networks to Motivate Humans to Train Agents. In Proceedings of the 13th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1571-1572, 2014. (Extended abstract)
35) Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Using Informative Behavior to Increase Engagement in the TAMER Framework. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 909-916, 2013.
36) Sander Bakkes, Shimon Whiteson, Guangliang Li, George Viorel Visniuc, Efstathios Charitos, Norbert Heijne and Arjen Swellengrebel. Challenge Balancing for Personalised Game Spaces. In Proceedings of the 6th IEEE Consumer Electronics Society Games, Entertainment, Media Conference (IEEE GEM). 2014.
37) Eugenio Bargiacchi, Camiel Verschoor, Guangliang Li and Diederik Roijers. Decentralized Solutions and Tactics for RTS. In Proceedings of the 25th Benelux Conference on Artificial Intelligence (BNAIC 2013). (Demo Paper)
38) Sile Ma, Qingmei Chen, Guangliang Li and Xiaohu he. Label Checking System of Flat Bottles Based on Siemens PLC. In Proceedings of the 8th World Congress on Intelligent Control and Automation (WCICA). 2010.
39) Dianrui Wang, Yue Shen, Qixin Sha, Guangliang Li, Xiangrui Kong, Guanzhong Chen, Bo He. Adaptive DDPG Design-Based Sliding-Mode Control for Autonomous Underwater Vehicles at Different Speeds. IEEE OES International Symposium on Underwater Technology. 2019.
40) Fei Yu, Yuemei Zhu, Qi Wang, Kaige Li, Meihan Wu, Guangliang Li, Tianhong Yan, Bo He. Segmentation of Side Scan Sonar Images on AUV. IEEE OES International Symposium on Underwater Technology. 2019.
41) Kaige Li, Fei Yu, Qi Wang, Meihan Wu, Guangliang Li, Tianhong Yan, Bo He. Real-Time Segmentation of Side Scan Sonar Images for AUVs. IEEE OES International Symposium on Underwater Technology. 2019.
42) Yuemei Zhu, Yan Song, Xin Zhang, Pengfei Lv, Guangliang Li, Bo He and Tianhong Yan. Segmentation of Underwater Object in Videos. In Proceedings of OCEANS. 2018.
43) Qixin Sha, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Bo He and Tianhong Yan. Classification and Mosaicking of Side Scan Sonar Image. In Proceedings of OCEANS 2017-Aberdeen.
44) Mingcui Zhu, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Bo He and Tianhong Yan. Side-scan Sonar Image Segmentation Based on Gray Level Co-occurrence Matrices and Unsupervised Extreme Learning Machine. In Proceedings of OCEANS 2017-Aberdeen.
45) Shaomin Wang, Yue Shen, Qixin Sha, Guangliang Li, Jingtao Jiang, Junhe Wan, Tianhong Yan, Bo He. Nonlinear Path Following of Autonomous Underwater Vehicle Considering Uncertainty. IEEE OES International Symposium on Underwater Technology. 2017.
46) Dianrui Wang, Yue Shen, Qixin Sha, Guangliang Li, Jingtao Jiang, Tianhong Yan, Junhe Wan, Bo He. Heading Control for an Autonomous Underwater Vehicle Using ELM-based Q-Learning. IEEE OES International Symposium on Underwater Technology. 2017.
47) Mingcui Zhu, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Tianhong Yan and Bo He. PCA and Kernel-based Extreme Learning Machine for Side-Scan Sonar Image Classification. IEEE OES International Symposium on Underwater Technology. 2017.
48) Xun Li, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Tianhong Yan, Bo He. Sensor Fault Diagnosis of Autonomous Underwater Vehicle Based on Extreme Learning Machine. IEEE OES International Symposium on Underwater Technology. 2017.
49) Guoqing Ding, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Tianhong Yan, Bo He. Side-scan Sonar Image Segmentation Using Kernel-based Extreme Learning Machine. IEEE OES International Symposium on Underwater Technology. 2017.
50) Yan Song, Yuemei Zhu, Guangliang Li, Chen Feng, Bo He, Tianhong Yan. Side Scan Sonar Segmentation Using Deep Convolutional Neural Network. In Proceedings of OCEANS 2017-Anchorage.
51) Guoqing Ding, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Bo He, Tianhong Yan. Fish Recognition Using Convolutional Neural Network. In Proceedings of OCEANS 2017-Anchorage.
52) Dianrui Wang, Yue Shen, Qixin Sha, Guangliang Li, Jingtao Jiang, Bo He, Tianhong Yan. Controller Design of An Autonomous Underwater Vehicle Using ELM-based Sliding Mode Control. In Proceedings of OCEANS 2017-Anchorage.
2024 Young Editorial Board, Intelligent Marine Technology and Systems
2024 Guest Editor, Robot Learning
2024 Organizer, IEEE International Conference on Robotics and Biomimetics (ROBIO 2024) Special Session
`23-Present Professional Committee, Hybrid Intelligence of Chinese Association of Automation
`18-Present Co-founder and Committee Member, Socially Intelligent Robotics Consortium
2022 Session Chair, Inter. Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS)
`19-`25 Program Committee, Inter. Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS)
‘18-`24 Program Committee, Pacific Rim International Conference on Artificial Intelligence (PRICAI)
`21-`22 Program Committee, Adaptive and Learning Workshop at AAMAS
2018 Organizer, International Conference on Robotics and Automation (ICRA) Workshop
2017 Organizer, IEEE RAS International Conference on Humanoid Robots Workshop
2015 Program Committee, International Conference on Robotics and Automation (ICRA) workshop on Machine Learning for Social Robotics
2013-2015 Organizer, Intelligent Autonomous Systems Academic Talk, University of Amsterdam
2013 Organizer and Program Committee, Workshop on Reinforcement Learning Competition at International Conference on Machine Learning (ICML), Atlanta, USA
2013 Organizer, Reinforcement Learning Competition 2013
`22 Artificial Intelligence
`18- Introduction to Matrix Analysis
`16- Signals and Systems
`17 Fundamentals of Circuit Analysis
2025 Excellent Early-Career Board Member Award of Robot Learning Journal
2025 Chinese Automation Association Award
2024 Young Taishan Scholar Program in Shandong Province
2024 Teaching Excellence Award at Ocean University of China
2024 Excellent Supervisor of Master Thesis in Shandong Province
2024 Excellent Supervisor of Master Thesis at Ocean University of China
2018 UBTech Prize, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
2018 Nanjing City Prize, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
2018 Excellent teacher in Ocean University of China
2016 Student Scholarship at the 15th Autonomous Agents and Multi-Agent Systems (AAMAS)
2013 Student Scholarship at the 12th Autonomous Agents and Multi-Agent Systems (AAMAS)
2007 Excellent student scholarship, Shandong University
2006 Excellent student scholarship, Shandong University
2006 National scholarship, Shandong University
2005 Excellent student scholarship, Shandong University
I am primarily interested in deep reinforcement learning (including interactive and inverse reinforcement learning, imitation learning, transfer learning) and its application in robotics (including social robot, quadruped robot, humanoids, mobile robot manipulator, autonomous underwater robot etc.), machine learning and human-robot interaction
Journal Articles
1) Xingwei Pan, Song Xiang, Shilong Niu, Zheng Fang, Jun Wang, Guangliang Li*. Multi-task Learning for Underwater Robot via Progressive Neural Network. Robot Learning, 2025 (2): 0009.
2) Fang Zheng, Tianhao Chen, Tian Shen, Dong Jiang, Zheng Zhang, Guangliang Li*. Multi-Agent Generative Adversarial Interactive Self-Imitation Learning for AUV Formation Control and Obstacle Avoidance. IEEE Robotics and Automation Letters, 2025, 10(5): 4356-4363.
3) Jun Wang, Song Xiang, Tian Shen, Zheng Fang, Shilong Niu, Xingwei Pan, Guangliang Li*. Imitation Learning from Observation for ROV Path Tracking. Intelligent Marine Technology and Systems. 2025(3): 20.
4) Shilong Niu, Xingwei Pan, Jun Wang, Guangliang Li*. Deep Reinforcement Learning from Human Preferences for ROV Path Tracking. Ocean Engineering, 2025, 317:120036
5) Guangliang Li* and Randy Gomez. Realizing Full Body Control of Humanoid Robots, Nature Machine Intelligence, 2024(6):990-991.
6) Tianhao Chen, Zheng Zhang, Zheng Fang, Dong Jiang, Guangliang Li*. Imitation learning from imperfect demonstrations for AUV path tracking and obstacle avoidance. Ocean Engineering, 2024, 298:117287.
7) Wei Meng, Hao Ju, Tongxu Ai, Randy Gomez, Eric Nichols, Guangliang Li*. Transferring Meta-Policy from Simulation to Reality via Progressive Neural Network. IEEE Robotics and Automation Letters, 2024, 9(4): 3696-3703.
8) Hao Ju, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Transferring Policy of Deep Reinforcement Learning from Simulation to Reality for Robotics. Nature Machine Intelligence, 2022, 4:1077-1087
9) Zheng Fang, Dong Jiang, Jie Huang, Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Autonomous Underwater Vehicle Formation Control and Obstacle Avoidance Using Multi-Agent Generative Adversarial Imitation Learning.Ocean Engineering. 2022, 262:112182
10) Dong Jiang, Jie Huang, Zheng Fang, Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Generative Adversarial Interactive Imitation Learning for Path Following of Autonomous Underwater Vehicle. Ocean Engineering. 2022, 260(1):111971
11) Dianrui Wang, Yue Shen, Junhe Wan, Qixin Sha, Guangliang Li, Bo He. Sliding Mode Heading Control for AUV Based on Continuous Hybrid Model-free and Model-Based Reinforcement Learning. Applied Ocean Research, 2022, 118(4): 102960
12) Dianrui Wang, Bo He, Yue Shen, Guangliang Li, Guanzhong Chen. A Modified ALOS Method of Path Tracking for AUVs with Reinforcement Learning Accelerated by Dynamic Data-Driven AUV Model. Journal of Intelligent and Robotic Systems, 2022, 104(3)
13) Jianjun Wang, Chen Feng, Lingyu Wang, Guangliang Li, Bo He. Detection of Weak and Small Targets in Forward-Looking Sonar Image Using Multi-Branch Shuttle Neural Network. IEEE Sensors Journal, 22(7):1-1, 2022
14) Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Path Panning and Obstacle Avoidance for AUV: A Review.Ocean Engineering. 2021, 235:109355
15) Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson and Hayley Hung. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. Autonomous Agents and Multi-Agent Systems (AAMAS), 2020, 34:1-29.
16) Guangliang Li, Randy Gomez, Keisuke Nakamura, Bo He. Human-Centered Reinforcement Learning: A Survey. IEEE Transactions on Human-Machine Systems. 2019, 49(4):337-349.
17) Yan Song, Bo He, Ying Zhao, Guangliang Li, Qixin Sha, Yue Shen, Tianhong Yan, Rui Nian, Amaury Lendasse. Segmentation of Sidescan Sonar Imagery Using Markov Random Fields and Extreme Learning Machine. IEEE Journal of Oceanic Engineering, 2019. 44(2): 502-513.
18) Guangliang Li, Shimon Whiteson, W. Bradley Knox and Hayley Hung. Social Interaction for Effective Agent Learning from Human Reward. Autonomous Agents and Multi-Agent Systems. 2018, 32:1-25.
19) Guangliang Li, Shimon Whiteson, W. Bradley Knox and Hayley Hung. Using Informative Behavior to Increase Engagement While Learning from Human Reward. Autonomous Agents and Multi-Agent Systems, 2016, 30:826-848.
20) Christos Dimitrakakis, Guangliang Li* and Nikoalos Tziortziotis. The Reinforcement Learning Competition 2014. Artificial Intelligence (AI) Magazine, AAAI press. 2014 Fall, 35(3): 61-65. (SCI).
Conference Papers
1) Xuyang Li, Jianwu Fang, Lin Li, Boyuan Chen, Guangliang Li, Jianru Xue. Guided Distillation and Risk Adaptive Evolution for Multi-Robot Navigation. The Fortieth AAAI Conference on Artificial Intelligence (AAAI 2026).
2) Yang Chen, Mingyang Hu, Liu Tian, Eric Nichols, Randy Gomez, Guangliang Li*. Improving Social Robot Haru's Emotional Perception via Physiological Signal Recognition and Analysis. The 2025 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2025).
3) Tongxu Ai, Yohei Hayamizu, Pengyu Zhao, Shiqi Zhang, Eric Nichols, Randy Gomez, Guangliang Li*. Policy Generating and Value Shaping via Large Language Model for Long-Horizon Manipulation. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
4) Ke Zhang, Enqi Zhao, Zicheng Sun, Zheng Fang, Eric Nichols, Randy Gomez, Guangliang Li*. Model-based Imitation Learning with Sim-to-real Transfer for Mobile Robot Path Planning. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
5) Hongqi Yu, Liu Tian, Fanggeng Xiong, Yang Chen, Eric Nichols, Randy Gomez, Guangliang Li*. Shaping Embodied Chatbot Haru Emotional Intelligence with Human Implicit Feedback. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
6) Tian Shen, Zheng Fang, Song Xiang, Randy Gomez, Guangliang Li*. Multi-AUV Coordination via Large Language Model-in-the-Loop Generative Adversarial Interactive Self-Imitation Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025 (Late Breaking Results)
7) Fei Tang, Mingyang Hu, Yu Fang, Eric Nichols, Randy Gomez, Guangliang Li*. Social Robot Haru Assisting Dynamic Group Discussion with Autonomous Eye Gaze Behavior. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025
8) Liu Tian, Yang Chen, Mingyang Hu, Eric Nichols, Randy Gomez, Guangliang Li*. Social Robot Haru Imitating Human Gaze for Attention and Turn-taking Coordination in Multi-party Conversation. In Proceedings of the 17thInternational Conference on Social Robotics, 2025.
9) Hongqi Yu, Fei Tang, Lei Zhang, Randy Gomez, Eric Nichols, Guangliang Li*. Improving Perceived Emotional Intelligence of Embodied Chatbot Haru via Multi-Modal Interaction. The 2024 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2024).
10) Lei Zhang, Chuanxiong Zheng, Hui Wang, Randy Gomez, Eric Nichols, Guangliang Li*. Autonomous Storytelling with Social Robot Haru with Human-Centered Reinforcement Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
11) Zheng Zhang, Xingwei Pan, Tianhao Chen, Dong Jiang, Zheng Fang, Guangliang Li*. Deep Reinforcement Learning with Model Predictive Control for Path Following of Autonomous Underwater Vehicle. The 43rd Chinese Control Conference (CCC), 2024
12) Chuanxiong Zheng, Lei Zhang, Hui Wang, Randy Gomez, Eric Nichols, Guangliang Li*. Shaping Social Robot to Play Games with Human Demonstrations and Evaluative Feedback. International Conference on Robotics and Automation (ICRA), 2024
13) Fei Tang, Chuanxiong Zheng, Hongqi Yu, Lei Zhang, Eric Nichols, Randy Gomez, Guangliang Li*. Assisting Group Discussions Using Desktop Robot Haru. International Conference on Robotics and Automation (ICRA), 2024
14) Lei Zhang, Chuanxiong Zheng, Hui Wang, Eric Nichols, Randy Gomez, Guangliang Li*. Emotional Understanding for Social Robot Haru via Human-Centered Reinforcement Learning. In Proceedings of the 15th International Conference on Social Robotics, pp.1-12, 2023
15) Jie Huang, Jiangshan Hao, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Model-based Adversarial Imitation Learning from Demonstrations and Human Reward. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2023.
16) Rongshun Juan, Hao Ju, Jie Huang, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Sim-to-Real Policy and Reward Transfer with Adaptive Forward Dynamics Model. In Proceedings of the 2023 International Conference on Robotics and Automation (ICRA), pp. 7212-7218, IEEE, 2023
17) Jie Huang, Jiangshan Hao, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. In Proceedings of the 2023 International Conference on Robotics and Automation (ICRA), pp. 4991-4998, IEEE, 2023
18) Hui Wang, Jinying Lin, Zhen Ma, Yurii Vasylkiv, Heike Brock, Keisuke Nakamura, Randy Gomez, Bo He, Guangliang Li*. Affective Behavior Learning for Social Robot Haru with Implicit Evaluative Feedback. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3881-3888, 2022
19) Hui Wang, Guodong Chen, Randy Gomez, Keisuke Nakamura, Bo He, Guangliang Li*. Shaping Haru’s Affective Behavior with Valence and Arousal Based Implicit Facial Feedback. In Proceedings of the 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 769-776, 2022
20) Chuanxiong Zheng, Hui Wang, Lei Zhang, Jiang Shan Hao, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Imitating Human Strategy for Social Robot in Real-Time Two-Player Games. In Proceedings of the 14thInternational Conference on Social Robotics, pp.1-12, 2022
21) Hui Wang, Lei Zhang, Chuanxiong Zheng, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Personalized Storytelling with Social Robot Haru. In Proceedings of the 14th International Conference on Social Robotics, pp. 1-12, 2022
22) Qilei Zhang, Chunxi Cheng, Zheng Fang, Dong Jiang, Bo He, Guangliang Li*. Continuous Control for Autonomous Underwater Vehicle Path Following Using Deep Interactive Reinforcement Learning. In Proceedings of the 2022 International Conference on Machine Learning, Control, and Robotics, pp. 1-8, 2022
23) Dong Jiang, Zheng Fang, Chunxi Cheng, Bo He, Guangliang Li*. Action Guidance-Based Deep Interactive Reinforcement Learning for AUV Path Planning. In Proceedings of the 2022 International Conference on Machine Learning, Control, and Robotics, pp. 1-8, 2022
24) Yurii Vasylkiv, Zhen Ma, Guangliang Li*, Eleanor Sandry, Heike Brock, Keisuke Nakamura, Irani Pourang and Randy Gomez. Automating Behavior Selection for Affective Telepresence Robot. In Proceedings of the 2021 International Conference on Robotics and Automation (ICRA), pp. 2026-2032, IEEE, 2021
25) Rongshun Juan, Jie Huang, Randy Gomez, Keisuke Nakamura, Qixin Sha, Bo He, Guangliang Li*. Shaping Progressive Net of Reinforcement Learning for Policy Transfer with Human Evaluative Feedback. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1281-1288, IEEE, 2021
26) Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson, Hayley Hung. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. In Proceedings of the 20th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1735-1737, 2021(Extended abstract)
27) Yurii Vasylkiv, Zhen Ma, Guangliang Li*, Heike Brock, Keisuke Nakamura, Irani Pourang and Randy Gomez. Shaping Affective Robot Haru’s Reactive Response. In Proceedings of the 30th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 989-996, IEEE, 2021
28) Chao Yu, Tianpei Yang, Wenxuan Zhu, Dongyu Wang, Guangliang Li. Interactive RL via Online Human Demonstrations. In Proceedings of the 19th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 2065-2067, 2020. (Extended abstract)
29) Jinying Lin, Qilei Zhang, Randy Gomez, Keisuke Nakamura, Bo He, Guangliang Li*. Human Social Feedback for Efficient Interactive Reinforcement Agent Learning. In Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp.706-712, 2020
30) Guangliang Li, Randy Gomez, Keisuke Nakamura, Bo He. Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. In Proceedings of 27th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2018, pp. 1156-1162. (Nanjing City Prize, UBTech Prize)
31) Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson and Hayley Hung. Towards Learning from Implicit Human Reward. In Proceedings of the 15th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1353-1354, 2016 (Extended abstract)
32) Guangliang Li, Hayley Hung and Shimon Whiteson. A Large-Scale Study of Agents Learning from Human Reward.In Proceedings of the 14th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1771-1772, 2015 (Extended abstract)
33) Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Learning from Human Reward Benefits from Socio-competitive Feedback. In Proceedings of the 4th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), pp. 93-100, 2014.
34) Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Leveraging Social Networks to Motivate Humans to Train Agents. In Proceedings of the 13th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1571-1572, 2014. (Extended abstract)
35) Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Using Informative Behavior to Increase Engagement in the TAMER Framework. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 909-916, 2013.
36) Sander Bakkes, Shimon Whiteson, Guangliang Li, George Viorel Visniuc, Efstathios Charitos, Norbert Heijne and Arjen Swellengrebel. Challenge Balancing for Personalised Game Spaces. In Proceedings of the 6th IEEE Consumer Electronics Society Games, Entertainment, Media Conference (IEEE GEM). 2014.
37) Eugenio Bargiacchi, Camiel Verschoor, Guangliang Li and Diederik Roijers. Decentralized Solutions and Tactics for RTS. In Proceedings of the 25th Benelux Conference on Artificial Intelligence (BNAIC 2013). (Demo Paper)
38) Sile Ma, Qingmei Chen, Guangliang Li and Xiaohu he. Label Checking System of Flat Bottles Based on Siemens PLC. In Proceedings of the 8th World Congress on Intelligent Control and Automation (WCICA). 2010.
39) Dianrui Wang, Yue Shen, Qixin Sha, Guangliang Li, Xiangrui Kong, Guanzhong Chen, Bo He. Adaptive DDPG Design-Based Sliding-Mode Control for Autonomous Underwater Vehicles at Different Speeds. IEEE OES International Symposium on Underwater Technology. 2019.
40) Fei Yu, Yuemei Zhu, Qi Wang, Kaige Li, Meihan Wu, Guangliang Li, Tianhong Yan, Bo He. Segmentation of Side Scan Sonar Images on AUV. IEEE OES International Symposium on Underwater Technology. 2019.
41) Kaige Li, Fei Yu, Qi Wang, Meihan Wu, Guangliang Li, Tianhong Yan, Bo He. Real-Time Segmentation of Side Scan Sonar Images for AUVs. IEEE OES International Symposium on Underwater Technology. 2019.
42) Yuemei Zhu, Yan Song, Xin Zhang, Pengfei Lv, Guangliang Li, Bo He and Tianhong Yan. Segmentation of Underwater Object in Videos. In Proceedings of OCEANS. 2018.
43) Qixin Sha, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Bo He and Tianhong Yan. Classification and Mosaicking of Side Scan Sonar Image. In Proceedings of OCEANS 2017-Aberdeen.
44) Mingcui Zhu, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Bo He and Tianhong Yan. Side-scan Sonar Image Segmentation Based on Gray Level Co-occurrence Matrices and Unsupervised Extreme Learning Machine. In Proceedings of OCEANS 2017-Aberdeen.
45) Shaomin Wang, Yue Shen, Qixin Sha, Guangliang Li, Jingtao Jiang, Junhe Wan, Tianhong Yan, Bo He. Nonlinear Path Following of Autonomous Underwater Vehicle Considering Uncertainty. IEEE OES International Symposium on Underwater Technology. 2017.
46) Dianrui Wang, Yue Shen, Qixin Sha, Guangliang Li, Jingtao Jiang, Tianhong Yan, Junhe Wan, Bo He. Heading Control for an Autonomous Underwater Vehicle Using ELM-based Q-Learning. IEEE OES International Symposium on Underwater Technology. 2017.
47) Mingcui Zhu, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Tianhong Yan and Bo He. PCA and Kernel-based Extreme Learning Machine for Side-Scan Sonar Image Classification. IEEE OES International Symposium on Underwater Technology. 2017.
48) Xun Li, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Tianhong Yan, Bo He. Sensor Fault Diagnosis of Autonomous Underwater Vehicle Based on Extreme Learning Machine. IEEE OES International Symposium on Underwater Technology. 2017.
49) Guoqing Ding, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Tianhong Yan, Bo He. Side-scan Sonar Image Segmentation Using Kernel-based Extreme Learning Machine. IEEE OES International Symposium on Underwater Technology. 2017.
50) Yan Song, Yuemei Zhu, Guangliang Li, Chen Feng, Bo He, Tianhong Yan. Side Scan Sonar Segmentation Using Deep Convolutional Neural Network. In Proceedings of OCEANS 2017-Anchorage.
51) Guoqing Ding, Yan Song, Jia Guo, Chen Feng, Guangliang Li, Bo He, Tianhong Yan. Fish Recognition Using Convolutional Neural Network. In Proceedings of OCEANS 2017-Anchorage.
52) Dianrui Wang, Yue Shen, Qixin Sha, Guangliang Li, Jingtao Jiang, Bo He, Tianhong Yan. Controller Design of An Autonomous Underwater Vehicle Using ELM-based Sliding Mode Control. In Proceedings of OCEANS 2017-Anchorage.
2024 Young Editorial Board, Intelligent Marine Technology and Systems
2024 Guest Editor, Robot Learning
2024 Organizer, IEEE International Conference on Robotics and Biomimetics (ROBIO 2024) Special Session
`23-Present Professional Committee, Hybrid Intelligence of Chinese Association of Automation
`18-Present Co-founder and Committee Member, Socially Intelligent Robotics Consortium
2022 Session Chair, Inter. Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS)
`19-`25 Program Committee, Inter. Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS)
‘18-`24 Program Committee, Pacific Rim International Conference on Artificial Intelligence (PRICAI)
`21-`22 Program Committee, Adaptive and Learning Workshop at AAMAS
2018 Organizer, International Conference on Robotics and Automation (ICRA) Workshop
2017 Organizer, IEEE RAS International Conference on Humanoid Robots Workshop
2015 Program Committee, International Conference on Robotics and Automation (ICRA) workshop on Machine Learning for Social Robotics
2013-2015 Organizer, Intelligent Autonomous Systems Academic Talk, University of Amsterdam
2013 Organizer and Program Committee, Workshop on Reinforcement Learning Competition at International Conference on Machine Learning (ICML), Atlanta, USA
2013 Organizer, Reinforcement Learning Competition 2013
`22 Artificial Intelligence
`18- Introduction to Matrix Analysis
`16- Signals and Systems
`17 Fundamentals of Circuit Analysis
2025 Excellent Early-Career Board Member Award of Robot Learning Journal
2025 Chinese Automation Association Award
2024 Young Taishan Scholar Program in Shandong Province
2024 Teaching Excellence Award at Ocean University of China
2024 Excellent Supervisor of Master Thesis in Shandong Province
2024 Excellent Supervisor of Master Thesis at Ocean University of China
2018 UBTech Prize, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
2018 Nanjing City Prize, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
2018 Excellent teacher in Ocean University of China
2016 Student Scholarship at the 15th Autonomous Agents and Multi-Agent Systems (AAMAS)
2013 Student Scholarship at the 12th Autonomous Agents and Multi-Agent Systems (AAMAS)
2007 Excellent student scholarship, Shandong University
2006 Excellent student scholarship, Shandong University
2006 National scholarship, Shandong University
2005 Excellent student scholarship, Shandong University
地址：青岛市松岭路238号 邮编：266100
Copyright © 2017 中国海洋大学信息科学与工程学部. All Rights Reserved.
Copyright © 2023 Ocean University of China . All rights reserved
