publications | Zhenshan Bing's webpage

2023

Lateral flexion of a compliant spine improves motor performance in a bioinspired mouse robot

Zhenshan Bing, Alex Rohregger, Florian Walter, Yuhong Huang, Peer Lucas, Fabrice O. Morin, Kai Huang, and Alois Knoll

Science Robotics 2023

Abs Bib

A flexible spine is critical to the motion capability of most animals and plays a pivotal role in their agility. Although state-of-the-art legged robots have already achieved very dynamic and agile movement solely relying on their legs, they still exhibit the type of stiff movement that compromises movement efficiency. The integration of a flexible spine thus appears to be a promising approach to improve their agility, especially for small and underactuated quadruped robots that are underpowered because of size limitations. Here, we show that the lateral flexion of a compliant spine can promote both walking speed and maneuver agility for a neurorobotic mouse (NeRmo). We present NeRmo as a biomimetic robotic mouse that mimics the morphology of biological mice and their muscle-tendon actuation system. First, by leveraging the lateral flexion of the compliant spine, NeRmo can greatly increase its static stability in an initially unstable configuration by adjusting its posture. Second, the lateral flexion of the spine can also effectively extend the stride length of a gait and therefore improve the walking speeds of NeRmo. Finally, NeRmo shows agile maneuvers that require both a small turning radius and fast walking speed with the help of the spine. These results advance our understanding of spine-based quadruped locomotion skills and highlight promising design concepts to develop more agile legged robots. Lateral flexion of a compliant spine can improve motor skills of a bioinspired mouse robot.
@article{doi:10.1126/scirobotics.adg7165, author = {Bing, Zhenshan and Rohregger, Alex and Walter, Florian and Huang, Yuhong and Lucas, Peer and Morin, Fabrice O. and Huang, Kai and Knoll, Alois}, title = {Lateral flexion of a compliant spine improves motor performance in a bioinspired mouse robot}, journal = {Science Robotics}, year = {2023}, volume = {8}, month = {}, number = {85}, pages = {eadg7165}, issn = {}, doi = {10.1126/scirobotics.adg7165}, language = {}, keywords = {}, }

ICRA

Meta-Reinforcement Learning via Language Instructions.

Zhenshan Bing, Alexander Koch, Xiangtong Yao, Kai Huang, and Alois Knoll

In 2023 IEEE International Conference on Robotics and Automation(ICRA) May 2023

@inproceedings{bing2023icra,
  editor = {},
  author = {Bing, Zhenshan and Koch, Alexander and Yao, Xiangtong and Huang, Kai and Knoll, Alois},
  title = {Meta-Reinforcement Learning via Language Instructions.},
  booktitle = {2023 IEEE International Conference on Robotics and Automation(ICRA)},
  year = {2023},
  month = may,
  volume = {},
  publisher = {},
  organization = {},
  series = {},
  number = {},
  pages = {},
  isbn = {},
  doi = {},
  language = {},
  keywords = {},
  note = {}
}

IROS

Contact-aware Shaping and Maintenance of Deformable Linear Objects With Fixtures

Kejia Chen, Zhenshan Bing, Fan Wu, Yuan Meng, Andre Kraft, Sami Haddadin, and Alois Knoll

In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023) 2023

Abs Bib

@inproceedings{chen,
  editor = {},
  author = {Chen, Kejia and Bing, Zhenshan and Wu, Fan and Meng, Yuan and Kraft, Andre and Haddadin, Sami and Knoll, Alois},
  title = {Contact-aware Shaping and Maintenance of Deformable Linear Objects With Fixtures},
  booktitle = {2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)},
  year = {2023},
  month = {},
  volume = {},
  publisher = {},
  organization = {},
  series = {},
  number = {},
  pages = {},
  isbn = {},
  doi = {},
  language = {},
  keywords = {},
  note = {}
}

TNNLS

Meta-Reinforcement Learning in Nonstationary and Nonparametric Environments

Zhenshan Bing, Lukas Knak, Long Cheng, Fabrice O. Morin, Kai Huang, and Alois Knoll

IEEE Transactions on Neural Networks and Learning Systems 2023

Abs Bib

@article{tigr,
  author = {Bing, Zhenshan and Knak, Lukas and Cheng, Long and Morin, Fabrice O. and Huang, Kai and Knoll, Alois},
  title = {Meta-Reinforcement Learning in Nonstationary and Nonparametric Environments},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2023},
  volume = {},
  month = {},
  number = {},
  pages = {1-15},
  issn = {},
  doi = {10.1109/tnnls.2023.3270298},
  language = {},
  keywords = {},
  note = {}
}

JAI

Towards cognitive navigation: A biologically inspired calibration mechanism for the head direction cell network

Zhenshan Bing, Dominik Nitschke, Genghang Zhuang, Kai Huang, and Alois Knoll

Journal of Automation and Intelligence 2023

Abs Bib PDF Code Video

@article{jai,
  author = {Bing, Zhenshan and Nitschke, Dominik and Zhuang, Genghang and Huang, Kai and Knoll, Alois},
  title = {Towards cognitive navigation: A biologically inspired calibration mechanism for the head direction cell network},
  journal = {Journal of Automation and Intelligence},
  year = {2023},
  volume = {2},
  month = {},
  number = {1},
  pages = {31-41},
  issn = {},
  doi = {10.1016/j.jai.2023.100020},
  language = {},
  keywords = {},
  note = {},
  video = {https://videoviewsite.wixsite.com/hdc-calibration}
}

2022

Simulation to Real: Learning Energy-Efficient Slithering Gaits for a Snake-Like Robot

Zhenshan Bing, Long Cheng, Kai Huang, and Alois Knoll

IEEE Robotics & Automation Magazine 2022

Bib PDF

@article{9895427,
  author = {Bing, Zhenshan and Cheng, Long and Huang, Kai and Knoll, Alois},
  journal = {IEEE Robotics & Automation Magazine},
  title = {Simulation to Real: Learning Energy-Efficient Slithering Gaits for a Snake-Like Robot},
  year = {2022},
  volume = {29},
  number = {4},
  pages = {92-103},
  doi = {10.1109/MRA.2022.3204237},
}

Meta-reinforcement learning in non-stationary and dynamic environments

Zhenshan Bing, David Lerch, Kai Huang, and Alois Knoll

IEEE Transactions on Pattern Analysis and Machine Intelligence 2022

Bib HTML PDF Code Video

@article{bing2022meta,
  title = {Meta-reinforcement learning in non-stationary and dynamic environments},
  author = {Bing, Zhenshan and Lerch, David and Huang, Kai and Knoll, Alois},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2022},
  publisher = {IEEE},
  video = {},
}

Solving Robotic Manipulation with Sparse Reward Reinforcement Learning via Graph-Based Diversity and Proximity

Zhenshan Bing, Hongkuan Zhou, Rui Li, Xiaojie Su, Fabrice Oliver Morin, Kai Huang, and Alois Knoll

IEEE Transactions on Industrial Electronics 2022
TFS

Reduced-Model Based Fault Detector and Controller Design for Discrete-Time Switching Fuzzy Systems

Yaoyao Tan, Xiaojie Su, Zhenshan Bing, Xiaokui Yang, and Alois Knoll

IEEE Transactions on Fuzzy Systems 2022
Toward Cognitive Navigation: Design and Implementation of a Biologically Inspired Head Direction Cell Network

Zhenshan Bing, Amir EI Sewisy, Genghang Zhuang, Florian Walter, Fabrice O. Morin, Kai Huang, and Alois Knoll

IEEE Transactions on Neural Networks and Learning Systems 2022
IEEE IV

A Biologically-Inspired Global Localization System for Mobile Robots Using LiDAR Sensor

Genghang Zhuang, Carlo Cagnetta, Zhenshan Bing, Hu Cao, Xinyi Li, Kai Huang, and Alois Knoll

In 2022 IEEE Intelligent Vehicles Symposium (IV) 2022

2021

Robotic Manipulation in Dynamic Scenarios via Bounding-Box-Based Hindsight Goal Generation

Zhenshan Bing, Erick Álvarez, Long Cheng, Fabrice O. Morin, Rui Li, Xiaojie Su, Kai Huang, and Alois Knoll

IEEE Transactions on Neural Networks and Learning Systems 2021
Complex Robotic Manipulation via Graph-Based Hindsight Goal Generation

Zhenshan Bing, Matthias Brucker, Fabrice O. Morin, Rui Li, Xiaojie Su, Kai Huang, and Alois Knoll

IEEE Transactions on Neural Networks and Learning Systems 2021
Spiking Neural Network for Fourier Transform and Object Detection for Automotive Radar

Javier López-Randulfe, Tobias Duswald, Zhenshan Bing, and Alois Knoll

Frontiers in Neurorobotics 2021

Abs

The development of advanced autonomous driving applications is hindered by the complex temporal structure of sensory data, as well as by the limited computational and energy resources of their on-board systems. Currently, neuromorphic engineering is a rapidly growing field that aims to design information processing systems similar to the human brain by leveraging novel algorithms based on spiking neural networks (SNNs). These systems are well-suited to recognize temporal patterns in data while maintaining a low energy consumption and offering highly parallel architectures for fast computation. However, the lack of effective algorithms for SNNs impedes their wide usage in mobile robot applications. This paper addresses the problem of radar signal processing by introducing a novel SNN that substitutes the discrete Fourier transform and constant false-alarm rate algorithm for raw radar data, where the weights and architecture of the SNN are derived from the original algorithms. We demonstrate that our proposed SNN can achieve competitive results compared to that of the original algorithms in simulated driving scenarios while retaining its spike-based nature.
arXiv

A Biologically Inspired Simultaneous Localization and Mapping System Based on LiDAR Sensor

Genghang Zhuang, Zhenshan Bing, Jiaxi Zhao, Ning Li, Yuhong Huang, Kai Huang, and Alois Knoll

arXiv preprint arXiv:2109.12910 2021
arXiv

Meta-Reinforcement Learning in Broad and Non-Parametric Environments

Zhenshan Bing, Lukas Knak, Fabrice Oliver Robin, Kai Huang, and Alois Knoll

arXiv preprint arXiv:2108.03718 2021
IJARS

Design and evaluation of the target spray platform

Mingchuan Zhou, Huanyu Jiang, Zhenshan Bing, Hang Su, and Alois Knoll

International Journal of Advanced Robotic Systems 2021

Abs

The target-oriented spraying is an effective way to minimize chemical input in agricultural production and it is important to actualizing sustainable agriculture. This article focused on the design and optimization of the target spray platform. The spray platform consists of three parts: the vision system, the spray system, and the moving platform. All components were effectively connected and preliminarily evaluated especially regarding the response time and target spray accuracy. A simulation system was built considering the real crop geometric shape and nozzle spray pattern using the Monte Carlo method. The spray simulator was used to optimize the spray height objective function of spray deposition rate and coefficient of variance for the spray deposition. The spray process can be easily visualized and compared for different spray parameters. The indoor experiment setup was built to test and optimize the parameters of the overall system, which is flexible to verify the system. Afterward, the outdoor tractor-based equipment was designed to test the system for the field environment. The experimental result showed that 80% of the crop had a spray deviation from 0 mm to 28 mm and the proposed spraying system can reduce 46.8% usage of the chemical compared to the uniform spray method.

2020

Neural Networks

Energy-efficient and damage-recovery slithering gait design for a snake-like robot based on reinforcement learning and inverse reinforcement learning

Zhenshan Bing, Christian Lemke, Long Cheng, Kai Huang, and Alois Knoll

Neural Networks 2020
Neural Networks

Indirect and direct training of spiking neural networks for end-to-end control of a lane-keeping vehicle

Zhenshan Bing, Claus Meschede, Guang Chen, Alois Knoll, and Kai Huang

Neural Networks 2020

Abs Code

Building spiking neural networks (SNNs) based on biological synaptic plasticities holds a promising potential for accomplishing fast and energy-efficient computing, which is beneficial to mobile robotic applications. However, the implementations of SNNs in robotic fields are limited due to the lack of practical training methods. In this paper, we therefore introduce both indirect and direct end-to-end training methods of SNNs for a lane-keeping vehicle. First, we adopt a policy learned using the Deep Q-Learning (DQN) algorithm and then subsequently transfer it to an SNN using supervised learning. Second, we adopt the reward-modulated spike-timing-dependent plasticity (R-STDP) for training SNNs directly, since it combines the advantages of both reinforcement learning and the well-known spike-timing-dependent plasticity (STDP). We examine the proposed approaches in three scenarios in which a robot is controlled to keep within lane markings by using an event-based neuromorphic vision sensor. We further demonstrate the advantages of the R-STDP approach in terms of the lateral localization accuracy and training time steps by comparing them with other three algorithms presented in this paper.
IROS

Target Tracking Control of a Wheel-less Snake Robot Based on a Supervised Multi-layered SNN

Zhuangyi Jiang, Richard Otto, Zhenshan Bing, Kai Huang, and Alois Knoll

In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2020
Frontiers

Perception-Action Coupling Target Tracking Control for a Snake Robot via Reinforcement Learning

Zhenshan Bing, Christian Lemke, Fabric O. Morin, Zhuangyi Jiang, Long Cheng, Kai Huang, and Alois Knoll

Frontiers in Neurorobotics 2020

Abs

Visual-guided locomotion for snake-like robots is a challenging task, since it involves not only the complex body undulation with many joints, but also a joint pipeline that connects the vision and the locomotion. Meanwhile, it is usually difficult to jointly coordinate these two separate sub-tasks as this requires time-consuming and trial-and-error tuning. In this paper, we introduce a novel approach for solving target tracking tasks for a snake-like robot as a whole using a model-free reinforcement learning (RL) algorithm. This RL-based controller directly maps the visual observations to the joint positions of the snake-like robot in an end-to-end fashion instead of dividing the process into a series of sub-tasks. With a novel customized reward function, our RL controller is trained in a dynamically changing track scenario. The controller is evaluated in four different tracking scenarios and the results show excellent adaptive locomotion ability to the unpredictable behavior of the target. Meanwhile, the results also prove that the RL-based controller outperforms the traditional model-based controller in terms of tracking accuracy.

2019

Toward Brain-Inspired Learning With the Neuromorphic Snake-Like Robot and the Neurorobotic Platform

Guang Chen, Zhenshan Bing, Florian Röhrbein, Jörg Conradt, Kai Huang, Long Cheng, Zhuangyi Jiang, and Alois Knoll

IEEE Transactions on Cognitive and Developmental Systems 2019
End to End Learning of a Multi-Layered Snn Based on R-Stdp for a Target Tracking Snake-Like Robot

Zhenshan Bing, Zhuangyi Jiang, Long Cheng, Caixia Cai, Kai Huang, and Alois Knoll

In 2019 International Conference on Robotics and Automation (ICRA) 2019
Supervised Learning in SNN via Reward-Modulated Spike-Timing-Dependent Plasticity for a Target Reaching Vehicle

Zhenshan Bing, Ivan Baumann, Zhuangyi Jiang, Kai Huang, Caixia Cai, and Alois Knoll

Frontiers in Neurorobotics 2019

Abs

Spiking neural networks (SNNs) offer many advantages over traditional artificial neural networks (ANNs) such as biological plausibility, fast information processing, and energy efficiency. Although SNNs have been used to solve a variety of control tasks using the Spike-Timing-Dependent Plasticity (STDP) learning rule, existing solutions usually involve hard-coded network architectures solving specific tasks rather than solving different kinds of tasks generally. This results in neglecting one of the biggest advantages of ANNs, i.e., being general-purpose and easy-to-use due to their simple network architecture, which usually consists of an input layer, one or multiple hidden layers and an output layer. This paper addresses the problem by introducing an end-to-end learning approach of spiking neural networks constructed with one hidden layer and reward-modulated Spike-Timing-Dependent Plasticity (R-STDP) synapses in an all-to-all fashion. We use the supervised reward-modulated Spike-Timing-Dependent-Plasticity learning rule to train two different SNN-based sub-controllers to replicate a desired obstacle avoiding and goal approaching behavior, provided by pre-generated datasets. Together they make up a target-reaching controller, which is used to control a simulated mobile robot to reach a target area while avoiding obstacles in its path. We demonstrate the performance and effectiveness of our trained SNNs to achieve target reaching tasks in different unknown scenarios.
Mixed Frame Event-Driven Fast Pedestrian Detection

Zhuangyi Jiang, Pengfei Xia, Kai Huang, Walter Stechele, Guang Chen, Zhenshan Bing, and Alois Knoll

In 2019 International Conference on Robotics and Automation (ICRA) 2019
Retina-Based Pipe-Like Object Tracking Implemented Through Spiking Neural Network on a Snake Robot

Zhuangyi Jiang, Zhenshan Bing, Kai Huang, and Alois Knoll

Frontiers in Neurorobotics 2019

Abs

Vision based-target tracking ability is crucial to bio-inspired snake robots for exploring unknown environments. However, it is difficult for the traditional vision modules of snake robots to overcome the image blur resulting from periodic swings. A promising approach is to use a neuromorphic vision sensor (NVS), which mimics the biological retina to detect a target at a higher temporal frequency and in a wider dynamic range. In this study, an NVS and a spiking neural network (SNN) were performed on a snake robot for the first time to achieve pipe-like object tracking. An SNN based on Hough Transform was designed to detect a target with an asynchronous event stream fed by the NVS. Combining the state of snake motion analyzed by the joint position sensors, a tracking framework was proposed. The experimental results obtained from the simulator demonstrated the validity of our framework and the autonomous locomotion ability of our snake robot. Comparing the performances of the SNN model on CPUs and on GPUs, respectively, the SNN model showed the best performance on a GPU under a simplified and synchronous update rule while it possessed higher precision on a CPU in an asynchronous way.
Thesis

Biological-inspired Hierarchical Control of a Snake-like Robot for Autonomous Locomotion

Zhenshan Bing

2019
Peak Temperature Minimization for Hard Real-Time Systems Using DVS and DPM

Mingchuan Zhou, Long Cheng, Manuel Dell’Antonio, Xiebing Wang, Zhenshan Bing, M Ali Nasseri, Kai Huang, and Alois Knoll

Journal of Circuits, Systems and Computers 2019
DVS

Neuromorphic Vision Datasets for Pedestrian Detection, Action Recognition, and Fall Detection

Shu Miao, Guang Chen, Xiangyu Ning, Yang Zi, Kejia Ren, Zhenshan Bing, and Alois Knoll

Frontiers in Neurorobotics 2019
IJCAI

Energy-Efficient Slithering Gait Exploration for a Snake-Like Robot Based on Reinforcement Learning

Zhenshan Bing, Christian Lemke, Zhuangyi Jiang, Kai Huang, and Alois Knoll

In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19 Jul 2019

2018

End to End Learning of Spiking Neural Network Based on R-STDP for a Lane Keeping Vehicle

Zhenshan Bing, Claus Meschede, Kai Huang, Guang Chen, Florian Rohrbein, Mahmoud Akl, and Alois Knoll

In 2018 IEEE International Conference on Robotics and Automation (ICRA) Jul 2018

Code
survey

A Survey of Robotics Control Based on Learning-Inspired Spiking Neural Networks

Zhenshan Bing, Claus Meschede, Florian Röhrbein, Kai Huang, and Alois C. Knoll

Frontiers in Neurorobotics Jul 2018

Abs

Biological intelligence processes information using impulses or spikes, which makes those living creatures able to perceive and act in the real world exceptionally well and outperform state-of-the-art robots in almost every aspect of life. To make up the deficit, emerging hardware technologies and software knowledge in the fields of neuroscience, electronics, and computer science have made it possible to design biologically realistic robots controlled by spiking neural networks (SNNs), inspired by the mechanism of brains. However, a comprehensive review on controlling robots based on SNNs is still missing. In this paper, we survey the developments of the past decade in the field of spiking neural networks for control tasks, with particular focus on the fast emerging robotics-related applications. We first highlight the primary impetuses of SNN-based robotics tasks in terms of speed, energy efficiency, and computation capabilities. We then classify those SNN-based robotic applications according to different learning rules and explicate those learning rules with their corresponding robotic applications. We also briefly present some existing platforms that offer an interaction between SNNs and robotics simulations for exploration and exploitation. Finally, we conclude our survey with a forecast of future challenges and some associated potential research topics in terms of controlling robots based on SNNs.
IEEE-HFR

Teleoperation Snake Robots with Panorama Vision

Long Chen, Xuan Yuwen, Zhenshan Bing, Kai Huang, and Jun Wang

In 2018 11th International Workshop on Human Friendly Robotics (HFR) Jul 2018
DVS

Neuromorphic vision based multivehicle detection and tracking for intelligent transportation system

Guang Chen, Hu Cao, Muhammad Aafaque, Jieneng Chen, Canbo Ye, Florian Röhrbein, Jörg Conradt, Kai Chen, Zhenshan Bing, Xingbo Liu, and others

Journal of advanced transportation Jul 2018

2017

Towards autonomous locomotion: CPG-based control of smooth 3D slithering gait transition of a snake-like robot

Zhenshan Bing, Long Cheng, Guang Chen, Florian Röhrbein, Kai Huang, and Alois Knoll

Bioinspiration &amp\mathsemicolon Biomimetics Apr 2017

Abs

Snake-like robots with 3D locomotion ability have significant advantages of adaptive travelling in diverse complex terrain over traditional legged or wheeled mobile robots. Despite numerous developed gaits, these snake-like robots suffer from unsmooth gait transitions by changing the locomotion speed, direction, and body shape, which would potentially cause undesired movement and abnormal torque. Hence, there exists a knowledge gap for snake-like robots to achieve autonomous locomotion. To address this problem, this paper presents the smooth slithering gait transition control based on a lightweight central pattern generator (CPG) model for snake-like robots. First, based on the convergence behavior of the gradient system, a lightweight CPG model with fast computing time was designed and compared with other widely adopted CPG models. Then, by reshaping the body into a more stable geometry, the slithering gait was modified, and studied based on the proposed CPG model, including the gait transition of locomotion speed, moving direction, and body shape. In contrast to sinusoid-based method, extensive simulations and prototype experiments finally demonstrated that smooth slithering gait transition can be effectively achieved using the proposed CPG-based control method without generating undesired locomotion and abnormal torque.
CPG-based control of smooth transition for body shape and locomotion speed of a snake-like robot

Zhenshan Bing, Long Cheng, Kai Huang, Mingchuan Zhou, and Alois Knoll

In 2017 IEEE International Conference on Robotics and Automation (ICRA) Apr 2017
Slope angle estimation based on multi-sensor fusion for a snake-like robot

Zhenshan Bing, Long Cheng, Alois Knoll, Anyang Zhong, Kai Huang, and Feihu Zhang

In 2017 20th International Conference on Information Fusion (Fusion) Apr 2017
Towards autonomous locomotion: Slithering gait design of a snake-like robot for target observation and tracking

Zhenshan Bing, Long Cheng, Kai Huang, Zhuangyi Jiang, Guang Chen, Florian Röhrbein, and Alois Knoll

In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Apr 2017
Springer

Online multi-object tracking-by-clustering for intelligent transportation system with neuromorphic vision sensor

Gereon Hinz, Guang Chen, Muhammad Aafaque, Florian Röhrbein, Jörg Conradt, Zhenshan Bing, Zhongnan Qu, Walter Stechele, and Alois Knoll

In Joint German/Austrian Conference on Artificial Intelligence (Künstliche Intelligenz) Apr 2017
ICNIP

Event-based target tracking control for a snake robot using a dynamic vision sensor

Zhuangyi Jiang, Zhenshan Bing, Kai Huang, Guang Chen, Long Cheng, and Alois Knoll

In International Conference on Neural Information Processing Apr 2017
ROBIO

Snake-like robot climbs inside different pipes

Shanshan Xiao, Zhenshan Bing, Kai Huang, and Yuhong Huang

In 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO) Apr 2017