Hongsheng He

Education:

• PhD, National University of Singapore Department of Electrical and Computer Engineering 2008-2012
• MS, Northeastern University Control Theory & Engineering, Department of Information Science and Technology 2006-2008
• BS, Wuhan University of Science and Technology Automation, Department of Information Science and Technology 2002-2006

Research Interests:

• Intelligent Robotics
• Artificial Intelligence
• Machine Learning
• Autonomy

Robotic Software

• Hongsheng He and Guofeng Tong, "MS Wheeled and Humanoid Micro Robot Simulation", Official RoboCup Competition Platform, 2009

Media Coverage

• WBIR-TV, “Robot sensor technology could help people who cannot see navigate unfamiliar places", by Emily Stroud, featured demos of blind navigation functions, November 4, 2015

Introduction to Intelligent Robotics (Fall 2018)

• The study of intelligent robotics allows robots to gather information from surrounding environments and take actions autonomously.
• This course will introduce the fundamental principles and methods of manipulation, navigation and perception for intelligent robotics.
• Topics covered include geometry transformations, kinematics, dynamics, localization, navigation, mapping, motion planning, intelligent processing, smart sensing, decision making, and robotic intelligence.
• The students will explore the robot concepts and algorithms, such as dexterous manipulation, simultaneous localization and mapping (SLAM), and autonomy, while working with Nao humanoid robots and Sawyer collaborative robots.

Artificial Intelligence for Robotics (Spring 2018)

• The course will cover advanced topics in artificial intelligence that are commonly used in robotics research, including probabilistic graph models, probabilistic logic learning, natural-language processing, and deep learning.
• State-of-the-art robotics research using these techniques will be introduced in the area of scene understanding, reasoning, and action planning.
• Students will get hands-on experience in using a Nao humanoid robot and a Sawyer collaborative robot.

Reinforcement Robot Learning (Fall 2020)

• Under preparation

Robot Vision (Spring 2020)

• Under preparation

Conference Paper

 

• Rotational coordinate transformation for visual-inertial sensor fusion
  Hongsheng He, Yan Li, and Jindong Tan
  Proceedings of International Conference on Social Robotics (ICSR), 412–422, 2016
  
• Adaptive ego-motion tracking using visual-inertial sensors for wearable blind navigation
  Hongsheng He and Jindong Tan
  Proceedings of the Wireless Health, National Institutes of Health, 1–7. ACM, Oct 29, 2014 - Oct 31, 2014
  
• A wearable navigator for the visually impaired and blind population
  Hongsheng He and Jindong Tan
  BMES Annual Meeting, San Antonio, Oct. 22-25 2014
  
• Ambient motion estimation in dynamic scenes using wearable visual and inertial sensors
  Hongsheng He and Jindong Tan
  Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1002–1007, May 31 - June 7 2014
  
• Geometry constrained sparse embedding for multi-dimensional transfer function design in direct volume rendering
  Zhenzhou Shao, Yong Guan, Hongsheng He, and Jindong Tan
  IEEE Conference on Robotics and Automation (ICRA), 1290–1295, May 31 - June 7 2014
• Design and development of nancy, a social robot
  Shuzhi Sam Ge, John-John Cabibihan, Zhengchen Zhang, Yanan Li, Cai Meng, Hongsheng He, Mohammadreza Safi Zadeh, Yinbei Li, and Jiaqiang Yang
  Proceedings of the 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), 568–573, 2011
• Neural-network-based human intention estimation for physical human-robot interaction
  Shuzhi Sam Ge, Yanan Li, and Hongsheng He
  Proceedings of the 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), 390–395, 2011
• Visual cortex inspired junction detection
  Shuzhi Sam Ge, Chengyao Shen, and Hongsheng He
  Proceedings of Neural Information Processing, 225–232, 2011
• Weighted graph model based sentence clustering and ranking for document summarization
  Shuzhi Sam Ge, Zhengchen Zhang, and Hongsheng He
  The 4th International Conference on Interaction Sciences (ICIS), 90–95, 2011
• Composite x marker detection and recognition
  Cai Meng, Hongsheng He, and Shuzhi Sam Ge
  IEEE Conference on Robotics, Automation and Mechatronics (RAM), 12–17, 2011
• Attention determination for social robots using salient region detection
  Hongsheng He, Zhengchen Zhang, and Shuzhi Sam Ge
  Proceedings of International Conference on Social Robotics (ICSR), 295–304, 2010
• Real-time face detection for human robot interaction
  Yaozhang Pan, Shuzhi Sam Ge, Hongsheng He, and Lei Chen
  IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 1016–1021, 2009
• A hifi simulator for robot soccer
  Guofeng Tong, Hongsheng He, and Zhenzhou Shao.
  Proceedings of the 7th World Congress on Intelligent Control and Automation, 3045–3048, June 25 - 27 2008

Journal

• Relative motion estimation from visual optical flow associated with inertial measurement
  Hongsheng He, Yan Li and Jindong Tan
  Autonomous Robots, 2017
• Data synthesis in the community land model for ecosystem simulation
  Hongsheng He, Dali Wang, Yang Xu, and Jindong Tan
  Journal of Computational Science, 2016
• Dietcam: Multi-view food recognition using a multi-kernel SVM
  Hongsheng He, Fanyu Kong, and Jindong Tan
  IEEE Journal of Biomedical and Health Informatics, 2015
• Recognition of car makes and models using a single traffic camera image
  Hongsheng He, Zhenzhou Shao, and Jindong Tan
  IEEE Transaction on Intelligent Transportation Systems, 2015
• Dietcam: Multi-view regular shape food recognition with a camera phone
  Fanyu Kong, Hongsheng He, Hollie A. Raynor, and Jindong Tan
  Pervasive and Mobile Computing, 19(2):108–121, 2015
• An attention-driven robotic head with biological saccade behaviors for social robots
  Hongsheng He, Shuzhi Sam Ge, and Zhengchen Zhang
  Autonomous Robotics, 36(3):225–240, 2014
• Geometrically local embedding in manifolds for dimension reduction
  Shuzhi Sam Ge, Hongsheng He, and Chengyao Shen
  Pattern Recognition, 45(4):1455–1470, 2012
• Mutual-reinforcement document summarization using embedded graph based sentence clustering for storytelling
  Zhengchen Zhang, Shuzhi Sam Ge, and Hongsheng He
  Information Processing & Management, 48(4):767–778, 2012
• Bottom-up saliency detection for attention determination
  Shuzhi Sam Ge, Hongsheng He, and Zhengchen Zhang
  Machine Vision and Applications, 24(1):103–116, 2011
• Visual attention prediction using saliency determination of scene understanding for social robots
  Hongsheng He, Shuzhi Sam Ge, and Zhengchen Zhang
  International Journal of Social Robotics, 3(4):457–468, 2011
• Implementation of visualized kinematics simulation platform for kld-600 6-dof robot based on matlab
  Xiaoyu Liu and Hongsheng He
  Techniques of Automation and Applications, 30(7):66–68, 2011
•  Robust line detection using two-orthogonal direction image scanning
  Kun Yang, Shuzhi Sam Ge, and Hongsheng He
  Computer Vision and Image Understanding, 115(8):1207–1222, 2011
• New 3d soccer simulator based on microsoft robotics studio
  Guofeng Tong, Hongsheng He, and Zhenzhou Shao
  Journal of University of JINAN (Sci&Tech), 21(S2-0001-05), 200

Book

• Social Robotics
  Arvin Agah, John-John Cabibihan, Ayanna M. Howard, Miguel A. Salichs, and Hongsheng He, Editors
  Lecture Notes in Artificial Intelligence (LNAI), Springer, 2016
• Visual attention and perception in scene understanding for social robotics
  Hongsheng He
  PhD thesis, Department of Electrical and Computer Engineering, National University of Singapore, 2012

• Assistant Professor Wichita State University, Wichita 2017–present
• Research Assistant Professor The University of Tennessee, Knoxville 2016–2017
• Research Associate & Lecturer The University of Tennessee, Knoxville 2013-2016
• Visiting Professor Northeastern University, Shenyang, China 10/2012-1/2013

•  John A See Innovation Award, 2021
• IEEE-HKN Award, Department of Electrical Engineering and Computer Science, WSU, 2019
• Notable Reviewer, International Journal of Social Robotics, Springer 2015
• Silver Medal, Robotic Competition: Microsoft Wheeled-Robot Soccer Simulation, Robocup, 2010

• Eye-in-hand Visual Inertial Measurement Unit
  Hongsheng He and Jian Lu
  US Provisional Patent, No. 62398536, 2016
•  Method of Estimating Relative Motion Using a Visual-Inertial Sensor
  Hongsheng He and Jindong Tan
  US Provisional Patent, No. 62393338, 2016
• Method of Depth Estimation Using a Camera and Inertial Sensor
  Hongsheng He
  US Provisional Patent, No. 62403230, 2016
• Human Motion Capture and Modeling with Wearable Inertial Sensors
  Hongsheng He, Jindong Tan, Xi Chen, and Xiaodong Yang
  UT Research Foundation, 16049-03, 2015
• Automatic Calibration of Visual and Inertial Sensors
  Hongsheng He, Jindong Tan, and Yan Li
  UT Research Foundation, 16060-03, 2015
• Fast Visual System of Design and Evaluation for Automation Education
  Z. Fang, T. Chai, L. Wang, S. Ge, H. He, Z. Li, H. Lv
  Patent, No. ZL 200810012934.1, CN 100590678C, 2010.2.17

K12: Innovation Hub Outreach

On 5/16/2018, an outreach event is hold in the Experiential Engineering Building, room 105. There are 65 third to fifth graders from Wichita local schools came to join this event. The principle of this event is about giving introduction about working machanism of basic robot. The Robotic Intelligence Lab provided several Nao robot demonstrations for the event. Demonstrations were including communications with Nao robot in natural language. Nao robot execute several functions such as dance in Gangnam style, walk and high five by given natural language orders are included as well. These demonstrations can not only enhance the understanding the basic of robotics but also can increase student's learning interests.

 

Research Experiences for Undergraduates (REU) NetCPS Program

Wichita State University's Research Experiences for Undergraduates in NetCPS program is an opportunity for undergraduate students to spend a summer working with faculty researchers renowned in areas such as computer networks, mobile computing, wireless communications, and information security and privacy. A number of projects are available in diverse areas. Accepted students will work closely with WSU faculty and researchers on research problems with the potential for publications and significant impact on the future practice of various networked CPS.
More information at: https://wichita.edu/?u=netcpsreu&p=/index/

• Project 6: Wearable Motion Understanding Using Body Sensor Networks
  REU students will learn and develop sensor fusion and machine learning algorithms for wearable computing. Students will study one or more of the following aspects as part of this project: (i) dynamics measurement using inertial sensors; (ii) body motion tracing using wearable sensor networks; and (iii) wearable motion understanding.
• Project 7: Natural Human-Robot Interaction Using Natural Languages
  REU students will learn and develop robotics and natural-language-processing algorithms for human-robot interaction. Students will have chances to work with an Nao humanoid robot and a Sawyer robot. Students will study one or more of the following aspects as part of this project: (i) natural language processing of human commands; (ii) parsing of human commands into robot actions; and (iii) command grounding through learning.

IEEE HKN Faculty Workshop on Robotics

The laboratory continues developing and participating in research programs to involve both graduate and undergraduate students into lab research. On 4/18/2018, Dr. He gave a lecture on intelligent robotics and Robot Operating System (ROS), and two PhD students provided several demonstrations on the Nao robot and the Sawyer robot. There were 22 graduate and undergraduate students from Wichita State University participating in the event. Nao robot executed several functions such as dance, walk and tracking a ball by given natural language orders. This event is expected to enhance the understanding of the basic of robotics and student's interests. Dr. He will keep recruiting students from local schools and make them gain first-hand hands-on experiences related to the collaborative robotics technologies using hardware and software developed in the proposed research work.

 

Real Men Real Heroes Mentoring Program for African American Boys

On 2/2/2019, The Robotic Intelligence Laboratory participated a mentoring program for African American boys. The program mainly aimmed to attract students to STEM studies and develop an interest in engineering topics. Around 50 students attended this event. Dr. He introduced human-robot interaction and presented sevral demostrations of a Nao robot. Demostrations included the Nao robot communicating with natural language instructions, dancing, and socially interacting such as "high-five".

 

 

• Award Committee Chair, School of Computing, Wichita State University, 2020–present
• Award Committee, College of Engineering, Wichita State University, 2020–present
•  Chair Search Committee, EECS Department, Wichita State University, 2017–2018
•  IEEE Senior Member (Institute of Electrical and Electronics Engineers)
• Member of Association for Unmanned Vehicle Systems International (AUVSI)

PhD Students

Hui Li

• In-Hand Perception for Deterous Manipulation Using Anthropomorphic Robotic Hands
• Contact hxli4@shockers.wichita.edu.

Fujian Yan

• Robotic Programing Using Controlled Natural Languages
• Contact fxyan@shockers.wichita.edu.

Master Students

Achyutha Bharath Rao

• Learning Robotic Grasping Using Natural Language Descriptions
• Contact axbharathrao@shockers.wichita.edu.

Undergraduate Students

Abishek Gomes

 

• Robotic Programing Using Controlled Natural Languages
• Contact asgomes2@shockers.wichita.edu.

Dang Minh Tran

 

• Natural Language Processing and Discourse Represent Theory
• Contact dmtran3@shockers.wichita.edu.

Visiting Students

Dustin Wilson

 

• Understanding Object Relations for Robot Scene Understanding.
• Contact dustin5282@gmail.com.

Thomas Russo

 

• Mining Object Properties for Detexterous Manipulation
• Contact trusso1@uwyo.edu.