LEARNING FROM NATURAL HUMAN INTERACTIONS FOR ASSISTIVE ROBOTS
- Project Research
- 1-5 Chapters
- Abstract : Available
- Table of Content: Available
- Reference Style: APA
- Recommended for : Student Researchers
- NGN 3000
ABSTRACT.
In our everyday lives, we interact with agents like personal computers, search engines, cars, etc., and reveal many of our personal choices, biases, and preferences. Improving agents by analyzing their interactions with humans is an active area of research. However, the algorithmic and systems challenges involved in interactive learning varies with the application. For example, there has been significant advances in learning from humans for information retrieval tasks such as recommendation systems [82, 126], ranking documents [102, 105, 199], etc. This is primarily due to the availability of scalable and easy-to-use interaction mechanisms (like search engines) that reap massive logs of interaction data. As things stand in robotics, interactive learning is in its early stages due to the involved systems challenges, data scarcity, scaling difficulties, and the multi-modal nature of robotics problems. Nonetheless, learning from humans is a necessary step to unlock natural human-robot interactions with applications ranging from household robots to autonomous cars. Interactive human-robot learning presents new opportunities for developing novel interaction mechanisms, algorithms for sensory-fusion, and learning preferences grounded in the physical-world. In this dissertation we study algorithms and applications of interactive learning between humans and robots. Figure 1.1 demonstrates two examples of interactions: one between a human and a household robot (Baxter) and another between a human driver and the car. In order for the agents (robot or car) to learn from such interactions, we address questions like: 1 0.1 0.2 0.7 Face Camera Road Camera Figure 1.1: Robot and human interactions • How do we design interaction mechanisms that are easy to use by non-expert users? • How do we build learning algorithms that can learn from weak human signals? • How do we model the rich spatio-temporal interactions using deep neural networks? 1.1 Robots and humans: Interactive learning In order for robots to operate autonomously, they need to learn many concepts about our physical world. The skills they should acquire ranges from perception to performing actions in the human environment. While several skills can be learned from large annotated databases (e.g. object detection using Imagenet [46]), many others require the robot to observe and interact with humans. In this dissertation we focus on skills that robots learn by interacting with humans. This includes learning context dependent actions, understanding and anticipating human behaviour, and generating desirable motions to fulfill tasks. 2 The interaction mechanism between the human and the robot is also an important aspect to consider. First, the interaction being analyzed should vary based on the application and the nature of skill that the robot wants to learn. Second, it should also take into account the sub-optimality of human signals. In this dissertation we address several human-robot interactive learning problems and propose mechanisms for eliciting human signals. We focus on learning from non-expert users and build interaction mechanisms that are easy-to-use – often as easy as a clicking a mouse – to widely elicit user interaction. Figure 1.1 shows some examples of robots interacting with humans. When interacting with robotic manipulators with high degrees-of-freedom, it becomes challenging for non-expert users to provide optimal kinesthetic demonstrations. In chapter 2 & 3, we consider such robotic manipulation and navigation tasks and learn user preferences over robot trajectories. We propose multiple easy-to-elicit feedback mechanisms and develop algorithms to learn from sub-optimal user feedback. We also develop a crowdsourcing platform to elicit such signals at a large scale. We explore similar kinds of interactive learning for other agents. In chapter 4 we model the commonly occurring interaction between a driver, the car, and their surroundings. We propose a vehicular sensor-rich platform and learning algorithms to anticipate the future maneuvers of the driver several seconds in advance. In our interaction system, we equip a car with cameras, Global Positioning System (GPS), and a computing device. We observe many drivers driving to their destination, and the drivers provide many implicit examples of maneuvers as learning signals (lane changes, turns etc.). In this dissertation we provide insights into developing such interactive 3 Human Object Object Object Spine Left arm Right arm Left leg Right leg Driver Outsid
Related Project Materials
FACTORS MILITATING AGAINST THE TEACHING OF MECHANICAL ENGINEERING CRAFT PRACTICE IN GOVERNMENT TECHNICAL COLLEGES
ABSTRACT
The journey on the path of technical education started as far back as in the 1930’s when...
THE ROLE OF EARLY CHILDHOOD EDUCATION IN EMOTIONAL REGULATION
ABSTRACT: The role of early childhood education in emotional regulation is...
BUDGETING SYSTEM AND BUDGETING CONTROL: AS A MEANS OF IMPROVED PERFORMANCE IN PUBLIC LIMITED COMPANY
ABSTRACT
The need for effective and proper planning necessitated the adoption of budgeting and budgetar...
PHARMACOGNOSTIC AND ANTIULCER EVALUATION OF THE STEM BARK OF PROSOPIS AFRICANA (GUILL. & PERR.) TAUB. (MIMOSACEAE)
Abstract
Prosopis africana (Guill. & Perr.) Taub. (Mimosaceae) is the only known species of its genus found in Africa. Pharmacognosti...
THE ROLE OF MANAGEMENT ACCOUNTING IN SUPPLY CHAIN MANAGEMENT
Abstract:
This study examines the role of management accounting in supply chain management in Lagos Sta...
DEVELOPMENT OF FUNCTIONAL MATERNITY APPARELS FROM COMMERCIAL BLOCKS PATTERNS, FASTENERS AND DISPOSAL OF FULLNESS IN FEDERAL CAPITAL TERRITORY ABUJA, NIGERIA
ABSTRACT
The study focused on theuse ofFasteners and Disposal of Fullness in the Development of Functional Maternity Apparels from Commer...
MANAGEMENT OF ENVIRONMENTAL HEALTH HAZARD IN THE OIL PRODUCING AREAS OF BAYELSA STATE
ABSTRACT:- 1956 oil was first struck in commercial qualities in Oloibiri in the present day Ogbia Local Gove...
CAUSES OF OCCUPATIONAL CHANGE IN SECRETARIAL PROFESSION A CASE STUDY OF INSTITUTE OF MANAGEMENT AND TECHNOLOGY (IMT) ENUGU
ABSTRACT
The topic of the study is causes of occupational change in secretarial profession – A case study of Insti...
INFLUENCE OF CORPORATE SOCIAL RESPONSIBILITY PROGRAMMES OF MULTINATIONAL OIL CORPORATIONS ON HOST COMMUNITIES IN SOUTH-SOUTH, NIGERIA
ABSTRACT
The concept of Corporate Social Responsibility (CSR) embraces the notion that Multinational Oil Corporations (MNCs) have moral a...
DESIGN AND CONSTRUCTION OF AUTOMATIC HAND DRYER WITH TEMPERATURE DISPLAY
ABSTRACT
This project work deals on the design and implementation of an automatic hand-dryer with display capable of drying up a wet hand...
