Observing People's Behaviors in Public Spaces for Initiating Proactive Human-Robot Interaction by Social Robots

• Material Type: 博士論文
• Title: Observing People's Behaviors in Public Spaces for Initiating Proactive Human-Robot Interaction by Social Robots
• Author/Editor: MD., GOLAM RASHED
• Author Heading: MD., GOLAM RASHED
• Publication, Distribution, etc.: 埼玉大学大学院理工学研究科
• Publication Date: 2016
• Publication Date (W3CDTF): 2016
• Alternative Title: ソーシャルロボットによる能動的なHRIの始動のための公共空間における人々の動きの観察
• Periodical title: 博士論文（埼玉大学大学院理工学研究科（博士後期課程））
• Degree grantor/type: 埼玉大学
• Date Granted: 2016-09-23
• Date Granted (W3CDTF): 2016-09-23
• Dissertation Number: 甲第1036号
• Degree Type: 博士(学術)
• Conferring No. (Dissertation): 甲第1036号
• Text Language Code: eng
• Subject Heading: HRI; network enabled sensing system; human behavior tracking; local behavior; global behavior; VFOA; gaze direction; head orientation; walking trajectory patterns; stereotypical movements; network enabled HRI system; museum; visiting styles; animal behaviors; museum guide robot; LIDARs; art gallery visitor; participants impressions; accuracy index; evaluation
• Target Audience: 一般
• Note (General): type:text; Traditionally, humans have viewed robots as a “mechanical machines”, designed to perform a variety of industrial tasks. But within the last decades, the reality of robots is quite different from the traditional view and has enabled us to start developing social robots to support humans in their daily activities. The concept of the social robot is rapidly emerging and gradually being introduced as a part of human society where interaction among humans and social robots seems to be important to provide mental, communicational, and physical support to humans in society. As a consequence, many social robots have already been deployed in social spaces, where humans interact with reactive services in which social robots wait until the human proactively seeks services. Nevertheless, nowadays we are moving in a direction where we introduce social robots in social spaces with the ability to proactively offer services to humans in which social robots estimate human intentions, and can offer services only to those who would need it. To achieve such capabilities, social robots should have the capacity to observe human behaviors so that they can easily identify humans who are in need. But, observing human behaviors is a challenging task for social robots. This dissertation deals with making human-robot interaction systems capable of observing human behaviors so that social robots can understand their intentions, interests, and preferences concerning surrounding environments. Our findings will help social robots to proactively offer services to those humans who may want to be serviced. In this dissertation, a real life museum guide robot scenario is considered as a testbed for my proactive social robotics research.The first part of the work is on developing a guide robot system which observes people’s interests and intentions towards paintings in museum scenarios and proactively offers guidance to them using a guide robot, if needed. To do that, multiple USB video camera sensors are utilized to support the guide robot in detecting and tracking people’s visual focus of attention (VFOA) toward paintings. Further, each person’s head orientation and profile information and computed importance values are considered as local behavior to identify a target-person that may be interested in a particular painting. After identifying the target-person, the guide robot moves autonomously through an appropriate motion path from the so called public-distance to his/her social-distance to explain details about the painting to which s/he is interested. Furthermore, the viability of the proposed guide robot system is demonstrated by experimenting with the Robovie-R3 as a museum guide robot. Finally, the system is tested to validate its effectiveness. Continuing to improve the recognition of people’s interests, intentions, and preferences concerning paintings in the museum, a network enabled sensing system is designed and implemented by incorporating different sensing modalities in combination where sensors are distributed in the environments as opposed to conventional sensing systems that are usually on-board the robot. This network enabled sensing system may assist the guide robot to recognize human intentions before proactively approaching people that may want guidance or commentary about the paintings. To do that, first, observational experiments are conducted in a museum with participants. From these experiments, mainly three kinds of walking trajectory patterns are found, which characterize global behavior, and additionally, visual attentional information are also found that indicates the local behavior of the people. These behaviors ultimately indicate whether certain people are interested in the exhibits and could benefit from the guide robot system providing additional details about the paintings. Based on the findings, a network enabled Human Robot Interaction (HRI) system is designed and implemented for the museum. Finally, the viability of the proposed HRI system is demonstrated by experimenting with a set of Desktop Robots as guide robots. Experiments reveal that the proposed HRI system is effective for the network enabled Desktop Robots to proactively provide guidance.To detect and track all the people inside any real public social spaces for reading an individual’s interests, intentions as well as extracting knowledge on their actual expectations from their surroundings, a social robot should have robust human sensing systems. Most state-of-the-art human sensing systems fail to track any initially detected person, especially in crowded large scale social spaces where potential partial and full occlusion between persons and/or objects frequently happen. To combat this issue in observing people’s behaviors for social robots, in the final part of this dissertation, a new method is introduced which uses LIDAR to identify humans and track their positions, body orientation, and movement trajectories in any public space to read their various types of behavioral responses to surroundings. We install a network of LIDAR poles at the shoulder level of typical adults to reduce potential occlusion between persons and/or objects even in large scale social environments. With this arrangement, a simple but effective human tracking method is proposed that works by combining multiple sensors’ data so that large-scale areas can be covered. How valuable information related to people’s behaviors can be autonomously collected and analyzed using this method is also described. Additionally, a solution to visualize people’s movement patterns and preferences with respect to any social space is presented. Thereafter, the effectiveness of the proposed human detection and tracking method is evaluated in an art gallery of a real museum. Ultimately, results revealed good human tracking performance and provided valuable behavioral information related to the art gallery which are very important to deploy in any museum guide robot system in the future.; Dedication iAcknowledgement iiAbstract ivContents viiiList of Figures xiiList of Tables xvi1 Introduction 11.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11.2 Objectives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31.3 Research Contribution . . . . . . . . . . . . . . . . . . . . . . . . 41.4 Organization of Sections . . . . . . . . . . . . . . . . . . . . . . . 52 Interdisciplinary Background 72.1 Definitions of Social Robots . . . . . . . . . . . . . . . . . . . . . 82.1.0.1 Socially Interactive Robots . . . . . . . . . . . . 82.1.0.2 Sociable Robots . . . . . . . . . . . . . . . . . . . 82.1.0.3 Design-Centered Social Robots . . . . . . . . . . 92.1.1 Towards a Definition of Social Robots . . . . . . . . . . . . 92.2 Potential Applications of Social Robots . . . . . . . . . . . . . . . 102.2.1 Guidance Services . . . . . . . . . . . . . . . . . . . . . . . 102.2.2 Informational Services . . . . . . . . . . . . . . . . . . . . 102.2.3 Assistance . . . . . . . . . . . . . . . . . . . . . . . . . . . 112.2.4 Entertainment Services and Companionship . . . . . . . . 122.2.5 Autism Therapy . . . . . . . . . . . . . . . . . . . . . . . 122.2.6 Peer, Tool, Tutorship in Education . . . . . . . . . . . . . 132.3 Human Robot Interaction . . . . . . . . . . . . . . . . . . . . . . 132.3.1 Human Detection and Tracking in Spaces . . . . . . . . . . 192.3.1.1 Vision Based System: . . . . . . . . . . . . . . . 192.3.1.2 Laser Based System . . . . . . . . . . . . . . . . 212.3.1.3 3-D Range Based System . . . . . . . . . . . . . 222.3.1.4 Ubiquitous Sensor Based System . . . . . . . . . 222.3.1.5 Different Sensing Modalities in Combination . . . 232.3.1.6 Occlusion Problems and Handling in Human Detection and Tracking . . . . . . . . . . . . . . . . 242.3.2 Human Intention Recognition in HRI . . . . . . . . . . . . 252.3.3 Designing the Social Robot’s Behaviors . . . . . . . . . . . 282.3.4 Interaction Between Humans and Social Robots . . . . . . 312.4 Tracking Human Behaviors in the Museum . . . . . . . . . . . . . 332.5 Museum Guide Robot . . . . . . . . . . . . . . . . . . . . . . . . 342.6 Overall Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . 353 A Vision Based Guide Robot System: Initiating Proactive Social Human Robot Interaction in Museum Scenarios 363.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 363.2 Proposed Guide Robot System . . . . . . . . . . . . . . . . . . . . 393.2.1 People Detection and Tracking Framework . . . . . . . . . 403.2.1.1 Target-Person Selection Procedure . . . . . . . . 403.2.1.2 Recognition of Target Person’s VFOA . . . . . 423.2.2 Guide Robot’s Motion Path Planning . . . . . . . . . . . . 433.3 System Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . 453.3.1 Experiment Design . . . . . . . . . . . . . . . . . . . . . . 463.3.2 Experimental Cases . . . . . . . . . . . . . . . . . . . . . . 463.3.3 Measurements . . . . . . . . . . . . . . . . . . . . . . . . . 483.3.3.1 People’s Impression . . . . . . . . . . . . . . . . . 483.3.3.2 Success Rate . . . . . . . . . . . . . . . . . . . . 483.3.4 Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 493.3.4.1 People’s Impression: . . . . . . . . . . . . . . . . 493.3.4.2 Success Rate . . . . . . . . . . . . . . . . . . . . 513.4 Chapter Summary . . . . . . . . . . . . . . . . . . . . . . . . . . 513.4.1 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . 524 Network Guide Robot System Proactively Initiating Interaction with Humans Based on Their Local and Global Behaviors 534.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 534.2 Observational Experiments . . . . . . . . . . . . . . . . . . . . . . 554.2.1 Findings of Conducted Observation Experiments . . . . . . 574.3 Proposed HRI System . . . . . . . . . . . . . . . . . . . . . . . . 594.3.1 Server Sub-System (SSS) . . . . . . . . . . . . . . . . . . . 614.3.1.1 Global Behavior Tracking Unit (GBTU). . . . . . 614.3.2 Client Sub-System (CSS) . . . . . . . . . . . . . . . . . . . 634.3.2.1 Local Behavior Tracking Unit (LBTU). . . . . . . 634.3.2.2 Robot Control Unit (RCU). . . . . . . . . . . . . 654.4 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 674.4.1 Demonstration using Guide Robots. . . . . . . . . . . . . . 684.4.1.1 Case-1. . . . . . . . . . . . . . . . . . . . . . . . 694.4.1.2 Case-2. . . . . . . . . . . . . . . . . . . . . . . . 704.5 Chapter Summary . . . . . . . . . . . . . . . . . . . . . . . . . . 724.5.1 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . 725 Robustly Tracking People with LIDARs in a Crowded Museum for Behavioral Analysis 735.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 735.1.1 Importance of Tracking Museum visitors . . . . . . . . . . 745.2 Drawbacks of a Human Tracking Method . . . . . . . . . . . . . 765.3 Extended Human Tracking System: Proposed Approach . . . . . 775.3.1 Likelihood Computing Model . . . . . . . . . . . . . . . . 795.3.2 Reassigning Unique-ID to a Temporarily Lost Person . . . 825.4 Art Gallery Installation . . . . . . . . . . . . . . . . . . . . . . . . 855.4.1 Tracking System Setup . . . . . . . . . . . . . . . . . . . . 855.4.2 Tracking Accuracy Evaluation . . . . . . . . . . . . . . . . 885.4.2.1 Visualization of Visitors’ Movement Patterns and Preferences to Exhibits . . . . . . . . . . . . . . . 915.4.3 Application of the proposed System for the MPs: Statistical Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . 925.4.4 Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . 945.5 Chapter Summary . . . . . . . . . . . . . . . . . . . . . . . . . . 955.5.1 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . 966 Conclusions 976.1 Methodological Contributions . . . . . . . . . . . . . . . . . . . . 986.2 Theoretical Contributions . . . . . . . . . . . . . . . . . . . . . . 986.3 Technical Contributions . . . . . . . . . . . . . . . . . . . . . . . 996.4 Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1016.5 Closing Remarks . . . . . . . . . . . . . . . . . . . . . . . . . . . 103A Data Collection Techniques 104References 108; 主指導教員 : 久野義徳
• DOI: 10.24561/00010426; https://doi.org/10.24561/00010426
• Persistent ID (NDL): info:ndljp/pid/10952390; https://dl.ndl.go.jp/pid/10952390
• Collection: 障害者向け資料
• Collection (Materials For Handicapped People:1): テキストデータ
• Collection (particular): 国立国会図書館デジタルコレクション > デジタル化資料 > 博士論文; https://dl.ndl.go.jp/collections/A00014
• Acquisition Basis: 博士論文（自動収集）
• Date Accepted (W3CDTF): 2017-09-02T15:28:24+09:00
• Date Created (W3CDTF): 2017-07-19
• Format (IMT): application/pdf
• Access Restrictions: 国立国会図書館内限定公開
• Service for the Digitized Contents Transmission Service: 図書館・個人送信対象外
• Availability of remote photoduplication service: 可
• Periodical Title (URI): http://dx.doi.org/10.24561/00010426; http://id.nii.ac.jp/1586/00010426/
• Data Provider (Database): 国立国会図書館 : 国立国会図書館デジタルコレクション; https://dl.ndl.go.jp

Table of Contents

2023-09-05 再収集