• shareshare
  • link
  • cite
  • add
auto_awesome_motion View all 3 versions
Publication . Article . 2018

TeMoto: Intuitive Multi-Range Telerobotic System with Natural Gestural and Verbal Instruction Interface

Robert Valner; Karl Kruusamäe; Mitchell W Pryor;
Open Access
Published: 01 Feb 2018 Journal: Robotics, volume 7, issue 1 (issn: 2218-6581, Copyright policy )
Publisher: MDPI AG
Teleoperated mobile robots, equipped with object manipulation capabilities, provide safe means for executing dangerous tasks in hazardous environments without putting humans at risk. However, mainly due to a communication delay, complex operator interfaces and insufficient Situational Awareness (SA), the task productivity of telerobots remains inferior to human workers. This paper addresses the shortcomings of telerobots by proposing a combined approach of (i) a scalable and intuitive operator interface with gestural and verbal input, (ii) improved Situational Awareness (SA) through sensor fusion according to documented best practices, (iii) integrated virtual fixtures for task simplification and minimizing the operator’s cognitive burden and (iv) integrated semiautonomous behaviors that further reduce cognitive burden and negate the impact of communication delays, execution latency and/or failures. The proposed teleoperation system, TeMoto, is implemented using ROS (Robot Operating System) to ensure hardware agnosticism, extensibility and community access. The operator’s command interface consists of a Leap Motion Controller for hand tracking, Griffin PowerMate USB as turn knob for scaling and a microphone for speech input. TeMoto is evaluated on multiple robots including two mobile manipulator platforms. In addition to standard, task-specific evaluation techniques (completion time, user studies, number of steps, etc.)—which are platform and task dependent and thus difficult to scale—this paper presents additional metrics for evaluating the user interface including task-independent criteria for measuring generalized (i) task completion efficiency and (ii) operator context switching.
Subjects by Vocabulary

Library of Congress Subject Headings: lcsh:Mechanical engineering and machinery lcsh:TJ1-1570

Microsoft Academic Graph classification: Situation awareness Computer science Context switch Mobile robot Interface (computing) Mobile manipulator Task (project management) User interface Human–computer interaction Teleoperation


teleoperation, human-robot interface, supervisory control, natural language input, gesture input, teleoperation; human-robot interface; supervisory control; natural language input; gesture input, Artificial Intelligence, Control and Optimization, Mechanical Engineering

51 references, page 1 of 6

1. De Gregory, J.; Lujan, R.; Haley, D.; Hamel, W. Robotics and intelligent machines: A DOE critical technology roadmap. In Proceedings of the 2001 Waste Management Symposium, Tucson, AZ, USA, 1 March 2001; pp. 1-13.

2. Rimando, R. EM Science of Safety (SoS): Robotics Technology Thrust. DOE National Cleanup Workshop: Alexandria, VA, USA, 15 September 2016. Available online: f33/DOE%20NCW%20-%20160915%20FINAL%20REV01.pdf (accessed on 22 October 2017).

3. Nagatani, K.; Kiribayashi, S.; Okada, Y.; Otake, K.; Yoshida, K.; Tadokoro, S.; Nishimura, T.; Yoshida, T.; Koyanagi, E.; Fukushima, M.; et al. Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots. J. Field Robot. 2013, 30, 44-63. [CrossRef]

4. Asada, H. The Current Status and Future Strategic Plan of Decommissioning of Fukushima Daiichi Nuclear Power Stations Using Remote-Controlled Robot Technology. In Proceedings of the IROS Open Forum on the Future of Robotics and Automation in Nuclear Facilities & Environments, Vancouver, CA, USA, 26 September 2017.

5. Leshin, L.A.; Mahaffy, P.R.; Webster, C.R.; Cabane, M.; Coll, P.; Conrad, P.G.; Archer, P.D.; Atreya, S.K.; Brunner, A.E.; Buch, A.; et al. Volatile, Isotope and Organic Analysis of Martian Fines with the Mars Curiosity Rover. Science 2013, 341, 1238937. [CrossRef] [PubMed]

6. Fong, T.; Zumbado, J.R.; Currie, N.; Mishkin, A.; Akin, D.L. Space Telerobotics: Unique Challenges to Human-Robot Collaboration in Space. Rev. Hum. Factors Ergon. 2013, 9, 6-56. [CrossRef]

7. Palep, J.H. Robotic assisted minimally invasive surgery. J. Minimal Access Surg. 2009, 5, 1-7. [CrossRef] [PubMed] [OpenAIRE]

8. Vandegrift, G.F.; Conner, C.; Hofman, G.L.; Leonard, R.A.; Mutalib, A.; Sedlet, J.; Walker, D.E.; Wiencek, T.C.; Snelgrove, J.L. Modification of Targets and Processes for Conversion of 99Mo Production from High- to Low-Enriched Uranium. Ind. Eng. Chem. Res. 2000, 39, 3140-3145. [CrossRef]

9. Parasuraman, R.; Sheridan, T.B.; Wickens, C.D. A model for types and levels of human interaction with automation. IEEE Trans. Syst. Man Cybern. Part Syst. Hum. 2000, 30, 286-297. [CrossRef]

10. Bruemmer, D.J.; Few, D.A.; Boring, R.L.; Marble, J.L.; Walton, M.C.; Nielsen, C.W. Shared Understanding for Collaborative Control. IEEE Trans. Syst. Man Cybern. Part Syst. Hum. 2005, 35, 494-504. [CrossRef]

Related to Research communities
Social Science and Humanities
Download fromView all 3 sources
License: cc-by
Providers: UnpayWall