Interactive Robot Task Learning: Human Teaching Proficiency with Different Feedback Approaches

Lukas Hindemith, Oleksandra Bruns, Arthur Maximilian Noller, Nikolas Hemion, Sebastian Schneider, Anna Lisa Vollmer

Research output: Contribution to journalArticlepeer-review

Abstract

The deployment of versatile robot systems in diverse environments requires intuitive approaches for humans to flexibly teach them new skills. In our present work, we investigate different user feedback types to teach a real robot a new movement skill. We compare feedback as star ratings on an absolute scale for single roll-outs versus preference-based feedback for pairwise comparisons with respective optimization algorithms (i.e., a variation of co-variance matrix adaptation -evolution strategy (CMA-ES) and random optimization) to teach the robot the game of skill cup-and-ball. In an experimental investigation with users, we investigated the influence of the feedback type on the user experience of interacting with the different interfaces and the performance of the learning systems. While there is no significant difference for the subjective user experience between the conditions, there is a significant difference in learning performance. The preference-based system learned the task quicker, but this did not influence the users’ evaluation of it. In a follow-up study, we confirmed that the difference in learning performance indeed can be attributed to the human users’ performance.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Transactions on Cognitive and Developmental Systems
DOIs
StateAccepted/In press - 2022
Externally publishedYes

Keywords

  • Behavioral sciences
  • Cost function
  • Education
  • Games
  • Human Feedback
  • Human-Robot Interaction Study
  • Human-in-the-loop robot learning
  • Interactive Machine Learning
  • Learning from Demonstration
  • Preference Learning
  • Programming by Demonstration
  • Radial Basis Function Network
  • Robot learning
  • Robots
  • Task analysis
  • User Study

Fingerprint

Dive into the research topics of 'Interactive Robot Task Learning: Human Teaching Proficiency with Different Feedback Approaches'. Together they form a unique fingerprint.

Cite this