A Framework for the Unsupervised Inference of Relations Between Sensed Object Spatial Distributions and Robot Behaviors

Published:

Authors: Christopher Morse, Lu Feng, Matthew Dwyer, Sebastian Elbaum

Abstract:

The spatial distribution of sensed objects strongly influences the behavior of mobile robots. Yet, as robots evolve in complexity to operate in increasingly rich environments, it becomes much more difficult specify the underlying relations between spatial object distributions and robot behavior. We aim to address this challenge by leveraging system trace data to automatically infer relations that help to better characterize these spatial associations. In particular, we introduce SpRInG, a framework for the unsupervised inference of system specifications that characterize the spatial relationships under which a robot operates. Our method builds on a parameterizable notion of reachability to encode relationships of spatial neighborship, which are used to instantiate a language of patterns. These patterns then provide the structure to infer from the traces the connection between such relationships and robot behaviors. We show that SpRInG can automatically infer spatial relations on two distinct domains: autonomous vehicles in traffic and a teleoperated surgical robot. Our results demonstrate the power and expressiveness of SpRInG, in its ability to learn existing system specifications as machine-checkable first-order logic, uncover previously unstated system specifications that are rich and insightful, and reveal contextual differences between executions.

Resources: [Paper] [Repo] [Video]