In this virtual research lab, we aim to empower robots with the ability to use general action plans that can be parameterised by various sources into a variation of actionable tasks, particularly in everyday manipulations like cutting, pouring or whisking. These plans enable robots to adapt cutting techniques such as slicing, quartering, and peeling to various fruits or to infer parameters for successful pouring and whisking based on the available ingredients and objects, making abstract knowledge practically applicable in robot perception-action loops.
Show me the plan for the following
Vanessa Hassouna (Robot Action Execution) and Michaela Kümpel (Knowledge Graph Parameters) and
Tel: +49 421 218 64021, +49 421 218 99651Mail: hassouna@cs.uni-bremen.de, michaela.kuempel@cs.uni-bremen.de
Profile Vanessa Hassouna Profile Michaela Kümpel
Interactive Actions and/or Examples
Show me the plan for the followingShow me the plan for the following
For Detailed information click here!
Parameterising General Action Plans with Web Knowledge
To achieve our goal of enabling a robotic agent to handle unkown task variations by parameterising general action plans using web knowledge, we employ the following architecture.
For more information, please check and cite:
Kümpel, Michaela, Töberg, Jan-Phillip, Hassouna, Vanessa, Cimiano, Phillip and Beetz, Michael, “Towards a Knowledge Engineering Methodology for Flexible Robot Manipulation in Everyday Tasks”, In Actionable Knowledge Representation and Reasoning for Robots (AKR^3) at European Semantic Web Conference (ESWC), 2024.
Creating General Action Plans
In general, the robot needs to have access to a general action designator of cutting that can be parameterised. When the robot is given a task request, it can either query the graph database with the knowledge graph directly via its SPARQL REST API or use a knowledge framework with additional functionalities such as the KnowRob knowledge processing system and pose Prolog queries, which then are translated to SPARQL queries. More information on the different ways of querying the knowledge graph can be found here.