Real-Time Simulation of Deformable Tactile Sensors in Robotic Grasping using Graph Neural Networks with Inductive Biases

1Ecole Centrale de Lyon, 2Technical University of Darmstadt 3University Claude Bernard Lyon 1 *Equal contributions

Poster Preview

Soft Body Grasping

Ground truth (FEM) vs. GNN prediction

Apple3 ground truth

Ground Truth (FEM)

Apple3 prediction

GNN Prediction

Apple

Ellipsoid ground truth

Ground Truth (FEM)

Ellipsoid prediction

GNN Prediction

Ellipsoid

Lemon ground truth

Ground Truth (FEM)

Lemon prediction

GNN Prediction

Lemon

Cucumber ground truth

Ground Truth (FEM)

Cucumber prediction

GNN Prediction

Cucumber

Rigid Body Grasping with Soft Visual Tactile Sensor

Tactile sensor deformation – Ground truth vs. GNN prediction

Lemon traj06 GT

Ground Truth (FEM)

Lemon traj06 pred

GNN Prediction

Lemon grasp (traj06)

Strawberry traj05 GT

Ground Truth (FEM)

Strawberry traj05 pred

GNN Prediction

Strawberry grasp (traj05)

Lemon traj26 GT

Ground Truth (FEM)

Lemon traj26 pred

GNN Prediction

Lemon stress (traj26)

Lemon undeformed traj07 GT

Ground Truth (FEM)

Lemon undeformed traj07 pred

GNN Prediction

Lemon undeformed (traj07)

BibTeX

@inproceedings{
duret2025realtime,
title={Real-Time Simulation of Deformable Tactile Sensors in Robotic Grasping using Graph Neural Networks},
author={Guillaume Duret and Danylo Mazurak and Frederik heller and Florence Zara and Jan Peters and Liming Chen},
booktitle={IROS 2025 Workshop on Tactile Sensing Toward Robot Dexterity and Intelligence},
year={2025},
url={https://openreview.net/forum?id=9lTIfriAjP}
}

@inproceedings{
heller2025inductive,
title={Inductive Biases for Predicting Deformation and Stress in Deformable Object Grasps with Graph Neural Networks},
author={Frederik Heller and Alap Kshirsagar and Tim Schneider and Guillaume Duret and Jan Peters},
booktitle={IROS 2025 - 5th Workshop on RObotic MAnipulation of Deformable Objects: holistic approaches and challenges forward},
year={2025},
url={https://openreview.net/forum?id=eTLSEx020o}
}

@inproceedings{
duret2026softrobotics,
title={Real-Time Simulation of Deformable Tactile Sensors and Objects in Robotic Grasping using Graph Neural Networks with Inductive Biases},
author={Guillaume Duret and Frederik Heller and Danylo Mazurak and Alap Kshirsagar and Tim Schneider and others},
booktitle={9th IEEE-RAS International Conference on Soft Robotics (RoboSoft 2026)},
year={2026},
month={April},
address={Kanazawa, Japan}
}