Dextrous Manipulation

How can we get robots to move stuff around?

The goal of robot manipulation is simple: just move an object from point A to point B. How hard could it be?

A simulated robot hand uses IDTO to perform in-hand manipulation.

Very hard, it turns out. For example, consider the board games chess and Go. These are very challenging games, with more possible games than atoms in the universe, and computers are better than people at both. But in the famous matches where computers first defeated the best human players, it was a human engineer, not a robot, that moved the computer’s pieces.

Computers can beat the best human players at chess and Go, but are still not very good at moving the pieces.

Dextrous manipulation is particularly difficult – and fascinating – because we humans are so good at it. This can blind us to what we’re actually doing. For example, early manipulation research focused a lot on grasping: how to position the fingers around an object, how to plan a collision-free path to that grasp, and so on.

Now there is a growing understanding that this may not be the best approach. When people move stuff around, we rarely search for stable grasps. Instead, we push, pull, shuffle, and slide things into place, constantly shifting between contact modes in complicated and interesting ways.

Image Sources

  1. https://www.pri.org/stories/2018-01-05/garry-kasparov-and-game-artificial-intelligence
  2. https://www.theguardian.com/technology/2016/mar/09/google-deepmind-alphago-ai-defeats-human-lee-sedol-first-game-go-contest

Related Publications

2024

  1. drop_cube.png
    DROP: Dexterous Reorientation via Online Planning
    Albert H Li, Preston Culbertson, Vince Kurtz , and 1 more author
    arXiv preprint, 2024

2023

  1. dual_jaco.png
    Inverse Dynamics Trajectory Optimization for Contact-Implicit Model Predictive Control
    Vince Kurtz, Alejandro Castro, Aykut Özgün Önol , and 1 more author
    arXiv preprint, 2023

2022

  1. contact_surface_composite.png
    Contact-Implicit Trajectory Optimization with Hydroelastic Contact and iLQR
    Vince Kurtz, and Hai Lin
    In International Conference on Intelligent Robots and Systems (IROS) , 2022

2021

  1. passivity_cbf.gif
    Control Barrier Functions for Singularity Avoidance in Passivity-Based Manipulator Control
    Vince Kurtz, Patrick M. Wensing, and Hai Lin
    In Conference on Decision and Control (CDC) , 2021

2020

  1. talos.png
    Trajectory Optimization for High-Dimensional Nonlinear Systems Under STL Specifications
    Vince Kurtz, and Hai Lin
    IEEE Control Systems Letters (L-CSS), 2020