Grasp Planning and Visual Servoing for an Outdoors Aerial Dual Manipulator

Pablo Ramon-Soria, Begoña C. Arrue, Anibal Ollero

Engineering ›› 2020, Vol. 6 ›› Issue (1) : 77 -88.

PDF (3258KB)
Engineering ›› 2020, Vol. 6 ›› Issue (1) : 77 -88. DOI: 10.1016/j.eng.2019.11.003
Research
Article

Grasp Planning and Visual Servoing for an Outdoors Aerial Dual Manipulator

Author information +
History +
PDF (3258KB)

Abstract

This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object's position. Next, an alignment algorithm is used to obtain the object's six-dimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object's pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV's oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.


Keywords

Aerial manipulation / Grasp planning / Visual servoing

Cite this article

Download citation ▾
Pablo Ramon-Soria, Begoña C. Arrue, Anibal Ollero. Grasp Planning and Visual Servoing for an Outdoors Aerial Dual Manipulator. Engineering, 2020, 6(1): 77-88 DOI:10.1016/j.eng.2019.11.003

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

()

AI Summary AI Mindmap
PDF (3258KB)

2754

Accesses

0

Citation

Detail

Sections
Recommended

AI思维导图

/