TY - JOUR
T1 - Natural object manipulation using anthropomorphic robotic hand through deep reinforcement learning and deep grasping probability network
AU - Valarezo Añazco, Edwin
AU - Rivera Lopez, Patricio
AU - Park, Nahyeon
AU - Oh, Jiheon
AU - Ryu, Gahyeon
AU - Al-antari, Mugahed A.
AU - Kim, Tae Seong
N1 - Funding Information:
This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean government (MEST) (NRF-2019R1A2C1003713). Edwin Valarezo Añazco gratefully acknowledges to “Escuela Superior Politécnica del Litoral (ESPOL)” and its excellence program “Walter Valdano Raffo.”
Publisher Copyright:
© 2020, Springer Science+Business Media, LLC, part of Springer Nature.
PY - 2021/2
Y1 - 2021/2
N2 - Human hands can perform complex manipulation of various objects. It is beneficial if anthropomorphic robotic hands can manipulate objects like human hands. However, it is still a challenge due to the high dimensionality and a lack of machine intelligence. In this work, we propose a novel framework based on Deep Reinforcement Learning (DRL) with Deep Grasping Probability Network (DGPN) to grasp and relocate various objects with an anthropomorphic robotic hand much like a human hand. DGPN is used to predict the probability of successful human-like natural grasping based on the priors of human grasping hand poses and object touch areas. Thus, our DRL with DGPN rewards natural grasping hand poses according to object geometry for successful human-like manipulation of objects. The proposed DRL with DGPN is evaluated by grasping and relocating five objects including apple, light bulb, cup, bottle, and can. The performance of our DRL with DGPN is compared with the standard DRL without DGPN. The results show that the standard DRL only achieves an average success rate of 22.60%, whereas our DRL with DGPN achieves 89.40% for the grasping and relocation tasks of the objects.
AB - Human hands can perform complex manipulation of various objects. It is beneficial if anthropomorphic robotic hands can manipulate objects like human hands. However, it is still a challenge due to the high dimensionality and a lack of machine intelligence. In this work, we propose a novel framework based on Deep Reinforcement Learning (DRL) with Deep Grasping Probability Network (DGPN) to grasp and relocate various objects with an anthropomorphic robotic hand much like a human hand. DGPN is used to predict the probability of successful human-like natural grasping based on the priors of human grasping hand poses and object touch areas. Thus, our DRL with DGPN rewards natural grasping hand poses according to object geometry for successful human-like manipulation of objects. The proposed DRL with DGPN is evaluated by grasping and relocating five objects including apple, light bulb, cup, bottle, and can. The performance of our DRL with DGPN is compared with the standard DRL without DGPN. The results show that the standard DRL only achieves an average success rate of 22.60%, whereas our DRL with DGPN achieves 89.40% for the grasping and relocation tasks of the objects.
KW - Anthropomorphic robotic hand
KW - Deep grasping probability network
KW - Deep reinforcement learning
KW - Human grasping hand poses
KW - Natural object grasping and relocation
KW - Natural policy gradient
UR - http://www.scopus.com/inward/record.url?scp=85091086403&partnerID=8YFLogxK
U2 - 10.1007/s10489-020-01870-6
DO - 10.1007/s10489-020-01870-6
M3 - Article
AN - SCOPUS:85091086403
SN - 0924-669X
VL - 51
SP - 1041
EP - 1055
JO - Applied Intelligence
JF - Applied Intelligence
IS - 2
ER -