Access to this article is restricted until 12 months after publication by request of the publisher. Restriction lift date: 2025-10-14
A digital twin of intelligent robotic grasping based on single-loop-optimized differentiable architecture search and sim-real collaborative learning
Loading...
Files
Date
2024-10-14
Authors
Jiao, Qing
Hu, Weifei
Hao, Guangbo
Cheng, Jin
Peng, Xiang
Liu, Zhenyu
Tan, Jianrong
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Nature
Published Version
Abstract
The effectiveness of deep learning models for vision-based intelligent robotic grasping (IRG) tasks typically hinges upon the deep neural network (DNN) architecture as well as the task-oriented annotated training samples. Nevertheless, current methods applied for designing DNN architectures depend on human expertise or discrete search by evolution and reinforcement learning algorithms, which leads to enormous computational cost. Moreover, DNNs trained solely on simulation-labeled data face challenges in direct real-world deployment. In response to these concerns, this paper proposes a new stable and fast differentiable architecture search method (DARTS) based on a single-loop optimization framework, named single-loop-optimized DARTS (SLO-DARTS). This method enables simultaneous updates to the weights and architecture parameters of neural networks by continuously relaxing the discrete search space. Additionally, a digital twin (DT) framework integrating the Grasp-CycleGAN method is developed to minimize the visual gap between simulated and real-world IRG scenarios, enhancing the transferability of DNNs trained in simulation. The DT framework can not only enhance the IRG accuracy but also save the costly expense of large-scale real labeled data collection. Experiments demonstrate that the proposed SLO-DARTS method achieves a time-efficient optimization process while delivering a DNN with improved prediction accuracy compared to the original dual-loop-optimized DARTS method. The developed DT framework produces IRG accuracies of 92.6%, 86.3%, and 83.7% for single household objects, single adversarial objects, and cluttered objects, respectively.
Description
Keywords
Robotic grasping , Deep neural network , Architecture search , Collaborative learning , Digital twin , Automatic design
Citation
Jiao, Q., Hu, W., Hao, G., Cheng, J., Peng, X., Liu, Z. and Tan, J. (2024) 'A digital twin of intelligent robotic grasping based on single-loop-optimized differentiable architecture search and sim-real collaborative learning', Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-024-02498-w
Link to publisher’s version
Copyright
© 2024, the Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024. This is a post-peer-review, pre-copyedit version of an article published in the Journal of Intelligent Manufacturing. The final authenticated version is available online at: https://doi.org/10.1007/s10845-024-02498-w