NSSC OpenIR  > 空间技术部
Augmented Virtuality for Model-Based Teleoperation
Vagvolgyi, Balazs; Niu, Wenlong; Chen, Zihan; Wilkening, Paul; Kazanzides, Peter
AbstractGround-based teleoperation of robots in space is subject to time delays of several seconds or more. This leads to the use of model-based approaches, where the operator interacts with a model (simulation) of the remote environment and the remote robot attempts to reproduce the results of that interaction. But, it is also desirable for the operator to view (delayed) images from the remote scene. These images, however, are often from one or more monocular cameras mounted on the robot end-effector, which leads to several other problems: unintuitive teleoperation due to the eye-in-hand configuration, limited field of view, and lack of stereo visualization. We present an augmented virtuality interface for teleoperation, which can solve these problems by projecting the real camera images onto a registered 3D model of the environment and allowing the operator to select any desired viewpoint. This approach is suitable when there is at least a partial model of the environment, as is the case for satellite servicing. The proposed method begins with a video survey to register the 3D model to the physical environment, followed by a user interface that presents a stereo visualization of the model, augmented by projections of real camera images onto the model. We quantitatively and qualitatively compare the augmented virtuality images to real camera images taken from the same viewpoint and perform experiments to evaluate the efficacy of the augmented virtuality paradigm for teleoperation. The results suggest that this approach can improve operator situation awareness, potentially leading to better performance, especially when the camera views are unintuitive or limited.
Conference NameIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Conference DateSEP 24-28, 2017
Conference PlaceVancouver, CANADA
Indexed ByCPCI
Document Type会议论文
Recommended Citation
GB/T 7714
Vagvolgyi, Balazs,Niu, Wenlong,Chen, Zihan,et al. Augmented Virtuality for Model-Based Teleoperation[C],2017:3826-3833.
Files in This Item:
File Name/Size DocType Version Access License
201708206233.pdf(2461KB)会议论文 开放获取CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Vagvolgyi, Balazs]'s Articles
[Niu, Wenlong]'s Articles
[Chen, Zihan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Vagvolgyi, Balazs]'s Articles
[Niu, Wenlong]'s Articles
[Chen, Zihan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Vagvolgyi, Balazs]'s Articles
[Niu, Wenlong]'s Articles
[Chen, Zihan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.