2018ISMAR Comparing Different Augmented Reality Support Applications for Cooperative Repair...
目录
ABSTRACT
Introduction
Aim of this study
User study
2.2.1 Head mounted display AR: condition ”HMD”
2.2.2 Projection based AR: condition ”Projection”
2.2.3 AR on tablet computer: conditions ”Video”, ”Screenshot” and ”Tracking”
2.2.4 Audio-only: condition ”Phone”
Results
SUMMARY AND CONCLUSION
ABSTRACT
Digitization and the growing capabilities of data networks enable companies to perform tasks via remote support, which previously
required service personnel to travel. But which mixed reality method leads to better results regarding human factors, grounding and performance criteria? This paper reports on a collaborative user study, in which a local worker is guided by a remote expert with the help of different augmented reality methods, specifically see-through HMD, spatial projection, and video-mixing tablet. The task to perform is the exchange of a controller in a switch cabinet of an industrial robot, a task rather typical for failure detection within the field. Our study was conducted in collaboration with a technician school, where 50 technician apprentices participated in our study. Our results show clear advantages of using augmented reality (AR) versus traditional conditions (audio, video, screenshot) to enable remote support. It further gives significant indications for using a projection based AR method.
Introduction
This paper reports on the development and evaluation of three different AR-methods targeting the local collaborator at the production site who is assisted by a remote expert. The three systems are based on (1) tablet-based AR, (2) optical see-through AR, and (3) projection-based AR. We compare these approaches with typical usability measures of humancomputer interaction (e.g., QUESI, NASA-TLX, ISONORM, etc.) and highlight pros and cons of each approach.
Aim of this study
Before the experiment, we formulated the following hypotheses:
• Participants wearing augmented reality glasses (head mounted display, HMD) are likely to perform the task quicker than when using other applications, because the user does not need to put the tablet out of hand or bend back for the projection based method. That is also why we think that of all tested variants, the HMD will provide the best support for building up situation awareness and grounding.
• The participants might prefer to use the projection based method, because it is more intuitive and requires a lower task
load. We think that this is due to the fact that it provides the most stable information presentation and is easiest to use, as
the worker does not need to do much on his or her own. This will show in the values for the questionnaires.
• For the grounding we assume that the HMD is the best solution for supporting both workers. It is the only application which
provides a continuous view for the expert and we also presume that this first person viewpoint enables the expert to help the
participant in a better way.
User study
2.2 Experimental setup
2.2.1 Head mounted display AR: condition ”HMD”
A head mounted display (HMD) is a display device worn on the
head or as part of a helmet, that has a small display optic in front
of one (monocular HMD) or each eye (binocular HMD). For this
experiment we used the Epson Moverio BT200, which is shown in
Fig. 2. Those are glasses which have a LCD polysilicium display
integrated for each eye, illuminated by mini projectors on the rim.
The displays provide a resolution of 960x540 pixels and cover 23
percent of the field of view. There is an external control device with
a touchpad, using a 1.2GHz dual-core-processor and 1GB RAM. It
uses Android 4.0.4.
The Android application connects to the expert’s Desktop PC
application, which is displayed in Fig. 1 via Wi-Fi and tries to
visually track camera picture features at the location of the expert’s
annotations. We have published a separate paper about the tracking
algorithms [11].
2.2.2 Projection based AR: condition ”Projection”
The projection based augmented reality application (or spatial augmented reality application [2]) uses a Panasonic PT-VZ575N projector with a resolution of 1920x1200 pixels. The setup is displayed
in Fig. 3: Mounted rigidly to the projector is a PointGrey Blackfly camera that offers a static third person perspective of the work
surface. After the camera and the projector have been calibrated, a
Structured Light approach is used to gather a surface model of the
working site. With the help of this model, the expert can directly
send visual instructions to the surface of the working environment,
which is displayed in Fig. 4. The worker also can use a pointing
device tracked by a Polaris Spectra system in order to visualize his
view. More publications to this specific setup can be found at [9].
2.2.3 AR on tablet computer: conditions ”Video”, ”Screenshot” and ”Tracking”
Tablet PCs have been commercially available for several years and
are regularly used in everyday life as well as in industrial settings.
This is why this device serves as a representative of the current
common practice in industry, and its performance in the described
experiment is also meant to encourage more computer supported
collaborative work with a shared visual view in the field. In our prior
work, we used tablet computers for cooperative work in an active
production environment [1].
This is also one reason why we compared three different applications running on the tablet PC: a version which provides just the
camera picture, a version which enables the expert to make a screenshot and annotate it (see Fig. 5) and a permanent tracking approach
(see Fig. 6). The latter figure also shows that the tablet PC needs to
be placed on the ground during the actual repair work.
We use a ASUS MEMO ME302C Tablet with an 1.6GHz Intel
Atom Z2560 Processor with 2GB RAM. The device runs Android
4.3 and the display has a resolution of 1920x1200 pixels.
2.2.4 Audio-only: condition ”Phone”
In order to provide a baseline to the AR application experiments,
we chose contact between worker and expert without shared visual
context by introducing a ”telephone” condition. In our experimental
setup, both users cannot see each other (see Fig. 7) but can have a
normal conversation in the same room. This is the optimal condition
which eliminates all latency of the audio, and this audio condition
is used for all of the experiments. There is of course an influence
of the audio quality and latency on the quality of CSCW, but it
is intentionally left out in this experiment in order to compare the
visual conditions only.
Results
SUMMARY AND CONCLUSION
This study and its findings contribute to the improvement of remote maintenance tasks by using concepts of industry 4.0, namely computer supported collaborative work. In an industrial remote maintenance task, a worker is supported in a repair task by a remote supervisor. The service technician is there to execute maintenance orders while the supervisor trusts on the technician to obtain situational awareness. Using a practical repair task, research on the impact of information highlighting using different means of multimedia representation was carried out. Different optical tracking algorithms were compared and implemented according to their suitability for industrial remote maintenance tasks. A tablet PC, optical see-through AR-Glasses, and a spatial AR projector were used as visual output media.
2018ISMAR Comparing Different Augmented Reality Support Applications for Cooperative Repair...相关推荐
- ARVE: Augmented Reality Applications in Vehicle to Edge Networks
ARVE:车辆到边缘网中的增强现实应用 本文为SIGCOMM 2018 Workshop (Mobile Edge Communications, MECOMM)论文. 笔者翻译了该论文.由于时间仓促 ...
- Augmented Reality Law, Privacy, and Ethics
Augmented Reality Law, Privacy, and Ethics Law, Society, and Emerging AR Technologies Brian D. Wasso ...
- Human Interface Guidelines - Augmented Reality
Augmented reality 增强现实 Augmented reality (or AR) lets you deliver immersive, engaging experiences th ...
- AR（Augmented Reality）学习
AR(Augmented Reality)学习 AR硬件概览 AR硬件发展的驱动力源于计算机处理器.显示技术.传感器.移动网络速率.电池续航等多个领域的技术进步. 目前能够确定的AR硬件类型有以下几种 ...
- Unity增强现实初学者指南视频教程 A Beginner’s Guide to Augmented Reality with Unity
Unity增强现实初学者指南视频教程 A Beginner's Guide to Augmented Reality with Unity MP4 |视频:h264,1280×720 (部分1920X ...
- 增强现实(Augmented Reality)浅谈
http://www.86ar.com/?p=1693 随着互联网的不断发展,各种需求不断的被发现和改善,Yahoo.Google.Youtube,Facebook.Twitter等的出现掀起一次又一 ...
- AR增强现实 Augmented Reality
增强现实(Augmented Reality,简称 AR),是一种实时地计算摄影机影像的位置及角度并加上相应图像的技术,这种技术的目标是在屏幕上把虚拟世界套在现实世界并进行互动.这种技术最早于1990 ...
- 增强现实(AR：Augmented Reality ) 之介绍及应用
一.什么是增强现实? 当你想知道今天的天气情况的时候,还是在听新闻联播之后的天气预报吗?当你想知道哪辆公车可以回家的时候,还是要挨个公交站牌去找寻么?当你想认识一个漂亮mm的时候,还是要鼓起勇气跑上前 ...
- 论文阅读（4）What, How, and Why are Visual Assets used in Industrial Augmented Reality?
A Systematic Review and Classification in Maintenance, Assembly, and Training (from1997 to 2019) Abs ...
- 【Augmented Reality】增强现实中的光学透射式头盔显示器的标定深入
前言 上次我们讲到,我们可以使用Unity3D编写程序标定摄像头和HMD之间的映射关系,并得到一个3*4的矩阵.通过这个矩阵我们就可以知道任意一个世界坐标系中的点在HMD屏幕上的位置.但是,仅仅这样我 ...
最新文章
- 手把手玩转协同编辑（1）：AST (Address Space Transformation)地址空间转换算法 基本介绍...
- JDK并发包-同步控制
- java流读取字符串_javaIO之字符流是怎么读取的？
- Linux(Ubuntu)内存查询top命令详解
- Android 短信开发学习
- java中JTextArea类_Swing JTextArea类
- 仿Google+相册的动画
- 文字游戏——《小黑屋》
- linux使用du命令查看文件夹大小（磁盘使用情况）
- 【数学建模】数学建模论文写作
- Win10运行pip install image-similarity-measures失败的处理方式（GDAL和rasterio安装）
- 数据挖掘在淘宝CRM中的应用
- HeadFirst 设计模式 4工厂模式（披萨店演变）
- 电商系统的商品库存管理
- 新南威尔士大学纯硅量子计算机,重磅！！新南威尔士大学澳洲工程学院到访
- RabbitMQ 开发时指定消息消费者的方式
- 什么是GAN（生成对抗网络）？
- 小说里的编程 【连载之二十二】元宇宙里月亮弯弯
- SMM框架学习日志——Spring详述
- 第六届全国计算机学科博士后论坛,首届全国计算机学科博士后论坛在清华大学圆满举行...