TU Darmstadt / ULB / TUbiblio

Time-of-Flight Based Scene Reconstruction with a Mesh Processing Tool for Model Based Camera Tracking

Kahn, Svenja and Wuest, Harald and Fellner, Dieter W. (2010):
Time-of-Flight Based Scene Reconstruction with a Mesh Processing Tool for Model Based Camera Tracking.
INSTICC Press, In: VISIGRAPP 2010. Proceedings, [Conference or Workshop Item]

Abstract

The most challenging algorithmical task for markerless Augmented Reality applications is the robust estimation of the camera pose. With a given 3D model of a scene the camera pose can be estimated via model-based camera tracking without the need to manipulate the scene with fiducial markers. Up to now, the bottleneck of model-based camera tracking is the availability of such a 3D model. Recently time-of-flight cameras were developed which acquire depth images in real time. With a sensor fusion approach combining the color data of a 2D color camera and the 3D measurements of a time-of-flight camera we acquire a textured 3D model of a scene. We propose a semi-manual reconstruction step in which the alignment of several submeshes with a mesh processing tool is supervised by the user to ensure a correct alignment. The evaluation of our approach shows its applicability for reconstructing a 3D model which is suitable for model-based camera tracking even for objects which are difficult to measure reliably with a time-of-flight camera due to their demanding surface characteristics.

Item Type: Conference or Workshop Item
Erschienen: 2010
Creators: Kahn, Svenja and Wuest, Harald and Fellner, Dieter W.
Title: Time-of-Flight Based Scene Reconstruction with a Mesh Processing Tool for Model Based Camera Tracking
Language: English
Abstract:

The most challenging algorithmical task for markerless Augmented Reality applications is the robust estimation of the camera pose. With a given 3D model of a scene the camera pose can be estimated via model-based camera tracking without the need to manipulate the scene with fiducial markers. Up to now, the bottleneck of model-based camera tracking is the availability of such a 3D model. Recently time-of-flight cameras were developed which acquire depth images in real time. With a sensor fusion approach combining the color data of a 2D color camera and the 3D measurements of a time-of-flight camera we acquire a textured 3D model of a scene. We propose a semi-manual reconstruction step in which the alignment of several submeshes with a mesh processing tool is supervised by the user to ensure a correct alignment. The evaluation of our approach shows its applicability for reconstructing a 3D model which is suitable for model-based camera tracking even for objects which are difficult to measure reliably with a time-of-flight camera due to their demanding surface characteristics.

Publisher: INSTICC Press
Uncontrolled Keywords: Forschungsgruppe Semantic Models, Immersive Systems (SMIS), 3D Reconstruction, Sensor fusion, Augmented reality (AR), Time-of-flight cameras (TOF cameras), Camera tracking
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Interactive Graphics Systems
Event Title: VISIGRAPP 2010. Proceedings
Date Deposited: 12 Nov 2018 11:16
Export:

Optionen (nur für Redakteure)

View Item View Item