SDK for real-time rectification

Abstract

Parallel oriented images are much easier to process for many computer vision algorithms e.g. depth from stereo or synthesis of intermediate views. Usually non-parallel images are captured, which have to be warped synthetically by the so-called rectification.

We are presenting a software solution based on the calibration information of the stereo camera set-up. In general, the backward mapping is used to compute the rectified image. In the case of segmented objects, a lot of pixels are transformed, which are not object pixels. Our solution takes this issue into account and presents a fast forward mapping directly from the original image using nearest neighbour interpolation. The algorithm is successfully applied in the prototype demonstrator im.point immersive meeting point of the Image Processing Department.

Features of the algorithm

• Computation of rectified images based on calibration information
• Real-time capability for full TV resolution video (720 x 576 pixel) i.e. less than 20 ms on a standard PC.
• Different interpolation methods can be applied

Example

Original left and right views

Rectified left and right views

References

N. Atzpadin, P. Kauff and O. Schreer: “Stereo Analysis by Hybrid Recursive Matching for Real-Time Immersive Video Conferencing”, Trans. on Circuits and Systems for Video Technology, Special Issue on Immersive Telecommunications, Vol.14, No.3, March 2004, pp.321-334

Our offer

• Provision of applications based on Windows XP
• Provision of Windows XP based SDK
• Adaptation of algorithms and interfaces according to the customers needs

Contact: