We developed a dynamic texture overlay method for the visualization of garments.
The system allows a user in a virtual mirror or virtual fitting room environment to view
himself wearing differently and personalized textured clothes without the need to
actually try them on.
A single camera captures a moving person and the elastic deformations and illumination
of his clothes are estimated. An arbitrary texture is augmented onto the moving
garment such that the person seems to wear the virtually textured piece of cloth.
In these virtual fitting room environments no additional equipment is required so that
the person can move freely in front of the virtual mirror.
Features
- Augmented reality visualization without glasses or other technical aids
- Combination of real and virtual parts in one world
- Visualization and customization of virtual products in real environments
- Visualize the look of new products without the need to actually put them on
- Possible applications of the system are the visualization of customized shoes, clothes, jewelry,glasses or hairstyles
Innovations
- Highly sophisticated image processing and tracking allow real-time experience
- Simple hardware architecture for more reliability
- High-end augmented reality technique
Tracking and Retexturing of Garments for Virtual Clothing
A single camera captures a moving person wearing a piece of cloth, e.g. a t-shirt or a
tie and the system replaces the original texture with a correctly deformed and shaded
arbitrarily personalized texture. The result is a combination of the real video and the new
augmented texture yielding a realistic impression of the virtual piece of cloth.
Image processing techniques estimate the elastic deformation of the garment at main
wrinkles and fold overs. Additionally, correct shading and illumination of the scene is
estimated which enhances the realistic appearance of the augmented garment even
at smaller wrinkles and fold overs. An arbitrary texture chosen by the user is correctly
deformed and shaded and augmented on the moving garment in the video.
Our framework combines real video and virtual computer generated content with highly
realistic appearance. In a virtual mirror application the user can move freely in front of
the mirror and does not need any additional equipment, such as glasses, to view himself
wearing the augmented clothes.
Video: Garment re-texturing and re-coloring. Left: Original shirt. Right: augmented result
Video: Garment re-texturing. Upper row: camera input. Lower row: output with personalized logos augmented into real scene.
Video: Garment re-coloring. Upper row: camera input. Lower row: output with personalized shirt color.
Video: Augmentation of a piece of paper. Upper row: camera input. Lower row: output of with personalized logo augmented into real scene.
Info Material
Flyer Virtual Clothing (PDF)
Contact
Dr. Peter Eisert
Email:
eisert@hhi.fhg.de
Phone: +49 30 31002 614
Fraunhofer Institute for Telecommunications
Einsteinufer 37
D-10587 Berlin
Germany
Start
Organisation
