3dtv.at
Introduction to the
Stereoscopic Player
3D Korea International Film Festival
November 19th, 2011
Gwangju, South Korea
Overview

Stereoscopic Player






Concept
Input settings
Output settings
Supported formats
Features
Other 3dtv.at applications


Stereoscopic Multiplexer
MVC to AVI Converter
Peter Wimmer - 3dtv.at
2
About 3dtv.at

Focus






Stereoscopic video playback
Stereoscopic video recording
Products
Location

Timeline

Stereoscopic Player
Stereoscopic Multiplexer
MVC to AVI Converter
Peter Wimmer - 3dtv.at
Linz, Austria
www.3dtv.at


Development
started 2001
Completed diploma
thesis in June 2004
Company founded
in 2005
3
Stereoscopic Player

The Stereoscopic Player is a 3D video playback application for
stereoscopic and multi-view videos on the Windows platform
Peter Wimmer - 3dtv.at
4
3D Video Playback
?
!

Peter Wimmer - 3dtv.at

The questions



The challenges



Why do we need 3D playback software?
Why not use any 2D video player?
Many 3D display technologies
Many 3D formats
The solution


Real-time format conversion
3D playback software
5
Real-Time Format Conversion

Real-time format conversion …




… avoids vast number of files
… requires full color left and right views
… gives best quality
Suitable source formats
L R
Side-by-Side
Peter Wimmer - 3dtv.at
LR
Dual Files/Stream
Interlaced
(Field Sequential)
L
R
Over/Under
6
Dual Files, Dual Streams

Dual files





Efficient use of multi processor systems
Circumvent codec limitations (often limited to 1920 x 1080)
Playback synchronization is prone to errors
Performance problems when located on same media
Dual streams




Avoid performance problem of separate files
2D video players show the left video stream only
Supported for Windows Media, MP4 and AVI formats
Multi View Coding (MVC) removes redundancy
Peter Wimmer - 3dtv.at
7
Stereoscopic Player Menues



Input settings
Stored per file
Different for each file
Peter Wimmer - 3dtv.at



Output settings
Stored globally
Configured once
8
Format Selection
Peter Wimmer - 3dtv.at

Stereoscopic Player asks
the user to select the format
when opening a new video

Stereoscopic Player
remembers settings for
each file in the built-in video
library
9
Stereoscopic Metadata

Fundamental idea




It is hard for users to find out the proper layout
The content creator knows the proper layout
Ship video files + format description (= metadata)
Stereoscopic Player …



… reads embedded metadata in Windows Media files
… reads metadata file in same folder as the video file
… contacts metadata server (turned off by default)

The official metadata server is maintained by 3dtv.at and
provides settings for most commercial 3D-DVDs and some
popular video files.
Peter Wimmer - 3dtv.at
10
Creating Stereoscopic Metadata

Use the Windows Media Stereo
Attribute Editor to embed
metadata in Windows Media files
(available for download on the
3dtv.at website)

Click File|Export in Stereoscopic
Player to create a separate
metadata file (for all other formats
than Windows Media)

Peter Wimmer - 3dtv.at
Improve user experience –
deliver your movies with metadata!
11
Stereoscopic Player Viewing Methods
Peter Wimmer - 3dtv.at
12
Stereoscopic Player Viewing Methods
Anaglyphs
Native support
Any graphics card, any display
Shutter glasses
NVIDIA 3D Vision / Quad Buffered OpenGL
Software Pageflipping (ATI and Intel)
Polarized projection
Dual Screen Output
Quad Buffered OpenGL
Peter Wimmer - 3dtv.at
13
Native Dual Screen Output
1.
Peter Wimmer - 3dtv.at
2.
14
Dual Screen Output via OpenGL



Requires professional graphics card (Quadro FX, FireGL)
Graphics driver set to clone mode
Normal 2D operation possible
Peter Wimmer - 3dtv.at
15
Stereoscopic Player Viewing Methods
HDMI 1.4 frame packing format
Via NVIDIA 3D Vision driver
Only 24 Hz at 1920 x 1080
Squeezed side-by-side format
View|Aspect Ratio|Half Width
TVs accept up to 60 Hz
Squeezed over/under format
View|Aspect Ratio|Half Height
Ideal for polarized TVs
Peter Wimmer - 3dtv.at
16
Stereoscopic Player Viewing Methods
3D-DLP-TVs
Checkerboard pattern natively support
Viewed with shutter glasses
LCD displays with micro-polarizer
Interlaced pattern natively supported
Viewed with circular polarized glasses
Peter Wimmer - 3dtv.at
17
Autostereoscopic Displays


Do not require glasses
Two basic technologies



Lenticular lenses in front of the LCD panel
Parallax barrier behind the LCD panel
Lenticular add-on lenses possible
Peter Wimmer - 3dtv.at
18
Types of Autostereoscopic Displays
Multi Viewer
Single Viewer


Narrow viewing angle
Only left and right view required
Peter Wimmer - 3dtv.at




Wider viewing angle
More than two views needed
Image acquisition difficult
Interpolation of images
planned for future player
version
19
Stereoscopic Player Viewing Methods

Autostereoscopic single-viewer





Column Interlaced
Tridelity SL Series 3D Display
Sharp 3D Displays
Generic Single-Viewer Display
Autostereoscopic multi-viewer


Tridelity MV Series Multi-Viewer Display
Generic Multi-Viewer Display
More displays are added on request but are already
supported by the generic viewing methods
Peter Wimmer - 3dtv.at
20
Stereoscopic Player Viewing Methods
Peter Wimmer - 3dtv.at
21
Stereoscopic Player Features

General features






Command line control
OLE Automation
Serial Sony 9-pin protocol
Peter Wimmer - 3dtv.at
Windows Media features




File playback
3D-DVD playback
Capture device support
Intuitive user interface
IR remote control support
Integration features





Streaming
Digital Rights Management
Multi-channel audio
Multiple audio languages
Professional features


Customization tool
Effect control (COM, UDP,
DMX512)
22
Supported File Formats

Video formats







Video for Windows (*.avi)
Windows Media (*.wmv)
Quicktime (*.mov)
MPEG-1, MPEG-2 (*.mpg)
Material Exchange Format (*.mxf)
Third party DirectShow decoders
allow playback of additional format
AVI
Image formats



Windows Bitmap (*.bmp)
JPEG (*.jpg, *.jps, *.mpo)
GIF (*.gif), TIFF (*.tif), PNG (*.png)
Peter Wimmer - 3dtv.at
MPG
23
3D Blu-ray Playback







Stereoscopic Player plays *.ssif files
No menu navigation yet (but planned)
Third party decryption tool required
Install AnyDVD HD
Click File|Open File
Go to the BDMV\
STREAM\SSIF folder
Select largest file
Peter Wimmer - 3dtv.at
24
MVC Playback



H.264 Multi View Coding (MVC) is the 3D video format of the future
MVC is used by 3D Blu-ray disks and the latest 3D camcorders
Player supports the MVC codec in *.mts (Sony) and *.mp4 (JVC) files
Peter Wimmer - 3dtv.at
25
H.264 Multi View Coding



MVC is an extension of the proven H.264/AVC industry standard
Saves approximately 50% of the right view's data rate
Exploits the correlations between the left and right views
Peter Wimmer - 3dtv.at
26
Effect Control



Control curtains, motion seats, lights, fog, water spray, …
Supports COM, UDP and DMX512 output
Effect data are stored in XML files with *.effx extension
Peter Wimmer - 3dtv.at
27
Effect Control File Example
<?xml version="1.0" encoding="UTF-8" ?>
<EffectStream>
<BytesSamples>
<BytesSample sampleTime="00:00:00.000" text="First command" />
<BytesSample sampleTime="00:00:01.000" text="Second command" />
<BytesSample sampleTime="00:00:02.000" text="Third command" />
</BytesSamples>
<DmxChannels>
<DmxChannel slotNumber="1" slotCount= "2" name="Sample Channel" />
</DmxChannels>
<DmxSamples>
<DmxSample sampleTime="00:00:00.000" channelIndex="1" value="x0102" />
<DmxSample sampleTime="00:00:01.000" channelIndex="1" value="x0304" />
<DmxSample sampleTime="00:00:02.000" channelIndex="1" value="x0506" />
</DmxSamples>
</EffectStream>
Peter Wimmer - 3dtv.at
28
Stereoscopic Multiplexer Concept
Right stream
Left stream
R
L
R
L
Combined video stream
Peter Wimmer - 3dtv.at
29
Fields of Applications

Live preview during recording


Live broadcasts



Stereoscopic Multiplexer loaded in Stereoscopic Player
Stereoscopic Multiplexer selected as capture device in
Windows Media Encoder, running on the server
Stereoscopic Player running on the client
Watching 3D recording


Transferring left and right tape to hard disk not required
Stereoscopic Multiplexer synchronizes tape drives
Peter Wimmer - 3dtv.at
30
Supported Hardware

Camcorders



Digital cameras




DV camcorders
HDV camcorders (next version)
Industrial Firewire cameras
Industrial USB cameras
Webcams
Others


Analog cameras via frame grabbers
Many other WDM-compatible capture devices
Peter Wimmer - 3dtv.at
31
MVC to AVI Converter

Batch converter for MP4 (JVC) and MTS (Sony) MVC files
Peter Wimmer - 3dtv.at
32
Thanks for Your Attention
 Q&A
Visit us at http://www.3dtv.at!
Peter Wimmer - 3dtv.at
33
Descargar

Stereoscopic Player and Stereoscopic Multiplexer