VR21's Tri-Vision(TM) auto stereoscopic Displays

Technology
1. How does glasses-free 3D-viewing work?
2. Why are multiple views required?
3. Can I move in front of the screen?
4. Can several observers see a spatial image simultaneously? Which viewing angle is preferred?
5. Which display sizes are available?

Applications
6. What can I use the VR21(TM) Tri-Vision(TM) 3D-displays for?
7. What are the benefits when using VR21(TM) Tri-Vision(TM) 3D-displays in the field of marketing?
8. What can be shown on VR21(TM) Tri-Vision(TM) 3D-displays?

Hardware requirements

Display control
9. How are Tri-Vision(TM) 3D-displays controlled?
10. Do Tri-Vision(TM) 3D-displays support any computer system?
11. Is there any recommended system configuration?
12. Does 3D-video footage require a special hardware?

Compatibility
13. Can I use VR21(TM) Tri-Vision(TM) 3D-displays as conventional computer monitors?
14. Can I use the Tri-Vision(TM) 3D Display as a conventional 2D-video monitor?
15. Can any DVD-footage immediately be seen in 3D when displaying it on a Tri-Vision(TM) 3D-display?

Software

Compatibility
16. Can I use any 3D-application in conjunction with the Tri-Vision(TM)3D-displays?
17. Which VR21(TM) software is available?
18. Can individual software be adapted?

The plugins for 3D Studio MAX
19. What's the purpose of the plugin for 3D Studio MAX?
20. What's the difference between the standard and the professional version?
21. How does the plugin process my scene?

More3D-DirectX-Driver
22. What's the purpose of the More3D-driver?
23. What are the More3D-driver's system requirements?
24. Which applications can be used in combination with the driver?
25. Can I use OpenGL-applications, too?

VR21(TM) Video Package
26.
What's the so called Pulfrich mode?
27. What are the requirements for real time display of real objects (turn table)?
28. Which video compression can be used?

Adaptation of individual software
29. How can I adapt my individual software to achieve compatibility to Tri-Vision(TM) 3D-displays?

Hints for Content Creators

Image Formats
30. Is it possible to compress 3D images?
31. Can I use the common JPS file format for stereo images?

Image contents
32. How should I design impressive 3D images?
33. How should I adjust the camera angle and the fixpoint?
34. What happens if an object cuts the screen border?
35. How can I determinate if the image is shown correctly or pseudoscopic?
36. What is better, eight view images or color image + depth map?

Videos basing on eight perspective views
37. At which resolutions should I create an Tri-Vision(TM) video file?
38. Which compression codec should I choose?
39. Is it a problem if I change the pixel aspect ratio in the Tri-Vision(TM) file?

Videos basing on color image + depth map
40. How can I simplify and improve the manual depth map creation for 2D videos?

Video employing a horizontal camera movement (Pulfrich mode)
41. How do I create videos with a Pulfrich-mode characteristic?
42. How can I playback a steady cam shot at best visual results?
43. Are there some more recommendations regarding the pulfrich file creation?

Video cut / arrangement
44. Can I cut or arrange Tri-Vision(TM) videos?
45. How can I arrange perspective image sequences in an efficient way?
46. How do I integrate a pulfrich sequence into an AfterEffects project?
47. Can I use color keying?

 

VR21(TM) Tri-Vision(TM) auto stereoscopic Displays

Technology

1. How does glasses-free 3D-viewing work?
VR21™ Tri-Vision™ displays are coated with a special optics. This filter defines particular light penetration directions for the light emitted from each coloured image element. In other words, differently coloured image elements can be seen from different spatial positions in front of the screen. Furthermore, the 3D image in use contains multiple perspective views of a scene, which are recorded from slightly different camera positions. Each of these nine views can be seen from various positions in front of the screen. The average eye distance of a viewer is 6, 5 cm (2, 5"). Thus, any viewer sees substantially different views of the scene and perceives a spatial impression.

2. Why are multiple views required?
Several views are required to largely avoid unpleasant viewing positions. Using only two views in a system without eye tracking will give a probability to see a correct 3D-image of only around 50 per cent. Furthermore, the quantity of nine views yielded overwhelming results in 3D viewing experiments and it can be suitably dealt with in software algorithms.


3. Can I move in front of the screen?
Yes, you can. Due to the multiple views in use, there is always a certain freedom of movement, which even increases when departing from the display. However, in addition to the large panorama zones with auto stereoscopic 3D vision, there are small zones, where there is not a correct 3D image. These are called the transitional areas, in which one sees duplicate images. If an observer is located in a transitional area, a slight head movement will find the auto stereoscopic area again. A further positive effect of the nine views is a "look-around" effect, which can be perceived when moving the observer's head in front of the display.


4. Can several observers see a spatial image simultaneously? Which viewing angle is preferred?

There an umpteen 3D panorama zones in front of the display, each of which contains all different views. The transitional areas separate the 3D panorama zones. As long as any observer is located within such a panorama zone, he will see a correct 3D image. Hence, several observers can see a spatial image simultaneously.


5. Which display sizes are available?
VR21™ provides several display sizes. Sizes are available on request. Furthermore, customer screens can be modified as 3D-displays. This modification is subject to certain constraints, such as a minimal brightness and minimal resolution of the customer screen.

Applications

Top

6. What can I use the VR21™ Tri-Vision™ 3D-displays for?
VR21(TM) Tri-Vision™ 3D-displays can be used for any application, which benefits from offering a spatial impression to one or more viewers. No viewing aids are required. Typical applications are: " Product presentation, advertisement, marketing " Visualization in design, architecture, medicine " Computer games " 3D-videos, 3D-television

7. What are the benefits when using VR21™ Tri-Vision™ 3D-displays in the field of marketing?
VR21™ Tri-Vision™ 3D-displays offer an overwhelming viewing experience based upon the 3D-impression. Thus, 3D-displays stop audiences in their tracks. In particular the 50"-display (1,27m diagonal screen size) is perfectly suited to attract people. VR21™ Tri-Vision™ 3D-displays create highest attention at exhibition stands, shop windows or other most frequented places.


8. What can be shown on Tri-Vision™ 3D-displays?
Interactive applications such as games or 3D-viewers can be shown as well as specifically edited 3D-footage. Computer animations can be edited, too. Any existing 2D-Video footage can be processed. VR21™ offers all related services. Special software can be used to present a real object placed on a turntable in real-time on the screen by using just a regular camera.

Hardware requirements

Display control


9. How is Tri-Vision™ 3D-displays controlled?
VR21™ Tri-Vision™ 3D-displays are base upon conventional DVI-flat panel displays. Hence, they can be connected to any DVI graphics card. The computer must only meet particular resolution requirements (depending on the 3D-display in use). You should pay attention to this fact when buying a new graphics card.


10. Do Tri-Vision™ 3D-displays support any computer system?
In general: yes, they do support any computer system (PC, MAC, SGI ...). The VR21™ software which is currently available has been developed for the use with Windows-PC's. Substantial algorithms for image generation and representation can be implemented for substantially any computer type and any operating system.

11. Is there any recommended system configuration?
The system configuration strongly depends on the application. VR21™ software is optimized for current versions of NVIDIA-graphics cards. Depending on the application (game driver, video player), GeForce2, GeForce3 (ti) or also GeForce4 (ti!) graphics cards are required. Increased processor power will result in increased graphics and video playback performance.

 

Top


12. Does 3D-video footage require a special hardware?
There are two types of 3D-video footage: A first one developed by VR21™ especially for 3D image compression and a second one comprising frames, wherein each frame is a mixture of eight views already. The first format, which is strongly advised by us, requires a very fast PC with GeForce3- or GeForce4 (ti)-Graphics card and at least a 2 GHz processor. The second format cannot be compressed currently. Thus, the 2nd format must be stored uncompressed and requires a video RAID array. This RAID array is required to achieve a sufficient video replay rate. To represent still 3D-images and to run interactive Applications (games, CAD-viewer etc.), no special hardware but a powerful NVIDIA graphics card is required.

Compatibility

13. Can I use Tri-Vision™ 3D-displays as conventional computer monitors?
In general: yes, you can. But the optics reduces the perceived resolution. Thus, standard Windows text is not easily legible anymore. Remedy can be found in choosing a larger Windows font. When running conventional applications, a second conventional 2D screen is highly recommended. This 2D screen can be run for instance in a split-screen-mode. Such a mode is supported by a GeForce4 graphics card with dualhead-multimonitor-support (as an example). Furthermore the 50" screen offers a VGA output as a standard where additional screens can be driven.

14. Can I use the Tri-Vision™ 3D Display as a conventional 2D-video monitor?
Yes, you can. There is a video box available for the 50"-display, which offers a Scart-Interface. The perceived resolution is decreased here, too. But when displaying conventional video footage, this reduction does not preponderate.

15. Can any DVD-footage immediately be seen in 3D when displaying it on a Tri-Vision™ 3D-display?
No, because conventional 2D-footage does not contain 3D information. Specifically edited video footage is required, which enables 3D viewing in combination with VR21(TM) software.

Software

Compatibility


16. Can I use any 3D-application in conjunction with the Tri-Vision™ 3D-displays?
To run Tri-Vision™ displays adapted software is always required. This is because the 3D-content must be formatted with regard to the 3D-display in use. VR21™ offers this adapted software, with which one can represent individual 3D-data and partially existing applications directly on the Tri-Vision™ 3D-displays.

17. Which VR21™ software is available?
There a several software packages depending on the field of application: " Plug-in for 3DS MAX; standard version included in the scope of supply of any Tri-Vision 3D-display; professional version available on request " More3D-DirectX-; Game driver, available on request " 3DVideo Package; 3D-video player and 3D-video creation tool, available on request

Top

18. Can individual software be adapted?
If the software bases on DirectX 9.0 and if it can be run under Windows 2000/XP in full screen mode, it can be used immediately utilizing the DirectX-driver. Any other popular software application can be modified subject to the availability of its source code. Respective instructions how to adapt OpenGL- and/or DirectX-applications can be obtained from the VR21™.


19. What's the purpose of the plug-in for 3D Studio MAX?
The Plug-in for 3D Studio MAX offers a rendering function to achieve 3DD-images. The required nine views are generated and combined automatically. Still images as well as image sequences can be created. To use the plug-in, 3D scenes need no particular modification.

20. What's the difference between the standard and the professional version?
The standard plug-in can be used in combination with a single computer. It is available in versions for 3DS MAX 5 and 3DS MAX 6. It is free of charge and is in the scope of supply of any 3D screen. The professional plug-in is implemented inside 3DS MAX as a camera effect and enables any additional features like network rendering, different renderers, effects etc. Especially the network rendering capability lowers the necessary computation time. The professional plug-in is compatible with 3DS MAX 5 and 3DS MAX 6. It is sold separately by VR21™.


21. How does the plug-in process my scene?
To render the nine views (partial images), the camera is slightly rotated. The rotation is centred by the camera target and includes a defined angle. Objects in front of the target seem to hang out of the 3D-display, while objects behind the target are perceived as laying behind the 3D-display's surface. The rotation angle can be set either manually or automatically. The automatic calculation only requires the manual selection of a close and a remote object.

Top

More3D-DirectX-Driver


22. What's the purpose of the More3D-driver?
This driver affects 3D-applications and 3D-games in a way, that they automatically create images compatible with the Tri-Vision 3D-displays. The utilization is similar to drivers for shutter glasses such as VR21™ EYEFORCE™.

23. What are the More3D-driver's system requirements?
The computer must comprise a graphics card with NVIDIA-chip set to run the More3D-DirectX-driver (e.g. GeForce2, GeForce3 or GeForce4) etc. The driver can be run under Windows 2000/XP.

24. Which applications can be used in combination with the driver?
The 3D-application needs to be executable basing on DirectX 9.0


25. Can I use OpenGL-applications, too?
No, because the driver needs to be executable basing on DirectX. But each existing OpenGL application can be modified to be compatible, if the source code can be modified.

26. What's the so called Pulfrich mode?
2D videos, in which a camera is moved on a horizontal track with regard to the scene or in which the camera is rotated around a centre point in scene or in which the depicted object itself is rotating in front of the camera can be represented immediately in a spatially perceivable manner by means of the Tri-Vision™-Player. Such features of 2D videos are normally used in conjunction with the so called "Pulfrich-Effect" to create a three-dimensional impression by showing different perspectives to the observer's eyes. A typical application of this approach is the "turn table". Real objects can thus be recorded three-dimensionally using only one single camera. It is also possible to employ a 2D-AVI-file, a DVD-Player, a video recorder and even a live camera as the image source.


Top

27. What are the requirements for real time display of real objects (turn table)?
The object has to do a horizontal turn movement. The size of the object doesn't matter. This rotation can be recorded before as a 2D video sequence. For real time use you need a FALCON frame grabber delivered by IDS-Imaging and a PAL video camera.


28. Which video compression can be used?
The player has been tested using different DivX-Codecs. The current version DivX 5.0.2 is highly recommended. It goes without saying that other Windows video Codec’s are applicable also, but these may yield slower motion and worse image quality.

Adaptation of individual software

29. How can I adapt my individual software to achieve compatibility to the Tr-Vision™ 3D-displays?
Generally, just the rendering function has to be modified. This function has to render the scene nine times (preferably in background) and to combine these nine views into one 3D-image. Common software functions need not to be modified in most cases.


30. Is it possible to compress 3D images?
Rastered 3D imaged shall not be compressed, because due to a compression the 3D impression is blurred. To enable an efficient compression.


31. Can I use the common JPS file format for stereo images?
Partially, this format can be used. But because stereo content only contains two images, you will see a 3D image only at a few spots in front of the Tri-Vision™ display.

Top


32. How should I design impressive 3D images?
The human brain can perceive 3D information better if the image offers clearly different depth structures. If a 3D object is positioned in front of a structured background, the depth impression will be much better. You will always see a depth difference between the object and the background, which supports the 3D perception. Sure, objects on a black background will be 3D, but a good structured background will support the viewer. Also, the images should have visible contrasts. A very bright background disturbs the depth perception, because structures in the surface are worse recognizable. When rendering geometric objects with a 3D programme, pay attention that you use well structured textures.

33. How should I adjust the camera angle and the fix point?
The camera angle defines "how deep" the 3D image will be. The fix point defines the reference layer of the scene related to the screen glass. Objects between camera and fix point will come "out of the screen", while objects behind the fix point can be seen "inside the screen". Wrong camera angle and fix point values will result in blurred, ghosting images. Your eyes will not be able to perceive a sharp 3D image if the angle is too large.

34. What happens if an object cuts the screen border?
If the object is located "inside" the screen (behind the screen glass), it will even enhance the depth perception. But it is bad if an "out screen" object cuts the screen border. In this case the 3D perception will be completely destroyed, because the brain sees an unnatural image. If you want to use out screen effects, place the object in the middle of the screen.

Top

35. How can I determinate if the image is shown correctly or pseudo-scopic?
Pay attention to the moving parallax: during slightly observer movements, the object should "move" analogue to the nature inside the screen. Off screen image contents should move the opposite direction to the observer. Content inside the screen should move the same direction like the observer. To reverse the views, press the "*" button on the num block.

36. What is better, nine view images or colour image + depth map?
When using a 3D render software, you should always use the eight views approach. This will result in best possible images. A 3D image, made of colour image + depth map, doesn't contain information about object edges and will always result in a "relief" of a 2D image. But it can be a suitable way if you are short in time to render a 2D image and save its depth buffer.

Hints for Content Creators

Image Formats
37. At which resolutions should I create a Tri-Vision™ video file?
There is no general recommendation. The possible resolution strongly depends on the computation power of the playback computer system. A Pentium III, 1 GHz, plays videos with a resolution of 256x168 pixels at 25 frames per second. If you take a more powerful computer, > 2 GHz, it will be able to handle sizes of 512x192 pixels already. The possible sub image resolution and the image quality will increase by using faster CPUs. The 3D Creator enables the free choice of the sub image resolution. You only should pay attention that the sub image resolution as well as the complete video resolution is a number divisible by eight. Otherwise the Div X codec will cause trouble.

Top

38. Which compression codec should I choose?
We recommend the use of a current Div X codec (currently 5.0.2, http://www.divx.com). You should select the "quality-based compression mode" and adjust the compression rate between 80-90%. You should experiment here to get the best compromise between file size and image quality. The older Cinepak codec is twice as fast as DivX, but has visible compression artefacts. But for slow playback devices it can be used if you can accept a worse colour quality. MPEG2 is currently not supported, because it can't be used with the AVI format.

39. Is it a problem if I change the pixel aspect ratio in the 3D file?
No, the original aspect ratio is saved separately in the 3D file. So you can save images, created at a 4:3 resolution, also as 512x192 without any problems. The player recognizes the original aspect ratio and stretches the image accordingly.

40. How can I simplify and improve the manual depth map creation for 2D videos?
Therefore you can use existing video compositing software (like Chalice, Combustion, After effects). Motion Tracking capabilities, mask layers and the possibility to modify the mask shapes over a couple of frames enable an easy and effective video conversion. Video employing a horizontal camera movement (Pulfrich mode)


41. How do I create videos with a Pulfrich-mode characteristic?
If a 2D video image sequence depicts slightly different views of an object, and if these views are just a horizontal movement or rotation, then we have an image sequence that is suitable for the pulfrich mode. It doesn't matter if an object rotates in front of a fixed camera (e.g. turn table), or if a camera rotates around a fixed object (e.g. helicopter flight around a castle). Even a parallel camera movement ("steady cam") of a static scene delivers suitable video sequences.

Top


42. How can I playback a steady cam shot at best visual results?
In the case of a parallel camera movement, you have to adjust a proper fix point value within the 3D player. You will see that the 3D scene moves between out screen and inside the screen by modifying the fix point. A good fix point is found if the 3D scene lies half inside and outside the screen. Also you should pay attention that off screen objects avoid to cut the screen borders.

43. Are there some more recommendations regarding the pulfrich file creation?
In general a pulfrich file is a regular 2D AVI video. The resolution if the video images shouldn't be too large (max. 720x576) to achieve a reasonable playback performance. If the video sequence is recorded by a video camera, the images should be de-interlaced prior to display. Also strong vertical movements will be a disadvantage for the observer. If it is possible, you should avoid vertical movement or try to equalize the motion (e.g. with motion tracking in a suitable video effect software). Video cut / arrangement

44. Can I cut or arrange Tri-Vision™ 3D videos?
No, currently we have no possibility to read images from created 3D video files. The compilation of a 3D file should always be the last step in the content creation process. The best case is if you work with sequences of still images, separated by perspective views, until the end of the content creation work.

45. How can I arrange perspective image sequences in an efficient way?
We made good experiences with Adobe After-effects. This software supports a parallel work with perspective image sequences. All you have to do is to create a separate composition for each perspective view (nine compositions for nine cameras). Now you insert the perspective image sequences parallel into the respective compositions. After effects enables image size modifications, cut of image sequences and the use of all the available video effects. The output from the render queue can be saved into distinct JPG image sequences, and these are combined into a 3D file using the 4D Creator as the last step. Even some special 3D effects like 3D compilation or shatter can be integrated three-dimensionally by adjusting the virtual camera position of the 3D effect accordingly to the respective composition.

46. How do I integrate a pulfrich sequence into an After Effects project?
You import the image sequence once as footage and insert this video sequence into each distinct composition, shifted between each composition by one frame. You only have to pay attention to the direction of this time shift to avoid pseudo scopy (just experiment with it).

47. Can I use colour keying?
Yes, you can. It is e.g. suitable to insert a background afterwards into a turn table video (hint: the background should be "behind" the object to get a good depth distance impression). Also a combination made of real world images (taken by nine cameras) and virtual rendered objects is possible. You just use the standard colour keying functions of After Effects separately for each distinct composition.

Top

 

VR21 Pty Ltd © Copyright 1999-2003. All rights reserved. VR21, Eyeforce™ are trademarks of VR21 Pty Ltd.
All other marks are the property of their respective owners.

 


Copyright 1999-2003 VR21 Pty Ltd