MSU Graphics & Media Lab Report #8 on stereo films quality assessment

Take a look at this article on the new site! Follow the link
https://videoprocessing.ai/stereo_quality/report8-additional.html

The largest part of the new report is devoted to the detailed analysis of geometric inconsistencies, where we focus on rotation and scale (field-of-view) mismatches between the views in S3D movies. Implicitly these problems were already analyzed in our previous reports #1-5 through detection of vertical shifts between the views, but the new metric is designed to assess the possible origins of the problem directly. Furthermore, these type of mismatches tend to be more painful to the viewers compared to plain vertical parallax that was the main focus of the geometric analysis in the previous reports.

However, the next parts of the report are far more interesting..

It appears to be the case that we are the first to perform a large-scale evaluation of temporal shift in stereoscopic movies (we welcome any tips regarding other research in this field). Temporal shift is considered to be one of the most irritating artifacts, while even small subframe shifts can be consciously noticed by the viewers, especially in fast-paced scenes with a lot of motion. Our experiments seem to indicate that it is the most easily noticeable artifact among all the relatively common ones. That's why it is rather surprising that 8 out of 15 natively captured S3D movies that we've evaluated contain at least one scene with temporal shift. We have detected 45 of such scenes in total, several of them even contain more than a half-frame shift, that could have been easily fixed (at least, partially) in post-production if those scenes were found at the right time. Moreover, there are software solutions that can fix subframe temporal discrepancies with a reasonable level of quality. And now, owing to advances in computer vision algorithms, it is possible to automatically detect this kind of problems and we hope that it will become a more widespread practice and help improve technical quality of S3D movies.


Image #1: Example of a temporal shift
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report8/images/image01.gif)


Image #2: Evaluated movies sorted by total duration of scenes with temporal shift
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report8/images/image02.png)

Also it seems that we are the first to analyze a number of S3D movies for channel mismatch (scenes with swapped left and right views). It is certainly a very annoying problem, even more so than temporal shift. And its detection is further complicated by the fact that it is often hard to consciously notice channel mismatch, as our brains do a pretty good job of adapting and compensating for such anomalies. But nonetheless it definitely can contribute to the overall visual fatigue and headaches experienced by some viewers after watching S3D movies. Channel mismatch is obviously very easy to fix, so the main problem lies in its detection in the right time. And our results show that it is not that rare: 8 movies out of 25 that we have tested contain at least one scene with channel mismatch. We hope that new instruments will enable more efficient quality control and help bring S3D technical quality to a new level.


Image #3: Example of a channel mismatch
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report8/images/image03.gif)


Image #4: Evaluated movies sorted by total duration of scenes with channel mismatch
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report8/images/image04.png)

Acknowledgements

We would like to thank the following people for providing valuable comments, opinions and feedback, which helped to improve this report (in alphabetical order):

  • Nick Brown, Stereographer, Stereo Supervisor
  • Ross Copeland, Online Editor / Stereographer & Colourist, Post-Production Consultant
  • Markus Lanxinger, Stereographer, Stereoscopic Supervisor
  • Daniele Pugni, 3D Motion Graphic Designer Freelancer for Sky 3D Channel
  • Jill Smolin, Director of Production Education for 3ality Technica
  • Paul Taylor, Supervising Stereographer

A key motive of our reports is to improve the stereo quality and therefore to reduce eyestrain and headache. The Graphics & Media Lab hopes that a high 3D video quality would contribute to a continually increasing number of people, leaving the modern theaters without annoyance and with good impressions from the image quality and storytelling.

Currently we are looking for collaboration on upcoming reports #9,10. If you would like to participate by commenting on the draft versions of the reports, please feel free to contact us: 3dmovietest@graphics.cs.msu.ru. If, for some reason, you cannot make public comments for inclusion in the reports, we would really appreciate any other kind of feedback.

For press

Reports overview

Stereo-analysis project description

Report 1 (S3D shooting quality analysis of 5 movies)

Release date: March 7, 2013

Download (Additional info for bloggers and press)

Pages: 246;   Figures: 295

Film list:

  • Pirates of the Caribbean: On Stranger Tides
  • Resident Evil: Afterlife
  • Step Up 3D
  • Galapagos: The Enchanted Voyage
  • Into the Deep

Film list:

  • Dolphin Tale
  • Drive Angry
  • Hugo
  • The Three Musketeers
  • Sanctum

Film list:

  • Alice in Wonderland
  • Clash of the Titans
  • Conan the Barbarian
  • Green Lantern
  • Abraham Lincoln: Vampire Hunter

Report 4 (S3D shooting quality analysis of 5 movies)

Release date: October 1, 2013

Download

Pages: 301;   Figures: 402

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Pina
  • Step Up Revolution
  • Resident Evil 5: Retribution
  • The Amazing Spider-Man

Film list:

  • The Avengers
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Gulliver’s Travels
  • Immortals
  • Wrath of the Titans

Report 6 (Stereo Window analysis of 10 movies)

Release date: September 10, 2014

Download (Additional info for bloggers and press)

Pages: 415;   Figures: 455

Film list:

  • The Amazing Spiderman
  • The Three Musketeers
  • Pirates of the Caribbean: On Stranger Tides
  • Dolphin Tale
  • Drive Angry
  • The Avengers
  • John Carter
  • G-Force
  • Abraham Lincoln: Vampire Hunter
  • Clash of the Titans

Report 7 (Stereo Window analysis of 10 movies)

Release date: October 22, 2014

Download (Additional info for bloggers and press)

Pages: 333;   Figures: 348

Film list:

  • Pina
  • Step Up Revolution
  • Resident Evil: Retribution
  • Hugo
  • Immortals
  • A Very Harold & Kumar 3D Christmas
  • Green Lantern
  • Conan the Barbarian
  • Wrath of the Titans
  • Alice in Wonderland

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Abraham Lincoln: Vampire Hunter
  • The Avengers
  • Alice in Wonderland
  • Conan the Barbarian
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Clash of the Titans
  • Drive Angry
  • Dolphin Tale
  • Galapagos: The Enchanted Voyage
  • Green Lantern
  • Gulliver's Travels
  • Hugo
  • Immortals
  • Into the Deep
  • Pirates of the Caribbean: On Stranger Tides
  • Pina
  • Resident Evil: Afterlife
  • Resident Evil: Retribution
  • Sanctum
  • Step Up 3D
  • Step Up Revolution
  • The Amazing Spider-Man
  • The Three Musketeers
  • Wrath of the Titans

Over 100 films are in film list, including:

  • Creature from the Black Lagoon (1954)
  • World War Z (2013)
  • Dredd (2012)
  • Thor (2011)
  • The Hobbit: An Unexpected Journey (2012)
  • Life of Pi (2012)
  • Oz the Great and Powerful (2013)
  • The Legend of Hercules (2014)
  • Men in Black 3 (2012)
  • Dial M for Murder (1954)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Last Airbender (2010)
  • TRON: Legacy (2010)
  • Jack the Giant Slayer (2013)
  • The Great Gatsby (2013)
  • Pacific Rim (2013)
  • The Avengers (2012)

Report 10 (Overall analysis of 105 movies)

Release date: November 1, 2020

Download

Pages: 211;   Figures: 270

105 films are in film list, including:

  • Gravity (2013)
  • The Great Gatsby (2013)
  • Oz the Great and Powerful (2013)
  • Stalingrad (2013)
  • Iron Man 3 (2013)
  • Man of Steel (2013)
  • Pacific Rim (2013)
  • Jack the Giant Slayer (2013)
  • The Hobbit: An Unexpected Journey (2012)
  • The Legend of Hercules (2014)
  • Alice in Wonderland (2010)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Avengers (2012)
  • The Amazing Spiderman (2012)
  • World War Z (2013)
  • Thor (2011)
  • The Last Airbender (2010)
  • Life of Pi (2012)
  • TRON: Legacy (2010)
  • Hugo (2011)

Report 11 (Overall analysis of 10 selected Chinese movies)

Approximate release date: 2021

The film list includes 10 Chinese movies


Contacts


For questions and proposition please contact us  

Video resources:

Last updated: 12-May-2022
Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab