Oliver Schreer

Dr. Oliver Schreer is Associate Professor at Technical University Berlin and Head of Immersive Media & Communication group at Vision & Imaging Technologies department at Fraunhofer Heinrich Hertz Institute.

His R&D activities are related to the following keywords: 3D video analysis, virtual view synthesis, real-time 3D video processing, future immersive media services exploiting Augmented Reality and Virtual Reality technologies, 3D video communication, human motion and gesture analysis and touchless interaction with media and content.

For further details about his activities, please check the subsections below.

Biography

Biography

Oliver Schreer is Associate Professor at Technical University Berlin and Head of Immersive Media & Communications Group at Vision & Imaging Technologies Department at Fraunhofer Heinrich Hertz Institute. He graduated in Electronics and Electrical Engineering at the Technical University of Berlin in 1993. From 1993 until 1998, he was research assistant at the Institute of Measurement and Automation, Group of Control Theory and System Dynamics, Technical University Berlin, responsible for lectures and practical courses in the field of image processing and pattern recognition. His research interests have been camera calibration, stereo image processing, 3D analysis, navigation and collision avoidance of autonomous mobile robots.

Since August 1998, he is working at Fraunhofer Heinrich Hertz Institute HHI. He started as scientific project manager in the Immersive Media & 3D Video Group at Image Processing Department of Fraunhofer Heinrich Hertz Institute. Since January 2015, he is leading the Immersive Media & Communications Group at Vision & Imaging Technologies Department. His main research fields and expertise are 3D video analysis, virtual view synthesis, real-time 3D video processing, future immersive media services exploiting Augmented Reality and Virtual Reality technologies, 3D video communication, human motion and gesture analysis and touchless interaction with media and content. From 2000 to 2003, he was the responsible person for the European IST-project VIRTUE at Fraunhofer HHI, leading the work package, "Real-time Platform". From February 2007 to July 2009, Dr. Oliver Schreer hold the position of a project coordinator of the European FP6 project RUSHES on "Retrieval of multimedia Semantic units for enhanced reusability" (http://cordis.europa.eu/ist/kct/rushes_synopsis.htm). From January 2008 until July 2010, he was workpackage leader of the European FP7 project "3DPresence " (3dpresence.tid.es) and from January 2010 until July 2013, he was leading the workpackage on "Scene Capture, Production Networks & Layered Production" in the European FP7 Project "FascinatE" (www.fascinate-project.eu). Oliver Schreer was also responsible for the Fraunhofer HHI activities in the Fraunhofer/Max-Planck project AVATech - Advancing Video Audio Technology in Humanities Research (www.mpi.nl/avatech) from July 2009 until June 2012. From November 2011 to October 2014, he was coordinating the contributions of Fraunhofer HHI in the FP7 project inEvent (www.inevent-project.eu). He was also responsible for the Fraunhofer HHI research activities in the national project AUVIS - Audiovisuelles Data Mining am Beispiel der Ereignissegmentierung in multimodalen Sprachdaten (tla.mpi.nl/projects_info/auvis) from July 2012 until June 2015, which was funded by the Federal Ministry of Education and Research (BMBF). Since December 2016, Oliver Schreer is official contributor to the world's largest Open Source Software Library OpenCV, release 3.2.

In November 1999, he finished his PhD in electrical engineering at the Technical University of Berlin entitled by "Stereo Image Processing and Navigation in Mobile Robotics", Dissertation 1999, Mensch & Buch Verlag, Berlin, Germany, (ISBN 3-89820-060-4). Since autumn 2001, Oliver Schreer is Adjunct Professor at the Faculty of Electrical Engineering and Computer Science, Technical University Berlin. He is giving a complementary set of lectures entitled by "Stereo Image Processing in Videocommunications" and "View Synthesis in Videocommunications".

In June 2006, Oliver Schreer received his habilitation degree in the field of "Computer Vision/Videocommunication" at the faculty of Electrical Engineering and Computer Science, Technical University Berlin. His habilitation thesis is a german lecture book on "Stereoanalysis and View Synthesis" published at Springer in 2005. Since November 2006, Oliver Schreer is Associate Professor (Privatdozent) in the same faculty in the Computer Vision and Remote Sensing Group. He is guest editor for the IEEE Transactions on Circuits, Systems and Video Technology. He published more than 100 papers in conferences and journals. Oliver Schreer is also editor of a book on "3D Videocommunication" published in 2005 at Wiley & Sons, UK. The same book has been translated to simple Chinese and published in July 2010 by Tsinghua University Beijing, China. In January 2014, another book was published at Wiley & Sons entitled by "Media Production, Delivery and Interaction for Platform Independent Systems: Format-Agnostic Media" that has been edited by O. Schreer, J.-F. Macq, O.A. Niamut, J. Ruiz-Hidalgo, B. Shirley, G. Thallinger and G. Thomas. 

Publications

Publications

Books and Book Chapters

    2014

  • Oliver Schreer, Ingo Feldmann, R. Salmon, J. Steurer, and G. Thomas:
    Video Acquisition,
    in Oliver Schreer, J.-F. Macq, O.A. Niamut, J. Ruiz-Hidalgo, B. Shirley, G. Thallinger, G. Thomas, (Editors): Media Production, Delivery and Interaction for Platform Independent Systems: Format-Agnostic Media, John Wiley & Sons, Chichester, UK, pp. 74-129, January 2014, Book Chapter.
  • Oliver Schreer, J.-F. Macq, O.A. Niamut, J. Ruiz-Hidalgo, B. Shirley, G. Thallinger, and G. Thomas, (Editors):
    Media Production, Delivery and Interaction for Platform Independent Systems: Format-Agnostic Media,
    John Wiley & Sons, Chichester, UK, January 2014.

  • 2011

  • Oliver Schreer, Peter Kauff, and Thomas Sikora:
    3D Videocommunication, simple chinese edition - translated by Q. Dai, X. Cao, and G. Er,
    Department of Automation, Tsinghua University Press, Beijing, China, April 2011.

  • 2005

  • Oliver Schreer, Peter Kauff, and Thomas Sikora:
    3D Videocommunication,
    John Wiley & Sons, Chichester, UK, July 2005.
  • Peter Kauff, Oliver Schreer:
    Immersive Videoconferencing,
    in Oliver Schreer, Peter Kauff and Thomas Sikora, (Editors): 3D Videocommunication, John Wiley & Sons, Chichester, UK, pp. 75-90, July 2005.
  • Oliver Schreer:
    Stereoanalyse und Bildsynthese,
    Springer-Verlag, Berlin, Heidelberg, New York, Tokyo, ISBN 3-540-23439-X, March 2005.

Journal Papers


    2017

  • Thomas Ebner, Ingo Feldmann, Sylvain Renault, Oliver Schreer, and Peter Eisert:
    Multi-view reconstruction of dynamic real-world objects and their integration in augmented and virtual reality applications,
    Journal of the Society for Information Display, vol. 25, no. 3, pp. 151–157, March 2017, doi:10.1002/jsid.538.
  • 2015

  • Oliver Schreer, Ingo Feldmann, and Sascha Ebel:
    Fotorealistische 3D-Modellierung von Gebäuden,
    FKT-Fachzeitschrift für Fernsehen, Film und Elektronische Medien, no. 10, October 2015.

  • 2013

  • Oliver Schreer, Ingo Feldmann, Christian Weissig, Peter Kauff, and Ralf Schäfer:
    Ultrahigh-Resolution Panoramic Imaging for Format-Agnostic Video Production,
    Proceedings of IEEE, vol. 101, issue 1, pp. 99-114, January 2013, Invited Paper.

  • 2012

  • Oliver Schreer and D. Schneider:
    Supporting linguistic research using generic automatic audio/video analysis,
    Language Documentation & Conservation Special Publication: Potentials of Language Documentation: Methods, Analyses, and Utilization, ed. By Frank Seifart, Geoffrey Haig, Nikolaus P. Himmelmann, Dagmar Jung, Anna Margetts, and Paul Trilsbeek, ISBN 978-0-9856211-0-0, no. 6, pp. 39–46, 2012, further information.
  • Oliver Schreer and G. Thallinger:
    Formatagnostisches Konzept für die Produktion, übertragung und Wiedergabe immersiver Medien,
    Fachzeitschrift für Fernsehen Film und elektronische Medien FKT, Jahrgang 2012/8-9, August 2012.

  • 2009

  • Oliver Schreer, Ingo Feldmann, I. Alonso, P. Concejero, A.H. Sadka, M. R. Swash, S. Benini, R. Leonardi, T. Janjusevic, and Ebroul Izquierdo:
    RUSHES - An Annotation and Retrieval Engine for Multimedia Semantic Units,
    International Journal on Multimedia Tools and Applications, Springer Netherlands, ISSN: 1380-7501 (Print) 1573-7721 (Online), October 1, 2009.

  • 2008

  • Oliver Schreer, Roman Englert, Peter Eisert, and Ralf Tanger:
    Real-Time Vision and Speech Driven Avatars for Multimedia Applications,
    IEEE Transactions on Multimedia, vol. 10, no. 3, pp. 352-360, April 2008.

  • 2007

  • Peter Kauff, Nicole Atzpadin, Christoph Fehn, Marcus Müller, Oliver Schreer, Aljoscha Smolic, and Ralf Tanger:
    Depth Map Creation and Image Based Rendering for Advanced 3DTV Services Providing Interoperability and Scalability,
    Signal Processing: Image Communication, special Issue on Three-Dimensional Television and Applications, vol. 22, no. 2, pp. 217-234, February 2007, Invited Paper.

  • 2004

  • Nicole Atzpadin, Peter Kauff, and Oliver Schreer:
    Stereo Analysis by Hybrid Recursive Matching for Real-Time Immersive Video Conferencing,
    IEEE Transactions on Circuits and Systems for Video Technology, special Issue on Immersive Telecommunications, vol. 14, no. 3, pp. 321-334, January 2004.
  • F. Isgro, E. Trucco, Peter Kauff, Oliver Schreer:
    Three-Dimensional Image Processing in the Future of Immersive Media,
    IEEE Transactions on Circuits and Systems for Video Technology, special Issue on Immersive Telecommunications, vol. 14, no. 3, pp. 288-303, January 2004.

  • 2002

  • Christoph Fehn, Eddie Cooke, Oliver Schreer, and Peter Kauff:
    3D Analysis and Image-Based Rendering for Immersive TV Applications,
    Signal Processing: Image Communication Journal, Special Issue on Image Processing Techniques for Virtual Environments and 3D Imaging, vol. 17, no. 3, pp. 705-715, October 2002, Invited Paper.

  • 2001

  • Oliver Schreer and Peter Kauff:
    Immersive 3D -Videokonferenz,
    Der Fernmeldeingenieur, Verlag für Wissenschaft und Leben Georg Heidecker GmbH, Erlangen, vol. 55, no. 8, August 2001, in German, Invited Paper.

Conference Proceedings


    2017

  • Thomas Ebner, Ingo Feldmann, Sylvain Renault, and Oliver Schreer:
    Dynamic Real World Objects in Augmented and Virtual Reality Applications,
    SID Symposium Digest of Technical Papers, Los Angeles, USA, vol. 48, no. 1, pp. 673–676, May 2017, Distinguished Paper Award.

  • 2016

  • Sylvain Renault, Thomas Ebner, Ingo Feldmann, and Oliver Schreer:
    Point cloud compression framework for the Web,
    International Conference on 3D Imaging (IC3D 2016), Liége, Belgium, December 13-14, 2016.
  • Ingo Feldmann, Oliver Schreer, Thomas Ebner, Peter Eisert, Anna Hilsmann, N. Nonne, and S. Haeberlein:
    Digitization of People and Objects for Virtual Museum Applications,
    Electronic Media and Visual Arts, Berlin, Germany, November 10-11, 2016.
  • Ingo Feldmann, Oliver Schreer, Thomas Ebner, Sascha Ebel, and Sylvain Renault:
    Real Persons and Objects for Virtual Reality Applications,
    Society for Information Display Mid-Europe Fall Meeting (SID-ME), Berlin, Germany, November 3-4, 2016.
  • Wolfgang Waizenegger, Ingo Feldmann, Oliver Schreer, Peter Kauff, Peter Eisert:
    Real-time 3D Body Reconstruction for Immersive TV,
    Proceedings of the 23rd International Conference on Image Processing (ICIP 2016), Phoenix, Arizona, USA, September 25-28, 2016.
  • Oliver Schreer, Wolfgang Waizenegger, W. Fernando, H. Kodikara Arachchi, A. Oehme, Aljoscha Smolic, B. Yargicoglu, A. Akman, and U. Curjel:
    Mixed Reality Technologies for Immersive Interactive Broadcast,
    International Broadcast Convention (IBC 2016), Amsterdam, The Netherlands, September 2016, doi:10.1049/ibc.2016.0030.
  • N. Gabor, F. Vitinius, R. Obliers, Oliver Schreer, and H. Lausberg:
    Das Handbewegungsverhalten von Arzt und Schauspielpatient während einer simulierten Konsultation,
    Deutscher Kongress für Psychosomatische Medizin und Psychotherapie, Potsdam, Germany, March 16-19, 2016.

  • 2014

  • Sascha Ebel, Wolfgang Waizenegger, Michael Reinhardt, Oliver Schreer, and Ingo Feldmann:
    Visibility-driven Patch Group Generation,
    IEEE International Conference on 3D Imaging (IC3D), Liege, Belgium, December 2014, Best Paper Award.
  • M. Ferras, Stefano Masneri, Oliver Schreer and H. Bourlard:
    Diarizing Large Corpora using Multi-modal Speaker Linking,
    15th Annual Conference of the International Speech Communication Association (INTERSPEECH 2014), Singapore, September 14-18, 2014.
  • Oliver Schreer, Stefano Masneri, H. Lausberg, and H. Skomroch:
    Coding Hand Movement Behavior and Gesture with NEUROGES Supported by Automatic Video Analysis,
    9th International Conference on Methods and Techniques in Behavioral Research (Measuring Behavior 2014), Wageningen, The Netherlands, August 27-19, 2014.
  • Oliver Schreer and Stefano Masneri:
    Automatic Video Analysis for Annotation of Human Body Motion in Humanities Research,
    International Workshop on Multimodal Corpora in conjunction with 9th edition of the Language Resources and Evaluation Conference, Reykjavik, Iceland, May 26-31, 2014.
  • Stefano Masneri and Oliver Schreer:
    SVM-based Video Segmentation and Annotation of Lectures and Conferences,
    9th International Conference on Computer Vision Theory and Applications, Lisbon, Portugal, 5-8 January 2014.

  • 2013

  • Ch. A. Bhatt, A. Popescu-Belis, M. Habibi, S. Ingram, Stefano Masneri, F. McInnes, N. Pappas, and Oliver Schreer:
    Multi-factor Segmentation for Topic Visualization and Recommendation: the MUST-VIS System,
    Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, Spain, October 21-25, 2013.
  • Wolfgang Waizenegger, Ingo Feldmann, Oliver Schreer, and Peter Eisert:
    Scene Flow Constrained Multi-Prior Patch-Sweeping for Real-Time Upper Body 3D Reconstruction,
    Proceedings IEEE International Conference on Image Processing (ICIP), Melbourne, Australia, September 2013.
  • Oliver Schreer, Marian Bertzen, Nicole Atzpadin, Christian Riechert, Wolfgang Waizenegger and Ingo Feldmann:
    User-Feedback and Optimization for Multi-View Calibration,
    11th IEEE IVMSP Workshop: 3D Image/Video Technologies and Applications, Yonsei University, Seoul, Korea, June 10-12, 2013.
  • O. A. Niamut, R. Kaiser, G. Kienast, A. Kochale, J. Spille, Oliver Schreer, J. Ruiz Hidalgo, J.-F. Macq, and B. Shirley:
    Towards A Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media,
    ACM Multimedia Systems 2013, Oslo, Norway, February/March 2013.

  • 2012

  • Wolfgang Waizenegger, Nicole Atzpadin, Oliver Schreer, Ingo Feldmann and Peter Eisert:
    Model Based 3D Gaze Estimation for Provision of Virtual Eye Contact,
    Proceedings of 19th International Conference on Image Processing (ICIP 2012), Orlando, Florida, USA, September 2012.
  • Oliver Schreer, Peter Kauff, Peter Eisert, Christian Weissig, and Jean-Claude Rosenthal:
    Geometrical Design Concept for Panoramic 3D Video Acquisition,
    20th European Signal Processing Conference (EUSIPCO 2012), Bucharest, Romania, August 27-31, 2012.
  • P. Lenkiewicz, E. Auer, Oliver Schreer, Stefano Masneri, D. Schneider and S. Tschöpel:
    AVATecH? automated annotation through audio and video analysis,
    Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012), Istanbul, Turkey, pp. 209-214, May 23-25, 2012, European Language Resources Association.
  • Christian Weissig, Oliver Schreer, Peter Eisert, and Peter Kauff:
    The Ultimate Immersive Experience: Panoramic 3D Video Acquisition,
    18th International Conference on Multimedia Modeling, Klagenfurt, Austria, January 4-6, 2012.

  • 2011

  • P. Lenkiewicz, P. Wittenburg, Stefano Masneri, Oliver Schreer, B.G. Gebre and A. Lenkiewicz:
    Application of Video Processing Methods for Language Preservation,
    5th Language & Technology Conference (LTC), Poznan, Poland, November 25-27, 2011.
  • P. Lenkiewicz, P. Wittenburg, Oliver Schreer, Stefano Masneri, D. Schneider and S. Tschöpel:
    Application of Audio and Video Processing Methods for Language Research,
    Supporting Digital Humanities, Copenhagen, Denmark, November 17-18, 2011.
  • Oliver Schreer, G. Thomas, O.A. Niamut, J-F. Macq, A. Kochale, J-M. Batke, J. Ruiz Hidalgo, R. Oldfield, B. Shirley and G. Thallinger:
    Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media,
    NEM Summit 2011, Torino, Italy, September 27-29, 2011.
  • S. Tschöpel, D. Schneider, R. Bardeli, Oliver Schreer, Stefano Masneri, P. Wittenburg, H. Sloetjes, P. Lenkiewicz and E. Auer:
    AVATecH: Audio/Video Technology for Humanities Research,
    Workshop on Language Technologies for Digital Humanities and Cultural Heritage (LTDigH) associated with the RANLP 2011 Conference, Hissar, Bulgaria, September 15-16, 2011.
  • Wolfgang Waizenegger, Nicole Atzpadin, Oliver Schreer and Ingo Feldmann:
    Patch-Sweeping with Robust Prior for High Precision Depth Estimation in Real-Time Systems,
    Proceedings of 18th International Conference on Image Processing (ICIP 2011), Brussels, Belgium, September 11-14, 2011.
  • G. A. Thomas, Oliver Schreer, B. Shirley, and J. Spille:
    Combining Panoramic Image and 3D Audio Capture With Conventional Coverage for Immersive and Interactive Content Production,
    Proceedings of the IBC 2011, Amsterdam, Netherlands, September 2011.
  • Stefano Masneri and Oliver Schreer:
    A new Skin Colour Estimation Method based on Change Detection and Cluster Analysis,
    Proceedings of 12th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Delft, Netherlands, April 13-15, 2011.
  • Wolfgang Waizenegger, Ingo Feldmann, and Oliver Schreer:
    Real-time Patch Sweeping for High-Quality Depth Estimation in 3D Videoconferencing Applications,
    SPIE 2011 Conference on Real-Time Image and Video Processing, San Francisco, CA, USA, January 23-27, 2011, Invited Paper.

  • 2010

  • P. Wittenburg, E. Auer, H. Sloetjes, Oliver Schreer, Stefano Masneri, D. Schneider, and S. Tschöpel:
    Automatic Annotation of Media Field Recordings,
    ECAI 2010 Workshop on: Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH 2010), Lisbon, Portugal, August 16, 2010.
  • Stefano Masneri, Oliver Schreer, D. Schneider, S. Tschöpel, R. Bardeli, S. Bordag, E. Auer, H. Sloetjes, and P. Wittenburg:
    Towards Semi-Automatic Annotations for Video and Audio Corpora,
    4th Workshop on Representation and Processing of Sign Languages: Corpora and Sign Language Technologies in conjunction with 7th Int. Conf. on Language Resources and Evaluation (LREC), Malta, June 22, 2010.
  • E. Auer, A. Russel, H. Sloetjes, P. Wittenburg, Oliver Schreer, Stefano Masneri, D. Schneider, and S. Tschöpel:
    ELAN as Flexible Annotation Framework for Sound and Image Processing Detectors,
    Proceedings of 7th International Conference on Language Resources and Evaluation (LREC), Malta, June 19-21, 2010.
  • Ingo Feldmann, Wolfgang Waizenegger, Nicole Atzpadin, and Oliver Schreer:
    Real-Time Depth Estimation for Immersive 3D Videoconferencing,
    Proceedings of 3DTV Conference 2010, Tampere, Finland, June 07-09, 2010.
  • Oliver Schreer, S. Brodin, Ingo Feldmann, and Wolfgang Waizenegger:
    High-level Semantic Video Annotation Based on 3D Scene Structure Analysis,
    Proceedings of 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano del Garda, Italy, April 12-14, 2010.
  • O. Divorra Escoda, J. Civit, F. Zuo, H. Belt, Ingo Feldmann, Oliver Schreer, E. Yellin, W. Ijsselsteijn, R. van Eijk, D. Espinola, P. Hagendorf, Wolfgang Waizennegger, and R. Braspenning:
    Towards 3D-Aware Telepresence: Working on Technologies Behind the Scene,
    Proceedings of ACM Conference on Computer Supported Cooperative Work (CSCW), New Frontiers in Telepresence, Savannah, Georgia, USA, February 06-10, 2010.

  • 2009

  • Ingo Feldmann, Nicole Atzapadin, Oliver Schreer, J.-C. Pujol-Acolado, J.-L. Landabaso, and O. Divorra Escoda:
    Multi-View Depth Estimation Based on Visual-Hull Enhanced Hybrid Recursive Matching for 3D Video Conference Systems,
    Proceedings of 16th International Conference on Image Processing (ICIP 2009), Kairo, Egypt, November 2009.
  • Ingo Feldmann, Oliver Schreer, Peter Kauff, Ralf Schäfer, Z. Fei, H.J.W. Belt, and Ò. Divorra Escoda:
    Immersive Multi-User 3D Video Communication,
    Proceedings of International Broadcast Conference (IBC 2009), Amsterdam, NL, September 2009.
  • Oliver Schreer, Ingo Feldmann, I. Alonso, P. Concejero, A.H. Sadka, and M.R. Swash:
    RUSHES - Retrieval of Multimedia Semantic Units for Enhanced Reusability,
    7th International Workshop on Content-Based Multimedia Indexing (CBMI 2009), Chania, Crete, Greek, June 3-5, 2009.
  • Oliver Schreer, Nicole Atzapadin, and Ingo Feldmann:
    Multi-baseline Disparity Fusion for Immersive Videoconferencing,
    2nd International Conference on Immersive Telecommunications (IMMERSCOM 2009), University of California, Berkeley, CA, USA, May 27-29, 2009.

  • 2008

  • Oliver Schreer, Ingo Feldmann, Nicole Atzpadin, Peter Eisert, Peter Kauff, Harm Belt:
    3DPresence – A system concept for multi-user and multi-party immersive 3D videoconferencing,
    5th European Conf. on Visual Media Production (CVMP 2008), London, UK, November 2008.
  • Samuele Salti, Oliver Schreer, Luigi Di Stefano:
    Real-time 3D Arm Pose Estimation from Monocular Video for Enhanced HCI,
    1st ACM International Workshop on Vision Networks for Behaviour Analysis (VNBA) in conjunction with ACM Multimedia 2008, Vancouver, Canada, October 2008.
  • Ingo Feldmann, Wolfgang Waizenegger, Oliver Schreer:
    Extraction of 3D Scene Structure for Semantic Annotation and Retrieval of Unedited Video,
    Proceedings of International Workshop on Multimedia Signal Processing (MMSP), Cairns, Queensland, Australia, October 2008.
  • Wolfgang Waizenegger, Ingo Feldmann, and Oliver Schreer:
    Semantic Annotation and Retrieval of Unedited Video based on Extraction of 3D Camera Motion,
    Proceedings of 6th International Workshop on Content-Based Multimedia Indexing (CBMI), London, UK, June 2008.
  • Oliver Schreer, Leticia Fuentes Ardeo, Dimitrious Sotiriou, Abdul Sadka, Ebroul Izquierdo:
    User Requirements for Multimedia Indexing and Retrieval of Unedited Audio-Visual Footage - RUSHES,
    Proceedings of 9th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS),Klagenfurt, Austria, May 2008.

  • 2007

  • Oliver Schreer and Seinghor Ngongang:
    Real-time Gesture Recognition in Advanced Videocommunication Services,
    Proceedings of 14th International Conference on Image Analysis and Processing (ICIAP 2007), Modena, Italy, pp. 253-258, September 2007.

  • 2006

  • Christoph Fehn, Nicole Atzpadin, Marcus Müller, Oliver Schreer, Aljoscha Smolic, Ralf Tanger, and Peter Kauff:
    An Advanced 3DTV Concept Providing Interoperability and Scalability for a Wide Range of Multi-Baseline Geometries,
    Proceedings of 13th International Conference on Image Processing (ICIP 2006), Atlanta, GA, USA, October 2006.
  • Oliver Schreer, Peter Kauff, Peter Eisert, Ralf Tanger, and Roman Englert:
    GestAvatar - Real-Time Animation of Avatars,
    Demo Session of 9th European Conference on Computer Vision (ECCV), Graz, Austria, July 2006.
  • Oliver Schreer, Christoph Fehn, Nicole Atzpadin, Marcus Müller, Aljoscha Smolic, Ralf Tanger, and Peter Kauff:
    A Flexible 3D TV System for Different Multi-Baseline Geometries,
    Proceedings of International Conference on Multimedia and Expo (ICME 2006), Toronto, pp. 1877-1880, July 2006.
  • Oliver Schreer, Peter Eisert, Peter Kauff, Ralf Tanger, and Roman Englert:
    Towards Robust Intuitive Vision-Based User Interfaces,
    Proceedings of International Conference on Multimedia and Expo (ICME 2006), Toronto, Canada, pp. 69-72, July 2006.

  • 2005

  • Oliver Schreer, Ralf Tanger, Peter Eisert, Peter Kauff, Bernhard Kaspar, and Roman Englert:
    Real-time Avatar Animation Steered by Live Body Motion,
    Proceedings of 13th International Conference on Image Analysis and Processing (ICIAP 2005), Cagliari, Italy, pp. 147-154, September 2005.
  • Ralf Tanger, Peter Kauff, Oliver Schreer, D. Pavy, S.L. Dit Picard, and G. Saugis:
    Team Collaboration Mixing Immersive Video Conferencing with Shared Virtual 3D Objects,
    Proceedings of Tyrrhenian International Workshop on Digital Communications Distributed Cooperative Laboratories - Issues in Networking, Instrumentation and Measurements, Sorento, Italy, July 2005.

  • 2004

  • Ralf Tanger, Peter Kauff, and Oliver Schreer:
    Immersive Meeting Point (im.point) - An approach Towards Immersive Media Portals,
    Proceedings of Pacific-Rim Conference on Multimedia, January 2004.
  • Serap Askar, Y. Kondratyuk, K. Elazouzi, Peter Kauff, and Oliver Schreer:
    Vision-Based Skin-Colour Segmentation of Moving Hands for Real-Time Applications,
    1st European Conference on Visual Media Production (CVMP), London, United Kingdom, March 2004.

  • 2003

  • J. Freeman, J. Lessiter, Oliver Schreer, and Peter Kauff:
    Evaluation of the VIRTUE Video-Conference System Using the ITC-Sense of Presence Inventory,
    International Workshop on Presence, Aalborg, Denmark, October 2003, on CD-ROM.
  • Eddie Cooke, Peter Kauff, and Oliver Schreer:
    A Scalable and Modular Solution for Virtual View Creation in Image-Based Rendering Systems,
    Proceedings of International Workshop on Very Low Bitrate Video (VLBV 2003), Madrid, Spain, pp. 323-330, September 2003.
  • Eddie Cooke, Ingo Feldmann, Peter Kauff, and Oliver Schreer:
    A Modular Approach to Virtual View Creation for a Scalable Immersive Teleconferencing Configuration,
    Proceedings of International Conference on Image Processing (ICIP 2003), Barcelona, Spain, pp. 41-44, September 2003.
  • Oliver Schreer, Nicole Atzpadin, S.Askar, and Peter Kauff:
    Advanced 3D Signal Processing in Virtual Team User Environments,
    Proceedings of International IEEE Conference on Multimedia and Expo (ICME 2003), Baltimore, MD, USA, July 2003, on CD-ROM.
  • Eddie Cooke, Ingo Feldmann, Peter Kauff, and Oliver Schreer:
    Multi-View Synthesis for an Extendable Teleconferencing System,
    Proceedings of 3rd International Picture Coding Symposium (PCS 2003), St. Malo, France, pp. 199-204, April 2003.
  • Eddie Cooke, Peter Kauff, and Oliver Schreer:
    Image Analysis and Synthesis for Multiple Stereo Camera Teleconferencing Systems,
    Proceedings of 4th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2003), London, UK, pp. 405-410, April 2003.
  • Nicole Atzpadin, Serap Askar, Peter Kauff, and Oliver Schreer:
    New Concept For Joint Disparity Estimation and Segmentation for Real-Time Video Processing,
    Proceedings of 3rd International Picture Coding Symposium (PCS 2003), St. Malo, France, pp. 155-160, April 2003.
  • Ingo Feldmann, Oliver Schreer, and Peter Kauff:
    Nonlinear Depth Scaling For Immersive Video Applications,
    Proceedings of 4th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2003), London, UK, pp. 433-438, April 2003.

  • 2002

  • Oliver Schreer, E.A. Hendriks, J.M. Schraagen, J. Stone, E. Trucco, and M. Jewell:
    Virtual Team User Environments - A Key Application in Telecommunication,
    Proceedings of eBusiness and eWork, Prague, Cech Republic, pp. 916-923, October 2002.
  • Oliver Schreer and Peter Kauff:
    An Immersive 3D Video-Conferencing System Using Shared Virtual Team User Environments,
    Proceedings of ACM Collaborative Virtual Environments (CVE 2002), Bonn, Germany, pp. 105-112, October 2002.
  • Peter Kauff and Oliver Schreer:
    Virtual Team User Environments - A Step From Tele-Cubicles Towards Distributed Tele-Colaboration in Mediated Workspaces,
    Proceedings of IEEE Conference on Multimedia and Expo (ICME2002), Lausanne, Switzerland, August 2002.
  • Oliver Schreer, Michael Karl, and Peter Kauff:
    PCI-Based Multi-Processor System For Immersive Videoconference Terminals,
    Proceedings of IEEE Conference on Multimedia and Expo (ICME2002), Lausanne, Switzerland, August 2002.
  • Oliver Schreer, Michael Karl, and Peter Kauff:
    A TriMedia Based Multi-Processor System Using PCI Technology for Immersive Videoconference Terminals,
    Proceedings of 14th International Conference on Digital Signal Processing (DSP), Santorini, Greece, pp. 289-293, July 2002.
  • Oliver Schreer, Ingo Feldmann, Ulrich Gölz, and Peter Kauff:
    Fast and Robust Shadow Detection in Videoconference Applications,
    Proceedings of 4th EURASIP IEEE International Symposium on Video Processing and Multimedia Communications (VIPromCom), Zadar, Croatia, pp. 371-377, June 2002.
  • Eddie Cooke, Peter Kauff, and Oliver Schreer:
    Multiple Narrow-Baseline System for Immersive Teleconferencing,
    Proceedings of 4th EURASIP IEEE International Symposium on Video Processing and Multimedia Communications (VIPromCom 2002), Zadar, Croatia, pp. 367-370, June 2002.
  • Serap Askar, Peter Kauff, Nicole Brandenburg, and Oliver Schreer:
    Fast Adaptive Upscaling of Low Structured Images Using a Hierarchical Filling Strategy,
    Proceedings of 4th EURASIP IEEE International Symposium on Video Processing and Multimedia Communications (VIPromCom), Zadar, Croatia, pp. 289-295, June 2002.
  • Eddie Cooke, Peter Kauff, and Oliver Schreer:
    Image-Based Rendering for Tele-Conference Systems,
    Proceedings of 10th International Conference on Computer Graphics, Visualization and Computer Vision (WSCG 2002), Plzen, Czech Republic, February 2002.
  • Ingo Feldmann, Serap Askar, Nicole Brandenburg, Peter Kauff, and Oliver Schreer:
    Real-Time Segmentation for Advanced Disparity Estimation in Immersive Videoconference Applications,
    Proceedings of 10th International Conference on Computer Graphics, Visualization and Computer Vision (WSCG 2002), Plzen, Czech Republic, pp. 171-178, February 2002.
  • Peter Kauff, Oliver Schreer, and Ralf Tanger:
    Virtual Team User Environments - A Mixed Reality Approach for Immersive Tele-Collaboration”,
    International Workshop on Immersive Telepresence (ITP 2002), pp. 1-4, January 2002.

  • 2001

  • Oliver Schreer, Nicole Brandenburg, Serap Askar, and Peter Kauff:
    Hybrid Recursive Matching and Segmentation-Based Postprocessing in Real-Time Immersive Video Conferencing,
    Proceedings of Vision, Modeling and Visualization (VMV 2001), Stuttgart, Germany, pp. 383-390, November 2001.
  • Oliver Schreer, Nicole Brandenburg, Serap Askar, and M. Trucco:
    A Virtual 3D Video-Conference System Providing Semi-Immersive Telepresence: A Real-Time Solution in Hardware and Software,
    Proceedings of eBusiness and eWork 2001, Venice, Italy, pp. 184-190, October 2001.
  • Christoph Fehn, Peter Kauff, Oliver Schreer, and Ralf Schäfer:
    Interactive Virtual View Video for Immersive TV Applications,
    Proceedings of International Broadcast Conference (IBC 2001), Amsterdam, Netherlands, pp. 53-61, September 2001, IBC President's Award for the best technical paper.
  • Oliver Schreer, Nicole Brandenburg, and Peter Kauff:
    Real-Time Disparity Analysis for Applications in Immersive Tele-Conference Scenarios - A Comparative Study,
    Proceedings of 11th International Conference on Image Analysis and Processing (ICIAP 2001), Palermo, Italy, pp. 346-353, September 2001.
  • E. Trucco, C. Plakas, Nicole Brandenburg, Peter Kauff, Michael Karl, and Oliver Schreer:
    Real-Time Disparity Analysis for Immersive 3-D Teleconferencing by Hybrid Recursive Matching and Census Transform,
    8th IEEE International Conference on Computer Vision, Proceedings of Workshop on Video Registration, Vancouver, Canada, July 2001.
  • Christoph Fehn, Eddie Cooke, Oliver Schreer, and Peter Kauff:
    3D Analysis and Image-Based Rendering for Immersive TV Applications,
    Proceedings of International Conference on Augmented, Virtual Environments and Three-Dimensional Imaging (ICAV3D), Mykonos, Greece, pp.192-195, May 2001.
  • Peter Kauff, Oliver Schreer, and Jens-Rainer Ohm:
    An Universal Algorithm for Real-Time Estimation of Dense Displacement Vector Fields,
    Proceedings of International Conference on Media Futures, Florence, Italy, pp. 311-314, May 2001.
  • Christoph Fehn, Eddie Cooke, Oliver Schreer, and Peter Kauff:
    3D Image Analysis and Image-Based Rendering for Immersive TV Applications,
    Proc. International Conference on Augmented, Virtual Environments and Three-Dimensional Imaging (ICAV3D), Mykonos, Greece, vol. 17, no. 9, pp. 705-715, May 2001, Invited Journal paper.
  • Oliver Schreer, Nicole Brandenburg, C. Plakas, E. Trucco, and Peter Kauff:
    A Combination of Census Transform and a Hybrid Block- and Pixel-Recursive Disparity Analysis Approach for Real-Time Videoconferencing Applications,
    Proceedings of International Conference on Augmented, Virtual Environments and Three-Dimensional Imaging (ICAV3D), Mykonos, Greece, pp. 29-32, May 2001.
  • Oliver Schreer, Christoph Fehn, Nicole Brandenburg, Michael Karl, and Peter Kauff:
    Fast Disparity Estimator for Real-Time Video Processing Using a Hybrid Block- and Pixel-Recursive Matching Technique,
    Proceedings of 22nd Picture Coding Symposium (PCS 2001), Seoul, Korea, pp. 405-408, April 2001.
  • Peter Kauff, Christoph Fehn, Eddie Cooke, and Oliver Schreer:
    Advanced Incomplete 3D Representation of Video Objects Using Trilinear Warping for Novel View Synthesis,
    Proceedings of 22nd Picture Coding Symposium (PCS 2001), Seoul, Korea, pp. 429-432, April 2001.
  • Peter Kauff, Nicole Brandenburg, Michael Karl, and Oliver Schreer:
    Fast Hybrid Block- And Pixel-Recursive Disparity Analysis For Real-Time Applications in Immersive Tele-Conference Scenarios,
    Proceedings of 9th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG), Plzen, Czech Republic, February 2001.

  • 2000

  • Ralf Schäfer, Peter Kauff, and Oliver Schreer:
    Immersive Telepresence for Broadcast and Communication,
    Proceedings of Information Society Technologies (IST 2000), Nice, France, November 2000, Invited Paper.
  • Eddie Cooke, Oliver Schreer, B. Pasewaldt, and Peter Kauff:
    Extension of Incomplete 3D for Arbitrary Multi-View-Synthesis,
    Proceedings of 5th International Fall Workshop Vision, Modeling, and Visualization (VMV 2000), Saarbrücken, Germany, November 2000.
  • Oliver Schreer and P.Sheppard:
    VIRTUE – The step towards immersive telepresence in virtual video-conference systems,
    Proceedings of eBusiness and eWorks 2000, Madrid, Spain, pp. 989-995, October 2000.
  • Oliver Schreer, Nicole Brandenburg, and Peter Kauff:
    Disparitätsanalyse konvergenter und rektifizierter Stereoansichten: Eine vergleichende Untersuchung,
    Proceedings of 22. DAGM-Symposium of Pattern Recognition (DAGM), Kiel, Germany, pp. 59-66, September 2000.
  • Oliver Schreer, Nicole Brandenburg, and Peter Kauff:
    A Comparative Study on Disparity Analysis Based on Convergent and Rectified Views,
    Proceedings of 11th British Machine Vision Conference (BMVC 2000), Bristol, United Kingdom, pp. 556-565, September 2000.
  • Peter Kauff, Ralf Schäfer, and Oliver Schreer:
    Tele-Immersion in Shared Presence Conference Systems,
    Proceedings of International Broadcast Conference (IBC 2000), Amsterdam, Netherlands, pp. 610-615, September 2000.
  • Eddie Cooke, Michael Karl, Peter Kauff, and Oliver Schreer:
    Realtime View Adaptation of Video Objects in 3-Dimensional Virtual Environments,
    Proceedings of International Workshop on Presence, Delft, Netherlands, April 2000.

  • 1998

  • Oliver Schreer:
    Dynamische Analyse von rekonstruierten 3D Punkten zur Navigation eines Stereo-Vision basierten mobilen Systems,
    20. DAGM-Symposium "Mustererkennung 1998", Stuttgart, Germany, TN00115.doc, October 1998.
  • Oliver Schreer:
    Stereo Vision-Based Navigation in Unknown Indoor Environment,
    European Conference on Computer Vision, Freiburg, Germany, June 1998.

  • 1997

  • Oliver Schreer, I. Hartmann, and R. Adams:
    Analysis of Grey-Level Features for Line Segment Stereo Matching,
    International Conference of Image Analysis and Processing, Florence, Italy, September 1997.

Contributions to Standards

    2007

  • Aljoscha Smolic, Karsten Müller, Philipp Merkle, Nicole Atzpadin, Christoph Fehn, Marcus Müller, Oliver Schreer, Ralf Tanger, Peter Kauff, Thomas Wiegand, Z. Megyesi:
    Multi-view video plus depth (MVD) format for advanced 3D video systems,
    JVT-V100, San Jose, CA, USA, April 2007.

Patents

US 9521362 View Rendering for the Provision of Virtual Eye Contact Using Special Geometric Constraints in Combination With Eye-Tracking

EP2781099 Vorrichtung und Verfahren für Echtzeitfähige Disparitätsschätzung zur Darstellung einer Virtuellen Ansicht mit Eignung für Multi-Threaded-Ausführung

US9158994 Apparatus and Method for Real-Time Capable Disparity Estimation for Virtual View Rendering Suitable for Multi-Threaded Execution

Teaching

Teaching

Lecture "Stereo Image Processing in Videocommunication" (winter term 2017/2018)

Lecture "Stereo Image Processing in Videocommunication" (winter term 2017/2018)

Stereo Image Processing

Date: Monday, starting on 16th of October 2017
Time: 10:00 - 12:00
Room: E-N 368

The topics of the lecture are as follows:

  • Fundamentals of projective geometry
  • Camera model
  • Camera calibration
  • Epipolargeometry
  • Estimation of the projective geometry
  • Rectification
  • Correspondence problem in stereo image processing
  • Correspondence analysis (overview and example approaches)
  • Iterative Patch Sweep for correspondence analysis
  • 3D videocommunication at a glance

 

 

Lecture "View Synthesis in Videocommunication" (summer term 2017)

Lecture "View Synthesis in Videocommunication" (summer term 2017)

Date: Monday, starting on 8th of May 2017
Time: 10:00 - 12:00
Room: E-N 368

The topics of the lecture are as follows:

  • Quick tour into camera model and epipolar geometry
  • Homography
  • 3D reconstruction from two views
  • Trifocale stereo
  • The trilinearities
  • Trifocal tensor
  • Plenoptic modeling
  • View interpolation and image transfer
  • Volumetric reconstruction

Schedule for winter term 2017/2018

Schedule for winter term 2017/2018

The slides are provided as colour version and two-on-one in grey scale at the HHI data cloud.

DateTopic
16.10.2017Overview on video communication applications
23.10.2017--------- skipped
30.10.2017Projective Geometry - Part I
06.11.2017Projective Geometry - Part II
13.11.2017Camera model
20.11.2017Camera calibration
27.11.2017Epipolar geometry
04.12.2017Estimation of projective stereo geometry
11.12.2017Rectification
18.12.2017Correspondence problem
08.01.2018Stereo approaches
15.01.2018Correspondence analysis of line segments
22.01.2018Iterative Patch-Sweep for correspondence analysis
29.01.20183D Video Communication at a glance
06.02.2018--------- skipped
12.02.2018Visit of TiMELab and 3IT - Innovation Center for Immersive Imaging Technologies at Fraunhofer HHI

Schedule for summer term 2017

Schedule for summer term 2017

The slides are provided as colour version and two-on-one in grey scale at the HHI data cloud.

DateTopic
08.05.2017Applications of View Synthesis in Videocommunications
15.05.2017Camera model and stereo geometry
22.05.2017Homography I
29.05.2017Homography II
05.06.2017-------- skipped --- pentecost
12.06.2017-------- skipped ---
19.06.20173D Reconstruction from stereo views  & Trifocal stereo
26.06.2017Trilinearities & Trifocal tensor
03.07.2017Synthesis I - Plenoptic modelling
10.07.2017Synthesis II -Image-based rendering
17.07.2017Synthesis III - Volumetric reconstruction
18.07.2017Visit of TiMELab and 3IT - Innovation Center for Immersive Imaging Technologies at Fraunhofer HHI

Lecture Book

Lecture Book

A german lecture book is available, which contains all relevant topics of both lectures. The content of the book can be read there.
The book has been published at Springer Verlag in March 2005. Please follow this link for more information.
A sample chapter is also available. A preliminary list of errors is available here.

Literature

Literature

Introduction and Overview

O. Schreer: “ "Ein Beitrag zur Stereobildverarbeitung und mobile Robotik ", Dissertation 1999, Mensch & Buch Verlag, Berlin, Germany, (ISBN 3-89820-060-4)

O. Schreer, “Stereoanalyse und Bildsynthese”, March 2005, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo, ISBN: 3-540-23439-X

O. Schreer, P. Kauff and T. Sikora, “3D Videocommunication”, July 2005, John Wiley & Sons, Chichester, UK

O. Schreer, P. Kauff: „Immersive 3D –Videokonferenz“, Der Fernmeldeingenieur, Heft 8, 55. Jahrgang, Verlag für Wissenschaft und Leben Georg Heidecker GmbH, Erlangen, August 2001

P. Kauff, R. Schäfer, O. Schreer: „Tele-Immersion in Shared Presence Conference Systems“, Int. Broadcasting Convention‘2000, Amsterdam, Netherlands, Sept. 2000

B. Jähne, „Digitale Bildverarbeitung. 6.Auflage. Springer-Verlag, 2005, ISBN 978-3-540-24999-3.

Fundamentals and Projective Geometry

I.N. Bronstein, K.A. Semendjajew: “Taschenbuch der Mathematik”, Verlag Harry Deutsch, 22.Auflage, Thun und Frankfurt/Main, 1985.

O. D. Faugeras: „Three-Dimensional Computer Vision“, The MIT Press, Cambridge, Massachusetts, London, England, 1993.

O.D. Faugeras, Q.T. Luong (2004), “The Geometry of Multiple Images”, The MIT Press, Cambridge, MA, USA, 2nd Edition

R. Mohr, B. Triggs: „Projective Geometry for Image Analysis “, Tutorial given at ISPRS, Vienna July 1996.

J.L. Mundy, A. Zissermann: “Geometric Invariance in Computer Vision”, The MIT Press, Cambridge, Massachusetts, London, England, 1992.

R.I. Hartley, A. Zisserman (2004), “Multiple View Geometry in Computer Vision”, Cambridge University Press, Cambridge, United Kingdom, 2nd Edition.

An Introduction to Projective Geometry (for computer vision) by Stan Birchfield (1998)

Projective 2D geometry (Course 2) by Marc Pollefeys (2003)

Epipolar Geometry

Zhang Z., Xu G.: „Epipolar Geometry in Stereo, Motion and Object Recognition“, Kluwer Academic Publisher, Netherlands, 1996.

H. Longuet-Higgins: „A Computer Algorithm for Reconstructing a Scene From Two Projections“, Nature, No.293, pp.133-135, 1981.

Rectification

A. Fusiello, E. Trucco, A. Verri: „Rectification with unconstrained stereo geometry“, British Machine Vision Conference, Essex, Sept.1997, pp.400-409, 1997

C. Loop, Z. Zhang: “Computing Rectifying Homographies for Stereo Vision”, Technical Report MSR-TR-99-21, Microsoft Research, April 1999.

Correspondence Problem

N. Atzpadin, P. Kauff and O. Schreer, “Stereo Analysis by Hybrid Recursive Matching for Real-Time Immersive Video Conferencing”,Trans. on Circuits and Systems for Video Technology, Special Issue on Immersive Telecommunications, Vol.14, No.3, March 2004, pp.321-334.

X. Hu, N. Ahuja: „Matching Point Features with Ordered Geometric, Rigidity and Disparity Constraints“, Trans. on Pattern Analysis and Machine Intelligence, Vol.16, No.10, October 1994.

O. Schreer, I. Hartmann, R. Adams: „Analysis of Grey-Level Features for Line Segment Stereo Matching“, Int. Conf. of Image Analysis and Processing, Florenz, Sept. 1997.

C. Gu, L. Wu: „Structural Matching of Multiresolution for Stereo Vision“, Int. Conf. on Pattern Recognition, June 1990.

R. Horaud, T. Skordas: „Structural Matching for Stereo Vision“, 9th Int. Conf. on Pattern Recognition, November 1988, Rome.

N. Ayache: „Artificial Vision for Mobile Robots“, The MIT Press, Cambridge, Massachusetts, 1991.

Camera Calibration

O. D. Faugeras, G. Toscanini: „The Calibration Problem for Stereo“, Proc. of  Int. Conf. on Comp. Vision and Pattern Recognition, Florida, 1986.

R.K. Lenz, R.Y. Tsai: „Techniques For Calibrating Of The Scale Factor And Image Center For High Accuracy 3D Machine Vision Metrology“, Int. Conf. on Robotics and Automation, pp.68-75, Raleigh, NC, 1987.

R. K. Lenz, R. Y. Tsai: „Calibrating a Cartesian Robot with Eye-on-Hand Configuration Independent of Eye-to-Hand Relationship“, Trans. on Pattern Analysis and Machine Intelligence, Vol.11, No.9, September 1989.

J. Heikkilä, O. Silven: „Calibration Procedure for Short Focal Length off-the-Shelf CCD Cameras“, Int. Conf. on Pattern Recognition, Aug. 1996, Austria.

P. Sturm: “Multi-View Geometry for General Camera Models”. Proc. of IEEE Conference on Computer Vision and Pattern Recognition, Volume 1, pp.206-212, 2005.

Z. Zhang, “A flexible new technique for camera calibration”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 22, Issue 11, pp.1330-1334, November 2000.

Estimation of Projective Geometry

Q.-T. Luong, R. Deriche, O.D. Faugeras, T. Papadopoulo: “On Determining the Fundamental Matrix: Analysis of Different Methods and Experimental Results”, Research Report 1994, INRIA, April 1993.

P.H.S. Torr, D.W. Murray: “The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix”, International Journal of Computer Vision, 24(3):271-300, September 1997.

Z. Zhang: “Determining the Epipolar Geometry and its Uncertanty: A Review”, Research Report 2927, INRIA, July 1996.

04), “Multiple View Geometry in Computer Vision”, Cambridge University Press, Cambridge, United Kingdom, 2nd Edition.

3D Reconstruction

C. Baillard, A. Zisserman: “Automatic Reconstruction of Piecewise Planar Models from Multiple Views”,  Proceedings of CVPR '99, pages 559-565, Fort Collins, CO, USA, June 1999.

R.P. Wildes: „Direct Recovery of Three-Dimensional Scene Geometry from Binocular Stereo Disparity“, Trans. on Pattern Analysis and Machine Intelligence, Vol.13, No.8, August 1991.

Homography

M. Han, T. Kanade: „Homography-Based 3D Scene Analysis of Video Sequences”, Proceedings of DARPA Image Understanding Workshop (IUW '98), Monteray, CA, USA, November 1998.

Z. Zhang, A. Hanson: “3D Reconstruction Based Homography Mapping”, Proceedings of DARPA Image Understanding Workshop (IUW '96), volume II, pages 1007-1012, Palm Springs, CA, USA, February 1996.

Trifocal Stereo and Trifocal Tensor

L. Falkenhagen: "Block-Based Depth Estimation from Image Triples with Unrestricted Camera Setup," IEEE Workshop Multimedia Sig. Proc., Princeton, NJ, June 1997.

O. D. Faugeras, L. Robert: “What can two images tell us about a third one?” The International Journal of Computer Vision, 18(1):5-20, April 1996.

N. Ayache, F. Lustmann: „Trinocular Stereo Vision for Robotics“, Trans. on Pattern Analysis and Machine Intelligence, Vol.13, No.1, January 1991.

U.R. Dhond, J. K. Aggarwal: “A Cost-Benefit Analysis of a Third Camera for Stereo Correspondence”, International Journal of Computer Vision, 6(1):39-58, 1991.

R.I. Hartley: “Lines and Points in Three Views and the Trifocal Tensor”, The International Journal of Computer Vision, 22(2):125-140, March 1997.

P.H.S. Torr, A.Zisserman: “Robust Parameterization and Computation of the Trifocal Tensor”, Image and Vision Computing, 15(8):591-605, August 1997.

View Synthesis

S.Laveau, O.D. Faugeras: “3-D Scene Representation as a Collection of Images and Fundamental Matrices”, Research Report 2205, INRIA, February 1994.

W.R. Mark, G.Bishop: „Efficient Reconstruction Techniques for Post-Rendering 3D Image Warping”, Technical Report TR98-011, University of North Carolina at Chapel Hill, 1998.

S. Avidan, A. Shashua: “Novel View Synthesis by Cascading Trilinear Tensors”, IEEE Transactions on Visualization and Computer Graphics, 4(4):293-306, October-December 1998.

Details about examination

Details about examination

Dates for exams by agreement. The examination is performed as individual examination with a duration of 30 min per candidate. It consist on written and oral parts.

Next possibility for oral exam is after end of winter term in February/March 2017.

Beside this, you may request via email for an examination date for "Stereo Image Processing in Videocommunication" or "View Synthesis in Videocommunication".

Evaluation of past lectures (in German)

Evaluation of past lectures (in German)

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2015/2016
Was hat Ihnen besonders gut gefallen?
  • Folien: ausführlich, online, Seitennummern im Buch, anschaulich durch viele Beispiele/Bilder
  • Referenzen zum aktuellen Stand der Forschung
  • Aufbau der Vorlesung und Buch begleitend zur Vorlesung
  • Dozent geht auf Stichpunkte/Grafiken der Folien ein
  • Redetempo gut/angenehm
  • Handout zu mathematischen Grundlagen hilfreich
Was fanden Sie verbesserungswürdig?
  • Themen werden zu schnell abgehandelt
  • Manche Herleitungen zu ausführlich
  • Herleitung mancher mathematischer Formeln könnte ausführlicher sein
  • Mehr praktische Beispiele/Rechenübungen oder Implementierungsaufgaben
  • Auf Beispiele in OpenCV eingehen, mehr Praxisnähe

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2016
Was hat Ihnen besonders gut gefallen?
  • Nachträgliche Verbesserungen in den Folien
  • Kombination von theoretischen Inhalten und praktischen Beispielen
  • Vortragsstil, freundliche und zuvorkommend Art des Dozenten
  • Schöne Gliederung, Zusammenfassungsfolie
  • Tolle Beispiele und interessante Inhalte
  • Gute Graphiken, Zeichnungen zur Geometrie
Was fanden Sie verbesserungswürdig?
  • Teilweise Redundanz in der theoretischen Herleitung
  • Nicht-handschriftliche Ergänzungen zur Theorie hilfreich
  • Die Absicht bei den Herleitungen ist im Nachhinein nicht mehr eindeutig
  • Sprechtempo war etwas zu langsam
  • Indizes in den Folien sollten überprüft werden
  • Handschrift teils unleserlich
  • Übersicht über Thema bei Vorlesungsbeginn

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2015/2016
Was hat Ihnen besonders gut gefallen?
  • Bereitstellung der Lehrmaterialien
  • Zeitplan
  • Struktur der Vorlesung und Inhalte
  • Zusammenfassung am Ende des Themas
  • Selbst Beispiele rechnen
Was fanden Sie verbesserungswürdig?
  • Geometrische Bedeutung der Formeln besser erklären
  • Mehr praktische Beispiele
  • Tempo manchmal zu schnell
  • Hausaufgaben oder Programmierübungen nach der Vorlesung
  • Lichtverhältnisse im Seminarraum

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2015
Was hat Ihnen besonders gut gefallen?
  • Vorlesung orientiert sich am Buch, sehr gut für die Vor- und Nachbereitung
  • Video- und Bildbeispiele aus der Praxis des Fraunhofer HHI
  • Aufbau der Folien
  • Bilder in den Folien bauen sich nach und nach auf
  • Vorlesungstempo und Vertiefung/Erklärung bestimmter Themen
Was fanden Sie verbesserungswürdig?
  • Längere Überlegungen und Gedankenpausen des Dozenten stören den Gedankenfluss
  • Mehr anschauliche Beispiele

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2014/2015
Was hat Ihnen besonders gut gefallen?
  • Vorlesungsfolien im Voraus
  • Kein Mitschreiben der Herleitungen notwendig
  • Folien und ausführliche Beschreibung der Thematik
  • Ausgewogenheit zwischen Theorie und geometrischem Verständnis
  • Gute Veranschaulichung komplexer Zusammenhänge (z.B. projektive Geometrie)
Was fanden Sie verbesserungswürdig?
  • Mehr Praxisbeispiele, Demos, algorithmische Beispiele
  • Farbwahl der Folien verbessern, zu geringer Kontrast

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2014
Was hat Ihnen besonders gut gefallen?
  • Inhalte der Vorlesung
  • Kostenloser Download des Buches
  • Anschauliches Bildmaterial
  • Darstellung der mathematischen Hintergründe
Was fanden Sie verbesserungswürdig?
  • Verweise auf Buchkapitel und Zusatzliteratur
  • Mehr Animationen
  • Vorlesungstempo könnte höher sein
  • Überlappung mit LV Stereobildverarbeitung
  • Vor-und Nachteile von Verfahren verdeutlichen
  • Bessere Vorbereitung bei handschriftlichen Herleitungen und ausführlichere Darstellung

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2013/2014
Was hat Ihnen besonders gut gefallen?
  • Gute Vorbereitung
  • Interessante Themen, neue Forschungsthemen
  • Gut strukturiert, konsistente Verwendung von Begriffen und Bezeichnungen
  • Übersichtliche Folien und sehr gute Skizzen
  • Offener Umgang, sehr gute Beantwortung von Fragen
Was fanden Sie verbesserungswürdig?
  • Mehr Bilder aus der Anwendung, mehr Animationen
  • Herleitungen mancher Formeln verbessern
  • Rechenübungen teilweise überflüssig
  • Aktuellere Beispiele

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2013
Was hat Ihnen besonders gut gefallen?
  • Neue Aspekte von Bildverarbeitungsmethoden
  • Interessante Forschungsthemen
  • Gute Beantwortung der Fragen
  • Herleitung auf Tablet
Was fanden Sie verbesserungswürdig?
  • Beispiele für Algorithmen, Programmierbeispiele
  • Bei theoretischen Herleitungen, Grafiken zur Anschauung

 


Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2012/2013
Was hat Ihnen besonders gut gefallen?
  • Rechenaufgaben
  • Praktische Beispiele
  • Guter Aufbau und gute Struktur der Vorlesung
  • Gute Kommunikation, Folien schnell online verfügbar
  • Mathematische Zusammenhänge gut verständlich
Was fanden Sie verbesserungswürdig?
  • Mehr Videos zur Erläuterung von Verfahren
  • Formeln in den Folien sind schlecht lesbar
  • Mehr Beispielaufgaben
  • Herleitungen eher auf Folie als an der Tafe

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2012
Was hat Ihnen besonders gut gefallen?
  • Praktische Beispiele
  • Visualisierung komplexer Inhalte
  • Forschungsbezug
  • Wiederholung am Anfang jeder Vorlesung
  • Handouts z.B. zum ersten Vorlesungsthema
  • Flexible Wahl des Prüfungstermins
  • Angemessenes Tempo
  • Ausführliche Beschreibung der Inhalte durch Tafelbilder, Formeln, Gafiken
Was fanden Sie verbesserungswürdig?
  • Vorlesungsfolien vor der Vorlesung
  • Mathematische Folien zu wenig selbsterklärend, Notizen auf den Folien wäre gut
  • Mehr Beispiele aus der Praxis
  • Vortragstempo steigern
  • Mehr Umdrucke nicht nur zu Semesterbeginn

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2011/2012
Was hat Ihnen besonders gut gefallen?
  • Vorlesungstempo
  • Rechenaufgaben
  • Klare Abgrenzung der Themen
  • Anwendung mathematischer Verfahren
Was fanden Sie verbesserungswürdig?
  • Folien sind nicht vor der Vorlesung im Netz verfügbar
  • Herleitungen sollten auch auf die Folie
  • Manchmal zu langsam
  • Paralleler Übungsbetrieb wäre schön

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2011
Was hat Ihnen besonders gut gefallen?
  • Anschauliche Beispiele aus der Praxis
  • Handouts z.B. zum ersten Vorlesungsthema
  • Aktuelle Forschung
  • Materialien und Vorlesung gut aufeinander abgestimmt
  • Langsamer, ausführlicher, guter Vortrag
Was fanden Sie verbesserungswürdig?
  • Mehr schriftliche Zusammenfassung
  • Fragmentierter Zeitplan
  • Vortragstempo steigern
  • Bedeutung einiger Graphiken ohne Erklärung nicht erkennbar
  • detailliertere Erklärungen in den Folien

 


Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2010/2011
Was hat Ihnen besonders gut gefallen?
  • Gute verständliche Erklärung
  • Kurze Rechenübung
  • Bezug zu aktuellen Forschungsergebnissen, praxisnahe Themen
  • Sinnvoller Aufbau
  • Evaluation
  • VL zur projektiven Geometrie verständlicher als in anderen Vorlesungen
Was fanden Sie verbesserungswürdig?
  • Folien sind nicht vor der Vorlesung im Netz verfügbar
  • Bei den Rechenübungen sollten Formlen für die Berechnung nochmal wiederholt werden
  • Folie mit Zusammenfassung und Gleichungen
  • Implementierungsdetails, Laufzeiten d. Algorithmen

 


Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2010
Was hat Ihnen besonders gut gefallen?
  • Roter Faden
  • Souverän
  • Vortragsaufbau
  • Materialien und Vorlesung gut aufeinander abgestimmt
  • Langsamer, ausführlicher, guter Vortrag
Was fanden Sie verbesserungswürdig?
  • Keine Praxis/Tutorien
  • Man droht in einer Menge von Formeln zu „ertrinken“

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2009/2010
Was hat Ihnen besonders gut gefallen?
  • Auf Fragen wird gut eingegangen
  • Bezug zum gesamten Thema der Vorlesung
  • Kleine Teilnehmeranzahl
  • Langsame und ausführliche Vortragsweise
  • Vorlesungstempo
  • Leicht für einen Ausländer zu verstehen
Was fanden Sie verbesserungswürdig?
  • Folien sind nicht vor der Vorlesung im Netz verfügbar
  • Mathematische Formeln sollten mit mehr Beispielen gerechnet werden
  • Keine praktischen Implementierungen, Übungen in Matlab wären toll

 


Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2009
Was hat Ihnen besonders gut gefallen?
  • Gute Folien
  • Guter Vortragsstil und gute Erklärungen
  • Vorlesung mit Warping und trivalentem Tensor gab guten Einblick in BS-Verfahren
  • Guter Einblick in die mathematische Theorie, Herleitungen
  • Praxisbezug und Aktualität
  • Verdeutlichung der Theorie mit kleinen Videos/Animationen (Tempel, Panoramen)
  • Wiederholung der letzten Vorlesung
Was fanden Sie verbesserungswürdig?
  • Mathematische Herleitungen oft schnell zu undurchsichtig
  • Vortragsweise könnte lebhafter sein, Betonung
  • Teilweise fehlen einfache Beispiele, um die Theorie besser verstehen zu können
  • Indizierung der Bezeichner nicht konsistent zwischen Tafelbild und Folien

 


Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2008/2009
Was hat Ihnen besonders gut gefallen?
  • Fragen wurden geklärt
  • Ruhige Art des Dozenten
  • Praxisnahe Beispiele
  • Übersichtliche geometrische Darstellungen
  • Tolle Anregungen für eigene Matlab-Untersuchungen
  • Rechenübungen unterstützen das Verständnis
  • Tempo nicht zu schnell
  • Gute Folien aus sich verständlich
Was fanden Sie verbesserungswürdig?
  • Schlecht gibt‘s nich
  • Da fällt mir nichts ein

 


Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2008
Was hat Ihnen besonders gut gefallen?
  • Folien und Tafelbild
  • Einblicke in die Praxis
  • Übungsaufgaben
  • Kleine Wiederholungen und Übungen sehr hilfreich
  • Gute anschauliche Folien
  • Netter und sympathischer Vortragsstil
  • Fragen sehr gut beantwortet
Was fanden Sie verbesserungswürdig?
  • Übungsaufgaben könnten häufiger sein
  • Vortragstempo könnte schneller sein
  • Etwas ausführlichere Folien

 


Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2007/2008
Was hat Ihnen besonders gut gefallen?
  • Das Thema der Vorlesung
  • Rechenübungen sind sehr nützlich
  • Die erste Vorlesung
  • Nutzung nicht nur von Folien sondern auch Erklärungen an der Tafel
  • Der Professor ist nett
  • Die Einladung ins Labor
Was fanden Sie verbesserungswürdig?
  • Etwas mehr Praxisnähe
  • Folien sind nicht vor der Vorlesung im Netz verfügbar
  • Folien könnten ausführlicher sein
  • Mathematische Formeln sind ein bisschen schwer zu verstehen
  • Keine praktischen Implementierungen, Übungen in Matlab wären toll

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2007
Was hat Ihnen besonders gut gefallen?
  • Praktische Beispiele
  • Bildbeispiele
Was fanden Sie verbesserungswürdig?
  • Oftmals sehr theoretisch
  • Motivation am Anfang der Vorlesung wäre hilfreich
  • Dozent orientiert sich stark nach dem Lehrbuch
  • Inhalt ohne Buch schwer zu erfassen

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2006/2007
Was hat Ihnen besonders gut gefallen?
  • Rechenübungen und die Zeit dafür während der Vorlesung
  • Vorlesungen sind gut strukturiert und verständlich
  • Inhaltlich sehr interessant
  • Die praktischen Beispiele (z.B. Homographie, Epipolargeometrie)
  • Nicht zu theoretisch
  • Teile der Vorlesung in Englisch
  • Vorlesung deckt einen großen Bereich ab
  • Tempo der Vorlesung
Was fanden Sie verbesserungswürdig?
  • Etwas mehr Praxisnähe
  • Folien sind nicht aus sich heraus verständlich, wodurch man gezwungen ist, das Buch zu kaufen (gibt es nicht in der Unibibliothek)

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2005/2006
Was hat Ihnen besonders gut gefallen?
  • Gutes Skript, scheint sehr umfangreich
  • Inhalte der Vorlesung
  • Die Probleme werden genau erklärt
Was fanden Sie verbesserungswürdig?
  • Dieses Semester nichts

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2005
Was hat Ihnen besonders gut gefallen?
  • Gutes Skript, scheint sehr umfangreich
  • Kompetenter Dozent
  • Gute Kombination aus Vortrag, Tafelbild, PowerPoint-Präsentation und Skript
  • Trotz weniger Studierender wird die Vorlesung gehalten
Was fanden Sie verbesserungswürdig?
  • Vortrag manchmal zu langsam
  • Einführung in die benötigten Grundlagen der Geometrie wären nützlich
  • Zu geringe Teilnehmerzahl

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2004/2005
Was hat Ihnen besonders gut gefallen?
  • Inhalt der Vorlesung
  • Skript
  • Dozent beantwortet alle Fragen sehr freundlich
  • Die Übungsaufgaben helfen beim Verständnis
Was fanden Sie verbesserungswürdig?
  • Übungsaufgaben könnten auch im Umdruck stehen

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2004
Was hat Ihnen besonders gut gefallen?
  • Gute theoretische Grundlagen
  • Ausgedruckte Materialien unentgeltlich
  • Anzahl und Übersichtlichkeit der Folien
Was fanden Sie verbesserungswürdig?
  • Teilweise zuviel Theorie
  • Zu wenige Beispiele, wie sieht das in der Praxis aus?
  • Sprachtempo des Dozenten, viele Pausen
Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2003/2004
Was hat Ihnen besonders gut gefallen?
  • Rechnen von Beispielaufgaben
  • Ausgewogenheit zwischen Präsentation und Tafel
  • Zeichnungen gut verständlich, Inhalt baut aufeinander auf
  • Die 1. Vorlesung
  • Leicht verständlich, keine Vorkenntnisse
  • Kostenlose Handouts und Folien
  • Dozent ist bemüht und kennt Inhalt der VL sehr gut
Was fanden Sie verbesserungswürdig?
  • Skript ist nur kurze Zusammenfassung der VL
  • Weiterführende Literatur angeben
  • Beschreibung der Zeichnungen und mathem. Formeln
  • Zu viel Zeit für Rechenaufgaben
  • Dozent leicht nervös, redundante Erklärungen, VL zieht sich in die Länge
  • Inkorrekte Links auf Web-Seite
  • Wenig Beispiele

Ergebnis der Umfrage zur Vorlesung " Bildsynthese in der Videokommunikation" im SoSe 2003
Was hat Ihnen besonders gut gefallen?
  • Sehr guter Aufbau der Vorlesung
  • Die Zeichnungen in den Folien
  • Folien waren i.A. gut aufgebaut
  • Skript ähnelt der Vorlesung inhaltlich, hilfreich zum Nacharbeiten
  • Vorlesung ist verständlich, Theorie ist gut erklärt
  • Rechenaufgaben meist sehr einfach, führt zu besserem Verständnis
Was fanden Sie verbesserungswürdig?
  • Rechenaufgaben sind nicht immer verständlich
  • Mathematik ist ok, aber es ist nicht immer verständlich, was die Theorie bedeutet
  • Formeltheorie mit Ergebnissen aus Forschungsprojekten erklären

Anregung: Andere Techniken zur 3D Videokommunikation behandeln, was macht die Konkurrenz?

Ergebnis der Umfrage zur Vorlesung "Stereobildverarbeitung in der Videokommunikation" im WS 2002/2003
Was hat Ihnen besonders gut gefallen?
  • Die Handouts, gute Zusammenfassung, Bilder anschaulich
  • Zusammenfassungen zu den einzelnen Vorlesungen sind sehr sinnvoll
  • Ausgewogenheit zwischen Skript, Folien und Tafel
  • Klare nachvollziehbare Entwicklung des Materials
  • Einführung war sehr motivierend
  • Übungen zur Vektorrechnung
Was fanden Sie verbesserungswürdig?
  • Am Anfang der LV zu langsames Tempo und zum Ende zu schnell
  • Manchmal wird zu oft wiederholt (ist aber nicht besonders schlecht)
  • An manchen Stellen zu ausführlich (besonders am Anfang)
  • Nicht so viele Beispiele zum Nachrechnen, es könnten mehr sein

Ergebnis der Umfrage zur Vorlesung "Multi-View Geometrie in 3D Vision" im SoSe 2002

 

Books

Books

Media Production, Delivery and Interaction for Platform Independent Systems:
Format-Agnostic Media.
by O. Schreer, J.-F. Macq, O.A. Niamut, J. Ruiz-Hidalgo, B. Shirley, G. Thallinger, G. Thomas (eds.), John Wiley & Sons, Chichester, UK, January 2014

Presents current trends and potential future developments by leading researchers in immersive media production, delivery, rendering and interaction. The underlying audio and video processing technology that is discussed in the book relates to areas such as 3D object extraction, audio event detection; 3D sound rendering and face detection, gesture analysis and tracking using video and depth information. The book will give an insight into current trends and developments of future media production, delivery and reproduction. Consideration of the complete production, processing and distribution chain will allow for a full picture to be presented to the reader. Production developments covered will include integrated workflows developed by researchers and industry practitioners as well as capture of ultra-high resolution panoramic video and 3D object based audio across a range of programme genres. Distribution developments will include script based format agnostic network delivery to a full range of devices from large scale public panoramic displays with wavefield synthesis and ambisonic audio reproduction to ’small screen’ mobile devices. Key developments at the consumer end of the chain apply to both passive and interactive viewing modes and will incorporate user interfaces such as gesture recognition and ‘second screen’ devices to allow manipulation of the audio visual content.

3D Videocommunication: Algorithms, concepts and real-time systems in human centred communication.

O. Schreer, P. Kauff, Th. Sikora (eds.)

ISBN: 0-470-02271-X, Hardcover, 364 pages, John Wiley & Sons, Chichester, UK,
July 2005

Since April 2011, a translation of this book to simple Chinese is available. Translated by Q. Dai, X. Cao, and G. Er, Department of Automation, Tsinghua University, Beijing, China: 3D Videocommunication, simple chinese edition, Tsinghua University Press, Beijing, China, April 2011.

The migration of immersive media towards telecommunication applications is advancing rapidly. Impressive progress in the field of media compression, media representation, and the larger and ever increasing bandwidth available to the customer, will foster the introduction of these services in the future. One of the key components for the envisioned applications is the development from two-dimensional towards three-dimensional audio-visual communications. With contributions from key experts in the field, 3D Videocommunication:

  • provides a complete overview of existing systems and technologies in 3D video communications and provides guidance on future trends and research;
  • considers all aspects of the 3D videocommunication processing chain including video coding, signal processing and computer graphics;
  • focuses on the current state-of-the-art and highlights the directions in which the technology is likely to move;
  • discusses in detail the relevance of 3D videocommunication for telepresence systems and immersive media; and
  • provides an exhaustive bibliography for further reading.

Researchers and students interested in the field of 3D audio-visual communications will find 3D Videocommunication a valuable resource, covering a broad overview of the current state-of-the-art. Practical engineers from industry will also find it a useful tool in envisioning and building innovative applications.

Stereoanalyse und Bildsynthese (engl. Stereo Analysis and View Synthesis),
by Schreer, O. 2005, XII, 278 pages, 165 illustrations.
Softcover, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo, ISBN 3-540-23439-X, March 2005

Content of the book
Sample chapter
Errata

Seit März 2005 ist ein deutschsprachiges Lehrbuch zur "Stereoanalyse und Bildsynthese" im Springer Verlag erhältlich. Weitere Informationen finden sie hier.

Dieses Buch behandelt das sehr junge Forschungsgebiet der Stereobildanalyse und Bildsynthese. Basierend auf einer ausführlichen Darstellung der projektiven Geometrie leitet der Autor das mathematische Modell einer einzelnen Kamera, die Stereogeometrie und die geometrischen Beziehungen zwischen mehreren Kameraansichten her. Er erläutert detailliert die Herausforderungen in der Stereoanalyse, gibt eine Übersicht über existierende Verfahren und Lösungskonzepte und beschreibt moderne Bildsyntheseverfahren. Zahlreiche praktische Beispiele ergänzen die detaillierten mathematischen Ausführungen und erleichtern so das Verständnis. Das Buch überzeugt durch den logischen Aufbau und durch die geschlossene Erläuterung der mathematischen Grundlagen in einer einheitlichen Form und Notation. Es eignet sich besonders für Studierende und Wissenschaftler der Elektrotechnik und Informatik, insbesondere der Kommunikationstechnik.

Geschrieben für:
Studierende an Universitäten und Technischen Hochschulen in Elektrotechnik, Nachrichtentechnik, Informatik, Kommunikationstechnik; wissenschaftlich Tätige in Forschung und Industrie (Industrielle Bildverarbeitung, Videokommunikation, Medienproduktion).

Hinweis: Kein Buch ist perfekt. Falls Sie Fehler finden, bin ich um jeden Hinweis dankbar. Bitte senden Sie eine email an Oliver Schreer.

Talks, Tutorials, Lectures, Awards, ...

Talks, Tutorials, Lectures, Awards, ...

Invited Talks

Oliver Schreer, W. Waizenegger, S. Ebel, I. Feldmann, „3D Video Analysis for Immersive Media and Communication“, FKTG Fachtagung, Leipzig, Germany, May 9-11, 2016.

Oliver Schreer, „Produktions- und Distributionsszenarien für höchstauflösende Videosysteme“, ITG Fachausschuss 3.1 & 3.2, Berlin, Germany, Oct. 25, 2012.

O. Schreer, „The Next Level of Immersive Experience: Live Panoramic Stereo Video Acquisition and Rendering“, 3D Stereo Media, Liege, Belgium, Dec. 9, 2011.

O. Schreer, „Supporting Language Research with Generic Automatic Audio/Video Analysis“, DOBES Workshop, Potentials of Language Documentation: Methods, Analyses, and Utilization, Leipzig, Nov. 3, 2011.

O. Schreer, "Video Analysis for Automatic Annotation of Human Motion and Behavior", Cologne-Aachen Gesture Colloquium, Deutsche Sporthochschule Köln, Cologne, Germany, May 16, 2011.

O. Schreer, "Solutions for Immersive 3D Video Communication", iMinds 2010, breakout session on "Immersive Experiences", Ghent, Belgium, December 16, 2010.

O. Schreer, "Recent Advances in 3D Videocommunication", Dept. of Computer Science, Vision, Image Processing and Sound Laboratory, Prof. Andrea Fusiello, University of Verona, Italy, April 15, 2010.

O. Schreer, "Future Directions of 3DTV", Sat Expo Europe, Rome, Italy, February 4, 2010.

O. Schreer, "Advances in 3D Videocommunication", School of Computing, Prof. Manuel Trucco, University of Dundee, United Kingdom, June 24, 2009.

O. Schreer, "Stereo Image Processing and View Synthesis in Advanced 3D-TV Concepts", Dept. of Electronic and Computer Engineering (ECE), Centre for Media Communications Research, Prof. Abdul Sadka, Brunel University West London, United Kingdom, November 17, 2007.

O. Schreer, "Adaptation of Multi-View Geometries for Capturing and 3D Reproduction in Advanced 3D-TV Services", Dept. of Computer Science, Vision, Image Processing and Sound Laboratory, Prof. Andrea Fusiello, University of Verona, Italy, LIMA 3D Workshop (Low cost 3D imaging and modelling automatic system), March 17, 2006.

O. Schreer, "Current State of Research on Immersive Video Conferencing", Department of Computer Science, Prof. Henry Fuchs, University of North Carolina at Chapel Hill, USA, July 23, 2003.

O. Schreer, "Advances in Immersive Video Communication", Dept. of Computer and Information Science, Prof. Kostas Daniilidis, University of Pennsylvania, USA, July 18, 2003.

Tutorials

O. Schreer, P. Kauff, "VR Masterclass", DVB World 2017, Vienna, Austria, March 13, 2017.

O. Schreer, "Challenges and Solutions for Immersive 3D Video Communication", 3DTV-CON, Tampere, Finland, June 8, 2010.

O. Schreer, "3D Video Processing for Immersive 3D Videoconferencing", Int. Conf. on Image Analysis and Processing, Salerno, Italy, September 8, 2009.

O. Schreer, "Concepts, Systems and Algorithms for Immersive Video Communication", 25th DAGM Symposium on Pattern Recognition, Magdeburg, Germany, September 9, 2003.

O. Schreer, "Immersive Videoconferencing", Int. Conference on Multimedia and Expo (ICME 2003), Baltimore, MD, USA, July 6, 2003.

Lectures

O. Schreer, "Challenges and Solutions for Real-Time Immersive Video Communication", University of Genova, Italy, Biophysical and Electronic Engineering Dept., Prof. Carlo Regazzoni, duration 10 hours, 13-15 April 2005.

O. Schreer, "Stereoanalysis and View Synthesis in 3D Video Communication", University of Verona, Italy; Vision, Image Processing and Sound Laboratory; Dept. of Computer Science, Prof. Andrea Fusiello, 7th VIPS Advanced School on Computer Vision, Pattern Recognition and Image Processing, duration 16 hours, 13-16 March 2006.

Awards

Distinguished Paper Award of SID Symposium Digest of Technical Papers 2017 to Thomas Ebner, Ingo Feldmann, Sylvain Renault, and Oliver Schreer for their paper "Dynamic Real World Objects in Augmented and Virtual Reality Applications" published at SID Symposium Digest of Technical Papers, Los Angeles, USA, May 2017.

Lumiére Best Paper Award of the International 3D & Advanced Imaging Society 2014 to S. Ebel, W. Waizenegger, M. Reinhardt, O. Schreer and I. Feldmann for their paper “Visibility-driven Patch Group Generation,” published at IEEE International Conference on 3D Imaging (IC3D), Liege, Belgium, December 2014.

EURASIP - Bi-Annual Best Paper Award 2012 to P. Kauff, N. Atzpadin, C. Fehn, M. Mueller, O. Schreer, A. Smolic, and R. Tanger, for their paper “Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability,” published in Signal Processing: Image Communication. Vol. 22, pp. 217–234, 2007.

President's Award for Best Technical Paper at International Broadcast Conference 2001 (IBC) to C. Fehn, P. Kauff, O. Schreer and Ralf Schäfer for their paper "Interactive Virtual View Video for Immersive TV Applications", published at proceedings of International Broadcast Conference (IBC 2001), Amsterdam, Netherlands, pp. 53-61, September 2001.

Committees

Chair of Special Session “Interactive and Immersive Entertainment and Communication ”, 18th International Conference on MultiMedia Modeling (MMM 2012), January 4-6, 2012, Klagenfurt, Austria

Program Chair, 12th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), May 13-15, 2011, Delft, Netherlands

General Chair, 1st International Workshop on 3D Video Processing (3DVP), in conjunction with ACM Multimedia 2010, Florence, Italy, 29th October 2010.

Chair of Special Session “Real-time high definition depth estimation”, 3DTV-CONFERENCE, June 7-9, 2010, Tampere, Finland.

Chair of Special Session “Rushes - Multimedia Indexing and Retrieval of Unedited Audio-Visual Footage”, 9th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), May 7-9, 2008, Klagenfurt, Austria.

Demonstrations

O. Schreer, "Real-time Gesture Recognition and Avatar Animation System”, Int. Conf. on Image Analysis and Processing (ICIAP), Modena, Italy, September 2007.

O. Schreer, P. Eisert, P. Kauff, R. Tanger, R. Englert, "GestAvatar - Real-Time Animation of Avatars", 9th European Conf. on Computer Vision (ECCV), Graz, Austria, May 2006.

An Artist's Impression by Emanuele Trucco

An Artist's Impression by Emanuele Trucco

Emanuele Trucco is not only an enthusiastic researcher in computer vision, but also an outstanding artist. He kindly offered me a set of introductory drawings for my lecture book on stereo image processing and view synthesis at Springer.

All about his scientific work at School of Computing, University of Dundee, Scotland, can be found here.