Ingo Feldmann

Ingo Feldmann is Head of Immersive Media & Communication group at Vision & Imaging Technologies department.

His R&D activities are related to the following keywords: 3D video analysis, virtual view synthesis, real-time 3D video processing, future immersive media services exploiting Augmented Reality and Virtual Reality technologies, 3D video communication, human motion and gesture analysis and touchless interaction with media and content.

For further details about his activities please check the subsections below.

Biography

Biography

Ingo Feldmann is head of the Immersive Media & Communication group in the Vision & Imaging Technologies department of Fraunhofer Heinrich Hertz Institute HHI. He received his Dipl.-Ing. degree in Electrical Engineering from the Technical University of Berlin in 2000 respectively. Since September 2000 he is with Fraunhofer HHI, where he was engaged in various research activities in the field of 2D image processing, 3D scene reconstruction and modeling, digital cinema, multi-view projector-camera systems, real-time 3D video conferencing and immersive TV applications. He was involved in several German and European research projects, such as ATTEST, VIRTUE, ITI, TSDK, Prime, Rushes, 3DPresence and FascinatE. Further on, he contributed with his work to the MPEG 3DAV ad hoc group. Ingo Feldmann is constantly acting as reviewer for major Computer Vision conferences and published more than 50 papers. His main research activities are in the area of multi-view video processing, 3D reconstruction, human-machine interaction, future immersive media services exploiting Augmented Reality and Virtual Reality technologies.

Publications

Publications

Books and Book Chapters

    2014

  • Oliver Schreer, Ingo Feldmann, R. Salmon, J. Steurer, and G. Thomas:
    Video Acquisition,
    in Oliver Schreer, J.-F. Macq, O.A. Niamut, J. Ruiz-Hidalgo, B. Shirley, G. Thallinger, G. Thomas, (Editors): Media Production, Delivery and Interaction for Platform Independent Systems: Format-Agnostic Media, John Wiley & Sons, Chichester, UK, pp. 74-129, January 2014, Book Chapter.

Journal Papers


    2017

  • Thomas Ebner, Ingo Feldmann, Sylvain Renault, Oliver Schreer, and Peter Eisert:
    Multi-view reconstruction of dynamic real-world objects and their integration in augmented and virtual reality applications,
    Journal of the Society for Information Display, vol. 25, no. 3, pp. 151–157, March 2017, doi:10.1002/jsid.538.
  • 2015

  • Oliver Schreer, Ingo Feldmann, and Sascha Ebel:
    Fotorealistische 3D-Modellierung von Gebäuden,
    FKT-Fachzeitschrift für Fernsehen, Film und Elektronische Medien, no. 10, October 2015.

  • 2013

  • Oliver Schreer, Ingo Feldmann, Christian Weissig, Peter Kauff, and Ralf Schäfer:
    Ultrahigh-Resolution Panoramic Imaging for Format-Agnostic Video Production,
    Proceedings of IEEE, vol. 101, issue 1, pp. 99-114, January 2013, Invited Paper.

  • 2009

  • Oliver Schreer, Ingo Feldmann, I. Alonso, P. Concejero, A.H. Sadka, M. R. Swash, S. Benini, R. Leonardi, T. Janjusevic, and Ebroul Izquierdo:
    RUSHES - An Annotation and Retrieval Engine for Multimedia Semantic Units,
    International Journal on Multimedia Tools and Applications, Springer Netherlands, ISSN: 1380-7501 (Print) 1573-7721 (Online), October 1, 2009.

  • 2007

  • Christoph Fehn, Christian Weissig, Ingo Feldmann, Marcus Müller, Peter Eisert, Peter Kauff and H. Bloß:
    Creation of High-Resolution Video Panoramas for Sport Events,
    International Journal of Semantic Computing (IJSC), vol. 1, no. 2, pp. 171-184, June 2007.

Conference Proceedings


    2017

  • Thomas Ebner, Ingo Feldmann, Sylvain Renault, and Oliver Schreer:
    Dynamic Real World Objects in Augmented and Virtual Reality Applications,
    SID Symposium Digest of Technical Papers, Los Angeles, USA, vol. 48, no. 1, pp. 673–676, May 2017, Distinguished Paper Award.
  • 2016

  • Sylvain Renault, Thomas Ebner, Ingo Feldmann, and Oliver Schreer:
    Point cloud compression framework for the Web,
    International Conference on 3D Imaging (IC3D 2016), Liége, Belgium, December 13-14, 2016.
  • Ingo Feldmann, Oliver Schreer, Thomas Ebner, Peter Eisert, Anna Hilsmann, N. Nonne, and S. Haeberlein:
    Digitization of People and Objects for Virtual Museum Applications,
    Electronic Media and Visual Arts, Berlin, Germany, November 10-11, 2016.
  • Ingo Feldmann, Oliver Schreer, Thomas Ebner, Sascha Ebel, and Sylvain Renault:
    Real Persons and Objects for Virtual Reality Applications,
    Society for Information Display Mid-Europe Fall Meeting (SID-ME), Berlin, Germany, November 3-4, 2016.
  • Wolfgang Waizenegger, Ingo Feldmann, Oliver Schreer, Peter Kauff, Peter Eisert:
    Real-time 3D Body Reconstruction for Immersive TV,
    Proceedings of the 23rd International Conference on Image Processing (ICIP 2016), Phoenix, Arizona, USA, September 25-28, 2016.

  • 2014

  • Sascha Ebel, Wolfgang Waizenegger, Michael Reinhardt, Oliver Schreer, and Ingo Feldmann:
    Visibility-driven Patch Group Generation,
    IEEE International Conference on 3D Imaging (IC3D), Liege, Belgium, December 2014, Best Paper Award.

  • 2013

  • C. Haccius, T. Herfet, V. Matvienko, Peter Eisert, Ingo Feldmann, A. Hilton, J. Guillemaut, M. Klaudiny, J. Jachalsky, and S. Rogmans:
    A Novel Scene Representation for Digital Media,
    Proceedings of NEM Summit, Nantes, France, October 2013.
  • Wolfgang Waizenegger, Ingo Feldmann, Oliver Schreer, and Peter Eisert:
    Scene Flow Constrained Multi-Prior Patch-Sweeping for Real-Time Upper Body 3D Reconstruction,
    Proceedings IEEE International Conference on Image Processing (ICIP), Melbourne, Australia, September 2013.
  • Oliver Schreer, Marian Bertzen, Nicole Atzpadin, Christian Riechert, Wolfgang Waizenegger and Ingo Feldmann:
    User-Feedback and Optimization for Multi-View Calibration,
    11th IEEE IVMSP Workshop: 3D Image/Video Technologies and Applications, Yonsei University, Seoul, Korea, June 10-12, 2013.

  • 2012

  • Wolfgang Waizenegger, Nicole Atzpadin, Oliver Schreer, Ingo Feldmann and Peter Eisert:
    Model Based 3D Gaze Estimation for Provision of Virtual Eye Contact,
    Proceedings of 19th International Conference on Image Processing (ICIP 2012), Orlando, Florida, USA, September 2012.

  • 2011

  • Wolfgang Waizenegger, Ingo Feldmann, and Peter Eisert:
    Depth Driven Photometric and Geometric Image Registration for Real-Time Stereo Systems,
    16th International Workshop on Vision, Modeling and Visualization (VMV), Berlin, Germany, pp. 25-32, October 4-6, 2011.
  • Wolfgang Waizenegger, Nicole Atzpadin, Oliver Schreer and Ingo Feldmann:
    Patch-Sweeping with Robust Prior for High Precision Depth Estimation in Real-Time Systems,
    Proceedings of 18th International Conference on Image Processing (ICIP 2011), Brussels, Belgium, September 11-14, 2011.
  • Wolfgang Waizenegger, Ingo Feldmann, and Oliver Schreer:
    Real-time Patch Sweeping for High-Quality Depth Estimation in 3D Videoconferencing Applications,
    SPIE 2011 Conference on Real-Time Image and Video Processing, San Francisco, CA, USA, January 23-27, 2011, Invited Paper.

  • 2010

  • Ingo Feldmann, Wolfgang Waizenegger, Nicole Atzpadin, and Oliver Schreer:
    Real-Time Depth Estimation for Immersive 3D Videoconferencing,
    Proceedings of 3DTV Conference 2010, Tampere, Finland, June 07-09, 2010.
  • Wolfgang Waizenegger and Ingo Feldmann:
    Calibration of a Synchronized Multi-Camera Setup for 3D Videoconferencing,
    roceedings of 3DTV Conference 2010, Tampere, Finland, June 7-9, 2010.
  • Oliver Schreer, S. Brodin, Ingo Feldmann, and Wolfgang Waizenegger:
    High-level Semantic Video Annotation Based on 3D Scene Structure Analysis,
    Proceedings of 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano del Garda, Italy, April 12-14, 2010.
  • O. Divorra Escoda, J. Civit, F. Zuo, H. Belt, Ingo Feldmann, Oliver Schreer, E. Yellin, W. Ijsselsteijn, R. van Eijk, D. Espinola, P. Hagendorf, Wolfgang Waizennegger, and R. Braspenning:
    Towards 3D-Aware Telepresence: Working on Technologies Behind the Scene,
    Proceedings of ACM Conference on Computer Supported Cooperative Work (CSCW), New Frontiers in Telepresence, Savannah, Georgia, USA, February 06-10, 2010.

  • 2009

  • Wolfgang Waizenegger, Ingo Feldmann, Peter Eisert, and Peter Kauff:
    Parallel High Resolution Real-Time Visual Hull on GPU,
    Proceedings of International Conference on Image Processing (ICIP), Cairo, Egypt, November 2009.
  • Ingo Feldmann, Nicole Atzapadin, Oliver Schreer, J.-C. Pujol-Acolado, J.-L. Landabaso, and O. Divorra Escoda:
    Multi-View Depth Estimation Based on Visual-Hull Enhanced Hybrid Recursive Matching for 3D Video Conference Systems,
    Proceedings of 16th International Conference on Image Processing (ICIP 2009), Kairo, Egypt, November 2009.
  • Ingo Feldmann, Oliver Schreer, Peter Kauff, Ralf Schäfer, Z. Fei, H.J.W. Belt, and Ò. Divorra Escoda:
    Immersive Multi-User 3D Video Communication,
    Proceedings of International Broadcast Conference (IBC 2009), Amsterdam, NL, September 2009.
  • Oliver Schreer, Ingo Feldmann, I. Alonso, P. Concejero, A.H. Sadka, and M.R. Swash:
    RUSHES - Retrieval of Multimedia Semantic Units for Enhanced Reusability,
    7th International Workshop on Content-Based Multimedia Indexing (CBMI 2009), Chania, Crete, Greek, June 3-5, 2009.
  • Oliver Schreer, Nicole Atzapadin, and Ingo Feldmann:
    Multi-baseline Disparity Fusion for Immersive Videoconferencing,
    2nd International Conference on Immersive Telecommunications (IMMERSCOM 2009), University of California, Berkeley, CA, USA, May 27-29, 2009.

  • 2008

  • Oliver Schreer, Ingo Feldmann, Nicole Atzpadin, Peter Eisert, Peter Kauff, Harm Belt:
    3DPresence – A system concept for multi-user and multi-party immersive 3D videoconferencing,
    5th European Conf. on Visual Media Production (CVMP 2008), London, UK, November 2008.
  • Ingo Feldmann, Wolfgang Waizenegger, Oliver Schreer:
    Extraction of 3D Scene Structure for Semantic Annotation and Retrieval of Unedited Video,
    Proceedings of International Workshop on Multimedia Signal Processing (MMSP), Cairns, Queensland, Australia, October 2008.
  • Wolfgang Waizenegger, Ingo Feldmann, and Oliver Schreer:
    Semantic Annotation and Retrieval of Unedited Video based on Extraction of 3D Camera Motion,
    Proceedings of 6th International Workshop on Content-Based Multimedia Indexing (CBMI), London, UK, June 2008.
  • Ingo Feldmann, Peter Kauff, Ralf Schäfer, Joachim Schüssler, and Christian Weissig:
    Technologien für höchstauflösende Aufnahme- und Projektionssysteme,
    Fernseh- und Kinotechnische Gesellschaft (FKTG), annual conference, Munich, May 2008, in German.

  • 2007

  • Ingo Feldmann, Peter Eisert, and Peter Kauff:
    Detection Strategies for Image Cube Trajectory Analysis,
    Proceedings of International Conference on Image Processing (ICIP 2007), San Antonio, Texas, USA, vol. 2, pp. 533-536, September 2007.
  • Christoph Fehn, Christian Weissig, Ingo Feldmann, Marcus Müller, Peter Eisert, Peter Kauff, and H. Bloß:
    Erzeugung von hochaufgelösten Video-Panoramen für Sport-Events,
    Proceedings of 12th Dortmunder Fersehseminar (DFS), Dortmund, Germany, pp. 133-138, March 2007, in German.

  • 2006

  • Christoph Fehn, Christian Weissig, Ingo Feldmann, Marcus Müller, Peter Eisert, Peter Kauff, and H. Bloss:
    Creation of High Resolution Video Panoramas of Sports Events,
    Proceedings of IEEE International Symposium on Multimedia (ISM2006), San Diego, USA, pp. 291-298, December 2006.

  • 2005

  • Christian Weissig, Ingo Feldmann, Joachim Schüssler, Ulrich Höfker, Peter Eisert, and Peter Kauff:
    A Modular High Resolution Multi-Projection System,
    Proceedings of 2nd Workshop on Immersive Communication and Broadcast Systems (ICOB 2005), Berlin, Germany, October 2005.
  • Ingo Feldmann, Peter Eisert, and Peter Kauff:
    Towards Arbitrary Camera Movements for Image Cube Trajectory Analysis,
    Proceedings of International Conference on Image Processing (ICIP 2005), Genova, Italy, pp. 812-815, September 2005.
  • M. Morgos, K. Ignasiak, Ingo Feldmann, Peter Eisert, P. Leray, and M. Marcon:
    Audiovisual Scene Rendering and Interaction,
    Proceedings of National Conference on Radiocommunications and Broadcasting (KKRRiT 2005), Krakow, Poland, pp. 41-52, June 2005.
  • Ingo Feldmann, Peter Kauff and Peter Eisert:
    Handling of Homogeneous Regions for Image Cube Trajectory Analysis,
    Proceedings of 6th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS, Montreux, Switzerland, April 2005.

  • 2004

  • Ingo Feldmann, Peter Kauff, Peter Eisert:
    Optimized Space Sampling for Circular Image Cube Trajectory Analysis,
    Proceedings of International Conference on Image Processing (ICIP 2004), Singapore, pp. 1947-1950, October 2004.

  • 2003

  • Ingo Feldmann, Peter Kauff, and Peter Eisert:
    Image Cube Trajectory Analysis for 3D Reconstruction of Concentric Mosaics,
    Proceedings of Workshop on Vision, Modeling, and Visualization, Munich, Germany, pp. 569-576, November 2003.
  • Eddie Cooke, Ingo Feldmann, Peter Kauff, and Oliver Schreer:
    A Modular Approach to Virtual View Creation for a Scalable Immersive Teleconferencing Configuration,
    Proceedings of International Conference on Image Processing (ICIP 2003), Barcelona, Spain, pp. 41-44, September 2003.
  • Ingo Feldmann, Peter Kauff, and Peter Eisert:
    Image Cube Trajectory Analysis for Concentric Mosaics,
    Proceedings of International Workshop on Very Low Bitrate Video VLBV 2003, Madrid, Spain, pp. 341-350, September 2003.
  • Ingo Feldmann, Peter Eisert, and Peter Kauff:
    Extension of Epipolar Image Analysis to Circular Camera Movements,
    Proceedings of International Conference on Image Processing ICIP 2003, Barcelona, Spain, vol. 3, pp. 697-700, September 2003.
  • Ingo Feldmann, Oliver Schreer, and Peter Kauff:
    Nonlinear Depth Scaling For Immersive Video Applications,
    Proceedings of 4th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2003), London, UK, pp. 433-438, April 2003.
  • Ingo Feldmann, Ulrich Gölz, and Peter Kauff:
    Navigation Dependent Nonlinear Depth Scaling,
    Proceedings of 3rd International Picture Coding Symposium (PCS 2003), St. Malo, France, pp. 387-390, April 2003.
  • Eddie Cooke, Ingo Feldmann, Peter Kauff, and Oliver Schreer:
    Multi-View Synthesis for an Extendable Teleconferencing System,
    Proceedings of 3rd International Picture Coding Symposium (PCS 2003), St. Malo, France, pp. 199-204, April 2003.

  • 2002

  • Oliver Schreer, Ingo Feldmann, Ulrich Gölz, and Peter Kauff:
    Fast and Robust Shadow Detection in Videoconference Applications,
    Proceedings of 4th EURASIP IEEE International Symposium on Video Processing and Multimedia Communications (VIPromCom), Zadar, Croatia, pp. 371-377, June 2002.
  • Ingo Feldmann, Serap Askar, Nicole Brandenburg, Peter Kauff, and Oliver Schreer:
    Real-Time Segmentation for Advanced Disparity Estimation in Immersive Videoconference Applications,
    Proceedings of 10th International Conference on Computer Graphics, Visualization and Computer Vision (WSCG 2002), Plzen, Czech Republic, pp. 171-178, February 2002.

Contribution to Standards

    2008

  • Ingo Feldmann, Marcus Müller, Frederik Zilly, Ralf Tanger, Karsten Müller, Aljoacha Smolic, Peter Kauff, and Thomas Wiegand:
    HHI Test Material for 3D Video,
    ISO/IEC JTC1/SC29/WG11, MPEG08/M15413, Archamps, France, May 2008.
  • Ingo Feldmann, Marcus Müller, Frederik Zilly, Ralf Tanger, Karsten Müller, Aljoacha Smolic, Peter Kauff, and Thomas Wiegand:
    Progress Report on 3DTV Video Acquisition,
    ISO/IEC JTC1/SC29/WG11, MPEG08/M15102, Antalya, Turkey, January 2008.

  • 2002

  • Christoph Fehn, Klaas Schüür, Ingo Feldmann, Peter Kauff, and Aljoscha Smolic:
    Distribution of ATTEST Test Sequences for EE4 in MPEG 3DAV,
    MPEG Meeting - ISO/IEC JTC1/SC29/WG11, Awaji Island, Japan, MPEG02/M9219, December 2002.
  • Christoph Fehn, Klaas Schüür, Ingo Feldmann, Peter Kauff, and Aljoscha Smolic:
    Proposed experimental conditions for EE4 in MPEG 3DAV,
    MPEG Meeting - ISO/IEC JTC1/SC29/WG11, Shanghai, China, MPEG02/M9016, October 2002.
  • Klaas Schüür, Christoph Fehn, Ingo Feldmann, Peter Kauff, and Aljoscha Smolic:
    Preliminary results on disparity coding with in-loop median filter,
    MPEG Meeting - ISO/IEC JTC1/SC29/WG11, Shanghai, China, MPEG02/M9017, October 2002.

Talks and Tutorials

    2010

  • Ingo Feldmann, Wolfgang Waizenegger, Nicole Atzpadin, and Oliver Schreer:
    3D Multi-view Technologies for Immersive Video Conferencing,
    3D Stereo Media, Liége, Belgium, December 9, 2010, Invited Talk.

Patents

US 9521362 View Rendering for the provision of Virtual Eye Contact Using Special Geometric Constraints in Combination with Eye-Tracking