Image Processing Video Coding Using High-Resolution Mosaics

Video Coding Using High-Resolution Mosaics_text
Video Coding Using High-Resolution Mosaics_text
The generation of high-resolution mosaics from multiple images is presented. The estimation of the high-resolution signal utilizes a motion-compensated filtering approach for video frames that are affected by spatial aliasing. For that, global motion models and the corresponding estimation algorithms are employed to provide a very accurate and continuous description of sub-pixel motion for the background of the video signal. The motion information is exploited to generate mosaics with four or sixteen times the resolution of the constructing video sequence or known mosaicing techniques. The mosaicing results indicate that the presented multi-frame methods provide superior visual quality. The approach is further extended to the generation of high-resolution video.
Video Mosaicing_fig1
Video Mosaicing_fig1
Video Mosaicing_fig1
Fig. 1: Process of mosaicing: warping and blending all frames of a video sequence towards a common reference system, controlled by estimated global motion parameters.
Video Mosaicing_fig2
Video Mosaicing_fig2
Video Mosaicing_fig2
Fig. 2: High-resolution mosaicing: transformation of video pixels into mosaic of double resolution in both directions, without interpolation of intensity values.
Video Mosaicing_fig3
Video Mosaicing_fig3
Video Mosaicing_fig3a
Fig. 3: Successive filling of a mosaic of double resolution in both directions (704x480 pixel), for sequence Stefan (SIF, 352x240 pixel). Results when processing 1, 5, 15, 49 frames are shown.
Video Mosaicing_fig3b
Fig. 3: Successive filling of a mosaic of double resolution in both directions (704x480 pixel), for sequence Stefan (SIF, 352x240 pixel). Results when processing 1, 5, 15, 49 frames are shown.
Video Mosaicing_fig3c
Fig. 3: Successive filling of a mosaic of double resolution in both directions (704x480 pixel), for sequence Stefan (SIF, 352x240 pixel). Results when processing 1, 5, 15, 49 frames are shown.
Video Mosaicing_fig3d
Fig. 3: Successive filling of a mosaic of double resolution in both directions (704x480 pixel), for sequence Stefan (SIF, 352x240 pixel). Results when processing 1, 5, 15, 49 frames are shown.
platzhalter
linkbox
fig4
video mosaicing_fig4
Video Mosaicing_fig4
Video Mosaicing_fig4a
Fig. 4: Mosaic (2040x1020 pixel) with 16 times the resolution of sequence Mobile & Calendar (SIF, 360x240 pixel) for all 300 frames
here: high-resolution mosaicing
Video Mosaicing_fig4b
Fig. 4: Mosaic (2040x1020 pixel) with 16 times the resolution of sequence Mobile & Calendar (SIF, 360x240 pixel) for all 300 frames
here: conventional mosaicing and up-sampling
linkbox2
Download Video:
Comparison of progressive TV (720/704x480 pixel) sequences generated form SIF (360/352x240 pixel) sequences using high resolution video mosaicing and bilinear interpolation
video mosaicing_fig5
video mosaicing_fig5
video mosaicing_fig5
Fig. 5: Details from images with 16 times the resolution of the original, for frame no. 150 of sequence Mobile & Calendar
left: bilinear interpolation from original image
right: high-resolution mosaicing
