Compression project >> Video Area Home

Project, idea: Dr. Dmitriy Vatolin
Algorithm: Karen Simonyan, Sergey Grishin
Implementation: Karen Simonyan

MSU Motion Estimation 1.0:
   Multiframe motion estimation was added
   Filter speedup
   Filter interface modified

MSU Motion Estimation 0.5:
   The filter was rewritten from scratch
   Algorithm is improved
   Filter interface modified

MSU Motion Estimation 0.1:
   The first public release

The filter performs multiframe and singleframe motion estimation and compensation in a video stream. It allows to show macroblocks' partition, motion vectors and the accuracy of motion vectors as well.

Settings

Filter configuration, "Main" property page (the main settings)

Motion estimation preset - the preset of motion estimation.

Motion estimation algorithm - the algorithm of motion estimation from the previous frame.

Block sizes - Block sizes used in motion estimation.
  Maximum block size - maximum size of a block.
  Minimum block size - minimum size of a block.

Precision - precision of motion vector search.
  Horizontal precision - horizontal precision of motion vector search.
    Pixel - pixel precision.
    Half pixel - half pixel precision.
    Quarter pixel - quarter pixel precision.
  Vertical precision - vertical precision of motion vector search.
    Pixel - pixel precision.
    Half pixel - half pixel precision.
    Quarter pixel - quarter pixel precision.

Halfpel interpolation algorithm - the algorithm of half pixel interpolation.

Number of reference frames - number of frames, from which motion estimation is performed. Can take on values from 1 to 10. If 1 reference frame is selected, singleframe motion estimation is performed.

Search radius - radius of motion vector search area.
  Horizontal - maximum length of motion vector's horizontal projection. Can take on values from 1 to 100.
  Vertical - maximum length of motion vector's vertical projection. Can take on values from 1 to 100.

Output - output of the filter.
  Compensated frame - show frame after motion compensation.
  Residual after motion compensation - show the residual between the original frame and the compensated one.
  Residual without motion compensation - show the residual between the original frame and the previous one.

Borders allowed - allow compensation from blocks, exceeding the frame borders.

Filter configuration, "Extras" property page (the additional settings)

Colorspace - the colorspace to perform motion estimation in.

Output settings - settings of filter output.
  Show MVs - show motion vectors. The mode is unavailable if Show residual without motion compensation is chosen or the number of reference frames exceeds 1. The vectors are displayed in different colors depending on their accuracy if Force MV's constant color isn't chosen.   Show MBs - show macroblocks' partition. Macroblocks are drawn in the same color as motion vectors.
  Color blocks according to accuracy - color blocks depending on motion vector accuracy.
  Force MV's constant color - draw motion vectors in a specified color not depending on motion vector accuracy.

  Integer-pixel MV color - the color of pixel precision motion vectors and corresponding blocks.
  Half-pixel MV color - the color of half-pixel precision motion vectors and corresponding blocks.
  Quarter-pixel MV color - the color of quarter-pixel precision motion vectors and corresponding blocks.
  MV color - the color of all motion vectors, if Force MV's constant color is chosen.

Log - logging of filter statistics.
The following indexes are saved: the time of filter execution, FPS, the algorithm of motion estimation, motion vector search area, allowed block sizes, a mean number of SAD calculations per pixel.
  Save log - save the log in a log-file.
  Choose file - choose a log-file.

Job control & AviSynth

The filter supports Job Control, which allows to use it in AviSynth. Example:

LoadVirtualDubPlugin("...\VirtualDub\plugins\MSU_Motion_Estimation.vdf","MSU_Motion_Estimation", 0)
clip=AVISource("...\clip_input.avi", false, "RGB24")
clip.ConvertToRGB32.MSU_Motion_Estimation(0,16,4,2,2,0,1,32,32,0,1,0,0,0,0,"C:\\statistics.txt")

Parameters

¹	Description	Allowed values
1	Motion estimation algorithm	0 - MSU 1 - Full search
2	Maximum block size	16 - 16x16 8 - 8x8 4 - 4x4
3	Minimum block size	16 - 16x16 8 - 8x8 4 - 4x4
4	Horizontal precision	0 -pixel precision 1 - half pixel precision 2 - quarter pixel precision
5	Vertical precision	0 -pixel precision 1 - half pixel precision 2 - quarter pixel precision
6	Halfpel interpolation algorithm	0 - 6-tap filter (H.264) 1 - bilinear interpolation
7	Number of reference frames	from 1 to 10
8	Horizontal maximum motion	from 1 to 100
9	Vertical maximum motion	from 1 to 100
10	Output	0 - compensated frame 1 - residual after compensation 2 - residual without compensation
11	Borders allowed	0 - forbid compensation from blocks, exceeding the frame borders 1 - allow compensation from blocks, exceeding the frame borders
12	Colorspace	0 - YUV 1 - YV12 2 - RGB
13	Show MVs This parameter is ignored in the case of Output = 2 or Number of reference frames > 1	0 - don't show motion vectors 1 - show motion vectors
14	Show MBs	0 - don't show macroblocks' partition 1 - show macroblocks' partition
15	Save log	0 - don't save statistics to a log-file 1 - save statistics to a log-file
16	File	path to the log-file

Examples

"Foreman" test sequence, 16x16 block size.

a frame from the sequence	the next frame from the sequence
compensated frame with motion vectors, blocks are colored according to motion vectors' accuracy
residual without motion compensation	residual after motion compensation

a frame from the sequence	the next frame from the sequence
compensated frame with motion vectors and macroblocks' partition
residual without motion compensation	residual after motion compensation

Download

• This filter for VirtualDub (148 kb, ZIPped)

Other resources

Video resources:

Public MSU video filters Here are available VirtualDub and AviSynth filters. Commonly we develop a whole family of some kind of a filter. Generally there are also versions optimized for PC and hardware implementations (ASIC/FPGA/DSP). These optimized versions can be licensed to companies. Please contact us for details via video(at)graphics.cs.msu_ru. MSU Cartoon Restore (New!) MSU Noise Estimation (New!) MSU Frame Rate Conversion (New!) MSU Image Restoration (New!) MSU Denoising (Top!) MSU Old Cinema MSU Deblocking (Top!) MSU Smart Brightness and Contrast (Top!) MSU Smart Sharpen (Top!) MSU Noise generation MSU Noise estimation MSU Motion Estimation Information MSU Subtitles removal MSU Logo removal (Top!) MSU Deflicker (Top!) MSU Field Shift Fixer AviSynth plug-in MSU StegoVideo MSU Cartoonizer (Top!) MSU SmartDeblocking (Top!) MSU Color Enhancement MSU Old Color Restoration MSU filters FAQ (Read me!) MSU filters statistics (New!)	MSU filters for companies We are working with Intel, Samsung, RealNetworks and other companies on adapting our filters other video processing algorithms for specific video streams, applications and hardware like TV-sets, graphics cards, etc. Some of such projects are non-exclusive. Also we have internal researches. Please let us know via video(at)graphics.cs.msu_ru if you are interested in acquiring a license for such filters or making a custom R&D project on video processing, compression, computer vision. Automatic Objects Segmentation (New!) Semiautomatic Objects Segmentation New Frame Rate Conversion (New!) New Deinterlacer (New!) MSU-Samsung Deinterlacing Project Digital TV Signal Enhancement Old Film Recovery Tuner TV Restore Panorama Video2Photo SuperResolution SuperPrecision MSU-Samsung image and video resampling MSU-Samsung Frame Rate Conversion Motion Phase filter Deshaker (video stabilization) Film Grain/Degrain filter (New!) Deblurring filter Video Content Marking
Codecs comparisons Objective and subjective quality evaluation tests for video and image codecs 4-th MPEG4-AVC/H.264 Comparison (New!) Lossless Video Codecs Comparison 2007 (New!) 3-rd MPEG4-AVC/H.264 Comparison HD Photo and JPEG 2000 Comparison MPEG-2 Decoders Crash Test (Top!) Subjective Compar. of 4 Modern Codecs (Top!) 2-nd MPEG-4 AVC/H.264 Comparison (Top!) FAQ of 2-nd H.264 Comparison 1-st MPEG-4 AVC/H.264 Codecs Comparison FAQ of 1-st H.264 Comparison JPEG 2000 Image Codecs Comparison (Top!) Lossless Video Codecs Comparison 2004 MPEG-4 SP/ASP Codecs Comparison (Top!) Video codecs comparison (old) Ads link: x264 parameters efficiency comparison	Video quality metrics Programs with different objective and subjective video quality metrics implementation MSU Video Quality Metric - objective metrics for codecs and filters comparison (Top!) Implemented metrics short info: PSNR, Delta, MSAD, MSE, SSIM, VQM, MSU Blurring, MSU Blocking MSU Brightness Flicking Metric MSU Brightness Independent PSNR MSU Drop Frame Metric MSU Noise Estimation Metric MSU VQM Metric Tool FAQ MSU Human Perceptual Quality Metric - several metrics for exact visual tests (Top!) Implemented metrics short info: ITU-R BT.500-11: DSIS, DSCQS I & II, SCACJ; EBU: SAMVIQ; MSUCQE MSU PVQ Metric Tool FAQ
Video codecs projects Different research and development projects on video codecs MSU Lossless Video Codec (Top!) MSU Screen Capture Lossless Codec (Top!) MSU MPEG-2 Video Codec x264 Codec Improvement	Other Other information Crazy gallery (filters screams :) License for commercial usage of MSU VideoGroup Public Software (please be careful: some soft like metrics has another license!)

Bookmark this page:   Add to Del.icio.us     Digg It     reddit
 

Last updated: 07-December-2007

---

Search (Russian): Server size: 7470 files, 919Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab