GLOBAL-MOTION ESTIMATION IN IMAGE SEQUENCES OF 3-D SCENES FOR CODING APPLICATIONS

被引:6
|
作者
AMITAY, A [1 ]
MALAH, D [1 ]
机构
[1] TECHNION ISRAEL INST TECHNOL,DEPT ELECT ENGN,IL-32000 HAIFA,ISRAEL
关键词
IMAGE SEQUENCE CODING; VIDEO CODING; GLOBAL MOTION; LOCAL MOTION; HOUGH TRANSFORM; LEAST SQUARES; ICM; MOTION ESTIMATION; MOTION SEGMENTATION; GIBBS DISTRIBUTION; MAXIMUM LIKELIHOOD SPLITTING MERGING;
D O I
10.1016/0923-5965(94)00034-G
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A technique for global-motion estimation and compensation in image sequences of 3-D scenes is described in this paper. Each frame is segmented into regions whose motion can be described by a single set of parameters and a set of motion parameters is estimated for each segment. This is done using an iterative block-based image segmentation combined with the estimation of the parameters describing the global motion of each segment. The segmentation is done using a Gibbs-Markov model-based iterative technique for finding a local optimum solution to a maximum a posteriori probability (MAP) segmentation problem. The initial condition for this process is obtained by applying a Hough transform to the motion vectors of each block in the frame obtained by block matching. In each iteration, given a segmentation, the motion parameters are estimated using the least-squares (LS) technique. To obtain the final segmentation and the more appropriate higher-order motion model for each segment, a final stage of splitting/merging of segments is needed. This step is performed on the basis of maximum-likelihood decisions combined with the determination of the higher-order model parameters by LS. The incorporation of the proposed global-motion estimation technique in an image-sequence coder was found to bring about a substantial reduction in bit-rate without degrading the perceived quality or the PSNR.
引用
收藏
页码:507 / 520
页数:14
相关论文
共 50 条
  • [1] 3-D MOTION ESTIMATION, UNDERSTANDING, AND PREDICTION FROM NOISY IMAGE SEQUENCES
    WENG, JY
    HUANG, TS
    AHUJA, N
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1987, 9 (03) : 370 - 389
  • [2] 3-D reconstruction of urban scenes from image sequences
    Faugeras, O
    Robert, L
    Laveau, S
    Csurka, G
    Zeller, C
    Gauclin, C
    Zoghlami, I
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 1998, 69 (03) : 292 - 309
  • [3] Robust 3-D camera motion parameter estimation with applications to video coding
    Kim, Eung-Tae
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-13, 2006, : 1509 - 1512
  • [4] 3-D MOTION ESTIMATION IN MODEL-BASED FACIAL IMAGE-CODING
    LI, HB
    ROIVAINEN, P
    FORCHHEIMER, R
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1993, 15 (06) : 545 - 555
  • [5] Real-time 3-D head motion estimation in facial image coding
    Yang, TJ
    Wu, FC
    Ming, OY
    [J]. 1998 MULTIMEDIA MODELING, PROCEEDINGS, 1998, : 50 - 51
  • [6] 3-D MOTION ESTIMATION AND WIREFRAME ADAPTATION INCLUDING PHOTOMETRIC EFFECTS FOR MODEL-BASED CODING OF FACIAL IMAGE SEQUENCES
    BOZDAGI, G
    TEKALP, AM
    ONURAL, L
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1994, 4 (03) : 246 - 256
  • [7] 3-D Kalman filter for image motion estimation
    Kim, J
    Woods, JW
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (01) : 42 - 52
  • [8] 3-D MOTION ESTIMATION OF HUMAN HEAD FOR MODEL-BASED IMAGE-CODING
    FUKUHARA, T
    MURAKAMI, T
    [J]. IEE PROCEEDINGS-I COMMUNICATIONS SPEECH AND VISION, 1993, 140 (01): : 26 - 35
  • [9] 3-d motion and shape from multiple image sequences
    Mecke, R
    Michaelis, B
    [J]. FOURTH INTERNATIONAL CONFERENCE ON 3-D DIGITAL IMAGING AND MODELING, PROCEEDINGS, 2003, : 155 - 162
  • [10] Robust and direct estimation of 3-D motion and scene depth from stereo image sequences
    Park, SK
    Kweon, IS
    [J]. PATTERN RECOGNITION, 2001, 34 (09) : 1713 - 1728