保持結構的影像映射

Structure-Preserving Approaches for Image Remapping

10.6342/NTU.2014.01690

張哲瀚

影像縮放 ； 全景圖投影 ； 投影模型 ； 廣角影像 ； 影像接合 ； 影像形變 ； image resizing ； image retargeting ； panoramic projection ； projection models ； wide-angle images ； image stitching ； image warping

臺灣大學資訊網路與多媒體研究所學位論文

2014年

博士

莊永裕

英文

Image remapping has received considerable attention in image processing and computer graphics in recent years. Previous approaches only focus on shape preservation while ignore the area change and important line structures in the image. To achieve structure preservation, image remapping must minimize distortion on not only shapes but also areas and line structures. In this dissertation, we propose four structure-preserving approaches for image remapping. The first one is a content-aware image resizing method which simultaneously preserves both salient image features and important line structure properties: parallelism, collinearity and orientation. The second one is a novel projection model for wide angle image visualization. The proposed model is a mapping from a hemisphere to a plane. Our proposed projection have the following properties: shape preserving, line preserving and rectangular outline. The third one is a projection model for panorama viewing. The proposed projection aims at making a good compromise among the preservation of shapes, area and lines. Both the second the third one are instances of the two-step projection model. The last one is a shape-preserving warp for image stitching. The proposed warp is a spatial combination of a projective transformation and a similarity transformation. such combination simultaneously takes into account the accuracy of alignment and the preservation of image structures.

1. [1] A. Agarwala, M. Agrawala, M. Cohen, D. Salesin, and R. Szeliski. Photographing long scenes with multi-viewpoint panoramas. In ACM Transactions on Graphics, volume 25, pages 853–861, 2006.
   連結：
2. [2] S. Avidan and A. Shamir. Seam carving for content-aware image resizing. ACM Trans. Graph., 26(3, article 118), 2007.
   連結：
3. [3] M. Brown and D. G. Lowe. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 74(1):59–73, 2007.
   連結：
4. [4] R. Carroll, A. Agarwala, and M. Agrawala. Image warps for artistic perspective manipulation. ACM Trans. Graph., 29(4, article 127), 2010.
   連結：
5. [5] R. Carroll, M. Agrawal, and A. Agarwala. Optimizing content-preserving projections for wide-angle images. In ACM Transactions on Graphics, volume 28, page 43, 2009.
   連結：
6. [6] C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang. Content-aware display adaptation and interactive editing for stereoscopic images. IEEE Transactions on Multimedia, 13(4):589–601, August 2011.
   連結：
7. [7] O. Chum and J. Matas. Planar affine rectification from change of scale. In Proceedings of ACCV 2010, pages 347–360, 2011.
   連結：
8. [8] O. Chum, T. Pajdla, and P. Sturm. The geometric error for homographies. Computer Vision and Image Understanding, 97(1):86–102, 2005.
   連結：
9. [9] M. P. Do Carmo. Differential geometry of curves and surfaces. Prentice-Hall, 1976.
   連結：
10. [10] W. Dong, N. Zhou, J.-C. Paul, and X. Zhang. Optimized image resizing using seam carving and scaling. ACM Trans. Graph., 28(5, article 125), 2009.
    連結：
11. [11] J. Gao, S. J. Kim, and M. S. Brown. Constructing image panoramas using dual-homography warping. In Proceedings of IEEE CVPR 2011, pages 49–56, 2011.
    連結：
12. [12] Y. Guo, F. Liu, J. Shi, Z.-H. Zhou, and M. Gleicher. Image retargeting using mesh parametrization. IEEE Transactions on Multimedia, 11(5):856–867, 2009.
    連結：
13. [14] J. Kopf, B. Chen, R. Szeliski, and M. Cohen. Street slide: browsing street level imagery. ACM Transactions on Graphics, 29(4):96, 2010.
    連結：
14. [15] J. Kopf, D. Lischinski, O. Deussen, D. Cohen-Or, and M. Cohen. Locally adapted projections to reduce panorama distortions. In Computer Graphics Forum, volume 28, pages 1083–1089, 2009.
    連結：
15. [16] J. Kopf, M. Uyttendaele, O. Deussen, and M. F. Cohen. Capturing and viewing gigapixel images. ACM Transactions on Graphics, 26(3):93, 2007.
    連結：
16. [18] P. H. Laskowski. The traditional and modern look at tissot’s indicatrix. The American Cartographer, 16(2), 1989.
    連結：
17. [23] M. Rubinstein, A. Shamir, and S. Avidan. Improved seam carving for video retargeting. ACM Trans. Graph., 27(3, article 16), 2008.
    連結：
18. [25] S. Schaefer, T. McPhail, and J. Warren. Image deformation using moving least squares. ACM Trans. Graph., 25:533–540, July 2006.
    連結：
19. [29] J. P. Snyder. Map projections–A working manual. Number 1395. USGPO, 1987.
    連結：
20. [30] R. Szeliski. Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Vision, 2(1):1–104, 2006.
    連結：
21. [31] R. Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and environment maps. In Proceedings of ACM SIGGRAPH 1997, pages 251–258, 1997.
    連結：
22. [32] A. Vedaldi and B. Fulkerson. VLFeat: An open and portable library of computer vision algorithms. In Proceedings of ACM Multimedia 2010, pages 1469–1472, 2010.
    連結：
23. [33] R. G. Von Gioi, J. Jakubowicz, J.-M. Morel, and G. Randall. LSD: A fast line segment detector with a false detection control. IEEE PAMI, 32(4):722–732, 2010.
    連結：
24. [34] Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image resizing. ACM Trans. Graph., 27(5, article 118), 2008.
    連結：
25. [35] J. Wei, C.-F. Li, S.-M. Hu, R. R. Martin, and C.-L. Tai. Fisheye video correction. IEEE TVCG, 18(10):1771–1783, 2012.
    連結：
26. [36] X. Ying and Z. Hu. Can we consider central catadioptric cameras and fisheye cameras within a unified imaging model. In Proceedings of ECCV 2004, pages 442–455, 2004.
    連結：
27. [37] J. Zaragoza, T.-J. Chin, M. S. Brown, and D. Suter. As-projective-as-possible image stitching with moving DLT. In Proceedings of IEEE CVPR 2013, pages 2339–2346, 2013.
    連結：
28. [39] G.-X. Zhang, M.-M. Cheng, S.-M. Hu, and R. R. Martin. A shape-preserving approach to image resizing. Computer Graphics Forum, 28(7):1897–1906, 2009.
    連結：
29. [40] D. Zorin and A. H. Barr. Correction of geometric perceptual distortions in pictures. In Proceedings of ACM SIGGRAPH, pages 257–264, 1995.
    連結：
30. [13] R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, second edition, 2004.
31. [17] P. Kr‥ahenb‥uhl, M. Lang, A. Hornung, and M. Gross. A system for retargeting of streaming video. ACM Trans. Graph., 28(5, article 126), 2009.
32. [19] W.-Y. Lin, S. Liu, Y. Matsushita, T.-T. Ng, and L.-F. Cheong. Smoothly varying affine stitching. In Proceedings of IEEE CVPR 2011, pages 345–352, 2011.
33. [20] A. Mansfield, P. Gehler, L. V. Gool, and C. Rother. Scene carving: Scene consistent image retargeting. In Proceedings of European Conference on Computer Vision (ECCV) 2010, 2010.
34. [21] Y. Pritch, E. Kav-Venaki, and S. Peleg. Shift-map image editing. In Proceedings of IEEE International Conference on Computer Vision, 2009.
35. [22] M. Rubinstein, D. Gutierrez, O. Sorkine, and A. Shamir. A comparative study of image retargeting. ACM Trans. Graph., 29:article 160, December 2010.
36. [24] M. Rubinstein, A. Shamir, and S. Avidan. Multi-operator media retargeting. ACM Trans. Graph., 28(3, article 23), 2009.
37. [26] V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch. Automatic image retargeting. In Proceedings of the 4th international conference on Mobile and ubiquitous multimedia, pages 59–68, 2005.
38. [27] A. Shamir and O. Sorkine. Visual media retargeting. In SIGGRAPH Asia 2009 Course Notes, 2009.
39. [28] T. K. Sharpless, B. Postle, and D. M. German. Pannini: a new projection for rendering wide angle perspective images. In Proceedings of the Sixth international conference on Computational Aesthetics in Graphics, Visualization and Imaging, pages 9–16, 2010.
40. [38] L. Zelnik-Manor, G. Peters, and P. Perona. Squaring the circle in panoramas. In Proceedings of ICCV 2005, volume 2, pages 1292–1299, 2005.