整合航測與行動裝置影像的三維建物模塑策略

3D Realistic Building Modelling by Integration of Aerial and Mobile Images

10.6234/JGR.2014.60.06

王聖鐸(Sen-Do Wang)

浮測模型 ； 三維建物模型 ； 模型式建物萃取 ； 數值攝影測量 ； Floating Model ； 3D Building Model ； Model-based Building Extraction ； Digital Photogrammetry

地理研究

60期（2014 / 06 / 01）

107 - 127

繁體中文

繼電子化政府、政府網路服務之後，標榜能察覺城市脈動、即時做出決策反應的智慧城市（Smart City），已成為世界各主要都市努力的目標。打造智慧城市必須先建置精確完善的三維建物模型，才能將各類感測器在三度空間中精確定位，而後才能對感測器傳回的資料進行空間分析，因此三維建物模型實為智慧城市之基礎建設。三維建物模塑主要可分為兩個階段：幾何模塑及牆面紋理貼圖。過去航空攝影測量一直是最有效且精確的測繪技術，然而傳統以浮測標逐點量測的方式重建三維建物模型時，操作員需要專注於屋角點的量測及點位之連結，是建物幾何模塑的瓶頸。為了使三維建物牆面具備真實的場景，必須花費大量人力、時間至現場拍照，回到內業還必須依據建物牆面逐一比對照片，挑出最完整的照片裁切出牆面影像，再依像片角度校正變形，才能作為牆面材質影像，需要大量人力、物力及時間。本研究以浮測模型（Floating Model）為核心，將傳統的浮測標擴充為浮測模型（Floating Model），使量測的單元不再是抽象的一個點位，而是許多種可伸縮、旋轉、移動的三維模型。浮測模型除了具備一個基準點可調整其三維位置外，還依模型種類增加了各方向的伸縮尺度、空間旋轉等參數，可想像成一個漂浮在空間中，可移動、旋轉、縮放大小以量測地物的模型。將浮測模型投影至所有影像，並套合至影像上的目標地物，便有如回復攝影瞬間之幾何空間條件，此時之模型參數與影像外方位元素即為最佳解。以此概念，本研究提出一套半自動化萃取策略，操作員透過人機互動介面將模型套合至所有航測影像，交由電腦透過最小二乘模型-影像套合演算法（Least-squares Model-image Fitting, LSMIF）自動計算最佳套合，得到最佳模型參數。其後將行動裝置拍攝建物的影像輸入電腦，由電腦自動計算每一面牆投影在所有像片上，以評估擷取牆面影像範圍，進而自動製作建物材質影像，完成三維建物模塑。透過實驗案例證明，浮測模型理論確可有效地萃取建物三維空間資訊，提高三維塑模之效率，並能達到傳統攝影測量之精度要求。

In the last decade, smart city, instead of e-government or i-government, has become a modern trend of urban development for the major cities in the world. However, a city would never be considered smart without knowing where the events are. A precise 3D city model is required as the infrastructure to mark and present the 3D location of the various sensors. The data transferred from the sensors can then be spatially analyzed in the 3D space. Photogrammetry has been considered as the most efficient technique for extracting 3D information or reconstructing 3D models. But its point-by-point measurement of using floating mark has become the bottleneck while reconstructing the 3D city model. In this paper, we expanded the floating mark to the floating model based on the concept of model-based building extraction. The measuring tool is no longer only an abstract point but also many kinds of 3D model, which can be scaled, rotated, or moved in the space. The floating model is defined with a datum point whose 3D coordinates indicate the spatial position of the model as the floating mark does. Furthermore, each kind of models is associated with a set of pose parameters to describe its rotation about the three orthogonal axes and shape parameters to describe its scales along predefined directions. In other words, the floating model is a flexible entity floating in the space, and can be adjusted to fit the object by these parameters. If the model parameters are good enough to represent the 3D spatial information of the object, the projection of the floating model on every overlapped image will all be coincident to the object's image. Therefore, the basic idea of the floating model theory is to fit model to the overlapped images by adjusting the model parameters. Based on the floating model theory, we proposed a semi-automated 3D building reconstruction strategy. A friendly human-machine interface is designed for the operator to choose and adjust the floating model to fit the aerial photos manually. Then, the computer calculate the optimal fit by an ad hoc Least-Squares Model-Image Fitting (LSMIF) algorithm. Thus the 3D spatial information can be extracted object-by-object rather than point-by-point by means of floating model, which increases the efficiency and accuracy. The building model are then projected onto photos taken by mobile devices to evaluate which is the most suitable photo for each façade. The façade then could be clipped from the photo and geometrically corrected as for the texture image. According to our tests and experiments, the proposed semi-automated strategy does increase the efficiency of 3D building model reconstruction.

1. Ameri, B.(2000).Stuttgart,University of Stuttgart.
2. Böhm, J.,Brenner, C.,Gühring, J.,Fritsch, D.(2000).Automated Extraction of Features from CAD Models for 3D Object Recognition.Proceedings of the XIXth Congress of the ISPRS
3. Braun, C.,Kolbe, T.H.,Lang, F.,Schickler, W.,Steinhage, V.,Cremers, A.B.,Förstner, W.,Plümer, L.(1995).Models for Photogrammetric Building Reconstruction.Computers & Graphics,19(1),109-118.
4. Canny, J.(1986).A Computational Approach to Edge Detection.IEEE Transactions on Pattern Analysis and Machine Intelligence,8(6),679-698.
5. Chio, S.-H.(2001).Tainan,National Cheng Kung University.
6. El-Hakim, S.(2000).A Practical Approach to Creating Precise and Detailed 3D Models from Single and Multiple Views.Proceedings of the XIXth Congress of the ISPRS
7. Ermes, P.(2000).Constraints in CAD Models for Reverse Engineering Using Photogrammetry.Proceedings of the XIXth Congress of the ISPRS
8. Ermes, P.,van den Heuvel, F.A.,Vosselman, G.(1999).A Photogrammetric Measurement Method Using CSG Models.ISPRS Workshop on "Measurements Project Modeling and Documentation in architecture and Industry"
9. Fischer, A.,Kolbe, T.H.,Lang, F.(1999).On The Use of Geometric and Semantic Models for Component-based Building Reconstruction.SMATI '99 Workshop
10. Förstner, W.(1994).A Framework for Low Level Feature Extraction.Computer Vision,Berlin:
11. Förstner, W.(1999).3D-City Models: Automatic and Semiautomatic Acquisition Methods.Photogrammetric Week '99
12. Fritsch, D.(1999).Virtual Cities and Landscape Models - What Has Photogrammetry to Offer?.Photogrammetric Week '99
13. Grün, A.(2000).Semi-automated Approaches to Site Recording and Modeling.Proceedings of the XIXth Congress of the ISPRS
14. Grün, A.,Dan, H.(1997).TOBAGO - A Topology Building for the Automated Generation of Building Models.Automatic Extraction of Man-Made Objects from Aerial and Space Images
15. Gülch, E.(1997).Application of Semi-Automatic Building Acquisition.Automatic Extraction of Man-Made Objects from Aerial and Space Images
16. Heuel, S.,Förstner, W.(2001).Matching, Reconstructing and Grouping 3D Lines from Multiple Views Using Uncertain Projective Geometry.IEEE Computer Society Conference on Computer Vision and Pattern Recognition
17. Hrabacek, J.,van den Heuvel, F.A.(2000).Weighted Geometric Objects Constraints Integrated in a Line-Photogrammetric Bundle Adjustment.Proceedings of the XIXth Congress of the ISPRS
18. Läbe, T.,Gülch, E.(1998).Robust Techniques for Estimating Parameters of 3D Building Primitives.ISPRS Commission II Symposium,Cambridge:
19. Lang, F.,Förstner, W.(1996).3D-City Modeling with a Digital One-eye Stereo System.Proceedings of the XVIIIth Congress of the ISPRS
20. Li, D.,Zhou, G.(1994).CAD-based Line Photogrammetry for Automatic Measurement and Reconstruction of Industrial Objects.ISPRS Commission V Symposium on Close Range Techniques and Machine
21. Lowe, D.G.(1991).Fitting Parameterized Three-Dimensional Models to Images.IEEE Transactions on Pattern Analysis and Machine Intelligence,13(5),441-450.
22. McIntosh, J.H.,Mutch, K.M.(1988).Matching Straight Lines.Computer Graphics and Image Processing,43,386-408.
23. Medioni, G.,Nevatia, R.(1984).Matching Images Using Linear Features.IEEE Transactions on Pattern Analysis and Machine Intelligence,6(6),675-685.
24. Mohan, R.,Nevatia, R.(1989).Using Perceptual Organization to Extract 3-D Structures.IEEE Transactions on Pattern Analysis and Machine Intelligence,11(11),1121-1139.
25. Mulawa, D.C.,Mikhail, E.M.(1988).Photogrammetric Treatment of Linear Features.Proceedings of the XVIth Congress of the ISPRS,383-393.
26. Noronha, S.,Nevatia, R.(1997).Detection and Description of Buildings from Multiple Aerial Images.IEEE Conference on Computer Vision and Pattern Recognition
27. Rau, J.-Y.(2002).ChungLi,National Central University.
28. Rottensteiner, F.(2000).Semi-Automatic Building Reconstruction Integrated in Strict Bundle Block Adjustment.Proceedings of the XIXth Congress of the ISPRS
29. Schindler, K.,Bauer, J.(2003).A Model-Based Method For Building Reconstruction.ICCV Workshop on Higher-Level Knowledge in 3D Modeling and Motion
30. Tseng, Y.-H.,Wang, S.(2001).Semi-automatic Building Extraction by Matching CSG Primitives with Aerial Images.The Asia GIS 2001
31. Tseng, Y.-H.,Wang, S.(2003).Semi-automated Building Extraction Based on CSG Model-Image Fitting.Photogrammetric Engineering & Remote Sensing,69(2),171-180.
32. van den Heuvel, F.A.(2000).Trends in CAD-based Photogrammetric Measurement.Proceedings of the XIXth Congress of the ISPRS
33. Veldhuis, H.,Vosselman, G.(1998).The 3D Reconstruction of Straight and Curved Pipes Using Digital Line Photogrammetry.ISPRS Journal of Photogrammetry and Remote Sensing,53(1),6-16.
34. Vosselman, G.,Haralick, R.M.(1996).Performance Analysis of Line and Circle Fitting in Digital Images.The Workshop on Performance Characteristics of Vision Algorithms
35. Vosselman, G.,Tangelder, J.W.H.(2000).3D Reconstruction of Industrial Installations by Constrained Fitting of CAD Models to Images.Mustererkennung 2000
36. Vosselman, G.,Veldhuis, H.(1999).Mapping by Dragging and Fitting of Wire-Frame Models.Photogrammetric Engineering & Remote Sensing,65(7),769-776.
37. Wang, S.,Tseng, Y.-H.(2009).Least-Squares Model-Image Fitting of Floating Models for Building Extraction from Images.Journal of the Chinese Institute of Engineers,32(5),667-677.
38. 王聖鐸(2007)。以浮測模型理論萃取三維空間資訊─以建物重建為例。航測及遙測學刊，12(4)，489-507。
39. 王聖鐸、曾義星、傅秉綱(2008)。以真實影像自動化敷貼三維建物模型表面之研究。航測及遙測學刊，13(2)，75-84。