以深度學習進行全方位軌道缺失構件檢測

A COMPREHENSIVE DETECTION SYSTEM OF DEFECTIVE TRACK COMPONENTS BY DEEP LEARNING

謝禎冏(Chen-Chiung Hsieh)；謝幼屏(Yu-Ping Hsieh)；賴瑞應(Jui-Ying Lai)；黃維信(Wei-Hsin Huang)；謝尚琳(Shan-Lin Hsieh)；徐倜雲(Ti-Yun Hsu)；杜宇豪(Yu-How Du)；賈漢文(Han-Wen Jia)

鐵路軌道巡檢 ； 軌道構件 ； 深度學習 ； YOLO ； Rail Track Inspection ； Track Fastener ； Deep Learning ； YOLO

運輸計劃季刊

52卷3期（2023 / 09 / 30）

191 - 219

繁體中文;英文

軌道扣件負責固定鋼軌於枕木上，避免軌道鬆脫變形。傳統鐵路軌道扣件巡檢方式係採人工，以目視方式進行巡檢。近年來，人工智慧深度學習蓬勃發展，在許多領域獲得突破性進展，因此本研究以人工智慧（Artificial Intelligence，AI）方式進行鐵路軌道缺失構件檢測，得以降低人工巡檢的負擔及時間，並將此技術實地測試與應用推廣。首先蒐集國內外鐵路軌道構件檢測案例並分析其設備及方法，接著建立軌道構件樣本的擷取設備，包含影像記錄及照明，再依收集之上視、側視軌道構件樣本，分為上視10種缺失類別、側視4種缺失類別與2種正常類別。採用YOLOv4-Tiny模型進行深度學習訓練。在實驗中錄製超過70公里軌道構件影像，分別以上視缺失構件與側視構件資料集進行訓練，所得上視缺失與側視缺失檢出率分別為91%與94%，平均精確率各別為91.7%與99.2%，顯示辨識指標良好，執行效能也可達150張／秒。期間比較YOLOv4-Tiny模型與人工徒步巡檢，成本與效能均較佳。

The rail fasteners are responsible for fixing the tracks on the sleepers to prevent the tracks from loosening and deforming. The traditional inspection method of railway track fasteners adopts human visual inspection. Artificial intelligence (AI) deep learning has developed rapidly and made a breakthrough in many fields in recent years. Therefore, this study uses artificial intelligence to detect missing components of railway tracks and reduce the burden and time of manual inspection. The goal is to promote this technology to field applications. Firstly, we have surveyed some commercial track fastener inspection products from both domestic and foreign; analyze the deployed equipment and method for domestic applicability. Then, the image collecting equipment for the track components, including image recording and lighting, is established. There are ten and six types of classes defined for the top and side view of the track, respectively. YOLOv4-tiny, for its superior performance, is selected for our application. More than 70 km of track images were recorded in experiments. Moreover, the performance metrics (recall rate, mAP) are (91%, 91.7%) and (94%, 99.2%) for the top and side-view, respectively. The execution speed of YOLOv4-tiny also reached 150 fps. Meanwhile, the AI model was compared with the human eye-sight inspection, and the overall performance was better than human inspections.

1. Forbes , “How Swiss Federal Railways Is Improving Passenger Safety with the Power of Deep Learning” , https://www.forbes.com/sites/nvidia/2018/08/02/how-swiss-federal-railway-is-improving-passenger-safety-with-the-power-of-deep-learning/?sh=4719312d50e3, 2018.
2. Ashish, J.,Wang, J.,Ye, C.,Nguyen, B. N.,Lou, Y.,Su,Y.,Vijay, C.,Zeng, Z.(2018).TrackNet -T A Deep Learning Based Fault Detection for Railway Track Inspection.2018 International Conference on Intelligent Rail Transportation (ICIRT)
3. Bochkovskiy, A.,Wang, C. Y.,Mark, H. Y.(2004).,未出版
4. BvSys Bildverarbeitungssysteme,“Visual Inspection Systems for Track Maintenance,” https://www.railway-technology.com/contractors/track/bvsys/, Retrieved Jun 18, 2020.
5. ENSCO, “Rail Surface Imaging System”, https://www.ensco.com/rail/track-imaging-systems, Retrieved Jan 19, 2020.
6. Gibert, X.,Patel, V. M.,Chellappa, R.(2017).Deep Multitask Learning for Railway Track Inspection.IEEE Transactions on Intelligent Transportation Systems,18(1),153-164.
7. Jiang, Z.,Zhao, L.,Li, S.,Jia, Y.(2020).,未出版
8. G. Jocher, “YOLOv5”, https://github.com/ultralytics/yolov5, Retrieved May, 2020.
9. Liu, W.,Anguelov, D.,Erhan, D.,Szegedy, C.,Reed, S.,Fu, C. Y.,Berg, A.(2016).SSD: Single Shot MultiBox Detector.Lecture Notes in Computer Science
10. mermecgroup.com/inspect/track-inspection/65/fishplate-joint-bar.php Mermec, “Fishplate/Joint bar Inspection”, http://www.mermecgroup.com/inspect/track-inspection/65/fishplate-joint-bar.php, Retrieved Jan 14, 2021.
11. Pavemetrics, “Laser Rail Inspection System (LRAIL),” Canada, http://www.pavemetrics.com/applications/rail-inspection/laser-rail-inspection-system/, Retrieved Jan 14,2019.
12. Redmon, J.,Farhadi, A.(2018).,未出版
13. Ren, S.,He, K.,Girshick, R.,Sun, J.(2015).,未出版
14. Song, Q.,Guo, Y.,Jiang, J.,Liu, C.,Hu, M.(2019).,未出版
15. Tan, M.,Pang, R.,Le, Q. V.(2020).,未出版
16. Wang, C.-Y.,Bochkovskiy, A.,Liao, H.-Y. M.(2011).,未出版
17. Wang, Chien-Yao,Liao, Hong-Yuan Mark,Yeh, I-Hau,Wu, Yueh-Hua,Chen, Ping-Yang,Hsieh, Jun-Wei(2019).,未出版
18. Yang, C.,Sun, Y.,Ladubec, C.,Liu, Y.(2021).Developing Machine Learning-Based Models for Railway Inspection.Applied Sciences,11(1)
19. 交通部運輸研究所(2021).軌道扣件巡檢系統建置扣件缺失辨識系統精進驗證.
20. 交通部運輸研究所(2020).軌道扣件巡檢系統建置.
21. 侯衛星(2020).0 号高速综合检测列车.北京:中國鐵道出版社民國.
22. 曹悅華，「鋼軌裂縫」，取自 https://udn.com/news/story/7266/5160558，查詢日期：2021年 1 月 12 日，聯合報。
23. 臺北捷運公司，「 TRTC 臺北捷運北投機廠軌道檢查車 EM-80E 」 ， https:// www.youtube.com/watch?v=JqEQARYCkag，查詢日期：2020 年 6 月 18 日。