以社會性標籤為基礎的擴充搜尋技術支援影音分享網站中之影片檢索

A Social-Tag-Based Query Expansion Approach for Supporting Video Retrieval in Video Sharing Websites

10.6382/JIM.201207.0533

李彥賢(Yen-Hsien Lee)；楊錦生(Chin-Sheng Yang)；廖國堯(Guo-Yauo Liau)

搜尋字串擴充 ； 影音檢索 ； 社會性標籤 ； 情境感知 ； 搜尋引擎 ； query expansion ； video retrieval ； social tagging ； context aware ； search engine

資訊管理學報

19卷3期（2012 / 07 / 01）

533 - 565

繁體中文

WEB 2.0的概念興起促使網路使用者從資訊接收者的角色轉變成資訊生產者，並透過適當的網路平台與其他網路使用者進行資訊分享與互動。近年來，隨著網路與資訊科技的快速發展，已使網際網路中分享的資訊媒體從過去單純的文字內容逐步演進到以影音多媒體為主流，並發展出許多影音分享網站。然而，為方便使用者在龐大的分享影音資料中進行搜尋，此類網站往往會提供影片搜尋機制。不若以文字描述為主要內容的傳統網站，影音分享網站每則影音檔案都只有少量的描繪資料可供進行關鍵字比對，容易在比對時造成字串錯配（Word Mismatch）的問題，進而影響影音檢索的效能。本研究提出以社會性標籤為基礎的擴充搜尋技術（STBQE），先藉由局部分析方法取得初步的影片搜尋結果，再試圖利用使用者分享影片時，針對影片內容所制定的描繪標籤，來進行搜尋字串擴充以及後續搜尋結果排序。本研究最後利用實證評估方式來比較現有影音分享網站的搜尋機制與本研究提出STBQE的差異，而結果發現本研究提出擴充搜尋技術能在特定情境之下改善現有方法的搜尋效能。

The advance of Internet and information technologies has turned the information sharing on the Web from the form of textual content into that of multimedia and fostered the development of video sharing websites. To ease the access of the large number of online videos, the sharing websites usually provide web surfers the mechanism for searching their targeted videos. However, traditional searching approaches that focus on the analysis of textual contents may not effectively support the search for the online videos, which generally contain a few annotations given by the providers. As a result, keyword search has been one of the familiar approaches to the video retrieval, although it may suffer from the word mismatch problem. In this study, we intend to improve the effectiveness on retrieving the online video by proposing the Social-Tag-Based Query Expansion (STBQE) approach. To identify from the initial search results the context words relevant to the user's query, our approach can use which to expand the search and well rank the search results. Our evaluation results also suggest that the effectiveness of our proposed STBQE approach is comparable to the performance benchmark, YouTube.com, under some evaluation scenario.

1. Attar, R.,Fraenkel, A. S.(1977).Local feedback in full-text retrieval systems.Journal of the ACM,24(3),397-417.
2. Au Yeung, C. M.,Gibbins, N.,Shadbolt, N.(2007).Understanding the semantics of anbiguous tags in folksonomies.Proceedings of the International Workshop on Emergent Semantics and Ontology Evolution,Busan, South Korea:
3. Baeza-Yates, R.,Ribeiro-Neto, B.(1999).Modern Information Retrieval.New York, NY:Addison Wesley.
4. Ballan, L.,Bertini, M.,Bimbo, A. D.,Meoni, M.,Serra, G.(2010).Tag suggestion and localization in user-generated videos based on social knowledge.Proceedings of Second ACM SIGMM Workshop on Social Media,Firenze, Italy:
5. Billhardt, H.,Borrajo, D.,Maojo, V.(2002).A context vector model for infirmation retrieval.Journal of the American Society for Information Science and Technology,53(3),236-249.
6. Buckley, C.,Singhal, A.,Mitra, M.,Salton, G.(1996).New retrieval approaches using SMART: TREC 4.Proceedings of the TREC 4 Conference,Gaithersburg, MD:
7. Carpineto, C.,Romano, G.,Giannini, V.(2002).Improving retrieval feedback with multiple term-ranking function combination.ACM Transactions on Information Systems,20(3),259-290.
8. Cauch, S. ,Wang, J.,Rachakonda, S. M.(1999).A corpus analysis approach for automatic query expansion and its extension to multiple databases.ACM Transactions on Information Systems,17(3),250-269.
9. Chi, E. H.,Mytkowicz, T.(2007).Understanding navigability of social tagging system.Proceedings of the SIGCHI conference on Human Factors in Computing System,San Jose, California:
10. Church, K. W.,Hanks, P.(1989).Word association norms, mutual information and lexicography.Proceedings of the 27th Annual Meeting of the ACL,Vancouver, Canada:
11. Croft, W. B.,Cook, R.,Wilder, D.(1995).Providing government information on the Internet: experiences with THOMAS.Proceedings of the Second Annual Conference on the Theory and Practice of Digital Libraries,Austin, Texas:
12. Cui, H.,Wen, J. R.,Nie, J. Y.,MA, W. Y.(2003).Query expansion by mining user logs.IEEE Transactions on Knoeledge and Data Engineering,15(4),829-839.
13. Deerwester, S.,Dumais, S. T.,Fyrnas, G. W.,Landauer, T. K.,Harshman, R. A.(1990).Indexing by latent semantic analysis.Journal of the American Society for Information Science,41(6),391-407.
14. Dinh, D.,Tamine, L.(2011).Combining global and local semantic contexts for improving biomedical information retrieval.Proceedings of the 33rd European Conference on Information Retrieval,Dublin, Ireland:
15. Drucker, P. F.(2001).Management Challenges for the 21st Century.New York:Harper Business.
16. Fano, R.(1961).Transmission of Information: A Statistical Theory of Communications.Cambridge, MA:MIT Press.
17. Furnas, G. W.,Landauer, T. K.,Gomez, L. M.,Dumais, S. T.(1987).The vocabulary problem in human-system communication.Communications of the ACM,30(11),964-971.
18. Golder, S. A.,Huberman, B. A.(2006).Usage patterns of collaborative tagging systems.Journal of Information Science,32(2),198-208.
19. Gong, Z.,Muyeba, M.,Guo, J.(2010).Business information query expansion through semantic network.Enterprise Information Systems,4(1),1-22.
20. Gong, Z,Cheang, C. W.,Leong, H. U.(2005).Web query expansion by WordNet.Proceedings of the International Conference on Database and Expert System Applications
21. Harman, D.(1992).Relevance feedback revisited.Proceedings of the 15th Annual International Conference on Research and Development in Information Retrieval,Copenhagen, Denmark:
22. Harman, D.(1993).Overview of the first text retrieval conference (TREC-1).Proceedings of the First Text Retrieval Conference (TREC-1),Gaithersburg, Maryland:
23. Haubold, A.,Natsev, A.,Naphade, M. R.(2006).Semantic multimedia retrieval using lexical query expansion and model-based reranking.Proceedings of the 2006 IEEE International Conference on Multimedia and Expo,Toronto, Canada:
24. Hawking, D.(2006).Web search engines: Part 2.IEEE Computer,39(8),88-90.
25. Hoeber, O.,Yang, X. D.,Yao, Y.(2005).Conceptual query expansion.Proceedings of the Third International Atlantic Web Intelligence Conference,Lodz, Poland:
26. Hong, Z.,Syin, C.,Lai, K. F.(1998).Query expansion by text and image features in image retrieval.Journal of Visual Communication and Image Representation,9(4),287-299.
27. Huang, C. K.,Chien, L. F.,Oyang, Y. J.(2003).Relevant term suggestion in interactive Web search based on contextual information in query session logs.Journal of the American Society for Information Science and Technology,54(7),638-649.
28. Jing, Y.,Croft, W. B.(1994).An association thesaurus for information retrieval.Proceedings of the RIAO'94,New York:
29. Jones, K. S.(1971).Automatic Keyword Classification for Information Retrieval.London, UK:Buterworth.
30. Jones, K. S.(1972).A statistical interpretation of term specificity and its application in retrieval.Journal of Documentation,28(1),11-21.
31. Khan, M. S.,Khor, S.(2004).Enhanced Web document retrieval using automatic query expansion.Journal of the American Society for Information Science and Technology,55(1),29-40.
32. Krestel, R.,Fankhauser, P.,Nejdl, W.(2009).Latent dirichlet allocation for tag recommendation.Proceedings of the Third ACM Conference on Recommender System (RecSys '09),New York:
33. Larsen, B.,Aone, C.(1999).Fast and effective text mining using linear-time document clustering.Proceedings of the Fifteenth International Conference on Knowledge Discovery and Data Mining,San Diego, CA:
34. Lew, M. S.,Sebe, N.,Djeraba, C.,Jain, R.(2006).Content-based multimedia information retrieval: state of the art and challenges.ACM Transactions on Multimedia Computing, Communications, and Applications,2(1),1-19.
35. Liu, Z.,Chu, W. W.(2005).Knowledge-based query expansion to support scenario-specific retrieval of medical free text.Proceedings of the ACM Symposium on Applied Computing,Santa Fe, New Mexico:
36. Losada, D. E.(2010).Statistical query expansion for sentence retrieval and its effects on weak and strong queries.Information Retrieval,13(5),485-506.
37. MacGregor, G.,McCulloch, E.(2006).Collaborative tagging as a knowledge organisation and resource discovery tool.Library View,55(5),291-300.
38. Makhoul, J.,Kubala, F.,Schwartz, R.,Ralph, W.(1999).Performance measures for information extraction.Proceedings of DARPA Broadcast News Workshop
39. Maron, M. E.,Kuhns, J. L.(1960).On relevance, probabilistic indexing and information retrieval.Journal of the ACM,7(3),216-244.
40. Miller, G. A.,Beckwith, R.,Felbaum, C.,Gross, D.,Miller, K.(1990).Introduction to WordNet: an on-line lexical database.International Journal of Lexicography,3(4),235-244.
41. Mithhell, T.(1997).Machine Learning.Boston, MA:McGraw Hill.
42. Passant, A.,Laublet, P.(2008).Meaning of a tag: a collaborative approach to bridge the gap between tagging and linked data.Proceedings of the Workshop on Linked Data on the Web,Beijing, China:
43. Qiu, Y.,Frei, H. P.(1993).Concept based query expansion.Proceedings of the 16th Annual International Conference on Research and Development in Information Retrieval,Pittsburgh, PA:
44. Quinlan, J. R.(1986).Induction of decision tree.Machine Learning,1,81-106.
45. Rahman, M. M.,Bhattacharya, P.(2009).Image retrieval with automatic query expansion based on local analysis in a semantical concept feature space.Proceeding of the ACM International Conference on Image and Video Retrieval,Island of Santorini, Greece:
46. Roberson, S. E.(1997).The probability ranking principle in IR.Journal of Documentation,33(4),294-304.
47. Roussinov, D.,Chen, H.(1999).Document clustering for electronic meetings: an experimental comparison of two techniques.Decision Support Systems,27(1),67-79.
48. Rowley, J. E.,Farrow, J.(1995).Organizing Knowledge: An Introduction to Managing Access to Information.Brookfield, VT:Gower.
49. Ruthven, I.(2003).Re-examining the potential effectiveness of interactive query expansion.Proceedings of the 26th Annual International Conference on Research and Development in Information Retrieval,Toronto, Canada:
50. Salton, G.(Ed.)(1971).The SMART Retrieval System.Upper Saddle River, NJ:Prentice-Hall.
51. Salton, G.,Buckley, C.(1990).Improving retrieval performance by relevance feedback.Journal of the American Society for Information Science,41(4),288-297.
52. Salton, G.,Fox, E. A.,Wu, H.(1983).Extended boolean information retrieval.Communications of the ACM,26(11),1022-1036.
53. Salton, G.,Wong, A.,Yang, C. S.(1975).A vector space model for automatic indexing.Communications of the ACM,18(11),613-620.
54. Schutze, H.,Hull, D. A.,Pedersen, J. O.(1995).A comparison of classifiers and document representations for the routing problem.Proceedings of the 18th Annual International Conference on Research and Development in Information Retrieval,Seattle, WA:
55. Singhal, A.(2001).Modern information retrieval: a brief overview.IEEE Data Engineering Bulletin,24(4),35-43.
56. van Rijsbergan, C. J.(1979).Information Retrieval.London, UK:Butterworths.
57. Voorhees, E. M.,Harman, D.(1999).Overview of the seventh text retrieval conference (TREC-7).Proceedings of the Seventh Text Retrieval Conference (TREC-7),Gaithersburg, MA:
58. Wei, C. P.,Hu, P.,Tai, C. H.,Huang, C. N.,Yang, C. S.(2007).Managing word mismatch problems in information retrieval: a topic-based query expansion approach.Journal of Management Information Systems,24(3),269-295.
59. Wong, S. K.,Yao, Y. Y.(1992).An information-theoretic measure of term specificity.Journal of the American Society for Information Science,43(1),54-61.
60. Xu, J.,Croft, W. B.(1996).Query expansion using local and global document analysis.Proceedings of the 19th Annual International Conference on Research and Development in Information Retrieval,Zurich, Switzerland:
61. Xu, J.,Croft, W. B.(2000).Improving the effectiveness of information retrieval with local context analysis.ACM Transactions on Information Systems,18(1),79-112.
62. Yang, Y.,Huang, Z.,Shen, H. T.,Zhou, X.(2011).Mining multi-tag association for image tagging.World Wide Web,14(2),133-156.
63. Zauder, K.,Lazic, J. L.,Zorica, M. B.(2007).Collaborative tagging supported knowledge discovery.Proceedings of the 29th International Conference on Information Technology Interfaces,Cavtat/Dubrovnik, Croatia:
64. Zhai, Y.,Liu, J.,Shah, M.(2006).Automatic query expansion for news video retrieval.Proceedings of the IEEE International Conference on Multimedia and Expo,Toronto, Canada:

1. 謝郁萍、吳鈺萍、池文海(2016)。從情感與認知評價之雙面觀點探討網路影音平台使用者行為。管理學報，33(3)，443-471。