無線手勢感測裝置之互動舞蹈表演系統研究

Interactive Dance Performance System Based on Wireless Wearable Gesture Sensing Device

10.6285/MIC.201809_7(2).0014

林冠儀(Guan-I Lin)；鄭建文(Chien-Wen Cheng)

人機互動 ； Myo手環 ； 手勢互動 ； 衍生影像 ； Human-Computer Interaction ； Myo Armband ； Gesture-Driven interaction ； Generated Imagery

管理資訊計算

7卷2期（2018 / 09 / 01）

167 - 184

繁體中文

隨著電腦科技的進步以及高度的易取得性，使得過去依賴文本、演員與舞台空間為核心的舞蹈表演有了更多元而豐富的表現手法。舞者與編舞家開始尋找一些新的表演方法來吸引對傳統表演形式沒興趣的族群，其中舞蹈與科技的結合常給予舞者與編舞家更多的表達空間與新的藝術思維，並挑戰創作者的想像極限。結合多媒體科技的舞蹈表演形式，早期作法常是利用預先製作好的影片作為現場舞蹈表演的背景影像，舞者必須透過繁複的練習才能達成舞蹈動作與背景影像內容緊密同步，以模擬舞者與背景影像之間的即時互動關係，但也因此限制了舞者的即興空間。有鑑於此，本研究設計一套互動表演系統，以方便舞者、編舞家與場控人員可以依照自己的需求，預先編排或立即切換舞蹈表演時，所需的背景影像投影。使用者戴上Myo手環，透過無線傳輸技術便能與系統產生於投影畫面上的衍生影像進行互動，另外系統在iPad上的場控介面可方便編舞家或場控人員即時切換衍生影像的效果。本系統經過業界專業舞蹈家與編舞者測試與驗證，以評估其可用性，此外，本研究亦蒐集業界專家意見，歸納出互動表演系統之設計原則。最後，研究者回顧本系統之設計歷程，針對相關研究成果進行探討，提出具體結論與建議。根據統計分析結果，無論舞者有無應用互動科技產品於舞蹈表演的經驗，經過試用本研究所設計之互動表演系統，皆認為此類系統有助於互動舞蹈表演之編舞與演出執行。

With advances in computer technology and a high degree of accessibility, dancers and choreographers are beginning to look for new ways of performances to attract groups that are not interested in traditional forms of performance. The combination between dancing and technology often gives dancers and choreographers more expression space and new artistic thinking, and expands the creator's imagination limits. Combined with the multimedia technology in the dance performances, in the early practice, pre-produced film was often used as background images. However, for live dance performance, dancers have to repeatedly practice to closely synchronize the dancers' instant movements with the background images, which limited the dancers' space of improvisation. To break through the limitations, the Interactive Dance Performance System is thus created. Dancers wearing Myo Armband, a gesture sensing device, through the wireless transmission technology and control system, can interact with the generated imagery on the projection screen. The choreographers or field control crew can use the control interface on the Max/MSP/Jitter system on the iPad to switch the effects of generated imagery easily. The system was tested and proved to be useful by professional dancers and choreographer. In addition, this study also collected their opinions and summarized the design principles of the interactive performance system. Finally, the researcher reviews the design process of the system, discusses the research results after the subjects' trial of the interactive performance system, and makes specific conclusions and propositions. According to the statistical analysis results, regardless of the dancers' experience in using interactive technology products in dance performances, it is considered that such systems are conducive to choreography and the execution of interactive dance performances.

1. Baldwin, C. Y.,Clark, K. B.(2004).Modularity in the Design of Complex Engineering Systems.Complex Engineered Systems Understanding Complex Systems,January,175-205.
2. Brooke, J.(1996).SUS - A quick and dirty usability scale.Usability Evaluation in Industry,189(194),4-7.
3. Clay, A.,Couture, N.,Nigay, L.,DeLa Riviere, J. B.,Martin, J. C.,Courgeon, M.,Domengero, G.(2012).Interactions and systems for augmenting a live dance performance.11th IEEE International Symposium on Mixed and Augmented Reality 2012 - Arts, Media, and Humanities Papers, ISMAR-AMH 2012
4. Clay, A.,Domenger, G.,Conan, J.,Domenger, A.,Couture, N.(2014).Integrating augmented reality to enhance expression, interaction & collaboration in live performances: A ballet dance case study.ISMAR 2014 - IEEE International Symposium on Mixed and Augmented Reality - Media, Arts, Social Science, Humanities and Design 2014, Proceedings
5. Cohen, P. (2013, 9 26). A New Survey Finds a Drop in Arts Attendance. The New York Times. Retrieved from: http://www.nytimes.com
6. Hart, S. G.,Staveland, L. E.(1988).Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.Advances in Psychology,52(C),139-183.
7. Kuşcu, H.,Akgün, B. T.(2005).A new approach to interactive performance systems.Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05)
8. Romano, N.(2016).Dance as a metaphor of a body-mind integrated education.Nietzsche, Jung and Nijinsky,VIII(2),24-36.
9. Sharma, A.,Agarwal, M.,Sharma, A.,Dhuria, P.(2013).Motion capture process, techniques and applications.International Journal on Recent and Innovation Trends in Computing and Communication,1(4),251-257.
10. Shingade, A.,Ghotkar, A.(2014).Animation of 3D Human Model Using Markerless Motion Capture Applied To Sports.International Journal of Computer Graphics & Animation (IJCGA),4(1),27-39.
11. 林珮淳、范銀霞(2004)。從數位藝術探討互動觀念、媒介與美學。藝術學報，74，99-111。
12. 曾鈺涓(2007)。程式、系統與數學邏輯—談60年代之電腦藝術創作。美育，157，10-19。
13. 葉謹睿(2010)。互動設計概論。台北:藝術家。