用振動器協助聽力障礙者感知節奏之研究

DanceVib: Assistive Tempo Experiencing for the Hearing Impaired

10.6342/NTU.2011.03421

趙娸羽

DanceVib ； PC播放模組 ； Vibrator ； 輔助 ； PC display module ； Vibrator ； DanceVib ； assist

臺灣大學電信工程學研究所學位論文

2011年

碩士

黃寶儀

繁體中文

了解到人聽到音樂而隨音樂起舞是一件很享受的事情，然而聽力障礙者因為無法聽清楚音樂節奏而喪失跳舞時對音樂的律動。為了能夠輔助聽力障礙者跳舞，我們設計了一個DanceVib系統，這個系統有三個部分組成，一個是BeatRoot，一個是Vibrator，另一個是PC播放模組。這個系統是基於詢問幾位聽力障礙者，他們是如何感受到音樂而跳舞的？並且得到他們的回應而設計的。實驗之後，評估方式使用正式問卷方式、加速度計分析和現場實驗錄影，目前針對35位受測者在主觀(正式問卷)得到4~5分的高分，在客觀(錄影後，請人打分數)分析得到，戴系統所設計的Vibrator輔助受測者的跳舞節拍。在客觀和主觀的數據上，都得到正面的回應。

We realize that it is enjoyable to hear and dance with music. However, since the deaf cannot hear music clearly, they loss the rhythms of music. In order to assist the deaf with dance, we develop a system named DanceVib. The system has three main components – BeatRoot,Vibrator and PC display module. It is developed based on asking several deaf people about how they feel the tempo and dance with music. After feedback received from them, we developed an initial system. A formal user study, accelerometer analysis and video record are used in evaluation after experiment. Currently, we have an experiment on 35 subjects. The result of their subjective method (formal questionnaire) got 4~5 points; on the other hand, the analysis of objective method (video record graded by people) was that Vibrator help subjects for improving dancing with the tempo. Thus, we use subjective and objective method for evaluation, we all obtained positive feedback from them.

1. [1] B. Engel-Yeger and D. Weissman, "A comparison of motor abilities and perceived self-efficacy between children with hearing impairments and normal hearing children," Disability & Rehabilitation, vol. 31, pp. 352-358, 2009.
   連結：
2. [2] Dummer, G. M., Haubenstricker, J. L., & Stewart, D. A. (1996). Motor skill performances of children who are deaf. Adapted Physical Activity Quarterly, 13, 400–14.
   連結：
3. [3] Rine RM, Robinson E, Rice M, O’Hare T. Longitudinal examination reveals progressive delay of motor skill acquisition in children with sensorineural hearing impairment. Phys Ther 1999;79:s37.
   連結：
4. [4] R. M. Rine, et al., "Balance and Motor Skills in Young Children With Sensorineural Hearing Impairment: A Preliminary Study," Pediatric Physical Therapy, vol. 8, pp. 55-61, 1996.
   連結：
5. [5] R. M. Rine, et al., "Improvement of motor development and postural control following intervention in children with sensorineural hearing loss and vestibular impairment," International Journal of Pediatric Otorhinolaryngology, vol. 68, pp. 1141-1148, 2004.
   連結：
6. [6] G. J. P. Savelsbergh, et al., "Auditory Perception and the Control of Spatially Coordinated Action of Deaf and Hearing Children," Journal of Child Psychology and Psychiatry, vol. 32, pp. 489-500, 1991
   連結：
7. [7] Darrow, A., & Gfeller K. (1991). A study of public school music programs mainstreaming hearing impaired students. Journal of Music Therapy, 28(1), 23-39.
   連結：
8. [9] J. M. H. Goldstein and A. Proctor, "Tactile aids for profoundly deaf children," The Journal of the Acoustical Society of America, vol. 77, pp. 258-265, 1985.
   連結：
9. [10] Darrow, A A. The effect of vibrotactile stimuli via the Somatron on the identification of rhythmic concepts by hearing impaired children. Journal of Music Therapy, 1992; 26(3):115-24.
   連結：
10. [11] S. Nanayakkara, et al., "An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair," presented at the Proceedings of the 27th international conference on Human factors in computing systems, Boston, MA, USA, 2009.
    連結：
11. [12] C. E. Perkins and P. Bhagwat, "Highly dynamic Destination-Sequenced Distance-Vector routing (DSDV) for mobile computers," presented at the Proceedings of the conference on Communications architectures, protocols and applications, London, United Kingdom, 1994.
    連結：
12. [13] C.-C. Chiang, “Routing in Clustered Multihop, Mobile Wireless Networks with Fading Channel,” Proc. IEEE SICON ’97, Apr. 1997, pp.197-211.
    連結：
13. [15] D. B. Johnson, et al., "DSR: the dynamic source routing protocol for multihop wireless ad hoc networks," in Ad hoc networking, ed: Addison-Wesley Longman Publishing Co., Inc., 2001, pp. 139-172.
    連結：
14. [16] S. Giannoulis, et al., "ZRP versus DSR and TORA: a comprehensive survey on ZRP performance," in Emerging Technologies and Factory Automation, 2005. ETFA 2005. 10th IEEE Conference on, 2005, pp. 8 pp.-1024.
    連結：
15. [19] M. Brandes, et al., "Accelerometry based assessment of gait parameters in children," Gait & Posture, vol. 24, pp. 482-486, 2006.
    連結：
16. [20] D. M. Karantonis, et al., "Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring," Information Technology in Biomedicine, IEEE Transactions on, vol. 10, pp. 156-167, 2006.
    連結：
17. [21] A. K. Bourke, et al., "Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm," Gait & Posture, vol. 26, pp. 194-199, 2007.
    連結：
18. [22] J. Fahrenberg, et al., "Assessment of posture and motion by multichannel piezoresistive accelerometer recordings," Psychophysiology, vol. 34, pp. 607-612, 1997.
    連結：
19. [23] K. Aminian, et al., "Physical activity monitoring based on accelerometry: validation and comparison with video observation," Medical and Biological Engineering and Computing, vol. 37, pp. 304-308, 1999.
    連結：
20. [25] H. Lee, et al., "Estimation of indoor physical activity level based on footstep vibration signal measured by MEMS accelerometer in smart home environments," presented at the Proceedings of the 2nd international conference on Mobile entity localization and tracking in GPS-less environments, Orlando, FL, USA, 2009.
    連結：
21. [26] F. Foerster and J. Fahrenberg, "Motion pattern and posture: correctly assessed by calibrated accelerometers" vol. 32, 2000
    連結：
22. [27] L. Bao and S. S. Intille. Activity Recognition from UserAnnotated Acceleration Data. In A. Ferscha and F. Mattern, editors, Pervasive, volume 3001 of Lecture Notes in Computer Science, pages 1–17. Springer, 2004.
    連結：
23. [28] P. H. Veltink, et al., "Detection of static and dynamic activities using uniaxial accelerometers," Rehabilitation Engineering, IEEE Transactions on, vol. 4, pp. 375-385, 1996
    連結：
24. [29] J. M. Winters and W. Yu, "Wearable sensors and telerehabilitation," Engineering in Medicine and Biology Magazine, IEEE, vol. 22, pp. 56-65, 2003.
    連結：
25. [31] Z. Wiebren and L. H. At, "Assessment of spatio-temporal gait parameters from trunk accelerations during human walking," Gait & Posture, vol. 18, pp. 1-10, 2003
    連結：
26. [33] S. Dixon, "Evaluation of the Audio Beat Tracking System BeatRoot," Journal of New Music Research, vol. 36, pp. 39-50, 2007
    連結：
27. [36] A. Klapuri, "Sound onset detection by applying psychoacoustic knowledge," in Acoustics, Speech, and Signal Processing, 1999. ICASSP '99. Proceedings., 1999 IEEE International Conference on, 1999, pp. 3089-3092 vol.6.
    連結：
28. [37] A.-A. Darrow and G. N. Heller, "Early Advocates of Music Education for the Hearing Impaired: William Wolcott Turner and David Ely Bartlett," Journal of Research in Music Education, vol. 33, pp. 269-279, 1985.
    連結：
29. [38] A. L. Solomon, "Music in Special Education before 1930: Hearing and Speech Development," Journal of Research in Music Education, vol. 28, pp. 236-242, 1980.
    連結：
30. [8] Stuckless, R. E. (1981). Real-time graphic display and language development for the hearing-impaired. Volta Review, 83(5), 291-300
31. [14] C. E. Perkins and E. M. Royer, "Ad-hoc on-demand distance vector routing," in Mobile Computing Systems and Applications, 1999. Proceedings. WMCSA '99. Second IEEE Workshop on, 1999, pp. 90-100.
32. [17] M. Bachlin, K. Forster, and G. Troster, “SwimMaster: a wearable assistant for swimmer,” in Proceedings of the 11th international conference on Ubiquitous computing (Ubicomp). New York, NY, USA: ACM, 2009, pp. 215–224
33. [18] L. Jung-Ah, et al., "Wearable Accelerometer System for Measuring the Temporal Parameters of Gait," in Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE, 2007, pp. 483-486.
34. [24] T. R. Burchfield and S. Venkatesan, "Accelerometer-based human abnormal movement detection in wireless sensor networks," presented at the Proceedings of the 1st ACM SIGMOBILE international workshop on Systems and networking support for healthcare and assisted living environments, San Juan, Puerto Rico, 2007.
35. [30] Kiani, Snijders, & Gelsema. (1997). Computerized analysis of daily life motor activity for ambulatory monitoring. Technology & Health Care, 5(4), 307. Retrieved from EBSCOhost
36. [32] H. Ying, et al., "Automatic Step Detection in the Accelerometer Signal," in 4th International Workshop on Wearable and Implantable Body Sensor Networks (BSN 2007). vol. 13, S. Leonhardt, et al., Eds., ed: Springer Berlin Heidelberg, 2007, pp. 80-85.
37. [34] C. Duxbury, et al., "A Hybrid Approach to Musical Note Onset Detection," in In Proc. Digital Audio Effects Workshop (DAFx, 2002.
38. [35] J. P. Bello, et al., "A Tutorial on Onset Detection in Music Signals," Speech and Audio Processing, IEEE Transactions on, vol. 13, pp. 1035-1047, 2005.