题名

透過動作及觸控感測增強行動及穿戴式裝置輸入與輸出方式

并列篇名

Enhancing Mobile and Wearable I/O using Motion and Touch Sensing

DOI

10.6342/NTU201704527

作者

蔡欣叡

关键词

觸控 ; 動作 ; 行動式裝置 ; 穿戴式裝置 ; 輸入方式 ; 虛擬實境 ; 觸覺回饋 ; 力回饋 ; touch ; motion ; mobile device ; wearable device ; input modality ; virtual reality ; haptic feedback ; force feedback

期刊名称

國立臺灣大學資訊工程學系學位論文

卷期/出版年月

2017年

学位类别

博士

导师

洪一平

内容语文

英文

中文摘要

近年來行動式及穿戴式裝置越來越普及,這些裝置提供了各種創新的功能及互動,使得人們的生活更加便利。然而,由於在行動式及穿戴式裝置上受限的輸入方式、範圍和姿勢,許多問題和限制也相應出現。在本論文中,我們專注在靈活的手部輸入與輸出,並利用觸控及動作感測的技術提出創新的互動並解決上述的問題及限制。透過動作感測,MotionWatch讓使用者能透過單手操作智慧手錶進而消彌了手錶輸入姿勢的限制,而ElasticVR在虛擬實境中提供力量的回饋。透過觸控感測,MovingScreen解決因輸入姿勢與範圍而產生的大螢幕手機單手操作問題,而TouchRing提供高隱私性及隱蔽性的多點觸控輸入增加輸入的方式。由結合動作和觸控輸入,ThumbRing在穿戴式裝置上提供了充足的輸入範圍,而SegTouch豐富了智慧手機上的手勢輸入。本篇論文中,我們透過動作及觸控感測,在行動及穿戴式裝置上探索各式創新的互動。

英文摘要

Mobile and wearable devices are widely used nowadays. Novel interactions are proposed and enabled on these devices to provide users with more convenient and advanced lives. However, several problems and restrictions exist on mobile and wearable devices as well due to limited input modality, area and pose. We focus on dexterous hand input and output by leveraging motion and touch sensing to propose innovative interactions and solve the problems and limitations in this dissertation. Using motion sensing, MotionWatch provides one-handed input on smartwatches to eliminate the input pose limitation and ElasticVR presents force feedback in virtual reality (VR). Using touch sensing, MovingScreen solves hard-to-reach problem caused by limited input pose and area, and TouchRing provides private and subtle multi-touch input to increase input modality. Combining motion and touch input, ThumbRing provides sufficient input area using a wearable device and SegTouch enriches touch gestures on smartphones. In this dissertation, we explore innovative interactions using motion and touch sensing on mobile and wearable devices.

主题分类 基礎與應用科學 > 資訊科學
電機資訊學院 > 資訊工程學系
参考文献
  1. [67] D. Prattichizzo, F. Chinello, C. Pacchierotti, and M. Malvezzi. Towards wearability in fingertip haptics: a 3-dof wearable device for cutaneous force feedback. IEEE Transactions on Haptics, 6(4):506–516, 2013.
    連結:
  2. [70] J. Rekimoto. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Wearable Computers, 2001. Proceedings. Fifth International Symposium on, pages 21–27. IEEE, 2001.
    連結:
  3. [71] M. Romano, L. Paolino, G. Tortora, and G. Vitiello. The tap and slide keyboard: a new interaction method for mobile device text entry. International Journal of Human-Computer Interaction, 30(12):935–945, 2014.
    連結:
  4. [72] V. Roth and T. Turner. Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1523–1526. ACM, 2009.
    連結:
  5. [77] R. E. Schoonmaker and C. G. Cao. Vibrotactile force feedback system for minimally invasive surgical procedures. In Systems, Man and Cybernetics, 2006. SMC’06. IEEE International Conference on, volume 3, pages 2464–2469. IEEE, 2006.
    連結:
  6. [79] S. Sridhar, A. Markussen, A. Oulasvirta, C. Theobalt, and S. Boring. Watchsense: On-and above-skin input sensing through a wearable depth sensor. 2017.
    連結:
  7. [82] D. Tsetserukou, K. Sato, and S. Tachi. Exointerfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. In Proceedings of the 1st Augmented Human International Conference, page 1. ACM, 2010.
    連結:
  8. [83] C. J. Turner, B. S. Chaparro, and J. He. Text input on a smartwatch qwerty keyboard: Tap vs. trace. International Journal of Human–Computer Interaction, pages 1–8, 2016.
    連結:
  9. [85] W. S. Walmsley, W. X. Snelgrove, and K. N. Truong. Disambiguation of imprecise input with one-dimensional rotational text entry. ACM Transactions on Computer-Human Interaction (TOCHI), 21(1):4, 2014.
    連結:
  10. [86] J. Weiner. Fitting the task to the man—an ergonomic approach. British journal of industrial medicine, 28(2):210, 1971.
    連結:
  11. [90] R. Xiao, G. Laput, and C. Harrison. Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 193–196. ACM, 2014.
    連結:
  12. [92] S. H. Yoon, K. Huo, V. P. Nguyen, and K. Ramani. Timmi: Finger-worn textile input device with multimodal sensing in mobile interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, pages 269–272. ACM, 2015.
    連結:
  13. [94] Y. Zhang and C. Harrison. Tomo: Wearable, low-cost electrical impedance tomography for hand gesture recognition. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 167–173. ACM, 2015.
    連結:
  14. [95] Y. Zhang, J. Zhou, G. Laput, and C. Harrison. Skintrack: Using the body as an electrical waveguide for continuous finger tracking on the skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 1491–1503. ACM, 2016.
    連結:
  15. [1] M. Achibet, A. Girard, A. Talvas, M. Marchal, and A. Lécuyer. Elastic-arm: Humanscale passive haptic feedback for augmenting interaction and perception in virtual environments. In Virtual Reality (VR), 2015 IEEE, pages 63–68. IEEE, 2015.
    連結:
  16. [2] D. Ashbrook, P. Baudisch, and S. White. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2043–2046. ACM, 2011.
    連結:
  17. [5] H. Benko, C. Holz, M. Sinclair, and E. Ofek. Normaltouch and texturetouch: Highfidelity 3d haptic shape rendering on handheld virtual reality controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pages 717–728. ACM, 2016.
    連結:
  18. [6] G. C. Burdea. Haptics issues in virtual environments. In Computer Graphics International, 2000. Proceedings, pages 295–302. IEEE, 2000.
    連結:
  19. [11] Y. Chang, S. L’Yi, K. Koh, and J. Seo. Understanding users’ touch behavior on large mobile touch-screens and assisted targeting by tilting gesture. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 1499–1508. ACM, 2015.
    連結:
  20. [25] A. Gupta, M. Anwar, and R. Balakrishnan. Porous interfaces for small screen multitasking using finger identification. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pages 145–156. ACM, 2016.
    連結:
  21. [29] S. G. Hart and L. E. Staveland. Development of nasa-tlx (task load index): Results of empirical and theoretical research. Advances in psychology, 52:139–183, 1988.
    連結:
  22. [32] C. Holz and P. Baudisch. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 581–590. ACM, 2010.
    連結:
  23. [34] D.-Y. Huang, L. Chan, S. Yang, F. Wang, R.-H. Liang, D.-N. Yang, Y.-P. Hung, and B.-Y. Chen. Digitspace: Designing thumb-to-fingers touch interfaces for one-handed and eyes-free interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 1526–1537. ACM, 2016.
    連結:
  24. [35] D.-Y. Huang, M.-C. Tsai, Y.-C. Tung, M.-L. Tsai, Y.-T. Yeh, L. Chan, Y.-P. Hung, and M. Y. Chen. Touchsense: expanding touchscreen input vocabulary using different areas of users’ finger pads. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 189–192. ACM, 2014.
    連結:
  25. [39] A. K. Karlson and B. B. Bederson. Thumbspace: generalized one-handed input for touchscreen-based mobile devices. In Human-Computer Interaction–INTERACT 2007, pages 324–338. Springer, 2007.
    連結:
  26. [46] I. Kim and J. H. Jo. Performance comparisons between thumb-based and finger-based input on a small touch-screen under realistic variability. International Journal of Human-Computer Interaction, 31(11):746–760, 2015.
    連結:
  27. [49] K. J. Kuchenbecker, J. Fiene, and G. Niemeyer. Improving contact realism through event-based haptic feedback. IEEE transactions on visualization and computer graphics, 12(2):219–230, 2006.
    連結:
  28. [56] P. Lopes, S. You, L.-P. Cheng, S. Marwecki, and P. Baudisch. Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 1471–1482. ACM, 2017.
    連結:
  29. [62] I. Oakley and S. O’Modhrain. Tilt to scroll: evaluating a motion based vibrotactile mobile interface. In Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint, pages 40–49. IEEE, 2005.
    連結:
  30. [67] D. Prattichizzo, F. Chinello, C. Pacchierotti, and M. Malvezzi. Towards wearability in fingertip haptics: a 3-dof wearable device for cutaneous force feedback. IEEE Transactions on Haptics, 6(4):506–516, 2013.
    連結:
  31. [70] J. Rekimoto. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Wearable Computers, 2001. Proceedings. Fifth International Symposium on, pages 21–27. IEEE, 2001.
    連結:
  32. [71] M. Romano, L. Paolino, G. Tortora, and G. Vitiello. The tap and slide keyboard: a new interaction method for mobile device text entry. International Journal of Human-Computer Interaction, 30(12):935–945, 2014.
    連結:
  33. [72] V. Roth and T. Turner. Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1523–1526. ACM, 2009.
    連結:
  34. [77] R. E. Schoonmaker and C. G. Cao. Vibrotactile force feedback system for minimally invasive surgical procedures. In Systems, Man and Cybernetics, 2006. SMC’06. IEEE International Conference on, volume 3, pages 2464–2469. IEEE, 2006.
    連結:
  35. [79] S. Sridhar, A. Markussen, A. Oulasvirta, C. Theobalt, and S. Boring. Watchsense: On-and above-skin input sensing through a wearable depth sensor. 2017.
    連結:
  36. [82] D. Tsetserukou, K. Sato, and S. Tachi. Exointerfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. In Proceedings of the 1st Augmented Human International Conference, page 1. ACM, 2010.
    連結:
  37. [83] C. J. Turner, B. S. Chaparro, and J. He. Text input on a smartwatch qwerty keyboard: Tap vs. trace. International Journal of Human–Computer Interaction, pages 1–8, 2016.
    連結:
  38. [85] W. S. Walmsley, W. X. Snelgrove, and K. N. Truong. Disambiguation of imprecise input with one-dimensional rotational text entry. ACM Transactions on Computer-Human Interaction (TOCHI), 21(1):4, 2014.
    連結:
  39. [86] J. Weiner. Fitting the task to the man—an ergonomic approach. British journal of industrial medicine, 28(2):210, 1971.
    連結:
  40. [90] R. Xiao, G. Laput, and C. Harrison. Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 193–196. ACM, 2014.
    連結:
  41. [92] S. H. Yoon, K. Huo, V. P. Nguyen, and K. Ramani. Timmi: Finger-worn textile input device with multimodal sensing in mobile interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, pages 269–272. ACM, 2015.
    連結:
  42. [94] Y. Zhang and C. Harrison. Tomo: Wearable, low-cost electrical impedance tomography for hand gesture recognition. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 167–173. ACM, 2015.
    連結:
  43. [95] Y. Zhang, J. Zhou, G. Laput, and C. Harrison. Skintrack: Using the body as an electrical waveguide for continuous finger tracking on the skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 1491–1503. ACM, 2016.
    連結:
  44. [66] S. T. Perrault, E. Lecolinet, J. Eagan, and Y. Guiard. Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1451–1460. ACM, 2013.
  45. [68] W. Premerlani and P. Bizard. Direction cosine matrix imu: Theory. DIY DRONE: USA, pages 13–15, 2009.
  46. [69] M. Rahman, S. Gustafson, P. Irani, and S. Subramanian. Tilt techniques: investigating the dexterity of wrist-based input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1943–1952. ACM, 2009.
  47. [73] A. Roudaut, S. Huot, and E. Lecolinet. Taptap and magstick: improving one-handed target acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces, pages 146–153. ACM, 2008.
  48. [74] J. Ruiz and Y. Li. Doubleflip: a motion gesture delimiter for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2717–2720. ACM, 2011.
  49. [75] J. Ruiz, Y. Li, and E. Lank. User-defined motion gestures for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 197–206. ACM, 2011.
  50. [76] T. S. Saponas, D. S. Tan, D. Morris, R. Balakrishnan, J. Turner, and J. A. Landay. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology, pages 167–176. ACM, 2009.
  51. [78] S. B. Schorr and A. M. Okamura. Fingertip tactile devices for virtual object manipulation and exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 3115–3119. ACM, 2017.
  52. [80] H.-R. Tsai, M.-C. Hsiu, J.-C. Hsiao, L.-T. Huang, M. Chen, and Y.-P. Hung. Touchring: subtle and always-available input using a multi-touch ring. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pages 891–898. ACM, 2016.
  53. [81] H.-R. Tsai, C.-Y. Wu, L.-T. Huang, and Y.-P. Hung. Thumbring: private interactions using one-handed thumb motion input on finger segments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pages 791–798. ACM, 2016.
  54. [84] D. Vogel and R. Balakrishnan. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 33–42. ACM, 2005.
  55. [87] D. Wigdor and R. Balakrishnan. Tilttext: using tilt for text input to mobile phones. In Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 81–90. ACM, 2003.
  56. [88] J. O. Wobbrock, H. H. Aung, B. Rothrock, and B. A. Myers. Maximizing the guessability of symbolic input. In CHI’05 extended abstracts on Human Factors in Computing Systems, pages 1869–1872. ACM, 2005.
  57. [89] J. O. Wobbrock, M. R. Morris, and A. D. Wilson. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1083–1092. ACM, 2009.
  58. [91] X.-D. Yang, K. Hasan, N. Bruce, and P. Irani. Surround-see: enabling peripheral vision on smartphones during active use. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pages 291–300. ACM, 2013.
  59. [93] N.-H. Yu, D.-Y. Huang, J.-J. Hsu, and Y.-P. Hung. Rapid selection of hard-to-access targets by thumb on mobile touch-screens. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services, pages 400–403. ACM, 2013.
  60. [3] D. L. Ashbrook. Enabling mobile microinteractions. 2010.
  61. [4] O. K.-C. Au, X. Su, and R. W. Lau. Lineardragger: a linear selector for one-finger target acquisition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2607–2616. ACM, 2014.
  62. [7] T. Carter, S. A. Seah, B. Long, B. Drinkwater, and S. Subramanian. Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pages 505–514. ACM, 2013.
  63. [8] J. Cauchard, M. Löchtefeld, M. Fraser, A. Krüger, and S. Subramanian. m+ pspaces: virtual workspaces in the spatially-aware mobile environment. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, pages 171–180. ACM, 2012.
  64. [9] L. Chan, Y.-L. Chen, C.-H. Hsieh, R.-H. Liang, and B.-Y. Chen. Cyclopsring: Enabling whole-hand and context-aware interactions through a fisheye ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 549–556. ACM, 2015.
  65. [10] L. Chan, R.-H. Liang, M.-C. Tsai, K.-Y. Cheng, C.-H. Su, M. Y. Chen, W.-H. Cheng, and B.-Y. Chen. Fingerpad: private and subtle interaction using fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pages 255–260. ACM, 2013.
  66. [12] C.-Y. Chen, Y.-Y. Chen, Y.-J. Chung, and N.-H. Yu. Motion guidance sleeve: Guiding the forearm rotation through external artificial muscles. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 3272–3276. ACM, 2016.
  67. [13] K.-Y. Chen, K. Lyons, S. White, and S. Patel. utrack: 3d input using two magnetic sensors. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pages 237–244. ACM, 2013.
  68. [14] X. Chen, N. Marquardt, A. Tang, S. Boring, and S. Greenberg. Extending a mobile device’s interaction space through body-centric interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, pages 151–160. ACM, 2012.
  69. [15] X. Chen, J. Schwarz, C. Harrison, J. Mankoff, and S. Hudson. Around-body interaction: sensing & interaction techniques for proprioception-enhanced input with mobile devices. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services, pages 287–290. ACM, 2014.
  70. [16] X. Chen, J. Schwarz, C. Harrison, J. Mankoff, and S. E. Hudson. Air+ touch: interweaving touch & in-air gestures. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pages 519–525. ACM, 2014.
  71. [17] I. Choi, E. W. Hawkes, D. L. Christensen, C. J. Ploch, and S. Follmer. Wolverine: A wearable haptic interface for grasping in virtual reality. In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on, pages 986–993. IEEE, 2016.
  72. [18] E. Costanza, S. A. Inverso, R. Allen, and P. Maes. Intimate interfaces in action: Assessing the usability and subtlety of emg-based motionless gestures. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 819–828. ACM, 2007.
  73. [19] A. Crossan, J. Williamson, S. Brewster, and R. Murray-Smith. Wrist rotation for interaction in mobile contexts. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, pages 435–438. ACM, 2008.
  74. [20] A. Dementyev and J. A. Paradiso. Wristflex: Low-power gesture input with wrist-worn pressure sensors. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pages 161–166. ACM, 2014.
  75. [21] dokiWatch. dokiwatch, 2016. https://www.kickstarter.com/projects/dokiwatch/dokiwatch-the-worlds-most-advanced-smartwatch-for.
  76. [22] M. Fukumoto and Y. Suenaga. “fingering”: a full-time wearable interface. In Conference companion on Human factors in computing systems, pages 81–82. ACM, 1994.
  77. [23] X. Gu, Y. Zhang, W. Sun, Y. Bian, D. Zhou, and P. O. Kristensson. Dexmo: An inexpensive and lightweight mechanical exoskeleton for motion capture and force feedback in vr. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 1991–1995. ACM, 2016.
  78. [24] A. Guo and T. Paek. Exploring tilt for no-touch, wrist-only interactions on smartwatches. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, pages 17–28. ACM, 2016.
  79. [26] C. Gutwin, A. Cockburn, J. Scarr, S. Malacria, and S. C. Olson. Faster command selection on tablets with fasttap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2617–2626. ACM, 2014.
  80. [27] C. Harrison and S. E. Hudson. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology, pages 121–124. ACM, 2009.
  81. [28] C. Harrison, J. Schwarz, and S. E. Hudson. Tapsense: enhancing finger interaction on touch surfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology, pages 627–636. ACM, 2011.
  82. [30] S. Heo and G. Lee. Forcetap: extending the input vocabulary of mobile touch screens by adding tap gestures. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pages 113–122. ACM, 2011.
  83. [31] K. Hinckley and H. Song. Sensor synaesthesia: touch in motion, and motion in touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 801–810. ACM, 2011.
  84. [33] D. Huang, X. Zhang, T. S. Saponas, J. Fogarty, and S. Gollakota. Leveraging dual-observable input for fine-grained thumb interaction using forearm emg. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 523–528. ACM, 2015.
  85. [36] A. Hyrskykari, H. Istance, and S. Vickers. Gaze gestures or dwell-based interaction? In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 229–232. ACM, 2012.
  86. [37] S. Jeong, N. Hashimoto, and S. Makoto. A novel interaction system with force feedback between real-and virtual human: an entertainment system: virtual catch ball. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, pages 61–66. ACM, 2004.
  87. [38] H.-L. C. Kao, A. Dementyev, J. A. Paradiso, and C. Schmandt. Nailo: Fingernails as an input surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 3015–3018. ACM, 2015.
  88. [40] A. K. Karlson, B. B. Bederson, and J. Contreras-Vidal. Understanding one handed use of mobile devices. Handbook of research on user interface design and evaluation for mobile technology, pages 86–101, 2008.
  89. [41] Y. Kawahara, S. Hodges, B. S. Cook, C. Zhang, and G. D. Abowd. Instant inkjet circuits: lab-based inkjet printing to support rapid prototyping of ubicomp devices. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, pages 363–372. ACM, 2013.
  90. [42] F. Kerber, P. Lessel, and A. Krüger. Same-side hand interactions with arm-placed devices using emg. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pages 1367–1372. ACM, 2015.
  91. [43] F. Kerber, P. Schardt, and M. Löchtefeld. Wristrotate: a personalized motion gesture delimiter for wrist-worn devices. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, pages 218–222. ACM, 2015.
  92. [44] W. Kienzle and K. Hinckley. Lightring: always-available 2d input on any surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pages 157–160. ACM, 2014.
  93. [45] D. Kim, O. Hilliges, S. Izadi, A. D. Butler, J. Chen, I. Oikonomidis, and P. Olivier. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the 25th annual ACM symposium on User interface software and technology, pages 167–176. ACM, 2012.
  94. [47] J. Kim, J. He, K. Lyons, and T. Starner. The gesture watch: A wireless contact-free gesture based wrist interface. In Wearable Computers, 2007 11th IEEE International Symposium on, pages 15–22. IEEE, 2007.
  95. [48] S. Kim, J. Yu, and G. Lee. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference, pages 295–298. ACM, 2012.
  96. [50] B. Lafreniere, C. Gutwin, A. Cockburn, and T. Grossman. Faster command selection on touchscreen watches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 4663–4674. ACM, 2016.
  97. [51] G. Laput, R. Xiao, X. Chen, S. E. Hudson, and C. Harrison. Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pages 389–394. ACM, 2014.
  98. [52] F. C. Y. Li, D. Dearman, and K. N. Truong. Virtual shelves: interactions with orientation aware devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology, pages 125–128. ACM, 2009.
  99. [53] J.-W. Lin, C. Wang, Y. Y. Huang, K.-T. Chou, H.-Y. Chen, W.-L. Tseng, and M. Y. Chen. Backhand: Sensing hand gestures via back of the hand. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 557–564. ACM, 2015.
  100. [54] S.-Y. Lin, C.-H. Su, K.-Y. Cheng, R.-H. Liang, T.-H. Kuo, and B.-Y. Chen. Pub-point upon body: exploring eyes-free interaction and methods on an arm. In Proceedings of the 24th annual ACM symposium on User interface software and technology, pages 481–488. ACM, 2011.
  101. [55] C. Loclair, S. Gustafson, and P. Baudisch. Pinchwatch: a wearable device for one-handed microinteractions. In Proc. MobileHCI, volume 10, 2010.
  102. [57] K. Lyons, D. Nguyen, D. Ashbrook, and S. White. Facet: a multi-segment wrist worn system. In Proceedings of the 25th annual ACM symposium on User interface software and technology, pages 123–130. ACM, 2012.
  103. [58] W. McMahan, J. Gewirtz, D. Standish, P. Martin, J. A. Kunkel, M. Lilavois, A. Wedmid, D. I. Lee, and K. J. Kuchenbecker. Tool contact acceleration feedback for telerobotic surgery. IEEE Transactions on Haptics, 4(3):210–220, 2011.
  104. [59] J. Murayama, L. Bougrila, Y. Luo, K. Akahane, S. Hasegawa, B. Hirsbrunner, and M. Sato. Spidar g&g: a two-handed haptic interface for bimanual vr interaction. In Proceedings of EuroHaptics, volume 2004, pages 138–146, 2004.
  105. [60] K. Nagai, S. Tanoue, K. Akahane, and M. Sato. Wearable 6-dof wrist haptic device spidar-w. In SIGGRAPH Asia 2015 Haptic Media And Contents Design, page 19. ACM, 2015.
  106. [61] I. Oakley and D. Lee. Interaction on the edge: offset sensing for small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 169–178. ACM, 2014.
  107. [63] M. Ogata, Y. Sugiura, H. Osawa, and M. Imai. iring: intelligent ring using infrared reflection. In Proceedings of the 25th annual ACM symposium on User interface software and technology, pages 131–136. ACM, 2012.
  108. [64] P. Parhi, A. K. Karlson, and B. B. Bederson. Target size study for one-handed thumb use on small touchscreen devices. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, pages 203–210. ACM, 2006.
  109. [65] A. G. Perez, D. Lobo, F. Chinello, G. Cirio, M. Malvezzi, J. San Martín, D. Prattichizzo, and M. A. Otaduy. Soft finger tactile rendering for wearable haptics. In World Haptics Conference (WHC), 2015 IEEE, pages 327–332. IEEE, 2015.
  110. [66] S. T. Perrault, E. Lecolinet, J. Eagan, and Y. Guiard. Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1451–1460. ACM, 2013.
  111. [68] W. Premerlani and P. Bizard. Direction cosine matrix imu: Theory. DIY DRONE: USA, pages 13–15, 2009.
  112. [69] M. Rahman, S. Gustafson, P. Irani, and S. Subramanian. Tilt techniques: investigating the dexterity of wrist-based input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1943–1952. ACM, 2009.
  113. [73] A. Roudaut, S. Huot, and E. Lecolinet. Taptap and magstick: improving one-handed target acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces, pages 146–153. ACM, 2008.
  114. [74] J. Ruiz and Y. Li. Doubleflip: a motion gesture delimiter for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2717–2720. ACM, 2011.
  115. [75] J. Ruiz, Y. Li, and E. Lank. User-defined motion gestures for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 197–206. ACM, 2011.
  116. [76] T. S. Saponas, D. S. Tan, D. Morris, R. Balakrishnan, J. Turner, and J. A. Landay. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology, pages 167–176. ACM, 2009.
  117. [78] S. B. Schorr and A. M. Okamura. Fingertip tactile devices for virtual object manipulation and exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 3115–3119. ACM, 2017.
  118. [80] H.-R. Tsai, M.-C. Hsiu, J.-C. Hsiao, L.-T. Huang, M. Chen, and Y.-P. Hung. Touchring: subtle and always-available input using a multi-touch ring. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pages 891–898. ACM, 2016.
  119. [81] H.-R. Tsai, C.-Y. Wu, L.-T. Huang, and Y.-P. Hung. Thumbring: private interactions using one-handed thumb motion input on finger segments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pages 791–798. ACM, 2016.
  120. [84] D. Vogel and R. Balakrishnan. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 33–42. ACM, 2005.
  121. [87] D. Wigdor and R. Balakrishnan. Tilttext: using tilt for text input to mobile phones. In Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 81–90. ACM, 2003.
  122. [88] J. O. Wobbrock, H. H. Aung, B. Rothrock, and B. A. Myers. Maximizing the guessability of symbolic input. In CHI’05 extended abstracts on Human Factors in Computing Systems, pages 1869–1872. ACM, 2005.
  123. [89] J. O. Wobbrock, M. R. Morris, and A. D. Wilson. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1083–1092. ACM, 2009.
  124. [91] X.-D. Yang, K. Hasan, N. Bruce, and P. Irani. Surround-see: enabling peripheral vision on smartphones during active use. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pages 291–300. ACM, 2013.
  125. [93] N.-H. Yu, D.-Y. Huang, J.-J. Hsu, and Y.-P. Hung. Rapid selection of hard-to-access targets by thumb on mobile touch-screens. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services, pages 400–403. ACM, 2013.