Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction

被引:0
|
作者
Lee, Edward Jangwon [1 ]
Yong, Sangeon [1 ]
Choi, Soonbeom [1 ]
Chan, Liwei [2 ]
Peiris, Roshan [3 ]
Nam, Juhan [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Daejeon, South Korea
[2] NCTU, Hsinchu, Taiwan
[3] Keio Univ, Yokohama, Kanagawa, Japan
来源
关键词
Mobile music; Force touch; 3D touch; Touch gestures; Relative force;
D O I
10.1007/978-3-030-01692-0_38
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The musical possibilities of force sensors on touchscreen devices are explored, using Apple's 3D Touch. Three functions are selected to be controlled by force: (a) excitation, (b) modification (aftertouch), and (c) mode change. Excitation starts a note, modification alters a playing note, and mode change controls binary on/off sound parameters. Four instruments are designed using different combinations of force-sound mapping strategies. ForceKlick is a single button instrument that plays consecutive notes within one touch by altering touch force, by detecting force down-peaks. The iPhone 6s/7 Ocarina features force-sensitive fingerholes that heightens octaves upon high force. Force Trombone continuously controls gain by force. Force Synth is a trigger pad array featuring all functions in one button: start note by touch, control vibrato with force, and toggle octaves upon abrupt burst of force. A simple user test suggests that adding force features to well-known instruments are more friendly and usable.
引用
收藏
页码:574 / 585
页数:12
相关论文
共 50 条
  • [1] Estimating Touch Force with Barometric Pressure Sensors
    Quinn, Philip
    [J]. CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
  • [2] Mobile Device Interaction with Force Sensing
    Scott, James
    Brown, Lorna M.
    Molloy, Mike
    [J]. PERVASIVE COMPUTING, PROCEEDINGS, 2009, 5538 : 133 - 150
  • [3] Interaction Force Transfer for Characteristic Evaluation of Touch Motion
    Pang, Muye
    Guo, Shuxiang
    Zhang, Songyuan
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2014), 2014, : 1237 - 1242
  • [4] Whole-Body Touch Sensors for Tracked Mobile Robots Using Force-sensitive Chain Guides
    Inoue, Daisuke
    Ohno, Kazunori
    Nakamura, Shinsuke
    Tadokoro, Satoshi
    Koyanagi, Eiji
    [J]. 2008 IEEE INTERNATIONAL WORKSHOP ON SAFETY, SECURITY & RESCUE ROBOTICS, 2008, : 71 - +
  • [5] Improved Use of Foot Force Sensors and Mobile Phone GPS for Mobility Activity Recognition
    Zhang, Zelun
    Poslad, Stefan
    [J]. IEEE SENSORS JOURNAL, 2014, 14 (12) : 4340 - 4347
  • [6] Force Touch Detection on Capacitive Sensors using Deep Neural Networks
    Boceck, Tobias
    Huy Viet Le
    Sprott, Sascha
    Mayer, Sven
    [J]. PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI'19), 2019,
  • [7] Inferring Interaction Force from Visual Information without Using Physical Force Sensors
    Hwang, Wonjun
    Lim, Soo-Chul
    [J]. SENSORS, 2017, 17 (11)
  • [8] MAGNETORESISTIVE FORCE SENSORS FOR USE IN AN INSTRUMENTED PEN
    RAKOWSKI, RT
    BORJONFIGUEROA, LF
    JONES, BE
    [J]. SENSORS AND ACTUATORS A-PHYSICAL, 1993, 37-8 : 422 - 429
  • [9] On the use of magnetostrictive amorphous wires in force sensors
    Chiriac, H
    Hristoforou, E
    Neagu, M
    Darie, I
    Barariu, F
    [J]. NONLINEAR ELECTROMAGNETIC SYSTEMS, 1996, 10 : 680 - 683
  • [10] Touch Interface for Sensing Fingertip Force in Mobile Device Using Electromyogram
    Odagaki, Masato
    Taura, Toshiyuki
    Harakawa, Tetsumi
    [J]. 2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 3447 - 3450