Rеsеаrсh оn Intеrасtiоn Primitivеs аnd Intеrасtiоn Mоdеl fоr Pеn + Tоuсh Inрuts

被引：0
|
作者：
Tong Q.-S. [1 ,2 ]
Kang W.-H. [1 ,2 ]
Fu Q. [1 ,2 ]
Huang J. [1 ]
Tian F. [1 ]
Dai G.-Z. [1 ]
机构：
[1] Beijing Key Laboratory of Human-computer Interaction (Institute of Software, Chinese Academy of Sciences), Beijing
[2] School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing
来源：
Ruan Jian Xue Bao/Journal of Software | 2024年 / 35卷 / 04期
关键词：
interaction model; interaction space; pen + touch input; pen-based interaction;
D O I：
10.13328/j.cnki.jos.006909
中图分类号：
O211 [概率论（几率论、或然率论）];
学科分类号：
摘要：
With the popularity of touch devices, pen + touch inputs have become mainstream input modes for mobile officing. However, existing applications mainly take one of them as input, which limits users’ interaction space. In addition, existing pen + touch research mainly focuses on serial pen + touch cooperation and parallel processing of specific interactive tasks and does not systematically consider parallel cooperation mechanism and intention correlation between different inputs. This study first proposes an interaction model based on pen + touch inputs and then defines pen + touch interaction primitives according to users’ behavioral habits in pen + touch cooperation, so as to extend pen + touch interaction space. Furthermore, by using a partially observable Markov decision process (POMDP), the study develops a method of extracting pen + touch input intentions based on time sequence information, so as to incrementally extract the interaction intention of polysemantic interaction primitives. Finally, the study evaluates the advantages of pen + touch inputs through a user experiment. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
下载
收藏
页码：2022 / 2038
页数：16
相关论文
共 30 条
  • [1] Tian F., Research on Post-WIMP software interface, (2003)
  • [2] Dai GZ, Tian F., Pen-based User Interface, (2014)
  • [3] Tong QS, Zhang ZQ, Huang J, Tian F, Liu J, Dai GZ., Scenario design tool based on hybrid input, Ruan Jian Xue Bao/Journal of Software, 30, pp. 48-61, (2019)
  • [4] Brandl P, Forlines C, Wigdor D, Haller M, Shen C., Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces, Proc. of the 2008 Working Conf. on Advanced Visual Interfaces, pp. 154-161, (2008)
  • [5] Zhang Y, Pahud M, Holz C, Xia HJ, Laput G, McGuffin M, Tu X, Mittereder A, Su F, Buxton W, Hinckley K., Sensing posture-aware pen+touch interaction on tablets, Proc. of the 2019 CHI Conf. on Human Factors in Computing Systems, (2019)
  • [6] Guiard Y., Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model, Journal of Motor Behavior, 19, 4, pp. 486-517, (1987)
  • [7] Hinckley K, Yatani K, Pahud M, Coddington N, Rodenhouse J, Wilson A, Benko H, Buxton B., Pen + touch = New tools, Proc. of the 23nd Annual ACM Symp. on User Interface Software and Technology, pp. 27-36, (2010)
  • [8] Pfeuffer K, Hinckley K, Pahud M, Buxton B., Thumb + pen interaction on tablets, Proc. of the 2017 CHI Conf. on Human Factors in Computing Systems, pp. 3254-3266, (2017)
  • [9] Hinckley K, Yatani K, Pahud M, Coddington N, Rodenhouse J, Wilson A, Benko H, Buxton B., Manual deskterity: An exploration of simultaneous pen+touch direct input, Proc. of the 2010 CHI Extended Abstracts on Human Factors in Computing Systems, pp. 2793-2802, (2010)
  • [10] Romat H, Pietriga E, Henry-Riche N, Hinckley K, Appert C., SpaceInk: Making space for in-context annotations, Proc. of the 32nd Annual ACM Symp. on User Interface Software and Technology, pp. 871-882, (2019)
123