FabricTouch: A Multimodal Fabric Assessment Touch Gesture Dataset to Slow Down Fast Fashion

被引：1

作者：

Olugbade, Temitayo ^{[1
,2
]}

Lin, Lili ^{[1
]}

Sansoni, Alice ^{[1
,4
]}

Warawita, Nihara ^{[1
]}

Gan, Yuanze ^{[1
]}

Wei, Xijia ^{[1
]}

Petreca, Bruna ^{[3
]}

Boccignone, Giuseppe ^{[4
]}

Atkinson, Douglas ^{[5
]}

Cho, Youngjun ^{[1
]}

Baurley, Sharon ^{[3
]}

Bianchi-Berthouze, Nadia ^{[1
]}

机构：

[1] UCL, London, England

[2] Univ Sussex, Brighton, E Sussex, England

[3] Royal Coll Art, London, England

[4] Univ Milan, Milan, Italy

[5] Manchester Metropolitan Univ, Manchester, Lancs, England

来源：

2023 11TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION, ACII | 2023年

基金：

欧盟地平线“2020”;

关键词：

Dataset; fabric; gesture recognition; movement; touch; muscle activity; multimodal; HAND; RECOGNITION; IMU;

D O I：

10.1109/ACIIW59127.2023.10388086

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Touch exploration of fabric is used to evaluate its properties, and it could further be leveraged to understand a consumer's sensory experience and preference so as to support them in real time to make careful clothing purchase decisions. In this paper, we open up opportunities to explore the use of technology to provide such support with our FabricTouch dataset, i.e., a multimodal dataset of fabric assessment touch gestures. The dataset consists of bilateral forearm movement and muscle activity data captured while 15 people explored 114 different garments in total to evaluate them according to 5 properties (warmth, thickness, smoothness, softness, and flexibility). The dataset further includes subjective ratings of the garments with respect to each property and ratings of pleasure experienced in exploring the garment through touch. We further report baseline work on automatic detection. Our results suggest that it is possible to recognise the type of fabric property that a consumer is exploring based on their touch behaviour. We obtained mean F1 score of 0.61 for unseen garments, for 5 types of fabric property. The results also highlight the possibility of additionally recognizing the consumer's subjective rating of the fabric when the property being rated is known, mean F1 score of 0.97 for unseen subjects, for 3 rating levels.

引用

页数：8