Abstract

Smart clothing has exhibited impressive body pose/movement tracking capabilities while preserving the soft, comfortable, and familiar nature of clothing. For practical everyday use, smart clothing should (1) be available in a range of sizes to accommodate different fit preferences, and (2) be washable to allow repeated use. In SeamFit, we demonstrate washable T-shirts, embedded with capacitive seam electrodes, available in three different sizes, for exercise logging. Our T-shirt design, customized signal processing & machine learning pipeline allow the SeamFit system to generalize across users, fits, and wash cycles. Prior wearable exercise logging solutions, which often attach a miniaturized sensor to a body location, struggle to track exercises that mainly involve other body parts. SeamFit T-shirt naturally covers a large area of the body and still tracks exercises that mainly involve uncovered joints (e.g., elbows and the lower body). In a user study with 15 participants performing 14 exercises, SeamFit detects exercises with an accuracy of 89%, classifies exercises with an accuracy of 93.4%, and counts exercises with an error of 0.9 counts, on average. SeamFit is a step towards practical smart clothing for everyday uses.

References

[1]

Mominul Ahsan, Siew Hon Teay, Abu Sadat Muhammad Sayem, and Alhussein Albarbar. 2022. Smart clothing framework for health monitoring applications. Signals 3, 1 (2022), 113–145.

[2]

Roland Aigner, Andreas Pointner, Thomas Preindl, Rainer Danner, and Michael Haller. 2021. Texyz: Embroidering enameled wires for three degree-of-freedom mutual capacitive sensing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.

[3]

Stephanie Alley, Stephanie Schoeppe, Diana Guertler, Cally Jennings, Mitch J Duncan, and Corneel Vandelanotte. 2016. Interest and preferences for using advanced physical activity tracking devices: results of a national cross-sectional survey. BMJ open 6, 7 (2016), e011243.

[4]

Apple. 2023. Apple Watch Series 9. https://www.apple.com/shop/buy-watch/apple-watch.

[5]

Hymalai Bello, Bo Zhou, Sungho Suh, and Paul Lukowicz. 2021. Mocapaci: Posture and gesture detection in loose garments using textile cables as capacitive antennas. In Proceedings of the 2021 ACM International Symposium on Wearable Computers. 78–83.

[6]

Leah Buechley and Michael Eisenberg. 2009. Fabric PCBs, electronic sequins, and socket buttons: techniques for e-textile craft. Personal and Ubiquitous Computing 13 (2009), 133–150.

[7]

Steven Ceron, Itai Cohen, Robert F Shepherd, James H Pikul, and Cindy Harnett. 2018. Fiber embroidery of self-sensing soft actuators. Biomimetics 3, 3 (2018), 24.

[8]

Xiaowei Chen, Xiao Jiang, Lishuang Zhan, Shihui Guo, Qunsheng Ruan, Guoliang Luo, Minghong Liao, and Yipeng Qin. 2023. Fullbody human motion reconstruction with sparse joint tracking using flexible sensors. ACM Transactions on Multimedia Computing, Communications and Applications 20, 2 (2023), 1–19.

[9]

Mohammad Iman Mokhlespour Esfahani and Maury A Nussbaum. 2018. A “smart” undershirt for tracking upper body motions: Task classification and angle estimation. IEEE sensors Journal 18, 18 (2018), 7650–7658.

[10]

Daniel Geißler, Bo Zhou, Hamraz Javaheri, Esther Friederike Zahn, Emil Woop, Stefan Schaffer, Paul Lukowicz, and Jakob Karolus. 2024. Towards Non-Distracting Smartphone Interaction While Biking Using Capacitive Sensing as Input Device. In Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. 181–185.

[11]

Bruna Goveia da Rocha, Oscar Tomico, Panos Markopoulos, and Daniel Tetteroo. 2020. Crafting research products through digital machine embroidery. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 341–350.

[12]

Xiaonan Guo, Jian Liu, Cong Shi, Hongbo Liu, Yingying Chen, and Mooi Choo Chuah. 2018. Device-free personalized fitness assistant using WiFi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1–23.

[13]

Holger Harm, Oliver Amft, Daniel Roggen, and Gerhard Tröster. 2010. Smash: A distributed sensing and processing garment for the classification of upper body postures. In 3rd International ICST Conference on Body Area Networks.

[14]

Kunpeng Huang, Ruojia Sun, Ximeng Zhang, Md Tahmidul Islam Molla, Margaret Dunne, Francois Guimbretiere, and Cindy Hsin-Liu Kao. 2021. WovenProbe: probing possibilities for weaving fully-integrated on-skin systems deployable in the field. In Proceedings of the 2021 ACM Designing Interactive Systems Conference. 1143–1158.

[15]

Ian Janssen and Allana G LeBlanc. 2010. Systematic review of the health benefits of physical activity and fitness in school-aged children and youth. International journal of behavioral nutrition and physical activity 7 (2010), 1–16.

[16]

Rushil Khurana, Karan Ahuja, Zac Yu, Jennifer Mankoff, Chris Harrison, and Mayank Goel. 2018. GymCam: Detecting, recognizing and tracking simultaneous exercises in unconstrained scenes. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1–17.

[17]

Jiha Kim, Younho Nam, Jungeun Lee, Young-Joo Suh, and Inseok Hwang. 2023. ProxiFit: Proximity Magnetic Sensing Using a Single Commodity Mobile toward Holistic Weight Exercise Monitoring. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1–32.

[18]

Shengjie Li, Xiang Li, Qin Lv, Guiyu Tian, and Daqing Zhang. 2018. WiFit: Ubiquitous bodyweight exercise monitoring with commodity wifi devices. In 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, 530–537.

[19]

Hyunchul Lim, Yaxuan Li, Matthew Dressa, Fang Hu, Jae Hoon Kim, Ruidong Zhang, and Cheng Zhang. 2022. BodyTrak: Inferring Full-Body Poses from Body Silhouettes Using a Miniature Camera on a Wristband. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–21.

[20]

Jongkuk Lim, Youngmin Oh, and Younggeun Choi. 2024. uLift: Adaptive Workout Tracker Using a Single Wrist-Worn Accelerometer. IEEE Access (2024).

[21]

Ziyu Liu, Hongwen Zhang, Zhenghao Chen, Zhiyong Wang, and Wanli Ouyang. 2020. Disentangling and unifying graph convolutions for skeleton-based action recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 143–152.

[22]

Yiyue Luo, Kui Wu, Tomás Palacios, and Wojciech Matusik. 2021. KnitUI: Fabricating interactive and sensing textiles with machine knitting. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.

[23]

Saif Mahmud, Ke Li, Guilin Hu, Hao Chen, Richard Jin, Ruidong Zhang, François Guimbretière, and Cheng Zhang. 2023. PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1–28.

[24]

Dafna Merom, Chris Rissel, Philayrath Phongsavan, Ben J Smith, Cathelijne Van Kemenade, Wendy J Brown, and Adrian E Bauman. 2007. Promoting walking with pedometers in the community: the step-by-step trial. American journal of preventive medicine 32, 4 (2007), 290–297.

[25]

Dan Morris, T Scott Saponas, Andrew Guillory, and Ilya Kelner. 2014. RecoFit: using a wearable sensor to find, recognize, and count repetitive exercises. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3225–3234.

[26]

Movella. 2024. Xsens Products. https://www.movella.com/products/xsens.

[27]

Abu Sadat Muhammad Sayem, Siew Hon Teay, Hasan Shahariar, Paula Luise Fink, and Alhussein Albarbar. 2020. Review on smart electro-clothing systems (SeCSs). Sensors 20, 3 (2020), 587.

[28]

Yuecheng Peng, Danchang Yan, Haotian Chen, Yue Yang, Ye Tao, Weitao Song, Lingyun Sun, and Guanyun Wang. 2024. IntelliTex: Fabricating Low-cost and Washable Functional Textiles using A Double-coating Process. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–18.

[29]

Quang-Tien Pham, Duc-Anh Nguyen, Tien-Thanh Nguyen, Thanh Nam Nguyen, Duy-Tung Nguyen, Dinh-Tan Pham, Thanh Hai Tran, Thi-Lan Le, and Hai Vu. 2022. A study on skeleton-based action recognition and its application to physical exercise recognition. In Proceedings of the 11th International Symposium on Information and Communication Technology. 239–246.

[30]

Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E Robinson. 2016. Project Jacquard: interactive digital textiles at scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4216–4227.

[31]

Mirana Randriambelonoro, Yu Chen, and Pearl Pu. 2017. Can fitness trackers help diabetic and obese users make and sustain lifestyle changes? Computer 50, 3 (2017), 20–29.

[32]

Olivia Ruston, Leon Watts, and Mike Fraser. 2021. More than it Seams: Garment Stitching in Wearable e-Textiles. In Proceedings of the 2021 ACM Designing Interactive Systems Conference. 1171–1182.

[33]

Olivia G Ruston, Adwait Sharma, and Mike Fraser. 2024. SeamSleeve: Robust Arm Movement Sensing through Powered Stitching. In Proceedings of the 2024 ACM Designing Interactive Systems Conference. 1134–1147.

[34]

Qijia Shao, Jiting Liu, Emily Bejerano, Ho Man Colman, Jingping Nie, Xiaofan Jiang, and Xia Zhou. 2024. Joey: Supporting Kangaroo Mother Care with Computational Fabrics. In Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services. 237–251.

[35]

Chenguang Shen, Bo-Jhang Ho, and Mani Srivastava. 2017. Milift: Efficient smartwatch-based workout tracking using automatic segmentation. IEEE Transactions on Mobile Computing 17, 7 (2017), 1609–1622.

[36]

Jessica Stanley, John A Hunt, Phil Kunovski, and Yang Wei. 2022. A review of connectors and joining technologies for electronic textiles. Engineering Reports 4, 6 (2022), e12491.

[37]

David Strömbäck, Sangxia Huang, and Valentin Radu. 2020. Mm-fit: Multimodal deep learning for automatic exercise logging across sensing devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1–22.

[38]

Ryo Takahashi, Wakako Yukita, Tomoyuki Yokota, Takao Someya, and Yoshihiro Kawahara. 2022. Meander Coil++: A body-scale wireless power transmission using safe-to-body and energy-efficient transmitter coil. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–12.

[39]

Irmandy Wicaksono, Carson I Tucker, Tao Sun, Cesar A Guerrero, Clare Liu, Wesley M Woo, Eric J Pence, and Canan Dagdeviren. 2020. A tailored, electronic textile conformable suit for large-scale spatiotemporal physiological sensing in vivo. npj Flexible Electronics 4, 1 (2020), 1–13.

[40]

Tianhong Catherine Yu, Riku Arakawa, James McCann, and Mayank Goel. 2023. uKnit: A Position-Aware Reconfigurable Machine-Knitted Wearable for Gestural Interaction and Passive Sensing using Electrical Impedance Tomography. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.

[41]

Tianhong Catherine Yu, Manru Mary Zhang, Peter He, Chi-Jung Lee, Cassidy Cheesman, Saif Mahmud, Ruidong Zhang, Francois Guimbretiere, and Cheng Zhang. 2024. SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking. In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology. 1–13.

[42]

Michelle Yuen, Arun Cherian, Jennifer C Case, Justin Seipel, and Rebecca K Kramer. 2014. Conformable actuation and sensing with robotic fabric. In 2014 IEEE/RSJ international conference on intelligent robots and systems. IEEE, 580–586.

[43]

Jiahao Zhang, Stephen Gould, and Itzik Ben-Shabat. 2020. Vidat—ANU CVML Video Annotation Tool. https://github.com/anucvml/vidat.

[44]

Bo Zhou, Daniel Geissler, Marc Faulhaber, Clara Elisabeth Gleiss, Esther Friederike Zahn, Lala Shakti Swarup Ray, David Gamarra, Vitor Fortes Rey, Sungho Suh, Sizhen Bian, et al. 2023. Mocapose: Motion capturing with textile-integrated capacitive sensors in loose-fitting smart garments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1–40.

[45]

Jingwen Zhu and Hsin-Liu Kao. 2022. Scaling E-Textile Production: Understanding the Challenges of Soft Wearable Production for Individual Creators. In Proceedings of the 2022 ACM International Symposium on Wearable Computers. 94–99.

[46]

Chengxu Zuo, Yiming Wang, Lishuang Zhan, Shihui Guo, Xinyu Yi, Feng Xu, and Yipeng Qin. 2024. Loose inertial poser: Motion capture with IMU-attached loose-wear jacket. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.