Interpreting and tracking finger motion in free space is of use in the development of control interfaces for augmented and virtual reality systems. One approach to create human–machine interfaces capable of accurate finger motion recognition is to use wearable sensors with integrated neuromorphic computing. Here we show that an integrated titanium-oxide-based artificial synapse array and organic motion sensor can be conformably attached to a finger and provide real-time motion recognition. The synaptic device and sensor exhibit well-defined synaptic and light-responsive electrical properties, respectively, as well as flexibility and mechanical robustness. The integrated synapses–sensor enables optical–electrical signal conversion and summation of post-synaptic current. Finger motions for time-resolved digit patterns (0–9) can be learned and recognized with an accuracy of up to 95% at varying strains and up to 100 strain cycles.
This work was supported by the National Research Foundation of Korea (NRF-2022R1A2B5B02001455, NRF-2022M3H4A1A01009526, NRF-2022K2A9A1A01098066, RS-2023-00220077, RS-2023-00213089 and 2022R1I1A1A01073911); the KU-KIST Research Fund, the Korea University Research Grant, the MSIT, Korea, under the ITRC (Information Technology Research Center) support program (grant no. IITP-2023-2020-0-01461) supervised by the Institute for Information & Communications Technology Planning & Evaluation (IITP); and the Technology Innovation Program (grant no. RS-2022-00154781) funded by the Ministry of Trade, Industry & Energy (MOTIE, Korea). We would like to express our gratitude to B.-G. Lee from Gwangju Institute of Science and Technology and S. Gi from Korea Electronics Technology Institute for their valuable contributions in reviewing and providing insightful feedback on circuit designs.This work was supported by the National Research Foundation of Korea (NRF-2022R1A2B5B02001455, NRF-2022M3H4A1A01009526, NRF-2022K2A9A1A01098066, RS-2023-00220077, RS-2023-00213089 and 2022R1I1A1A01073911); the KU-KIST Research Fund, the Korea University Research Grant, the MSIT, Korea, under the ITRC (Information Technology Research Center) support program (grant no. IITP-2023-2020-0-01461) supervised by the Institute for Information & Communications Technology Planning & Evaluation (IITP); and the Technology Innovation Program (grant no. RS-2022-00154781) funded by the Ministry of Trade, Industry & Energy (MOTIE, Korea). We would like to express our gratitude to B.-G. Lee from Gwangju Institute of Science and Technology and S. Gi from Korea Electronics Technology Institute for their valuable contributions in reviewing and providing insightful feedback on circuit designs.
