Abstract

This paper introduces ClothFace, a shirtsleeve-integrated human-technology interface platform, which comprises two wrist antennas and three radio frequency identification (RFID) integrated circuits (ICs), each with a unique ID. The platform prototype, which is created on a shirtsleeve by cutting the antennas and antenna-IC interconnections from copper tape, can be used for push button and swipe controlling. Each IC can be activated, i.e., electrically connected to the two antennas, by touching the IC. These ICs can act as wireless input buttons to the technology around us. Due to the used passive ultrahigh-frequency (UHF) RFID technology, there is no need for clothing-integrated energy sources, but the interface platform gets all the needed energy from an external RFID reader. The platform prototype was found to be readable with an external RFID reader from all directions at distances of 70–80 cm. Further, seven people giving altogether 1400 inputs tested the prototype sleeves on a table and on body. In these first tests, 96–100% (table) and 92–100% (on-body) success rates were achieved in a gamelike testing setup. Further, the platform was proved to be readable with an off-the-shelf handheld RFID reader from a distance of 40 cm. Based on these initial results, this implementation holds the potential to be used as a touch interface blended into daily clothing, as well as a modular touch-based interaction platform that can be integrated into the surfaces of electronic devices, such as home appliances.

1. Introduction

Technology today allows us to communicate and participate, as well as play games, organize our lives, and learn new things. Digital devices are also rapidly taking a larger role in daily health monitoring, along with their increasing use for supporting exercising, activation, and rehabilitation. However, the current handheld, screen-based, and touch-operated devices are not ideal for all consumers and all use situations [13]. For example, lowered cognitive skills, dry fingertips, bad eyesight, and decreased motor skills are preventing the efficient use of digital devices. The available alternatives are usually based on voice or body movement controlling. Voice-controlled interfaces, such as Apple’s Siri, Amazon’s Alexa, Microsoft Cortana, or Google Assistant, while popular and developing quickly, have their own challenges, such as linguistic coverage and challenges in noisy and strictly noiseless environments. Similarly, there are commercial interfaces that use human body movements, such as Nintendo Wii Remote, Sony PlayStation Move, Jacquard by Google, Kinect from Microsoft, Myo armband from Thalmic Labs, and E-skin sensor shirt from Xenoma. Further, different technologies have been suggested for detecting hand movement on the human body, such as different sensor technologies [49] and interactive textiles [1013]. All the available solutions, however, require a line-of-sight to work, i.e., the gesture maker needs to be directly seen, or an on-board power source, which increases their cost and limits their practical daily use. To overcome these challenges, WIFI signals have been used for gesture monitoring [1416] but, despite the promising results, these solutions have challenges with multiple user environments and they are only functional in a specific use environment [17].

Passive RFID (radio frequency identification) technology, especially in the UHF (ultrahigh frequency) range, has the potential to become a solution for overcoming the problems mentioned above. Passive RFID uses battery-free, remotely addressable electronic tags, composed only of an antenna and a small RFID IC (integrated circuit) component, having a unique ID. A passive RFID tag gets all its energy from an RFID reader and responds by backscattering. Variations of backscattered signal strengths and phases from body-attached passive RFID tags have been shown to provide information about body positions and movements [1824]. Further, when a user touches an RFID tag with a finger, the user manifests as a change in phase of the tag’s backscattered signal [25, 26]. Moreover, integrating versatile sensing options into passive RFID tags has been done [2732], and by tracking changes in the tags’ backscattered signals, passive UHF RFID tags have been used, for example, as autonomous strain [3337] and moisture [3842] sensors. However, despite the promising results, the presented passive RFID tag-based results have shown that the backscattered signals of passive RFID tags are noisy and unstable and strongly affected by the environment. Thus, a new type of approach is needed in order to fully benefit from passive UHF RFID in human-technology interaction.

To satisfy this need, we have developed our ClothFace solution, in which several combined passive RFID IC components are simply “switched on and off” by touch-created electrical interconnections to RFID antennas. Due to the unique ID of each IC, these components can be then used as specific input buttons. Our first passive RFID-based human-technology interaction solution was based on a shirt-integrated antenna, which could be used to activate single RFID IC components placed around the user [43]. Next, we further developed this concept of integrating RFID ICs in the environment around us, by installing a passive RFID-based platform, consisting of three RFID ICs on the surface of the wooden table [44]. Now, in this study, we introduce a new ClothFace concept, a shirtsleeve-integrated touchpad solution, which comprises two wrist antennas and three RFID ICs (each with a unique ID). The interface prototype, which is integrated on a shirtsleeve by cutting the antennas and antenna-IC interconnections from copper tape, can be used for push button and swipe controlling. Each IC can be activated, i.e., electrically connected to the two wrist antennas, by touching with finger. An external RFID reader antenna will provide all the needed energy for the wireless system, which enables the uniqueness of our solution. Our shirtsleeve-integrated interface is fully passive and maintenance-free, having no on-cloth energy sources, which makes fabrication directly into clothing simple and easy, and provides great mobility for practical use. The cost of a basic passive RFID IC is only a few cents, which makes our solution cost-effective and convenient for use in daily clothing. Further, by applying a coating, the platform can be made waterproof and fully washable.

2. Platform Design and Fabrication

The design and dimensions of the platform prototype are shown in Figure 1. Our sleeve interface includes two wrist antennas and three RFID ICs, which act as input buttons. The antenna design is based on our previous paper [43], where we introduced a wrist antenna that had antenna bands going around the wrist. The idea of these antenna bands is that the human wrist will not fully cover the antenna. The bands will go around the wrist, which will provide a better wireless performance and a longer read range. We now combined two of such wrist antennas together and connected the RFID IC components into both. This new type of simple design will allow these three ICs to be readable even when they are not directly facing the RFID reader.

Each RFID IC has a unique ID due to the unique electronic product code (EPC). Based on their EPC codes, the ICs (input buttons) in the sleeve interface are numbered 1–3 from left to right. These prototype antennas and interconnections are manufactured from copper tape, which has glue on the backside, and can thus be easily integrated into the shirtsleeve. The used ICs (shown in Figure 2) are NXP UCODE G2iL RFID microchips (with a wake-up power of −18 dBm), which the manufacturer has embedded into a plastic film strap structure. This IC strap has two 3 × 3 mm2 copper pads, which are used to attach the component to one of the two copper tape conductors. As presented in Figure 1, in our platform, these two copper tape conductors are connecting the two copper tape wrist antennas.

In this first prototype of the sleeve interface, the ICs are activated using an “input finger” that is a piece of textile (a finger cut from a glove), coated with a copper tape material. Alternatively, the ICs are activated by touching with a bare fingertip. Thus, we are now testing two different methods for further development. When a specific IC strap is touched, the copper tape in the input finger or the bare finger itself will create the needed electrical interconnection from the IC strap pad to the second copper tape line and switch that specific IC readable to the RFID reader.

3. Preliminary Tests

As a preliminary test, the sleeve interface is firstly tested with Thingmagic M6 RFID reader on an office table. The reader operates at the European standard frequency range (865.6–867.6 MHz) and the used power is 28 dBm. The maximum read range of the sleeve interface (the distance from the RFID reader antenna, where the interface is still working flawlessly) is measured from different directions, as presented in Figure 3. Further, the backscattered power for each IC on the sleeve is recorded at the maximum distance. As can be seen from Table 1, the sleeve works from all directions from distances of 70–80 cm, which is a good starting point.

Next, the on-body performance of the sleeve interface is tested in an office environment with a handheld mobile RFID reader. In order to evaluate the practical potential of the sleeve, it is tested on a male subject (as presented in Figure 3) and the maximum read range is measured. The reader (Nordic ID Medea) operates at 866 MHz. The three ICs on the sleeve operate efficiently at 40 cm from the mobile reader.

4. Practical Test

As presented in Figure 4, the sleeve interface is tested while placed on a wooden table (meaning without the effects of the human body) and while worn on body (where the lossy human body as well as body movement may affect the antenna performance). The sleeve interface is tested by seven users (three females and four males), who are each asked to give 200 random inputs by our gamelike testing software. Four of the users test the interface with the input finger, while three of them test the interface with a bare finger. By using both methods, only a gentle touch is needed to activate the ICs.

Figure 5 shows the measurement setup, which includes the interface platform, integrated into a sleeve of a cotton shirt, one circularly polarized reader antenna, attached to Thingmagic M6 RFID reader through a connecting cable, and our testing software user interface. The practical testing of our sleeve interface is done in a normal office environment with wooden and metallic furniture, people, and computers. The wireless environment in the office is also in a normal condition, meaning that mobile phones are used and there is also an indoor WIFI signal. As shown in Figure 4, the reader antenna was placed directly opposite to the wrist antennas on the table, while it was facing the wrist antennas at a 90-degree angle when the interface was tested on body. The goal was to get a better understanding of the practical use possibilities.

Figure 6 shows an example of a situation, where the software asks the user to touch button 3, and the user is controlling the platform with a bare finger. Further, in Figure 7, the software asks the user to swipe right, and the user is controlling the platform with the input finger. The testing software is developed on the Net framework with C# as windows forms application. The testing software uses ThingMagic Mercury API tools to control the M6 reader and filter received RFID tag IDs to focus only on the ICs on the test (and not to be disturbed by any surrounding RFID tags). The ThingMagic Mercury API supports continuous reading, so it was chosen to retrieve RFID tags from the M6 reader. The testing software asks the users to perform the following actions in random order: swipe left (i.e., touch buttons 3–1), swipe right (i.e., touch buttons 1–3), touch button 1, touch button 2, and touch button 3.

During testing, the system stores the asked input, the given input, and the information if the given input was the same as the asked input. As shown in Figure 6, the color on the testing software screen is initially blue. When the correct input is detected by the testing software, green color appears on the screen and the software stores the data as “1”. If there is no input for 5 seconds or a wrong input is given, red color appears on the screen and “0” is saved.

Table 2 shows the testing results from the four testers, who use the interface with the input fingers, while Table 3 presents the results from the three users, who use the platform with their bare fingers. The overall success rate for the table and arm setup is 96–100% and 92–100%, respectively. These preliminary results prove that this sleeve-integrated platform can attain high input accuracy in normal office conditions, despite the challenging wireless environment. The performance seems to be equally good on a table and on body, which supports the use of our novel wearable platform design having two wrist antennas attached to the ICs. There is no significant difference between the results achieved with the input finger and a bare finger. The results from table measurements with a bare finger and with the input finger are 96–99% and 96–100%, respectively, while the on-body results are 92–97% and 97–100%, respectively. Based on these results, it is possible to control the ClothFace interface with a bare finger, which removes the need for a specific input finger and provides more flexibility for practical use. Thus, the development of the next prototype will focus on using the platform with a bare finger.

As can be seen from Figures 6 and 7, the sleeve interface may get crumpled when used. This may result in unwanted inputs and wanted inputs being ignored by the system. This did not occur during any of the tests but needs to be considered in the future. Thus, our plan is to fabricate the next prototype from electrotextiles, which blend into clothing better than the copper tape. Further, we trust that a protective coating will also help with the abovementioned challenge.

Previous projects, such as Google Jacquard [10], also provide similar interaction modalities; however, due to their complex structures and components, they need specifically designed clothes preventing the variety in terms of aesthetics and functionality. On the contrary, our implementation promises versatility in terms of visual aesthetics, interaction resolution and area, and broad opportunities for customization to different uses and contexts. The fundamental strength of the user interface implemented here lies within its passive nature, cost-effectiveness, and simple implementation into clothes.

It is not hard to imagine rapidly deploying ClothFace to different types of clothing, such as pants, gloves, or hats. This versatility can suggest using our system as a platform for implementing and testing many speculative on-body gesture design studies, such as [45, 46]. Moreover, although antennas and the circuit can be concealed beneath the cloth, the form factor of the current implementation also hints fashion design studies that can help to create a new visual language for RFID-based smart clothing, which can leave copper parts visible by incorporating diverse visual interpretations. The results achieved with the handheld mobile reader support our future goal to study using such interfaces with mobile phone-integrated UHF RFID readers. If mobile phones widely adopt UHF RFID readers, clothes can be designed for different functions in various forms. For example, we can produce a diverse array of gaming t-shirts representing distinct game characters. Easy deployment of our system can facilitate producing different types of input commands that can be used on various parts of the body for controlling games. This would create unique player experiences for different characters according to their special abilities in a game and would be a worthy contribution to the emerging gaming wearable area [47, 48]. This versatility can also be expanded into daily life tasks, such as kitchen-aprons interacting with the house while preparing a meal or pajamas giving access to the control of TV and the music system. Our solution can give special groups, such as disabled people with different limitations and elderly people with bad eyesight and memory, more possibilities for independent living. Further and more detailed implementations of this system will also make exploring body-related interactions in a rapid way possible, which can yield a platform for design research in areas such as Somesthetic Design [49]. These speculative ideas demonstrate that the virility of our implementation and our further work encapsulate exploring these distinct dimensions.

In this direction, our next step as further work is to create a wearable prototype, which can be comfortably used for daily life actions. The sleeve platform will be embedded between two layers of cotton textiles. The copper tape lines and the RFID IC strap pads inside will be separated by a thin textile net, which means that they will form a contact when the surface of the top layer textile is touched. This will remove the need for a specific input finger and integrate the platform seamlessly into the shirtsleeve.

5. Conclusions

We introduced a ClothFace sleeve, a passive UHF RFID-based human-technology interface, integrated into a sleeve of a cotton shirt. The created textile touchpad enables push button and swipe controlling without on-cloth energy sources. During practical testing, 96–100% and 92–100% success rates were achieved on a table and on body, respectively. These results are very encouraging, especially when considering that the sleeve interface, being cost-effective and flexible, promises versatile and practical application areas in an extensive number of different contexts. As these preliminary results seem to suggest that it is possible to control the platform with a bare finger, the next prototype will be developed to be controlled without an input finger, which will make it more flexible and more suitable for practical use. More, the prototype will be further developed by seamlessly integrating it into clothing. The next goals are to make the platform smaller in size, optimize the antenna design for longer read ranges, and test different coating materials to achieve washability. Due to the promising results achieved with the handheld mobile reader, our plan is to start tests with mobile phone-integrated UHF RFID readers, which can be held in a pocket for a truly mobile system. We imagine that this type of clothing-integrated user interface opens possibilities especially for special needs groups, such as people using alternative and assistive communication technologies. By using individually tailored mobile phone applications, these people could benefit from versatile “communication clothes” in their daily lives.

Data Availability

The measurement data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflicts of interest.

Acknowledgments

This work has been funded by The Finnish Cultural Foundation, Jane and Aatos Erkko Foundation, the Academy of Finland (decision number 294534), and the European Union’s Horizon 2020 Research and Innovation Programme under the Marie Sklodowska-Curie grant agreement no. 833731-WEARTUAL.