Hand tracking and gesture recognition using lensless smart sensors

Simple item page
dc.contributor.authorAbraham, Lizy
dc.contributor.authorUrro, Andrea
dc.contributor.authorNormani, Niccolò
dc.contributor.authorWilk, Mariusz P.
dc.contributor.authorWalsh, Michael
dc.contributor.authorO'Flynn, Brendan
dc.contributor.funderScience Foundation Irelanden
dc.contributor.funderEuropean Regional Development Funden
dc.date.accessioned2018-08-29T13:45:45Z
dc.date.available2018-08-29T13:45:45Z
dc.date.issued2018-08-28
dc.date.updated2018-08-29T13:38:14Z
dc.description.abstractThe Lensless Smart Sensor (LSS) developed by Rambus, Inc. is a low-power, low-cost visual sensing technology that captures information-rich optical data in a tiny form factor using a novel approach to optical sensing. The spiral gratings of LSS diffractive grating, coupled with sophisticated computational algorithms, allow point tracking down to millimeter-level accuracy. This work is focused on developing novel algorithms for the detection of multiple points and thereby enabling hand tracking and gesture recognition using the LSS. The algorithms are formulated based on geometrical and mathematical constraints around the placement of infrared light-emitting diodes (LEDs) on the hand. The developed techniques dynamically adapt the recognition and orientation of the hand and associated gestures. A detailed accuracy analysis for both hand tracking and gesture classification as a function of LED positions is conducted to validate the performance of the system. Our results indicate that the technology is a promising approach, as the current state-of-the-art focuses on human motion tracking that requires highly complex and expensive systems. A wearable, low-power, low-cost system could make a significant impact in this field, as it does not require complex hardware or additional sensors on the tracked segments.en
dc.description.statusPeer revieweden
dc.description.versionPublished Versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationAbraham, L., Urru, A., Normani, N., Wilk, M., Walsh, M. and O’Flynn, B. (2018) 'Hand Tracking and Gesture Recognition Using Lensless Smart Sensors', Sensors, 18(9), 2834 (24 pp). doi: 10.3390/s18092834en
dc.identifier.doi10.3390/s18092834
dc.identifier.endpage2834-24en
dc.identifier.issn1424-8220
dc.identifier.issued9en
dc.identifier.journaltitleSensorsen
dc.identifier.startpage2834-1en
dc.identifier.urihttps://hdl.handle.net/10468/6654
dc.identifier.volume18en
dc.language.isoenen
dc.publisherMDPIen
dc.relation.projectinfo:eu-repo/grantAgreement/SFI/SFI Research Centres/13/RC/2077/IE/CONNECT: The Centre for Future Networks & Communications/en
dc.relation.urihttp://www.mdpi.com/1424-8220/18/9/2834
dc.rights© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).en
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.subjectLSSen
dc.subjectInfrared LEDsen
dc.subjectCalibrationen
dc.subjectTrackingen
dc.subjectGesturesen
dc.subjectRMSEen
dc.subjectRepeatabilityen
dc.subjectTemporal Noiseen
dc.subjectLatencyen
dc.subjectLensless Smart Sensor (LSS)en
dc.subjectLight-emitting diodes (LEDs)en
dc.titleHand tracking and gesture recognition using lensless smart sensorsen
dc.typeArticle (peer-reviewed)en
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
6886.pdf
Size:
7.67 MB
Format:
Adobe Portable Document Format
Description:
Published version
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Tyndall National Institute - Journal Articles