Holographic Raman tweezers controlled by multi-modal natural user interface

0459077 - ÚPT 2017 RIV GB eng J - Journal Article
Tomori, Z. - Keša, P. - Nikorovič, M. - Kaňka, Jan - Jákl, Petr - Šerý, Mojmír - Bernatová, Silvie - Valušová, E. - Antalík, M. - Zemánek, Pavel
Holographic Raman tweezers controlled by multi-modal natural user interface.
Journal of Optics. Roč. 18, č. 1 (2016), 015602:1-9. ISSN 2040-8978. E-ISSN 2040-8986
R&D Projects: GA MŠMT(CZ) LO1212; GA MŠMT(CZ) LD14069
Institutional support: RVO:68081731
Keywords : holographic optical tweezers * Raman microspectroscopy * human-computer interface
Subject RIV: BH - Optics, Masers, Lasers
Impact factor: 1.741, year: 2016

Holographic optical tweezers provide a contactless way to trap and manipulate several microobjects independently in space using focused laser beams. Although the methods of fast and efficient generation of optical traps are well developed, their user friendly control still lags behind. Even though several attempts have appeared recently to exploit touch tablets, 2D cameras, or Kinect game consoles, they have not yet reached the level of natural human interface. Here we demonstrate a multi-modal 'natural user interface' approach that combines finger and gaze tracking with gesture and speech recognition. This allows us to select objects with an operator's gaze and voice, to trap the objects and control their positions via tracking of finger movement in space and to run semi-automatic procedures such as acquisition of Raman spectra from preselected objects. This approach takes advantage of the power of human processing of images together with smooth control of human fingertips and downscales these skills to control remotely the motion of microobjects at microscale in a natural way for the human operator.
Permanent Link: http://hdl.handle.net/11104/0259343