VISUAL GESTURE BASED AUGMENTED VIRTUAL KEYBOARD SYSTEM
Abstract
This paper presents a novel enhancement in design of virtual keyboards for consumers of tablets and standard computing devices. Hand video is captured for virtual keyboard functionality. Hand video is augmented with a background keyboard and displayed on lower part of screen to provide feedback to user for seamless interaction with virtual keyboard. Hands are detected in video sequence. Finger joints trajectory based keystroke detection and recognition fused with augmented keys spatial information reveals the key pressed. Real time system is developed by integrating USB camera with tablet computer. Reliable results are experienced while a low cost system is achieved in comparison to existing virtual keyboard systems.References
M. Goldstein and D. Chincholle, Finger-Joint
Gesture Wearable Keypad; in Second
Workshop on Human Computer Interaction
with Mobile Devices (1999).
R. Rosenberg, Computing without Mice and
Keyboards: Text and Graphic Input Devices
for Mobile Computing; Ph.D Thesis, Dept. of
Computer Science, University College,
London (1998).
M. Fukumoto and Y. Tonomura, Body
Coupled FingeRing, Wireless Wearable
Keyboard, ACM CHI (1997).
F. Evans, S. Skiena and A. Varshney,
VType: Entering Text in a Virtual World,
Submitted to International Journal of HumanComputer Studies
Samsung Scurry; PCWorld article at
http://www.pcworld.com/article/70568/virtual_
keyboards_let_you_type_in_air.html.
Senseboard, http://www.senseboard.com.
Z. Zhang, Y. Wu, Y. Shan and S. Shafer,
Visual Panel: Virtual Mouse, Keyboard and
D Controller with an Ordinary Piece of
Paper. ACM Workshop on Perceptive User
Interfaces (Nov. 2001).
Virtual Devices, Inc., VKPC; http://www.
virtualdevices.net.
i-Tech’s Virtual Keyboard at http://www.vkbsupport.com.
NadeekaSamanthiWijewantha, Chanaka
Amarasekara, VISTAKEY: A Keyboard
Without A Keyboard – A Type of Virtual
Keyboard, IEEE Eleventh Annual Conference
Sri Lanka (2004).
H. Du, T.Oggier and F.Lustenberger, A
Virtual Keyboard Based on True-3D Optical
Ranging, British Machine Vision Conference
(2005).
H. Du and E.Charbon, A Virtual Keyboard
System based on Multi-Level Feature
Matching, International Conference on
Human Systems Interaction (2008).
M. Lee and W. Woo, ARKB: 3D Vision-based
Augmented Reality Keyboard, International
Conference on Artificial Reality and
Telexistence (2003) pp. 54-57.
Hafiz A. Habib and M. Mufti, IEEE
Transactions on Consumer Electronics 52,
No. 4 (2006) 1261.
R. Bowden, A. Zisserman, T. Kadir and
M. Brady, Vision Based Interpretation of
Natural Sign Languages, Proc. 3rd Int.
Conference on Comput. Vis. Syst., Graz,
Austria (April 2003) pp. 391- 401.
Y. Liu and Y.Lia, A Robust Hand Tracking
and Gesture Recognition Method for
Wearable Virtual Interfaces and its
Applications, 3rd International Conference on
Image and Graphics (2004).
L. Lumbardi and M.Porta, Adding Gestures to
Ordinary Mouse Use: A New Input Modality
for Improved Human- Computer Interactionâ€
th International Conference on Image
Analysis and Processing (2007).
M. Alpern and K. Minardo, Developing a Car
Gesture Interface For Use as a Secondary
Task, CHI (2003) pp. 32-33
X. Yin and M.Xie, Finger Identification and
Hand Posture Recognition for Human–Robot
Interaction, Image and Vision Computing 25
(2007) 1291.
J. Brand and J. Mason, A Comparative
Assessment of Three Approachesto
Pixellevel Human Skin-Detection, Proc.
thIEEE/IAPR International Conference on
Pattern Recognition,Vol. 1, Barcelona, Spain
(2000) pp. 1056–1059.
M. H. Yousaf and H. A. Habib, Springer
Arabian Journal for Science and Engineering
DOI: 10.1007/s13369-013-0909-2.
A. Yilmaz, O.Javed and M. Shah, ACM
Computing Surveys 38, No. 4 (2006)
Article. 13.
