Authors:
Joseph Craig, Daniel Goins, Suzanne Griep, Linda Newton, Tony Niverth, Jarrell Norwood, Jessica Snead
Abstract:
This disclosure proposes a vending machine with a touchless item selection feature. Currently the user is required to press physical buttons on the device to make their selection, but what if they could simply point to or look at their selection instead?
Background:
Vending Machines are hot spots for bacteria and viruses because of the way users must interact with them when selecting an item for purchase. There are no vending machines on the market that use a touchless user interface. During a pandemic or public health crisis, a touch-free technology solution can make vending machines a safer option that users can trust.
Description:
This solution functions like a normal vending machine, but with a new touch-free item selection feature and a screen to provide textual user guidance.
The touchless interaction component of this vending machine could be designed with either or both of the following methods:
- Cameras inside the device detect the user's pointed finger and determine which item is selected behind the vending machine glass.
- Infrared cameras detect eye movement and focus direction to determine the item selection, so the user looks at the selected item, then makes a gesture to confirm their choice.
A touch-free vending machine purchase flows as follows:
- The user approaches the vending machine, visually scans the available items, and decides which item to purchase.
- The user inserts currency or card to pay.
- The user selects an item by one of the following methods:
- Pointing at the desired item behind the glass
- Looking at the desired item and making a gesture to confirm the choice
- The device provides feedback via light-up indicators near the item to confirm the selection and prompt the user "Did you mean this item?"
- The user confirms or declines the device’s assumption of their selection by a facial gesture (such as a nod, shake, or blink) or a hand gesture (such as a snap, raise/lower, or sign language yes/no).
- If the user confirms the selection, then the device dispenses the selected item to the user and the transaction completes.
- If the user declines the selection, the device prompts them to choose again or cancel the purchase.
Enabling Technology:
Pointing gesture visual recognition by body feature detection and tracking
https://link.springer.com/chapter/10.1007/1-4020-4179-9_29
This book describes methods to use finger pointing and/or eye pointing direction as a gesture for human/computer interaction
Eye Recognition and Hand Gesture Identification Fusion System
This paper introduces an eye and hand gesture recognition system to recognize ‘dynamic gesture’.
TGCS Reference 1895
