Effects of Auditory Feedback on Menu Selection in Hand-Gesture Interfaces

Josh Mills

2016-02-25

Focus of this study

The proposal

Gesture Interface Example

Ref image

Article's Aim

Conventional Auditory Feedback

Ref image

Issue with transitional auditory feedback for gestural interface

Solution

Preemptive Auditory Feedback

Ref image

Another Solution

Continuous Auditory Feedback

Ref image

When it comes to the touching gesture, finding the location of the touch surface is a difficult task for the user

Study Design

Ref image

Results

The difference in selection times between the transitional auditory feedback and visual-only feedback conditions was not significant

The preemptive auditory feedback did not yield significant difference in selection time when compared with visual-only and transitional auditory feedback conditions, indicating that participants selected slightly faster when using continuous auditory feedback and depth auditory feedback

Accuracy

participants selected more accurately when using preemptive auditory feedback and depth auditory feedback

Overall, depth auditory feedback gave the best performance, achieving the highest accu- racy and the quickest selection time

It was the only feedback that yielded significantly better performance than both visual-only feedback and conventional or tran- sitional auditory feedback

The mean selection time of the transitional auditory feedback condition was 2.76 seconds, 4.4 percent faster than the visual-only feedback

both the continuous and depth auditory feedback conditions showed much larger and statistically significant improvements in the mean selection time, resulting in 13.6 and 15.5 percent increases, respectively

Continuous Auditory Feedback

Depth Auditory Feedback

The mean selection accuracy of the visual-only feedback condition was 90 percent; for the transitional auditory feedback condition, it was 89.5 percent, which was close to the visual-only feedback condition

Results

Ref image

The mean selection accuracy of the visual-only feedback condition was 90 percent; for the transitional auditory feedback condition, it was 89.5 percent, which was close to the visual-only feedback condition

Questions?