Talks
Speakers
Events
Topics
Sign in
Home
Talks
Speakers
Events
Topics
Leaderboard
Use
Analytics
Sign in
Suggest modification to this talk
Title
Description
RailsConf 2017: Implementing the Web Speech API for Voice Data Entry by Cameron Jacoby We live in a world where you can schedule a meeting by talking to your watch or turn off your lights by asking Alexa as if she were your roommate. But would voice dictation work for something more intensive, like a web app used for hours of data entry? In this talk, I’ll show you how to implement the Web Speech API in a few simple steps. I’ll also walk through a case study of using the API in a production Rails app. You’ll leave with an understanding of how to implement voice dictation on the web as well as criteria to evaluate if voice is a viable solution to a given problem.
Date
Summarized using AI?
If this talk's summary was generated by AI, please check this box. A "Summarized using AI" badge will be displayed in the summary tab to indicate that the summary was generated using AI.
Show "Summarized using AI" badge on summary page
Summary
Markdown supported
In his talk at RailsConf 2017, Cameron Jacoby discusses the implementation of the Web Speech API for voice data entry, exploring its potential and challenges in web applications. Key points include: - **Introduction to the Web Speech API**: Cameron starts by capturing the audience's experience with voice dictation software, setting the stage to delve into the web speech API's application. He highlights the accuracy issues with existing software, prompting the need for a robust solution. - **Case Study from Stitch Fix**: Jacoby presents a case study on how Stitch Fix uses voice dictation to streamline the measurement process of garments in their warehouse. He explains the company's model and the initial challenges faced with existing measurement data entry methods, which relied on Google Sheets. - **User Research and Prototyping**: The presentation details the user research phase where they observed associates measuring garments. One significant takeaway was that associates frequently shifted between measuring items and typing entries, leading to inefficiencies. This revelation led to testing a voice dictation solution, starting with pair measuring. - **Voice Usability Studies**: Jacoby discusses the results from testing prototypes among warehouse associates, differentiating between keyboard entry and voice dictation. Results showed increased efficiency and reduced discomfort when using voice dictation, especially for those who could maintain a natural measuring posture instead of hunching over a keyboard. - **Implementation of Web Speech API**: Cameron explains how to initialize the Web Speech API, emphasizing its ease of use in Chrome. The technical details reveal several challenges experienced, such as contextual formatting errors and dictation errors due to varied user enunciation. Jacoby emphasizes the importance of training users for effective implementation. - **Challenges with Voice Dictation**: Throughout the project, Jacoby identified challenges related to accuracy, reliability, and the need for fallback options. Despite achieving substantial improvements in data entry efficiency with voice records, he notes issues like unexpected halts in recording functionality, stressing the need for ongoing evaluations. - **Conclusion & Takeaways**: The presentation concludes with several takeaways, including the importance of user experience (UX) and engineering collaboration. Jacoby reinforces that utilizing voice technology is experimental, noting that it works best when user context and technological capabilities align. Through this exploration of voice dictation within the context of a Ruby on Rails application, attendees learned valuable insights about integrating emerging technologies with established user practices in a real-world setting.
Suggest modifications
Cancel
