Talks
Speakers
Events
Topics
Sign in
Home
Talks
Speakers
Events
Topics
Leaderboard
Use
Analytics
Sign in
Suggest modification to this talk
Title
Description
@zachfeldman The Amazon Echo recently debuted and made a big splash with its incredibly accurate voice recognition, capable of hearing and transliterating commands from 20-30 feet away. Home automation enthusiasts and hackers alike wondered if it would be possible to intercept commands from the device and trigger custom actions. While device traffic is encrypted, the device pushes commands to a history page in a web application. Using Watir WebDriver, which normally is used for feature testing, we've created a proxy that can be run on a Raspberry Pi as well as a modular Ruby framework based on Sinatra to run custom commands, allowing us to control the Hue wireless lighting system, Nest, and even request an Uber! Talk given at GORUCO 2015: http://goruco.com
Date
Summarized using AI?
If this talk's summary was generated by AI, please check this box. A "Summarized using AI" badge will be displayed in the summary tab to indicate that the summary was generated using AI.
Show "Summarized using AI" badge on summary page
Summary
Markdown supported
This video, titled "Home Automation with the Amazon Echo and Ruby" and presented by Zachary Feldman at GoRuCo 2015, explores the integration of the Amazon Echo with Ruby programming to enhance home automation experiences. Zach begins by introducing the Amazon Echo, highlighting its advanced capabilities, particularly its impressive voice recognition technology which uses seven microphones for better command interpretation. He shares how he came to own the device and his initial enjoyment of its built-in functionalities, such as setting alarms and playing music, while also expressing a desire for further enhancements. Key points discussed include: - **API Creation**: Zach explains the motivation behind developing an API to extend the Echo's functionalities, showcasing how he began to create a proxy and an API to achieve this. - **Command Integration**: He demonstrates how to issue an event command without physical interaction through the Echo, illustrating the practicality of voice commands in managing tasks. - **Scraping and Interaction**: The use of Watir WebDriver to log into the Amazon Echo web application for monitoring verbal commands is explained, along with how to ensure user privacy through encrypted command requests. - **Handling Command Redundancy**: Zach describes how he resolved issues of executing duplicate commands by implementing a monitoring system that filters out ghost commands. - **Modular Architecture**: The project employs a modular structure built with Sinatra, allowing for easy contributions and extensions by other developers, with specific modules created for controlling devices like Hue lights, Google Calendar, and Uber. - **Collaborative Potential**: He emphasizes the importance of documenting the project to foster collaboration, encouraging other developers to contribute to the open-source initiative to enhance functionality. - **Inspiration and Growth**: Zach stresses the rewarding nature of engaging with others in the tech community, nurturing both personal growth and helping new developers thrive. In conclusion, Zach urges the audience to engage with the project, highlighting the potential of open-source innovation to enrich our interactions with technology and automate everyday tasks more efficiently. The video successfully conveys how programming can empower users to create tailored home automation solutions using the Amazon Echo and Ruby.
Suggest modifications
Cancel
