Talks
Speakers
Events
Topics
Sign in
Home
Talks
Speakers
Events
Topics
Leaderboard
Use
Analytics
Sign in
Suggest modification to this talk
Title
Description
Stratocaster is an internal GitHub Ruby project written to replace the organically grown GitHub Event timeline. This is a tale of an overgrown MySQL table being replaced by a more specific Redis setup. We'll see what new possibilities that Redis is able to provide. Also, we'll go over how Mustache was able to replace Erb for event rendering. Help us caption & translate this video! http://amara.org/v/GZCa/
Date
Summarized using AI?
If this talk's summary was generated by AI, please check this box. A "Summarized using AI" badge will be displayed in the summary tab to indicate that the summary was generated using AI.
Show "Summarized using AI" badge on summary page
Summary
Markdown supported
In the video titled "Stratocaster: Redis Event Timeline," speaker Rick Olson discusses the evolution of GitHub's event timeline, moving from a MySQL-based system to a more efficient Redis-based architecture through a new library called Stratocaster. The presentation emphasizes the challenges faced when managing large-scale event feeds and how switching to a push architecture alleviates database strain. Key topics covered include: - **Definition of Event Feeds**: Olson clarifies what event feeds are, emphasizing they represent user actions on GitHub rather than event-driven programming. - **Feeding Frenzy Paper**: He references a paper from Yahoo Research discussing event feed management, distinguishing between consumers and producers in feed systems. - **Push vs. Pull Architecture**: GitHub's push model entails proactively creating user feeds, which enables real-time updates but also increases data size. - **Challenges with the Current System**: Large-scale feeds can overload databases, particularly when popular users generate many events. - **Data Management Improvements**: Olson discusses caching strategies, bulk inserts, and the transition from ERB to Mustache templates to enhance performance and readability. - **Introduction of Stratocaster**: This new library aims to modernize event handling by leveraging Redis for efficient data storage, retaining only essential event IDs rather than duplicating data. - **Performance Comparisons**: Olson shares testing results showcasing a 10x reduction in data storage when using Redis, with tests indicating significant memory efficiency in newer Redis versions. - **Future Directions**: The session wraps up with Olson hinting at refining the Stratocaster API for public release and discussing ongoing improvements. Overall, Olson's presentation highlights the importance of optimizing event management systems for efficiency and user experience as GitHub continues to scale its infrastructure. The move to Redis is presented as both a strategic choice and a necessary evolution in their technology landscape.
Suggest modifications
Cancel
