Ruby Video
Talks
Speakers
Events
Topics
Leaderboard
Sign in
Talks
Speakers
Events
Topics
Use
Analytics
Sign in
Suggest modification to this talk
Title
Description
RailsConf 2017: ​Recurring Background Jobs with Sidekiq-scheduler by Andreas Fast & Gianfranco Zas When background job processing needs arise, Sidekiq is the de facto choice. It's a great tool which has been around for years, but it doesn't provide recurring job processing out of the box. sidekiq-scheduler fills that gap, it's a Sidekiq extension to run background jobs in a recurring manner. In this talk, we'll cover how sidekiq-scheduler does its job, different use cases, challenges when running on distributed environments, its future, how we distribute capacity over open source initiatives, and as a bonus, how to write your own Sidekiq extensions.
Date
Summarized using AI?
If this talk's summary was generated by AI, please check this box. A "Summarized using AI" badge will be displayed in the summary tab to indicate that the summary was generated using AI.
Show "Summarized using AI" badge on summary page
Summary
Markdown supported
The video titled "Recurring Background Jobs with Sidekiq-scheduler" features Andreas Fast and Gianfranco Zas discussing the Sidekiq-scheduler extension for Sidekiq, a popular background job processing tool in Ruby on Rails applications. The talk aims to fill the gap in Sidekiq's functionality by enabling the scheduling of recurring background jobs, which it does not natively support. Throughout the session, they highlight the following key points: - **Introduction to Sidekiq-scheduler**: The presenters, representing MoveIt, discuss their expansion and technical needs, setting the stage for a deeper look at sidekiq-scheduler. - **Use Cases**: They share their experience from 2012 where they needed to daily fetch financial data and send reports, revealing the limitations of using cron jobs and exploring the inefficiencies discovered with current entries, particularly in a JRuby environment. - **Integration Challenges**: They encountered issues managing multiple cron entries and the fact that deploying an app in a clustered environment often triggered duplicate tasks. This led to the search for a better solution, resulting in the development of the Sidekiq-scheduler. - **Cyclic Scheduler Architecture**: The main functionality of the Sidekiq-scheduler is discussed, explaining how it adheres to the Sidekiq lifecycle, including the setup of Rufus-scheduler as part of the configuration to manage recurring jobs effectively. - **Handling Multiple Instances**: The talk addresses the complexities of running multiple Sidekiq instances and how the scheduler can be utilized to avoid running duplicated jobs across different nodes. - **Future of Sidekiq-scheduler**: Fast and Zas outline their vision to improve the scheduler by minimizing conflicts in the global Sidekiq configuration and ensuring better multi-instance support without overstepping into functionalities outside of scheduling. - **Open Source Contributions and Extensions**: As a final bonus, they provide insights on creating custom Sidekiq extensions, detailing how developers can contribute to the Sidekiq ecosystem and leverage it for their applications. In conclusion, the video presents a comprehensive view of how the Sidekiq-scheduler enhances the capabilities of Sidekiq by enabling recurring job scheduling, which is essential for efficiently managing background tasks in Ruby on Rails applications. The discussion reinforces the importance of collaboration and community contributions within the open-source environment.
Suggest modifications
Cancel