About the role#
You will manage SRE Skills Bench, an open-source project designed to measure how well AI models handle real-world reliability engineering tasks. This role involves moving the project from research questions to public releases. You will work directly with the Head of Rootly AI Labs to combine applied AI research, technical project management, and community building. We are looking for students in Computer Science, Data Science, or Engineering fields who are ready to contribute to open-source benchmarks.
What you'll do#
- Shape the roadmap and research questions for SRE Skills Bench.
- Build an active community around the benchmark to encourage outside contributions.
- Create realistic evaluation tasks covering incident response, debugging, infrastructure, observability, and production operations.
- Develop methods for evaluating frontier and open-source models.
- Analyze results to produce reports, technical articles, and public datasets.
- Evaluate how new models, agents, and coding environments perform on operational work.
- Collaborate with SREs, researchers, and open-source contributors to establish industry standards.
What you'll need#
- Hands-on experience or a strong interest in SRE, infrastructure, platform engineering, DevOps, or production operations.
- Familiarity with LLM evaluations, benchmarks, agents, or applied AI research.
- An experimental mindset with an interest in designing reproducible tests and examining imperfect results.
- A self-driven approach to make decisions and move projects forward with minimal guidance.
- Ability to explain technical work clearly through articles, social media, or talks at meetups and conferences.
Location & details#
- Location: Toronto, Ontario (Hybrid).
- Employment: Full-time internship.
- Term: Rolling.
- Compensation: Paid position.
About Rootly
Rootly provides software for incident management and on-call response. The company operates within the DevOps and site reliability engineering sectors. It integrates with Slack and Microsoft Teams to assist teams with alerts and retrospectives. Founded in 2020, the business is based in Toronto and maintains a staff of approximately 89 employees.
How to get in at Rootly
Securing an internship at Rootly requires speed because early applicants often receive more attention before the candidate pool grows. Intern Insider sends an instant alert the moment a role matching your target is published anywhere, ensuring you apply among the first. This timing helps you stay visible to the recruiting team. You can also improve your response rates by reaching out to the recruiters behind the company's roles directly. Intern Insider surfaces these specific contacts so you can ask about the role or a referral, which is a more effective strategy than waiting for a response from a general application queue.
