Senior Software Engineer, AI

Job Description

Toast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful business insights.

Responsibilities

• Design, build, and maintain backend systems that power LLM-driven and agentic workflows
• Develop retrieval pipelines, orchestration layers, and multi‑step agent architectures that support scalable AI‑powered search experiences
• Lead the evaluation of agentic systems using automated, offline, and human‑in‑the‑loop frameworks to measure relevance, quality, latency, and task success
• Improve retrieval and ranking systems across hybrid retrieval, re‑ranking, query rewriting, and post‑retrieval synthesis
• Optimize LLM‑powered workflows for speed, accuracy, reliability, and production readiness
<...