Senior Software Developer (LLM Infrastructure)

Description du poste

The Machine Learning Infrastructure team builds the core foundation powering AI and GenAI initiatives across Wealthsimple. As our AI footprint expands, our priority is building scalable, cost-effective infrastructure that enables high-performance inference using open-source models alongside vendor solutions. Our responsibilities are to: Build and maintain infrastructure to host and serve open-source LLMs reliably on cloud/GPU systems Implement intelligent model-routing frameworks to optimize performance, cost, and latency Develop evaluation and benchmarking tooling (Evals) to test, validate, and compare model performance across use cases Set the technical direction for operating scalable LLM infrastructure company-wide As a Senior Software Engineer on the ML Infrastructure team, you will design and implement the core backend and infrastructure powering our AI systems. You will work closely with data scientists, platform engineers, and engineering leaders to scale our GenAI footprint efficiently and securely In this role, you will have the opportunity to: Build model-routing architecture (e.g., LiteLLM integration) to dynamically direct requests across internal and external models Provision and manage high-performance GPU infrastructure for serving open-source LLMs Build evaluation frameworks (Evals) that enable engineers and data scientists to benchmark model quality against production requirements Drive key cost-optimization and infrastructure efficiency initiatives without sacrificing system accuracy or reliability Benefits Retirement savings matching plan through Wealthsimple Work Company equity for full-time employees Access to Premium Client perks, including personal finance learning & advice and a boosted interest rate on deposits Paid parental leave (6 months topped up to 100% of salary) 20 vacation days per year 90 Days Away program Top-tier health benefits Life & disability insurance Generous sick and mental health days Employee resou

Annonce publiée sur Welcome to the Jungle et reprise par Intelligence Academy. Seule l'annonce d'origine fait foi ; nous ne sommes pas l'employeur.