Senior Staff LLM Inference Engineer

Description du poste

We are hiring end-to-end inference engineers who are comfortable going from a novel research idea to a deployed, optimized system You will work at every layer of the inference stack — from kernel-level optimization to distributed orchestration to high-level serving APIs Identify and prototype emerging LLM inference use cases suited to heterogeneous hardware deployments Build compelling proof-of-concept systems that demonstrate D-Matrix capabilities to customers, partners, and internal stakeholders Develop and tune custom kernels and operator-level optimizations to maximize throughput and minimize latency Drive quantization, sparsity, and batching strategies tailored to D-Matrix computational model Build and maintain inference runtimes, serving frameworks, and evaluation tooling Contribute to distributed inference systems: tensor/pipeline parallelism, disaggregated prefill/decode, KV-cache management Work closely with hardware architects to provide firmware and compiler teams with actionable inference workload insights Partner with product and business development to translate POCs into customer-facing demonstrations Contribute to technical publications, whitepapers, and open-source projects that advance D-Matrix visibility Benefits Equity Health care Flexible time-off Paid paternity leave 401k retirement plan Remote & hybrid working model Work with world-leading engineers and researchers Free food and snacks Happy hours Peer coaching & development Team-building activities On-site fitness center

Annonce publiée sur Welcome to the Jungle et reprise par Intelligence Academy. Seule l'annonce d'origine fait foi ; nous ne sommes pas l'employeur.