Stage - AI Agent Evaluation for Simcenter Amesim f/m - Strategic Student Program

Description du poste

Company Overview

Siemens Digital Industries Software is a leading provider of solutions for the design, simulation, and manufacture of products across many different industries. Formula 1 cars, skyscrapers, ships, space exploration vehicles, and many of the objects we see in our daily lives are being conceived and manufactured using our Product Lifecycle Management (PLM) software.

Start your career with the Strategic Student Program (SSP)

The Strategic Student Program is our formal internship program globally. You will be mentored by guides and gain invaluable professional experience. At Siemens, SSP interns get access to an international student network and community, career development opportunities with professional growth pathways, comprehensive practical training throughout the program, access to the Siemens Learning Hub and other training materials, and the opportunity to collaborate on exciting projects within a global, diverse team.

Topic

Development of a platform for evaluating MCP workflows and LLM usage.

Position Overview

In collaboration with the Nexus team, which develops the Model Context Protocol (MCP) integrations for Simcenter Amesim APIs, you will be responsible for designing and developing an evaluation platform (either standalone or integrated into CI pipelines). The objective is to analyze and compare the performance of MCP-based workflows and automate result validation by leveraging Large Language Models (LLMs).

Key Responsibilities

• Design and implement robust test suites (using MLflow or equivalent tools) to measure the performance, quality, and relevance of AI agents and MCP-driven interactions with Simcenter Amesim.
• Develop a dedicated evaluation platform to automate the testing, monitoring, and benchmarking of AI workflows.
• Investigate and integrate LLM-based evaluation techniques to automatically validate generated results and assess workflow quality.
• Work in a rapidly evolving technolo

Annonce publiée sur LinkedIn et reprise par Intelligence Academy. Seule l'annonce d'origine fait foi ; nous ne sommes pas l'employeur.