AI Software Engineer - Model Evaluation (f/m/d)

Job description

Our Mission Aleph Alpha is one of the few companies in Europe doing serious foundation model pre-training. Our customers - in finance, manufacturing, public administration - need models that understand German, meet European regulatory requirements, and work reliably in high-stakes settings. We're building that in Heidelberg. We're growing our pre-training team and hiring someone to own evaluation: defining what "better" means for our models, building the systems that measure it, and ensuring our training team has the signal it needs to iterate confidently. Team Culture: At Aleph Alpha, we foster a culture built on ownership, autonomy, and empowerment. Teams and individual contributors are trusted to take responsibility for their work and drive meaningful impact. We maintain a flat organizational structure with efficient, supportive management that enables quick decision‑making, open communication, and a strong sense of shared purpose. About the Role: As a Senior AI Engineer in Pre-training Evaluation , you will work across the full stack of evaluation - from methodology design to implementation to analysis. Some weeks you'll be deep in benchmark curation, understanding what a given...