12 beste Stellen als development engineer in mannheim, bw – aktuell auf Personalsuche

Senior AI Software Engineer - Model Evaluation (f/m/d)
Aleph Alpha —Heidelberg
- Vollzeit
- Hybrides Arbeiten
- Doktorat
- Master
- Machine Learning
- Flexible Arbeitszeiten
Full-Stack Developer
CibusCell Technology GmbH —Speyer
- Vollzeit
- Azure
- Englisch
- Softwareentwicklung
Direkt bewerben
HVDC Sales Manager (f/m/d)
Hitachi —Mannheim
- Vollzeit
- Vertrieb
- Microsoft Office
- Master
Working Student Full-Stack Developer
CibusCell Technology GmbH —Speyer
- Teilzeit
- Azure
- Englisch
- Softwareentwicklung
Direkt bewerben
SENIOR DIGITAL / RTL DESIGN ENGINEER (M/F/D)
Extoll GmbH —Mannheim
- Vollzeit
- Englisch
- Master
- Bachelor
- Gleitzeit
Direkt bewerben
Technical Expert Cleanliness and Adhesive Bonding and Joining Solutions (m/f/d)
TE Connectivity —Speyer
- Doktorat
- Datenanalyse
- Master
Senior Backend Developer - (Typescript)
osapiens —Madrid, Madrid provincia
- Vollzeit
- Hybrides Arbeiten
- Spanisch
- Englisch
- Büro
Direkt bewerben
Head of Product Marketing (m/f/d)
Nova Ltd. —Mannheim
- Master
- Mit Reiseanteil
- Marketing
- Gleitzeit
- Flexible Arbeitszeiten
Direkt bewerben
Engagement Manager Data & AI Solutions (m/w/d)
Rewire —Heidelberg
- Vollzeit
- Hybrides Arbeiten
- Master
- Mit Reiseanteil
- Künstliche Intelligenz
Direkt bewerben
Principal Data & AI Solutions (m/w/d)
Rewire —Heidelberg
- Vollzeit
- Hybrides Arbeiten
- Master
- Mit Reiseanteil
- Künstliche Intelligenz
Direkt bewerben
Senior Go Developer (f/m/d) – Focus on gRPC & Enterprise Applications
Natuvion GmbH —Walldorf
- Vollzeit
- Homeoffice
- Datenbanken
- APIs
Direkt bewerben
Supplier Development Engineer (m/w/d)
Caterpillar —Mannheim
- 89.785 € pro Jahr
- Vollzeit
- Ingenieurwissenschaft
- Englisch
- Analysefähigkeit
2 Tage

Ich möchte aktuelle Job-E-Mails für Stellen als development engineer in mannheim, bw erhalten

Wenn Sie sich bei Ihrem Konto anmelden, stimmen Sie den Nutzungsbedingungen, den Richtlinien zur Verwendung von Cookies sowie der Datenschutzerklärung von SimplyHired zu.

Weitere Job-Standorte erkunden

development engineer jobs near mannheim, bw

Jobs als Head Of Product in Mannheim

Jobs als Senior Software Engineer in Heidelberg

Jobs als Golang Developer in München

Jobs als Golang Developer in Köln

Jobs als Golang Developer in Hamburg

Jobs als Golang Developer in Baden Württemberg

Jobs als Junior Developer in Berlin

Jobs als Business Development Manager in Hamburg

Jobs als Sport Event Manager in München

Jobs als Logistik Manager in München

Jobs als Social Media Manager in Hannover

Jobs als Engagement Manager in Frankfurt Am Main

Jobs als Engagement Manager in Düsseldorf

Jobs als Ai Governance in München

Jobs als Ai Working Student in München

Jobs als Head Of Product in Höhenkirchen Siegertsbrunn

Jobs als Chief Of Staff in Berlin

Jobs als Head Of Product in Nürnberg

Jobs als Head Of Product in Nordrhein Westfalen

Jobs als Head Of Product in Hamburg

Senior AI Software Engineer - Model Evaluation (f/m/d)

Aleph Alpha
Heidelberg

Jetzt bewerben

Details zur Stelle

Vollzeit

Leistungen

Flexible Arbeitszeiten

Qualifikationen

Doktorat
PyTorch
Master
Machine Learning
Computerlinguistik
Künstliche Intelligenz
Python
Deutsch

Vollständige Stellenbeschreibung

Aleph Alpha Research’s mission is to deliver category-defining AI innovation that enables open, accessible, and trustworthy deployment of GenAI in industrial applications. Our organization develops foundational models and next-generation methods that make it easy and affordable for Aleph Alpha’s customers to increase productivity in development, engineering, logistics, and manufacturing processes.

Team Culture

At Aleph Alpha, we foster a culture built on ownership, autonomy, and empowerment. Teams and individual contributors are trusted to take responsibility for their work and drive meaningful impact. We maintain a flat organizational structure with efficient, supportive management that enables quick decision‑making, open communication, and a strong sense of shared purpose.

About the Role

As a Senior AI Engineer in Pre-training Evaluation, you will work across the full stack of evaluation - from methodology design to implementation to analysis. Some weeks you'll be deep in benchmark curation, understanding what a given eval actually measures and whether it predicts downstream performance. Other weeks you'll be optimising pipeline throughput or building dashboards that surface training signals.

We are looking for someone that combines significant research experience (in industry or academia) with high engineering competence.

Your work sits at high leverage: the evaluations you design and build determine which training runs we pursue, which data mixtures we prioritise, and how we allocate compute. You'll have direct influence on the models we ship.

Your Responsibilities

Own benchmarks end-to-end: Select, implement, and maintain the evaluation suite used during pre-training - from dataset curation to scoring infrastructure to result analysis.
Build evaluation infrastructure: Develop and optimise the pipelines that run evaluations against training checkpoints, ensuring speed, reliability, and reproducibility.
Design aggregation and reporting: Define how benchmark results translate into training decisions, and build the tooling that makes results interpretable.
Close capability gaps: Work with product and post-training teams to identify where our models fall short, then create or integrate benchmarks that measure progress.
Own German evaluation: Ensure rigorous assessment of German language capabilities - this is core to our value proposition, not an afterthought.
Correlate signals: Establish which pre-training metrics actually predict downstream and system-level performance.

Your Profile

Experience with LLM evaluation, benchmark design, evaluation dataset curation, and experimental design.
Familiarity with statistical methods for evaluation and experiment design.
Track record of shipping impactful technical work - whether that's research, infrastructure, or both.
Strong Python skills and comfort with ML tooling (PyTorch, evaluation frameworks, distributed systems).
Ability to reason about what an evaluation measures and whether it matters - not just run benchmarks, but understand them.
Ownership mentality: you see problems through from diagnosis to solution to deployment.
Willingness to relocate to Heidelberg or travel regularly (potentially weekly).

Preferred Qualifications

Understanding of foundation model training - how data, scale, and architecture affect capabilities.
Experience with large-scale data processing or ML infrastructure.
German language proficiency (helpful for evaluating German capabilities, not required).
PhD in machine learning, NLP, statistics, or a related field (valued but not required - we care about what you can do).

What we offer

Become part of an AI revolution!
30 days of paid vacation
Access to a variety of fitness & wellness offerings via Wellhub
Mental health support through nilo.health
Substantially subsidized company pension plan for your future security
Subsidized Germany-wide transportation ticket
Budget for additional technical equipment
Flexible working hours for better work-life balance and hybrid working model
Virtual Stock Option Plan
JobRad Bike Lease

Jetzt bewerben

Erweiterte Suche

development engineer Jobs in mannheim, bw

Senior AI Software Engineer - Model Evaluation (f/m/d)

Full-Stack Developer

HVDC Sales Manager (f/m/d)

Working Student Full-Stack Developer

SENIOR DIGITAL / RTL DESIGN ENGINEER (M/F/D)

Technical Expert Cleanliness and Adhesive Bonding and Joining Solutions (m/f/d)

Senior Backend Developer - (Typescript)

Head of Product Marketing (m/f/d)

Engagement Manager Data & AI Solutions (m/w/d)

Principal Data & AI Solutions (m/w/d)

Senior Go Developer (f/m/d) – Focus on gRPC & Enterprise Applications

Supplier Development Engineer (m/w/d)

Ich möchte aktuelle Job-E-Mails für Stellen als development engineer in mannheim, bw erhalten

Related Searches

Weitere Job-Standorte erkunden

Tools für Jobsuchende

Arbeitgebertools

Durchsuchen

Bleiben Sie in Kontakt