Responsibilities
1. Design, implement, and maintain automated tests, especially for systems using AI/ML models
2. Integrate tests into CI/CD pipelines, monitor regression runs, and adjust strategies for AI components
3. Create and maintain comprehensive test plans covering requirements, use cases, and AI-specific quality aspects (performance, accuracy, robustness, fairness)
4. Actively contribute to scrum ceremonies, providing feedback from both a user and AI quality perspective
5. Collaborate with Product Owners, Tech Leads, Developers, and AI Engineers from use case definition to model refinement to ensure testability
6. Assess datasets for quality and bias and evaluate their impact on model behavior
7. Apply foundational knowledge of machine learning and statistics to design meaningful tests and interpret AI results
8. Drive continuous improvement in QA processes, especially AI-related testing methods
9. Work closely with QA colleagues and development teams across units to align on quality standards and address AI-specific challenges
Requirements
10. Experience in test automation, software development, or quality assurance, with proficiency in Python or similar languages
11. Strong understanding of QA principles, SDLC, and foundational machine learning concepts
12. Ability to design meaningful AI/ML test scenarios, focusing on model behavior, edge cases, and reliability
13. Knowledge of evaluation metrics and basic statistical methods (precision, recall, F1, AUC, distributions, sampling)
14. Experience assessing datasets, including labeling, data quality checks, and identifying bias, data drift, or concept drift
15. Familiarity with AI evaluation tools (e.g., MLflow, Weights & Biases) and standard automation or CI/CD tools (e.g., Selenium, GitLab, Jenkins)
16. Awareness of ethical AI principles and best practices for responsible AI
17. Good communication skills to collaborate with different stakeholders
What we offer
18. 28 days of well-deserved holidays
19. Onsite Onboarding in our HQ office for an optimal start
20. Great compensation and benefits packages including company achievement bonus and stock-based options, regular salary reviews
21. Public transport friendly office
22. Special terms for local gyms
23. Fresh organic fruits, muesli, soft drinks and snacks for free
24. Access to Corporate Benefits platform with many discounts
25. Regular Team events and company-wide celebrations
26. Open door policy, no dress code rules and frequent all Hands
27. Hybrid and Flexible work time with up to 50% home office
28. Work From Abroad Program allowing up to 40 days of work outside your contracting country
29. We celebrate diversity as one of core values, join and drive one of the c-a-r-e initiatives together with us!
For this position, the collectively agreed minimum salary (IT Collective Agreement) is €3,843 gross per month based on a 38.5-hour work week. Naturally, a market-competitive overpayment is possible depending on your qualifications, professional experience, and overall expertise.