ML QA/Model Validation Engineer
The CHI Software team is not standing still. We love our job and give it one hundred percent of us! Every new project is a challenge that we face successfully. The only thing that can stop us is… Wait, it’s nothing! The number of projects is growing, and with them, our team too. We are looking for ML QA/Model Validation Engineer.
We are looking for a Senior ML QA / Model Validation Engineer to join a high-impact project in the insurance domain. In this role, you will be responsible for ensuring that machine learning models are reliable, accurate, and fully compliant before going live.
You will work at the intersection of Machine Learning, Quality Assurance, and MLOps, owning the validation process end-to-end — from pre-production testing to post-deployment monitoring.
Key Responsibilities:
- Validate ML models before production, ensuring they meet agreed quality thresholds (precision, recall, etc.)
- Run and verify shadow mode testing on real production data before release
- Coordinate UAT with business stakeholders (Claims Adjudicators) and collect feedback
- Monitor and test for data drift and concept drift using automated test suites
- Perform regression testing on every model retraining cycle (weekly)
- Ensure all model predictions are properly logged and structured for regulatory audits
- Validate model performance against SLA commitments defined in RFPs
- Participate in formal model readiness reviews and provide sign-off for production releases
What We’re Looking For:
- Experience in ML model validation, ML QA, or related roles
- Strong understanding of ML metrics (precision, recall, accuracy) and model behavior
- Experience with production ML systems and real-world data validation
- Familiarity with MLOps practices (retraining, monitoring, CI/CD for ML)
- Experience working with stakeholders and coordinating UAT processes
- Understanding of data drift / concept drift and monitoring approaches
- Experience in regulated domains (insurance, healthcare, fintech) is a strong plus
Nice to Have:
- Experience with auditability, explainability, or model governance
- Background in data science or machine learning engineering
- Exposure to compliance or regulatory environments
Our perks
-
Covered vacation period: 20 business days and 5 days off
-
Free English classes
-
Flexible working schedule
-
Truly friendly and supporting atmosphere
-
Working remotely or in one of our offices
-
Medical insurance for employees from Ukraine
-
Legal support
