Product Data Scientist - Learning Platforms Infinitas Technology
Purpose
The Product Data Scientist raises the standard of how we measure and prove impact across our digital learning platform. You set the bar for trustworthy metrics, valid comparisons, and sound evidence and use it to answer the questions that shape our product. The scope covers learner and teacher experiences across our Learning Platforms. Becoming genuinely data-driven is a core pillar for our company, and this role is important in reaching that goal.
Key responsibilities
Experimentation and causal evaluation
Design A/B tests and, where controlled testing isn't possible (seasonality, classroom-locked cohorts, staged rollouts), apply quasi-experimental methods such as difference-in-differences, matching, and interrupted time series. Power analysis and minimum detectable effect up front; disciplined handling of peeking, multiple comparisons, and variance reduction.
Statistical modelling for validation and insight
Look beyond single metrics and simple comparisons. Use models to find what really drives an outcome, to account for the fact that users sit within groups such as classes and schools, to validate our data, and to test assumptions with forward-looking estimates. This is modelling to understand and validate not to build live machine learning.
Learning outcomes and efficacy
Build the evidence base that learners make progress on our platforms. Design A/B tests and comparison-group analyses that test whether product changes improve learning, accounting for prior ability and teacher and school effects.
Success metrics: design and validation
Define success metrics and guardrails for product initiatives, and validate them, does the metric measure what we claim, is it sensitive enough to detect real change, does it hold up over time and across segments. Own the definitions that everyone else builds on.
Analytical standards and judgement
Set the standards for how analysis is done here: unit of analysis, when numbers may be aggregated and when they may not, weighting, comparability across products and opcos, and how uncertainty is communicated. Review the work of others and raise the bar through that review.
AI-assisted analysis and analytical agents
Work with engineers to build and evaluate agents that support analysis (automated experiment readouts, anomaly detection, querying over certified data models). Own the evaluation side and analysis guardrails: define how we know an agent's answer is correct before we trust it at scale.
Measurement infrastructure and data quality
Co-own tracking and instrumentation plans with Engineering. Ensure the metrics we depend on are accurate, documented, monitored, and traceable.
Communication and decision impact
Turn analysis into short, sharp narratives with a clear recommendation and honest trade-offs. Be equally willing to say what the data supports and what it cannot answer.
Must-have
At least 3 year’s experience in statistical modelling or machine learning
Strong SQL and fluent Python or R for analysis and modelling
Experience in experimentation: experimental design, hypothesis and metric definition, power analysis, statistical testing, and causal inference where randomisation isn't available
Solid applied statistics: regression and multilevel models, correlation structures, comfort reasoning about uncertainty and confounding
Product analytics experience (web/app/platform): funnels, cohorts, retention, segmentation, adoption
Data quality mindset: instrumentation design, schema discipline, documentation, testing and monitoring
Communication: concise memos and visuals that drive decisions; credible with senior stakeholders
Stakeholder skills: effective partnership with PM, Design and Engineering
Nice to have
Experience with BI and product analytics tooling (Power BI, Mixpanel or similar)
Survey and attitudinal measurement methodology (sample sizing, CSAT interpretation)
Nice-to-have: educational measurement, psychometrics, IRT, learning analytics, or a background in educational/behavioural research methods
Team & practical
You'll join the data team within our product organisation, alongside two product analysts, reporting to the Head of Analytics. You'll work hybrid, with regular days at our Utrecht office.
