Data Scientist
Independently evaluate machine-learning and agentic AI models at Commonwealth Bank. The role builds reusable tests and investigates model data, assumptions and behaviour.
What you’d work on
Our reading of the posting: what a new hire in this role would most likely spend their first months on.
- Design and reproduce AI-model evaluations.
- Investigate agent traces, retrieval and tool-use failures.
- Build automated validation harnesses and explain technical findings.
What they ask for
Required
- Python
- AI or machine-learning evaluation
- Reproducible testing
- Reading unfamiliar model code
- Technical communication
Preferred
- SQL, R or TypeScript
- LangChain, LangGraph or Pydantic
- Evaluation and observability tools
- Education
- No degree requirement stated.
- Experience
- Relevant AI development or evaluation experience; no minimum years stated. Advert closes 10 November 2026.
- Languages and tools
How to prepare
- Build an evaluation set for an agentic workflow.
- Trace retrieval and tool errors back to model or data assumptions.
- Compare learned evaluations with independently checked examples.
What to study
The Model Validation Quant roadmap sets out the stages for this kind of role, with free resources for each.
Open the roadmapApply
Read the full posting on Commonwealth Bank of Australia’s site before applying: requirements, location and pay can change after we check them.
View the posting on Commonwealth Bank of Australia’s site ↗
SelfMadeQuant wrote this summary from the employer’s public posting, last checked 6 November 2026. SelfMadeQuant isn’t affiliated with Commonwealth Bank of Australia and doesn’t handle applications.