Senior Software Engineer, ML Evaluations

Artificial Agency

Location: Edmonton, Alberta (Remote possible for exceptional candidates)

Job Description

Artificial Agency, the leading player-facing agentic AI company for games, is seeking a Senior Software Engineer to own the platform our researchers and engineers use to run experiments and evaluations at scale. This is a hybrid role based in Edmonton, Alberta; remote is possible for exceptional candidates.

Reporting to the Head of Platform Engineering, the successful candidate will own the platform end to end, working directly with the teams who run their experiments on it. Every evaluation and benchmark we run goes through it, fanning out to hundreds of jobs across Linux and GPU Windows workers. You’ll build in Python (CLI, job-queueing service, Postgres data model), and own the infrastructure the jobs run on, with help from our infrastructure team.

Expect a mix of distributed-systems design, cloud infrastructure, and hands-on work with ML engineers: from troubleshooting runs that stall or fail to turning stakeholder requests into new platform features. You will make results traceable and useful—helping teams compare models, agent configurations, and software change