Software Engineer, Python - Codebase Q&A

This role is for one of our clients

Compensation: $130 per task

We are seeking experienced Python engineers to build the dataset that teaches AI agents to reason about real codebases.

Codebase Q&A is a reinforcement-learning environment for training AI agents to explore and reason about software repositories they have never seen before. You will build difficult codebase-exploration tasks: high-level engineering questions about production Python repositories that cannot be answered by reading a single file, and that require runtime evidence to resolve — the kind of question a senior engineer answers by actually investigating the system.

This track works on widely deployed Python codebases including Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff and Meson.

Contract, task-based work paid at $130 per approved task, performed remotely in our Studio.

Requirements

Key Responsibilities

• Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution
• Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history