Inference Software Engineer

About Etched

Etched is building hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency across both prefill and decode workloads. Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history.

Key responsibilities

• Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting.

• Build, enhance, and scale our runtime, including multi-node inference, intra-node execution, state management, and robust error handling.

• Optimize routing and communication layers using our collectives.

• Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues.

You may be a good fit if you have

• Proficiency in C++ or Rust.<