P
Posted 2mo agoSan Francisco or Palo Alto

Member of Technical Staff, Retrieval & Indexing

staffOn-site (Palo Alto)Salary undisclosed
Required Skills
Apache Spark
Job Description

About us

Parallel is a web infrastructure company. Our products are used by leading businesses in sales, marketing, insurance, and coding to build best-in-class AI agents with flexible and powerful programmatic access to the web.

We've raised $230 million from Kleiner Perkins, Sequoia, Index Ventures, Spark Capital, Khosla Ventures, First Round, and Terrain to build the web for AIs. We're currently valued at $2 billion and we're forming a world-class team of engineers, designers, marketers, sellers, researchers, and operational experts to achieve our mission.

The role:

You will build and operate the systems that let Parallel run its own large-scale full-text index over the web. You will work across the full lifecycle: deciding what belongs in the corpus, building the searchable structures that hold it, building the signals and models that judge source quality and freshness, and serving queries against the index quickly and economically. You will anticipate bottlenecks before they appear and ensure the architecture evolves to meet increasing demand.

About you:

Have deep intuition on information retrieval, distributed systems, and performance tuning. You like to reason about the trade-offs between classical

Similar Openings in Other

View all in category