Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
Perplexity is looking for a highly skilled Expert Systems Engineer to join our Search Core team. For the indexing and data processing stream. This role is critical to building next-generation search products and technologies. You will help drive key decisions around the architecture, design, and implementation of foundational components in our technical stack.
Responsibilities
Design and build core search engine components, especially indexing pipelines, data storage formats that operate at the scale of billions of pages
Develop streaming and batch data processing with YT systems for search index construction in a high-load environment
Push the limits of hardware performance through low-level optimizations and systems-level tuning
Tackle challenges in multithreading, concurrency, and system-level optimization
Design and build core search engine components, including indexing pipelines, retrieval algorithms, and ranking systems that operate at the scale of billions of pages
Develop streaming and batch data processing systems for search index construction in a high-load environment
