Vals AI logo
Posted 54m ago•San Francisco

Member of Technical Staff - Research, Cyber

staffOn-site (San Francisco)Salary undisclosed
Required Skills
PythonReactNext.jsAWSLLMsApache Spark
Job Description

About the role

We are looking for an exceptional researcher to design and build the next generation of AI benchmarks for cybersecurity. You will create high-impact, challenging evaluations that push the boundaries of what we can measure in foundation models. This role is ideal for someone with deep research expertise who wants to see their work directly influence how the world evaluates AI systems.

You will lead the design and development of novel benchmarks that assess real-world capabilities and risks of LLMs. Our benchmarks shape how foundation models are developed and generative AI applications are built. We work with every major foundation model lab - along with leading financial institutions and the application-layer companies pushing the frontier forward. Our work has been featured by the Wall Street Journal, New York Times, Washington Post, and Bloomberg.

We are building the standard for evaluating the ability of LLMs to perform real-world tasks. You will be at the forefront of defining what that standard looks like.

What you'll do

  • Design and develop novel, high-impact benchmarks that assess challenging real-world capabilities for cybersecurity

  • Conduct research to ensure our benchmarks are valid, reliable, and meaningful

  • <

Similar Openings in DevOps & Cloud

View all in category➔