AI Conversation Research & Evaluation Specialist
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are seeking experienced Subject Matter Experts (SMEs)in psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, and related advisory fields to support AI conversation evaluation research. You will review conversations between people and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality. The ideal candidate has at least 3–5 years of relevant professional experience, strong analytical skills, and the ability to distinguish information that could materially change a recommendation from details that are less relevant.
Key Responsibilities
Review AI conversations involving real-world interpersonal situations and everyday decision-making.
Identify missing context and recommend relevant follow-up questions that could improve the quality of AI responses.
Evaluate whether gathering additional in
