Machine Learning Researchers
Article excerpt
Highlighted: the sentence this signal was extracted from
Machine learning researchers. Job description. Mercor is partnering with a leading AI research lab on Project Vesuvius, an initiative designed to evaluate and enhance the ability of large language models (LLMs) to generate structured, high-quality research plans for open-ended machine learning problems. We are seeking machine learning researchers and phds to serve as annotators who will assess and provide structured feedback on AI-generated research plans. The goal is to improve how llms function as brainstorming partners for machine learning research. This is a remote, short-term engagement with flexible hours and opportunities to contribute to frontier AI evaluation and research. * Evaluate and compare AI-generated research plans for clarity, feasibility, and technical soundness. * Design and compile ML tasks based on real-world challenges and research competitions. * Draft detailed, executable natural language plans for machine learning workflows. * Implement and validate research plans in Python within a Docker environment. * Assess outputs against structured rubrics, provide usefulness scores, and deliver concise, objective feedback. * 5+ years of experience in applied machine learning or a PhD in machine learning or related fields. * Strong understanding of ML research methodologies, experimental design, and evaluation practices. * Excellent analytical and...
Keep reading with a free account
The rest of this article, and every signal for Mercor, is in your free account.
