MetaPhase Consulting

Research Engineering Specialist – Llama, GenAI

30 October 2024
Apply Now
Deadline date:
£124000 / year

Job Description

The Llama, GenAI team is seeking an AI Specialist for a Research Engineering role. This position involves advancing reasoning capabilities in large language models. In this role, you will work with our state-of-the-art Llama, model and implement cutting-edge techniques, including but not limited to Monte Carlo tree search, online reinforcement learning and advanced efficient inference methods with Llama. The focus will range from verifiable reasoning, such as mathematical reasoning, to more complex areas, including legal reasoning, causal analysis and decision-making.Research Engineering Specialist – Llama, GenAI Responsibilities

  • Execute research to push forward state-of-the-art reasoning capabilities in large language models.
  • Contribute to code health, research experiments, and organization of research insights, and communicate results effectively.
  • Collaborate with a global team from diverse backgrounds on the entire large language model post-training pipeline.
  • Thrive in a fast-paced environment with ambitious targets.

Minimum Qualifications

  • A minimum of a Bachelor’s degree in Computer Science, Computer Engineering, Artificial Intelligence, Machine Learning, or a related field.
  • Relevant industry or research experience related to the job, including experience in collaborative team environments.
  • Proficiency in software development and deep learning frameworks, such as PyTorch, and others.
  • Specialised experience in large language model reasoning through post-training, alignment demonstrated by past projects.

Preferred Qualifications

  • An advanced degree in machine learning and natural language processing (Master’s or PhD) is preferred.
  • Experience in reasoning (math and code and other non verifiable reasoning) space with LLMs.
  • Experience in reinforcement learning and tree search algorithms
  • Experience in various reword modeling in LLM alignment

LocationsAbout Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics. Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to [email protected].