AI Research Scientist – Multimodal Machine Learning

At Reality Labs Research (RL-R), our goal is to explore, innovate and design novel interfaces and hardware subsystems for the next generation of virtual, augmented, and mixed reality experiences. We are driving research towards a vision of an always-on augmented reality device that can enable high-quality contextually relevant interactions across a range of complex, dynamic, real-world tasks in natural environments; to achieve this goal, our team draws on and fundamentally advances methods and knowledge from artificial intelligence, multimodal machine learning, computer vision, and signal processing. We are looking for a skilled and motivated researcher with expertise in multimodal machine learning and large scale multimodal representation learning. More broadly, the chosen candidate will work with a diverse and highly interdisciplinary team of researchers and engineers and will have access to cutting edge technology, resources, and testing facilities.AI Research Scientist – Multimodal Machine Learning Responsibilities

• Lead, collaborate, and execute on research that pushes forward the state of the art in multimodal reasoning and generation research.
• Work collaboratively with other research scientists to develop novel solutions and models in service of contextualized AI for augmented reality.
• Working on curation of large datasets across many modalities (e.g., vision, audio, IMU, sEMG).
• Leading experimental design, implementation, evaluation, and reporting results to enable new capabilities for multimodal LLMs.
• Mentor other team members. Play a significant role in healthy cross-functional collaboration.

Minimum Qualifications

• PhD degree or equivalent experience in Computer Science, Mathematics, Engineering or a related field
• Publication record in machine learning, AI, computer science, statistics, applied mathematics, data science, or related technical fields
• 6+ years of experience in one or more of the following areas: Deep Learning, NLP, Multimodal, Computer Vision, Speech
• 6+ years of experience developing end-to-end ML pipelines with a focus on dataset preprocessing, model development and evaluation, software integration, and real-time deployment
• Experience writing software (Python and C/C++) and executing complex machine learning experiments
• Research experience in one or more of these areas: NLP, computer vision, Multimodal, Speech
• Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

Preferred Qualifications

• Publication record in AI conferences like NeurIPS, EMNLP, ACL, ICCV, CVPR, ICML, NAACL, ICLR, Interspeech, ICASSP.
• Programming experience in Python and hands-on experience with frameworks such as PyTorch.
• Experience with developing machine learning models at scale from inception to deployment.

LocationsAbout Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics. Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to [email protected]. $177,000/year to $251,000/year + bonus + equity + benefits

Individual pay is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base salary, Meta offers benefits. Learn more about benefits at Meta.