Captions
Applied Scientist, Neural Avatars
Job Description
Captions is the AI-powered creative studio. Millions of creators around the world have used Captions to make their video content stand out from the pack and we’re on a mission to empower the next billion.
Based in NYC, we are a team of ambitious, experienced, and devoted engineers, designers, and marketers. You’ll be joining an early team where you’ll have an outsized impact on both the product and company’s culture.
We’re very fortunate to have some the best investors and entrepreneurs backing us, including Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, Lenny Rachitsky, and more.
Check out our latest milestone and our recent feature on the TODAY show.
** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Soho) **
Responsibilities:
-
Conduct research and develop models to advance the state-of-the-art in generative computer vision technologies, with a focus on creating highly realistic digital faces and bodies.
-
Strive to set new standards in the realism of digital human appearance, movement, and personality, ensuring that generated content closely resembles real-life scenarios.
-
Implement techniques to achieve high-quality results in zero-shot or few-shot settings, as well as customized avatars for different use cases while maintaining speed and accuracy.
-
Develop innovative solutions to enable comprehensive customization of video content, including the creation of digital people, modifying scenes, and manipulating actions and speech within videos.
Preferred Qualifications:
-
PhD in computer science (or related field) and 2+ years of industry experience post-PhD
-
Strong academic background with a focus on computer vision and transformers, specializing in GANs, NeRFs, diffusion models, or related areas.
-
Publication Record: Highly relevant publication history, with a focus on generating or manipulating realistic digital faces, bodies, expressions, body movements, etc. Ideal candidates will have served as the primary author on these publications.
-
Expertise in Deep Learning: Proficiency in deep learning frameworks such as TensorFlow, PyTorch, or similar, with hands-on experience in designing, training, and deploying neural networks for multimodal tasks.
-
Strong understanding of Computer Science fundamentals (algorithms and data structures).
Benefits:
-
Comprehensive medical, dental, and vision plans
-
Anything you need to do your best work
-
We’ve done team off-sites to places like Paris, London, Park City, Los Angeles, and Nashville with more planned in the future.
Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.