Senior Software engineer- Data infrastructure

Job Description

Luma’s mission is to build multimodal AI to expand human imagination and capabilities.We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. You’ll be part of Luma’s applied research team and work directly on mission critical work-streams utilizing thousands of GPUs.
Startup mindset

Value velocity and execution.Communicate clearly.Focus on building what will matter to users and the product.Be resourceful at finding creative ways to overcome challenges.
Experience

Very strong generalist python coding.Requirement of 5+ years of engineering, including 2+ years of work experience in petabyte-level data processing. Experience engineering large-scale systems that process and serve petabytes of data.Deep understanding of Kubernetes, SLURM, Ray and other cluster orchestration systems.Experience working with visual data.Experience working closely with ML is a strong plus .We can not consider new grads for this role.
Roles and Responsibilities

Design, build and automate infrastructure for processing data across multiple clusters of thousands of GPUsWork with researchers to identify and implement technical data requirements, and optimize distributed loading for model trainingWork cross-functionally for diverse backend engineering needsDesign & build performant infrastructure to manage and leverage large-scale datasets for our model training.
Benefits

Equity grant to reflect the incredible value you will bring to Luma, with annual refreshes.Excellent salary and benefits.Full health, dental, and vision coverage.Latest and greatest gear.Stipends towards wellness, house cleaner, and phone/internet.Unlimited paid time off with 12 days minimum.Unlimited sick days.
Why Join Luma AI?

You will get to work with the world best AI researchers, shipping their research to millions of users around the worldYou will be equipped with all the tools, technologies, resources and AI tools you need to get the job doneWe build. We ship. Your work will matter to people.We are building a very widely usable product, and you’ll get to work on equally wide variety of challenging problems.We have fantastic traction from early customers, whom you’ll get to work directly with.We have backing of some of the best VCs in Silicon Valley, and Angels from across the industry.All your applications are reviewed by real people.