Databricks Data Engineer

Req ID: 301996 

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Databricks Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).

Job Duties: Key Responsibilities:

Data Pipeline Development: Design, build, and maintain scalable data pipelines using Databricks on AWS.
Data Integration: Ingest data from multiple sources (structured and unstructured) using AWS services such as S3, Lambda, Glue, and Kinesis.
Big Data Processing: Develop and optimize Spark-based ETL jobs to process large datasets on Databricks.
Data Architecture: Collaborate with the architecture team to implement best practices for cloud-based data lakes and data warehouses.
Optimization: Tune Spark jobs for performance improvements and efficient resource usage.
Strong experience with Databricks, including Apache Spark development.
Proficiency in Python or Scala for Spark job development.
Experience with SQL for querying and managing data.
Familiarity with CI/CD tools (e.g., Jenkins, GitLab) for automating deployment and testing of data pipelines.
Knowledge of big data technologies (Hadoop, Hive) and ETL frameworks.
Familiarity with AWS security best practices (IAM, VPC, security groups).
                        
Minimum Skills Required: Data Engineer, Databricks, Cloud migration 3+ year (Multiple projects)

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

NTT DATA is an equal opportunity employer and considers all applicants without regarding to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.