Senior Software Engineer (AWS & Big Data)

Job Description

Company DescriptionExperian is the world’s leading global information services company. During life’s big moments — from buying a home or a car to sending a child to college to growing a business by connecting with new customers — we empower consumers and our clients to manage their data with confidence. We help individuals to take financial control and access financial services, businesses to make smarter decisions and thrive, lenders to lend more responsibly, and organizations to prevent identity fraud and crime.We have 17,800 people operating across 44 countries, and every day we’re investing in new technologies, talented people and innovation to help all our clients maximize every opportunity. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index.Learn more at www.experianplc.com or visit our global content hub at our global news blog for the latest news and insights from the GroupExperian is the world’s leading global information services company. During life’s big moments — from buying a home or a car to sending a child to college to growing a business by connecting with new customers — we empower consumers and our clients to manage their data with confidence. We help individuals to take financial control and access financial services, businesses to make smarter decisions and thrive, lenders to lend more responsibly, and organizations to prevent identity fraud and crime.We have 17,800 people operating across 44 countries, and every day we’re investing in new technologies, talented people and innovation to help all our clients maximize every opportunity. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index.Learn more at www.experianplc.com or visit our global content hub at our global news blog for the latest news and insights from the GroupJob DescriptionJob responsibilities:The Senior Data Engineer at Experian India will work on Decisioning Analytics North America software and platforms with a focus on security remediation. Additional work areas will also include technical debt improvements and the implementation new features. Applications supported will include Precise ID, Precise Match, IEN, Document Capture among others. This role will participate as a member of a DA Technology Scrum team to fulfill these objectives. They will be expected to function with a fair degree of autonomy taking high level direction from Leadership and Product teams.Build, design and optimize data pipelines, data warehouses and reporting frameworks.Work closely with our AI team to prepare data for predictive and prescriptive modeling.Implement effective data storage solutions and manage data in AWS environments.Utilize Kafka for real-time data processing.Ensure the integrity and privacy of data through secure design and implementation.Leverage AWS cloud services for scalable application deployment and management.Comfortable taking the lead and driving/coordinating major workstreams.Collaborate with cross-functional teams to deliver on project goals and innovate.Ensure code quality, security, and scalability through best practices and regular reviews.Decompose workstreams into modular pieces and mentor other more junior team members to accomplish.Integration and build of software releases and release planning.Participate in Agile development as a scrum team member.Analyze program performance and devise improvements.Troubleshoots complex problems and identify fixes.Escalate when appropriate when blocked or unable to resolve on their own.QualificationsQualificationsBachelor’s or master’s degree in computer science, Data Science or related field or equivalent experienceStrong prompt engineering skills and effective usage of AI code assistance.5 to 8 years of experience with AWS services, Kafka, and data pipeline tools.Familiarity with ETL tools and pipelines, data warehousing and reporting software.Expertise in SQL, NoSQL, and big data technologies (ex. Hadoop, Spark, Redshift).Experience with AI and machine learning data processing requirements.Strong analytical skills and the ability to work collaboratively across teams.Experience with Infrastructure-as-Code tools and approaches (we use Terraform)Strong knowledge of CI/CD pipelines, automation testing and test-driven developmentExcellent problem-solving abilities and strong communication skills.You would be joining an agile delivery team which continues to refine their own processes and ways of working. You will find it easiest to understand the way we work if you have worked using agile delivery methods in the past.A Senior Engineer not only delivers their own work, but also demonstrates the ability to bring up others around them, for example through activities such as onboarding other engineers into the team or mentoring less experienced engineers working with them. They are engaged in the tasks, opportunities and risks faced in and around their team.Additional InformationExperian Careers – Creating a better tomorrow togetherFind out what its like to work for Experian by clicking here