Perficient
Senior Data Engineer (AWS)
Job Description
Why is Perficient the best option?
Inflection Point by Perficient is a leading global digital consultancy and has a presence around the globe transforming and connecting the most prominent brands with their customers. At Inflection Point by Perficient, we seek to grow alongside professionals promoting agile cultures and values as we challenge, champion, and celebrate our people for us to build a great future together.
Job Summary
Perficient is looking for a Data Engineer to join our team with a deep understanding of data mining and analytical techniques. The ideal candidate will possess strong technical skills, business acumen, and the ability to collaborate effectively with cross-functional teams.
What do you need to come aboard?
- Bachelor’s degree in Computer Science, Data Science, or a related technical field, or equivalent practical experience.
- Experience in building and maintaining AWS-based data pipelines, utilizing tools such as AWS Lambda, Docker / ECS, MSK, Airflow, Databricks, and Unity Catalog.
- Proficiency in development using two or more of the following technologies:
- Python (Pandas/Numpy, Boto3, SimpleSalesforce)
- Databricks (pySpark, pySQL, DLT), Apache Spark, Kafka and the Kafka Connect ecosystem (schema registry and Avro)
- Terraform (or other infrastructure as code platforms)
- Enthusiasm for direct collaboration with customer teams, including business units and internal IT departments.
- Proven experience with relational and NoSQL databases (e.g., Postgres, Redshift, MongoDB).
- Familiarity with version control systems (e.g., git) and experience with peer code reviews.
- Knowledge of data visualization techniques using tools such as Grafana, PowerBI, AWS
To Rock This Role, You Should:
- Collaborate with Data Architects to comprehend current data models and develop pipelines for data ingestion and transformation.
- Design, develop, and maintain a robust framework for observing and monitoring pipelines, with a focus on ensuring the reliability and performance of jobs.
- Identify and communicate data integration errors to relevant teams, emphasizing timely processing of new data, pipeline performance, and the integrity and quality of source data.
- Demonstrate hands-on experience in building data-lake style infrastructures using streaming data set technologies, particularly Apache Kafka.
What can we offer you?
- Law benefits
- Certifications
- Internal & External Courses
- English Classes
- Medical Insurance (Personal and Familiar)
- Life Insurance
- Savings Fund
- Pantry Vouchers
- Additional Holidays
*Once you apply you accept the terms and conditions of Perficient in Latin America and agree to be contacted by the talent acquisition team.
