Expleo
Data Engineer – Snowflake Experience (Based in Nenagh)
Job Description
Overview
Works independently taking full responsibility for a certain area and will create stable and reliable systems and leverage different data management methods to efficiently access information stored in databases.The position is based in NenaghIJ
Responsibilities
- Create and maintain optimal data pipeline architecture,
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction of data sources using SQL and AWS ‘big data’ technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights and other key business performance metrics
Qualifications
Essential:
- Bachelor’s Degree in Computer Science, Information Systems,or other related field, or equivalent work experience
Desirable:
- Certification in any one programming skill
Essential skills
- Hands-on Snowflake experience
- Proficiency in programming languages, such as Python, Java, or Scala
- Experience with big data
- Knowledge of database management systems, both relational (e.g., MySQL, PostgreSQL) and non-relational (e.g., MongoDB, Cassandra)
- Familiarity with data integration and ETL tools, such as Talend, Informatica, or Apache NiFi
- Strong problem-solving and analytical skills
- Excellent communication and collaboration abilities
- Adaptability and a willingness to learn new technologies and techniques
Desired skills
- Migration experience to Snowflake
- Hands on experience with Oracle RDBMS
- Exposure to Streamsets, DBT or other ETL tool
Experience
- 5+ year experience working in an enterprise big data environment
- Hands-on experience with Snowflake external tables concepts, Staging, Snow scheduler & performance tuning
- Hands-on experience in development, deployment and operation of data technologies and platforms such as:
- Integration using APIs, micro-services and ETL patterns
- Low latency/Streaming, batch and micro batch processing
- Data platforms such as Hadoop, Hive, Redshift or Snowflake
- Cloud Services such as AWS
- Cloud query services such as Athena
- DevOps Platforms such as Gitlab
- Containerisation technologies such as Docker and Kubernetes
- Orchestration solutions such as Airflow
What do I need before I apply
- This role will require onsite working 4 days per weekeo
Benefits
At Expleo, we are committed to providing a competitive salary and a substantial benefits offering with unique wellbeing, financial and employee recognition programmes.
We pride ourselves on our diverse and inclusive culture and offer a variety of family friendly policies and enhanced leave to help our you achieve a healthy work life balance.
By providing significant learning and development opportunities, we encourage individual growth and success throughout your career with us.
- Collaborative working environment – we stand shoulder to shoulder with our clients and ours peers through good times and challenges
- We empower all passionate technology loving professionals by allowing them to expand their skills and take part in inspiring projects
- Expleo Academy – enables you to acquire and develop the right skills by delivering a suite of accredited training courses
- Competitive company benefits such as medical and dental insurance, pension, life assurance, employee wellbeing programme, sports and social events, birthday hampers and much more!
- Always working as one team, our people are not afraid to think big and question the status quo.
“We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age”.
At Expleo, we understand that many people experience impostor syndrome throughout their lifetime, please do not let this discourage you from applying for this role. Our Talent Acquisition Team welcomes all CV’s and will consider your application in line with the values, requirements and role competencies.
#LI-DS1