Fractal
Big Data Engineer
Job Description
It’s fun to work in a company where people truly BELIEVE in what they are doing!
We’re committed to bringing passion and customer focus to the business.
JOB DESCRIPTION:
The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and in building end-to-end productionized MLOps pipelines.
RESPONSIBILITIES:
Mandatory Skills – Hadoop, Hive, Cloudera, Spark, SQL
• Big Data, Hadoop, SCALA, Spark, Data mining, Hive, Impala
• Strong understanding and experience in distributed computing frameworks particularly Apache Hadoop, YARN MapReduce HDFS and associated technologies one or more of Hive Oozie Impala etc
• Expert level proficiency in Spark, Pyspark or Scala
• Experience in at least one of Java or Python preferred
• Hands on experience with Apache Spark and its components’ Streaming SQL MLLib is a strong advantage.
• Experience working within a Linux computing environment and use of command line tools including knowledge of Shell Python scripting for automating common tasks.
• Ability to work in a team in an agile setting understanding of Git or any version control tools.
• Kafka and Spark Streaming is a plus.
• Hadoop (Hive / Impala / Kudu, HDFS, Map Reduce, Others),Java, Spark, Python
If you like wild growth and working with happy, enthusiastic over-achievers, you’ll enjoy your career with us!
Not the right fit? Let us know you’re interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
