3Cloud

Senior Data Engineer – Data Architecture & Engineering

12 March 2024
Apply Now
Deadline date:
£123000 - £190000

Job Description

Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you!

At 3Cloud, we hire people who aren’t afraid to experiment or fail. We hire people who are willing to give direct and candid feedback to their managers, leaders, and team members. We hire people who jump at those opportunities because they care about our collective growth and success. We hire people who challenge and hold each other accountable for living 3Cloud’s core values because they know that it will result in amazing experiences and solutions for our clients and each other.

3Cloud is a technology services firm helping clients transform their business through the power of the cloud. We leverage Microsoft Azure to help clients speed up innovation, operate more efficiently and be more responsive to their client’s needs. As a Microsoft partner, we specialize in Azure migration, cloud-scale custom application development, Internet of Things (IoT), analytics, and managed development (DevOps) achieved through Azure-enabled infrastructure automation. 3Cloud is headquartered in Chicago with an additional office in Dallas. Remote based, US only. 

As a consultant in the Data and Analytics Practice you will be responsible for delivering quality solutions using the Microsoft’s Azure suite of tools, focusing specifically on the Synapse ecosystem. This is a senior position with extensive experience in data engineering and development, focused on database technologies, with specific experience with Azure Synapse. You will use your experience creating and optimizing star schema models in a dedicated SQL pool on Synapse to create effective structures to ingest data for analysis. You will also work with Table Distribution and Index types and understand partitioning strategies to update large tables. You will also use PolicyBase and Azure Data Factory to help ingest data. Your experience with Synapse Dynamic Management Views will help you to monitor and manage Azure Synapse Analytics. If you are an individual who is highly interested in Azure and Databricks technologies, you may be just who we are looking for to join our team.

Responsibilities

  • Understand Azure Synapse Analytics architecture
  • Be able to identify performance bottlenecks
  • Monitor Azure Synapse Analytics using Dynamic Management Views
  • Build performing data with Table Distribution and Index types
  • Partition tables using partitioning strategy
  • Creating and optimizing star schema models in a Dedicated SQL Pool
  • Configure and manage workload classification and resource classes
  • Build ingestion pipelines with PolyBase and ADF to load and export data (best practices)

Qualifications

  • Bachelor’s Degree desired in Computer Science, Information Technology, or related field
  • Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
  • Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and tuning
  • Knowledge of relational and dimensional database structures, theories, principles, and practice
  • Expertise in working with Synapse and related technologies

Professional Skills:

  • Eagerness to contribute in a team-oriented environment
  • Desire to work in an information systems environment
  • Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
  • Passionate about learning new technologies
  • Analytical approach to problem-solving; ability to use technology to solve business problems
  • Ability to work in a fast-paced environment

Additional Preferred Experience:

  • Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies including Azure ML Studio/Services, R programming language
  • Other Azure development expertise including Azure Databricks, Python, Scala, R
  • Other Azure technologies including storage (DataLake, DeltaLake, Blob Storage)
  • Knowledge of relational and dimensional database structures, theories, principles, and practice
  • Certifications are a plus

Don’t meet every single requirement? At 3Cloud we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway.

At this time, we cannot sponsor applicants for work visas.