DTE Energy
Consultant, Data Engineer (Databricks, Spark)
Job Description
This position offers a hybrid work environment, requiring you to work in the office 2 days/week. Candidates must reside near one of our offices in Columbus, OH, Des Moines, IA, or Scottsdale, AZ.
This role will report to the Manager, Data Leader for the CIA team. The CIA team stands for Claims, Internet of Things (IoT) and Advanced Analytics Data Engineering. This role will focus on IoT build and run responsibilities. IoT is an exciting growth area as the industry expects more auto policies to be priced based on usage such as miles driven and driving behavior.
CIA team is looking for an experienced data engineer that will mature our data pipelines in the IOT space.
This role is part of a high performing team that is constantly evolving to meet the needs of the organization. Candidates should be comfortable with ambiguity and rapidly changing directives. Candidates should possess strong relationship building, technical leadership skills and be able to demonstrate strong delivery through partnerships.
Ideal candidate should be:
-
Lifelong Learner
-
Passionate about technology and making Nationwide a leader in usage based insurance policies such as SmartMiles, SmartRide, and SmartHome
-
Able to learn on the fly and fill knowledge gaps on demand
-
Ability to code while teaching others
-
Derives joy from tackling complex problems and working through solution tradeoffs
-
Able to debug problems to their root cause, especially when the path leads through multiple systems or environments
-
Desire to work with streaming datasets at scale
-
Desired experience in: AWS, Spark, Databricks, Unity Catalog, UAC, Cribl, Kafka, Kinesis, SQL,
-
Familiarity with HBase, Scala is a plus
-
Learning how to make the data more valuable for models and customers
Compensation Grade: G5
This role does not qualify for employer-sponsored work authorization. Nationwide does not participate in the Stem OPT Extension program.
#LI-AC1
Job Description Summary
Nationwide’s industry leading workforce is passionate about creating data solutions that are secure, reliable and efficient in support of our mission to provide extraordinary care. Nationwide embraces an agile work environment and collaborative culture through the understanding of business processes, relationship entities and requirements using data analysis, quality, visualization, governance, engineering, robotic process automation, and machine learning to produce targeted data solutions. If you have the drive and desire to be part of a future forward data enabled culture, we want to hear from you.
As a Data Engineer you’ll be responsible for acquiring, curating, and publishing data for analytical or operational uses. Data should be in a ready-to-use form that creates a single version of the truth across all data consumers, including business users, data scientists, and Technology. Ready-to-use data can be for both real time and batch data processes and may include unstructured data. Successful data engineers have the skills typically required for the full lifecycle software engineering development from translating requirements into design, development, testing, deployment, and production maintenance tasks. You’ll have the opportunity to work with various technologies from big data, relational and SQL databases, unstructured data technology, and programming languages.
Job Description
Key Responsibilities:
-
Consults on complex data product projects by analyzing moderate to complex end to end data product requirements and existing business processes to lead in the design, development and implementation of data products.
-
Responsible for producing data building blocks, data models, and data flows for varying client demands such as dimensional data, standard and ad hoc reporting, data feeds, dashboard reporting, and data science research & exploration.
-
Translates business data stories into a technical story breakdown structure and work estimate so value and fit for a schedule or sprint.
-
Responsible for applying secure software and systems engineering practices throughout the delivery lifecycle to ensure our data and technology solutions are protected from threats and vulnerabilities.
-
Creates business user access methods to structured and unstructured data by such techniques such as mapping data to a common data model, NLP, transforming data as necessary to satisfy business rules, AI, statistical computations and validation of data content.
-
Builds data cleansing, imputation, and common data meaning and standardization routines from source systems by understanding business and source system data practices and by using data profiling and source data change monitoring, extraction, ingestion and curation data flows.
-
Facilitates medium to large-scale data using cloud technologies – Azure and AWS (i.e. Redshift, S3, EC2, Data-pipeline and other big data technologies).
-
Collaborates with enterprise DevSecOps team and other internal organizations on CI/CD best practices experience using JIRA, Jenkins, Confluence etc.
-
Implements production processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
-
Develops and maintains scalable data pipelines for both streaming and batch requirements and builds out new API integrations to support continuing increases in data volume and complexity
-
Writes and performs data unit/integration tests for data quality With input from a business requirements/story, creates and executes testing data and scripts to validate that quality and completeness criteria are satisfied. Can create automated testing programs and data that are re-usable for future code changes.
-
Practices code management and integration with engineering Git principle and practice repositories.
-
Participates as an expert and learner in team tasks for data analysis, architecture, application design, coding, and testing practices.
May perform other responsibilities as assigned.
Reporting Relationships: Reports to Director or AVP Data Leader.
Typical Skills and Experiences:
Education: Undergraduate studies in computer science, management information systems, business, statistics, math, a related field or comparable experience and education strongly preferred. Graduate studies in business, statistics, math, computer science or a related field are a plus.
License/Certification/Designation: Certifications are not required but encouraged.
Experience: Five to eight years of relevant experience with data quality rules, data management organization/standards and practices. Solid experience with software development on large and/or concurrent projects. Experience in data warehousing, statistical analysis, data models, and queries. One to three years’ experience with developing compelling stories and distinctive visualizations. Insurance/financial services industry knowledge a plus.
Knowledge, Abilities and Skills: Data application and practices knowledge. Advanced skills with modern programming and scripting languages (e.g., SQL, R, Python, Spark, UNIX Shell scripting, Perl, or Ruby). Strong problem solving, oral and written communication skills. Ability to influence, build relationships, negotiate and present to senior leaders.
Other criteria, including leadership skills, competencies and experiences may take precedence.
Staffing exceptions to the above must be approved by the hiring manager’s leader and HR Business Partner.
Values: Regularly and consistently demonstrates the Nationwide Values.
Job Conditions:
Overtime Eligibility: Exempt (Not Eligible)
Working Conditions: Normal office environment.
ADA: The above statements cover what are generally believed to be principal and essential functions of this job. Specific circumstances may allow or require some people assigned to the job to perform a somewhat different combination of duties.
Benefits
We have an array of benefits to fit your needs, including: medical/dental/vision, life insurance, short and long term disability coverage, paid time off with newly hired associates receiving a minimum of 18 days paid time off each full calendar year pro-rated quarterly based on hire date, nine paid holidays, 8 hours of Lifetime paid time off, 8 hours of Unity Day paid time off, 401(k) with company match, company-paid pension plan, business casual attire, and more. To learn more about the benefits we offer, click here.
Nationwide is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive culture where everyone feels challenged, appreciated, respected and engaged. Nationwide prohibits discrimination and harassment and affords equal employment opportunities to employees and applicants without regard to any characteristic (or classification) protected by applicable law.
Smoke-Free Iowa Statement: Nationwide Mutual Insurance Company, its affiliates and subsidiaries comply with the Iowa Smokefree Air Act. Smoking is prohibited in all enclosed areas on or around company premises as well as company issued vehicles. The company offers designated smoking areas in which smoking is permitted at each individual location. The Act prohibits retaliation for reporting complaints or violations. For more information on the Iowa Smokefree Air Act, individuals may contact the Smokefree Air Act Helpline at 888-944-2247.
