Data Engineer IV

Spectrum
Missouri, US
Full-time

Position Type : Full Time Location : Town and Country, Missouri Date Posted : Date posted 08 / 27 / 2024 Areas of interest : Development, Information Technology, Software Engineering Requisition Number : 2024-39292 Business unit : Network Operations EGN319

JOB SCOPE

Responsible for maintaining scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science by gathering and processing raw data at scale.

Profiles data to measure quality, integrity, accuracy, and completeness and delivers solutions by developing, testing, and implementing code and scripts.

Develop data set processes for data modeling, mining, and consumption.

DUTIES AND RESPONSIBILITIES

  • Create and maintain scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science.
  • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
  • Use ETL processes in order to maintain, improve, clean, and manipulate data.
  • Profile data to measure quality, integrity, accuracy, and completeness.
  • Develop and implement tools, scripts, queries, and applications for ETL / ELT and data operations.
  • Design, build, and automate Machine Learning Data Pipeline.
  • Deliver solutions by developing, testing, and implementing code and scripts.
  • Produce reports and uphold data delivery schedules.
  • Manage life cycle of multiple data sources.
  • Work closely with stakeholders on the data demand side (analysts and data scientists).
  • Increase speed to delivery by implementing workload / workflow automation solutions.
  • Perform other duties as assigned.

BASIC / MINIMUM QUALIFICATIONS

  • Bachelor's degree in an engineering discipline or computer science
  • Minimum five (5) years of Hands-on working experience with AWS, RDBMS, SQL, scripting, and coding experience
  • Minimum three (3) years of Linux / Unix / CentOS system admin experience.

REQUIRED QUALIFICATIONS

  • Ability to use a wide variety of open source technologies and cloud services
  • Extensive coding / scripting experience using Python, R, shell scripts
  • Extensive experience with SQL, Tableau, ML Pipeline techniques, and ETL techniques
  • Extensive background in Linux / Unix / CentOS installation and administration; Windows experience preferred
  • Extensive knowledge in data storage that demonstrates knowledge of when to use a file system, relational database, or NoSQL variant
  • Extensive experience with Spark, and Hadoop / Hive
  • Extensive experience with AWS tools and services
  • Extensive familiarity with JavaScript API, Rest API or Data Extract APIs
  • Extensive experience receiving, converting, and cleansing big data
  • Extensive experience with visualization or BI tools, such as Tableau
  • Extensive experience with data virtualization concepts, and software (Denodo, Teiid, Jboss)
  • Extensive experience with data workflow / data prep platforms, such as Infomatica, Pentaho, or Talend
  • Ability to identify and resolve end-to-end performance, network, server, and platform issues
  • Effective attention to detail with the ability to effectively prioritize and execute multiple tasks

PREFERRED QUALIFICATIONS

  • Extensive experience with JavaScript API, Rest API or Data Extract APIs
  • Extensive experience with data workflow / data prep platforms, such as Infomatica, Pentaho, or Talend
  • Expert knowledge of best practices and IT operations in an always-up, always-available service
  • Extensive experience with data virtualization concepts, and software (Denodo, Teiid, JBoss)
  • Extensive experience with AWS tools and services
  • Extensive experience receiving, converting, and cleansing big data
  • Extensive experience with visualization or BI tools, such as Tableau
  • Extensive experience receiving, converting, and cleansing data
  • Extensive knowledge of best practices and IT operations in an always-up, always-available service
  • Ability to create proof of concept experiments for analytics, machine learning, or visualization tools that include hypothesis, test plans, and outcome analysis
  • Leadership experience in advanced operational analytics

EGN319 2024-39292 2024

Here, employees don’t just have jobs, they build careers. That’s why we believe in offering a comprehensive package that rewards employees for their contributions to our success, supports all aspects of their well-being, and delivers real value at every stage of life.

A qualified applicant’s criminal history, if any, will be considered in a manner consistent with applicable laws, including local ordinances.

17 days ago
Related jobs
Spectrum
Missouri, US

Responsible for maintaining scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science by gathering and processing raw data at scale. Extensive knowledge in data storage that demonstrates knowledge of when to use a file...

Promoted
Network and Data Solutions Integrators (NDSI)
St. Louis, Missouri

Deliver simple solutions to complex problems as a Machine Learning Engineer at NDSI. As a Machine Learning Engineer you will help ensure today is safe and tomorrow is smarter. Our work depends on TS/SCI cleared Machine Learning Engineer joining our team to support our intelligence customer in St. HO...

Promoted
PMI (Project Management Institute)
Kansas City, Missouri

JobPosting","title":"QA & Automation Engineer III","datePosted":"2024-09-04T00:00:00","validThrough":null,"description":"QA Automation Engineer (Multiple Openings), Project Management Institute, Inc. QA Automation Engineer (Multiple Openings), Project Management Institute, Inc. The position requires...

Promoted
Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council )
Kansas City, Missouri
Remote

Proven experience in systems engineering, with a focus on hybrid cloud platforms, automated storage systems, and data protection technologies. We are seeking a Systems Engineer who will be responsible for designing, implementing, and maintaining IT infrastructure, focusing on HPE GreenLake, VLM, and...

Promoted
Beacon Hill
Hazelwood, Missouri

We are seeking a talented Software Engineer with a strong background in embedded software engineering utilizing C++ to support a large Aerospace and Defense initiative. Develop software verification plans and ensure software and system level testing is performed to verify correct software functional...

Promoted
Clayco
Overland, Missouri

As a Data Engineer at Clayco, you will play a vital role in designing, building, and maintaining data pipelines and complex data sets to support reporting, advanced analytics, and ad-hoc analysis. We are seeking a highly skilled and motivated Data Engineer to join our dynamic Data Analytics team in ...

Promoted
Watlow
St. Louis, Missouri

Develop data transformation processes to integrate data from various sources and prepare the data for analysis. As a Data Scientist with a specialization in time series analysis, you will play a vital role in supporting the Industry 4. Ensure data processing meets business requirements and industry ...

Promoted
Sentry
California, Missouri

As a Software Engineer, New Grad, you will be coached by a diverse team of multi-talented engineers and will directly impact a complex and growing codebase. Sentry is looking for talented new graduates to join our growing Software Engineering teams. Engineers at Sentry are challenged to solve a rang...

Promoted
Tampa Gardens Senior Living
Kansas City, Missouri

As a Senior QA Engineer in OpenData, you will lead the effort for building the QA framework from the ground up and the overall QA of the Data Platform for OpenData. Bachelor’s degree in computer science/engineering or equivalent. ...

Promoted
DoorDash USA
California, Missouri

You have 2-5 years of experience as a software engineer in infrastructure and/or platform teams. Help us build the world's most reliable, on-demand logistics engine for last-mile delivery! We're bringing on experienced engineers to help us create and maintain a 24x7, no downtime, global infrastructu...