Search jobs > Atlanta, GA > Senior data engineer

Senior Data Engineer

Cargill
Atlanta, Georgia
Full-time

Job Purpose

and Impact

The Senior Data Engineer will take the lead designing, building and operating high performance data centric solutions utilizing the comprehensive big data capabilities for the company’s data platform environment.

In this role, you will treat data as an asset and be a subject matter expert for data access pathways and techniques in collaboration with analysts within the functional data analytics team.

You will also design data structures and pipelines to collect data and design and implement data transformations, combinations or aggregations.

LI-AA1

Key Accountabilities

  • Collaborate with businesses, application and process owners and product team members to define requirements and design product or solutions.
  • Participate in the decision making process related to architecting products solutions.
  • Develop technical products or solutions utilizing big data and cloud based technologies and ensure they are designed and built to be scalable, sustainable and robust.
  • Perform complex data modeling and prepare data in databases for use in various analytics tools and to configurate and develop data pipelines to move and optimize data assets.
  • Provide necessary technical guidance through all phases of product or solution life cycle.
  • Build complex prototypes to test new concepts and develop ideas on reusable frameworks, components and data products or solutions.
  • Help drive the adoption of new technologies and methods within the data engineering team and be a role model and mentor for data engineers.
  • You will work under minimal supervision and independently handle complex issues while referring only the most complex issues to higher-level staff.
  • Other duties as assigned

Minimum Qualifications

  • Bachelor’s Degree in MIS, Statistics, Business or related field
  • 7+ years of IT and business / industry work experience developing data or software applications including : analysis, design, coding, testing, deploying and support of applications
  • 3+ years of experience working with Hadoop or other Big Data platform and building solutions that deliver value through leveraging data as an asset
  • 3+ years experience in SQL Scripting
  • 1+ years applied experience and skills with message or event based platforms : Tibco, IBM MQ, or Kafka, etc.
  • 2+ years applied experience with Java and / or Python
  • 1+ year experience with development using GitHub, TSVS or TFS
  • 1+ year experience with Agile methodology

Preferred Qualifications

  • Applied experience with Snowflake
  • Applied experience in Reporting Tools like Power BI , Tableau etc
  • Applied experience with Cloud platforms including AWS and / or Azure
  • Experience working with various types of data sources such as SAP, JDE, legacy ERP systems
  • Strong interpersonal skills; demonstrated ability to build trust and strong relationships
  • Result orientation and ability to work in ambiguous situations where requirements are not clear, specifications not in detail etc.
  • Strong conceptual strength, strategic thinking, problem solving, technical, and analytical skills.
  • Demonstrated application of strong market awareness and customer focus.
  • Ability to ask next level questions anticipating business inquiries and performing root cause analysis

Minnesota Sick and Safe Leave

Minnesota Sick and Safe Leave accruals of one hour for every 30 worked, up to 48 hours per calendar year unless otherwise provided by law.

Equal Opportunity Employer, including Disability / Vet.

30+ days ago
Related jobs
Promoted
Hispanic Technology Executive Council
Atlanta, Georgia

They must have strong experience using a variety of data analysis methods and data science libraries to build and implement new models. Assess the effectiveness and accuracy of new data sources and data gathering techniques. Research and develop new data models and algorithms to apply to data sets. ...

Promoted
VirtualVocations
Norcross, Georgia

A company is looking for a Senior Data Engineer in Illinois. ...

Olsson Associates Inc.
Atlanta, Georgia
Remote

Senior Electrical Engineer - Arc Flash - Data Center (Remote). As a Senior Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. We are Olsson, a team-based, purpose-driven engineering and design firm. You will serve as ...

Promoted
VirtualVocations
Norcross, Georgia

A company is looking for a Senior Data Annotation Engineer II. ...

Cargill
Atlanta, Georgia

As a Senior Data Engineer at Cargill you work across the full stack to design, develop and operate complex high performance and data centric solutions using our comprehensive and modern data capabilities and platforms. Perform data analysis, handle data modeling and configure and develop data pipeli...

Promoted
VirtualVocations
Norcross, Georgia

A company is looking for a Senior Site Reliability Engineer, Data Engineering. ...

Wikimedia Foundation
Atlanta, Georgia

Senior Site Reliability Engineer, Data Engineering. As a Senior SRE Data Engineer, you will be responsible for the building, maintaining and operating of the data infrastructure that supports the Foundation's fundraising program. The ideal candidate will be an experienced Data Engineer / Site Re...

Epam
Georgia

We seek a Senior DevOps Engineer (Big Data) to join our team and be an essential resource for managing the Big Data platform environment. Are you a DevOps engineer who can easily navigate the world of Big Data? If so, we have an excellent opportunity for you. Release / Deployment / Application Engin...

KION Group
Atlanta, Georgia

Solid experience with architecting and implementing metadata management including data catalogues, data lineage, data quality and data observability for big data workflows. We are seeking a dynamic and highly skilled Senior Data Engineer who has extensive experience building self -service enterprise...

Rialtic, Inc.
Atlanta, Georgia

If you have experience with any of the following, that would be great, but none of these are expectations or requirements: R, Pandas, Numpy, or other dataframe-based or stats/data focused languages and tools; AWS (particularly with regards to Athena, Aurora, MSK, or self-managed PostgreSQL or Kafka)...