Data Engineer

Seneca Resources
NC, United States
Full-time
We are sorry. The job offer you are looking for is no longer available.

Position Title : Data Engineer

Location : Remote (preference for Central Eastern Time Zones)

Position Status : Long-term Contract

Position Description :

Our client is developing a cloud-based Common Data Platform (CDP) that serves as a comprehensive solution for data management and analytics.

To support this initiative, they are seeking consulting services with strong data engineering capabilities to enhance their delivery capacity.

Ideal candidates should have deep expertise in Immuta and Starburst, with additional experience in Databricks, Collibra, and / or Alteryx being highly desirable.

Key Responsibilities :

  • Perform data engineering and analytics work.
  • Perform data ingestions.
  • Troubleshoot and resolve issues during testing and validation activities. Provide data engineering consulting expertise especially in the areas of Starburst and Immuta.
  • Deliver assigned stories to include the following :
  • Design
  • Structured query language ( SQL ) orchestration
  • Data ingestion pipeline builds
  • Data modeling
  • Coding to include pair programming
  • Data analytics solutions
  • Code reviews
  • Documentation including data models
  • Automated tests
  • Automation, logging, and alerting
  • Troubleshooting and defect resolution
  • Support data migration

Qualifications :

An ideal candidate for this role would be someone with a strong background in data engineering, specifically focused on data governance, security, and distributed analytics.

They should have hands-on experience with both Immuta and Starburst, be comfortable working in a cloud environment, and have a good understanding of regulatory compliance and data privacy requirements.

  • Data Engineer with a specialization in data governance, security and analytics with in a modern data architecture
  • Should have primary expertise in Immuta and Starburst; Secondarily with Databricks, Collibra, and / or Al-teryx.
  • Understanding of data privacy laws and regulations, such as GDPR or CCPA, and how they are implemented within Immuta.
  • Strong SQL because Starburst is a distributed SQL engine
  • Experience optimizing complex queries in Starburst
  • Experience with Modern Data Platforms (e.g., AWS, Azure, GCP)
  • Understanding of distributed data systems, data lakes, and data warehouses and how they interact with Immuta and Starburst.
  • Programming in Python or Java for custom integrations or automations
  • Experience building and managing data pipelines that integrate with Immuta for governance and Starburst for Analytics.
  • Secondary technologies data bricks, Collibra (data governance and data management platform )and / or Alteryx (data analytics platform)

About Seneca Resources :

Seneca Resources is a client driven provider of strategic Information Technology consulting services and Workforce Solutions to government and industry.

Seneca Resources is a leading IT services provider with offices in Virginia, Alabama, Georgia, Florida, and North Carolina that service clients throughout the United States.

We are an Equal Opportunity Employer and value the benefits of diversity in our workplace.

30+ days ago
Related jobs
Promoted
Sumitomo Mitsui Banking Corporation (SMBC)
Charlotte, North Carolina

This role will be involved in the active development of the data platform, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains. As a result of this expansion, we are seeking an experienced software engineer, with 3+ year...

Promoted
VirtualVocations
Durham, North Carolina

A company is looking for a Data Integration Engineer for a remote opportunity. ...

Promoted
Golden Technology
Raleigh, North Carolina

Strong understanding of data warehousing (specifically working with Kimball-style dimensional models), data architecture, data quality processes, and database design, both logical and physical. Your skills in data modeling, advanced SQL, and cloud tools like Databricks, Azure Data Factory, and Azure...

Promoted
VirtualVocations
Durham, North Carolina

A company is looking for an IRIS Data Engineer. ...

Promoted
TD
Charlotte, North Carolina

Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and management, data provenance and lineage, and other specialized data management functions. Elicits, analyzes...

Promoted
VirtualVocations
Asheville, North Carolina

A company is looking for a Lead Data Analytics Engineer. ...

Magicforce
Raleigh, North Carolina

Hands on in Databricks SQL PySpark Expertise in data modelling datamappings understand the data model changes and propose the bestpractices andguidelines. Proficient in all Databricks engineering servicesUnity Catalog Spark Jobs Delta Live Table (DLT) DLT Meta DatabricksWorkflow AutoLoader. Experien...

CVS Health
High Point, North Carolina

Duties include: develop large scale data structures and pipelines to organize, collect and standardize data to generate insights and addresses reporting needs; write ETL (Extract/Transform/Load) processes, design database systems, and develop tools for real-time and offline analytic processing; coll...

The Hartford
Charlotte, North Carolina

The Small Commercial Analytics Office is seeking an enthusiastic Data Engineer to deliver data and analytical capabilities for the Small Commercial business area. The engineer will play a critical role in the enablement of the segment’s data strategy, including the migration of data pipelines to the...

Truist
Charlotte, North Carolina

Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging. As an Azure Data Engineer, master data integration and ETL tools crucial for seamless data processing. In-depth knowledge of Azure cloud data solutions, relational databases, ETL/ELT...