Big Data Engineer

Randstad
Atlanta, Georgia
$45-$75 an hour
Full-time

job summary :

Client Corporation is Fortune-300 transportation company specializing in freight railroading. We operate approximately 21,000 route miles in 22 states and the District of Columbia, serve every major container port in the eastern United States, and provide efficient connections to other rail carriers.

Client has the most extensive intermodal network in the East and is a major transporter of coal and industrial products.

responsibilities :

Big Data Engineers are responsible for architecture, design and build of Big Data applications to support business strategies and deliver business value.

A data engineer participates in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions, and perform data ingestion development and support duties.

Building data ingestion pipelines is highly technical and requires advanced skills with computers and proficiency with Big Data tools and technologies such as SQL, Python / Scala, Spark, Spark Structured Streaming, Spark SQL, Kafka, Sqoop, Hive, Kudu, HBASE, Impala, S3, HDFS, or Cloud platforms such as AWS, GCP, Azure, etc.

Data Engineers require ability to communicate effectively, both written and verbal, and have extensive experience working with business areas to translate their business data needs and data questions into project requirements.

qualifications :

  • Experience level : Experienced
  • Minimum 3 years of experience
  • Education : Bachelors (required)

skills :

  • Data Warehouse
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
Norcross, Georgia

Staff Software Engineer in Big Data. ...

Promoted
Mondo
Atlanta, Georgia

Apply now: Big Data Engineer, a hybrid position local to Atlanta, GA. Experience building data processing pipelines at scale on AWS. Nice to have experience on different monitoring, alerting, dashboarding tools like Datadog and PagerDuty. ...

Promoted
Open Systems Inc.
Atlanta, Georgia

Our client is currently seeking an experienced Data EngineerBig Data individual for their Midtown office in Atlanta, GA. Big Datadata ingestion pipelines, architectures, and data sets. The successful candidate must have Big Data engineering experience and must demonstrate an affinity for workin...

Promoted
JP Morgan Chase & Co.
Atlanta, Georgia

As an AWS Software Engineer III, Big Data and ETL at JPMorgan Chase within Corporate Technology, specifically as a part of Consumer and Community Banking Risk Technology team, your role will be to contribute to an agile team responsible for designing and delivering trusted, market-leading technology...

Highmark Health
GA, Working at Home, Georgia

In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...

Norfolk Southern
Atlanta, Georgia

Implements statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports Data Scientists and analytics and insights creation in data sourcing and preparation to visualize data and synthesize insights of commercial value. Defines data requirement...

Visionaire Partners
Atlanta, Georgia

Hands-on experience building, testing, and optimizing ‘Big Datadata ingestion pipelines, architectures and data sets. Interpreting and delivering impactful strategic plans for improving data integration, data quality, and data delivery in support of business initiatives and roadmaps. Seeking an ex...

Alliance of Professionals & Consultants, Inc.
Atlanta, Georgia

Development tasks on Apache Camel enterprise systems integration at an A&D client.Scope based on requirements, scenarios, and user stories as defined by client functional team.Essential Job Responsibilities:.Burndown of development tasks aligned to scope and program schedule.Required Skills &...

Epam
Georgia

We seek a Senior DevOps Engineer (Big Data) to join our team and be an essential resource for managing the Big Data platform environment. Are you a DevOps engineer who can easily navigate the world of Big Data? If so, we have an excellent opportunity for you. Exposure to Big Data systems Hadoop ecos...

Visionaire Partners
Atlanta, Georgia

Hands-on experience building, testing, and optimizing ‘Big Datadata ingestion pipelines, architectures and data sets. Interpreting and delivering impactful strategic plans for improving data integration, data quality, and data delivery in support of business initiatives and roadmaps. Seeking an ex...