Data Engineer

Open Systems Technologies
Alpharetta, GA, US
$69 an hour
Full-time

A financial firm is looking for a Data Engineer to join their team in Alpharetta, GA.

Pay : $69 / hr

Hybrid - 3 days per week onsite

Responsibilities :

  • Able to establish, modify or maintain data structures and associated components according to design
  • Understands and documents business data requirements
  • Able to come up with Conceptual and Logical Data Models at Enterprise, Business Unit / Domain Level
  • Understands XML / JSON and schema development / reuse, database concepts, database designs, Open Source and NoSQL concepts
  • Work with Sr. Data Engineers and Sr. Data architects to create platform level data models and database designs
  • Takes part in reviews of own work and reviews of colleagues' work
  • Able to participate in assigned team’s software delivery methodology (Agile, Scrum, Test-Driven Development, Waterfall, etc.

in support of data engineering pipeline development

  • Understands infrastructure technologies and components like servers, databases, and networking concepts
  • Write code to develop, maintain and optimized batch and event driven for storing, managing, and analyzing large volumes of structured and unstructured data both
  • Metadata integration in data pipelines
  • Automate build and deployment processes using Jenkins across all environments to enable faster, high-quality releases

Qualifications :

Up to 4 years of software development experience in a professional environment and / or comparable experience such as :

  • Understanding of Agile or other rapid application development methods
  • Exposure to design and development across one or more database management systems DB2, SybaseIQ, Snowflake as appropriate
  • Exposure to methods relating to application and database design, development, and automated testing
  • Understanding of big data technology and NOSQL design and development with variety of data stores (document, column family, graph, etc.)
  • Knowledge of distributed (multi-tiered) systems, algorithms, and relational & non-relational databases
  • Experience with Linux and Python scripting as well as large scale data processing technology such as spark
  • Exposure to Big Data technology and NoSQL design and coding with variety of data stores (document, column family, graph, etc.)
  • Experience with cloud technologies such as AWS and Azure, including deployment, management, and optimization of data analytics & science pipelines
  • Nice to have : Collibra, Terraform, Java, Golang, Ruby, Machine Learning Operation deployment
  • Bachelor’s degree in computer science, computer science engineering, or related field required
  • 30+ days ago
Related jobs
Aquesst
Alpharetta, Georgia

Advanced proficiency of Linux, security engineering, computer and network security, IP protocols. Experience with security related data analysis. ...

merchant e-Solutions
Alpharetta, Georgia

Build the reporting data model and help the data engineering team with creating views, SQL scripts. Provide data engineering with functional and technical requirements to improve efficiency of data pipelines. Perform dataflow, system and data analysis and develop meaningful and useful presentation o...

LexisNexis Risk Data Management, LLC Company
Alpharetta, Georgia

Global companies and governmental entities rely on us to solve their most complex data challenges. ...

Highmark Health
GA, Working at Home, Georgia

Performs modeling of data sources and flows, works with data management staff to define an operational framework that will define, develop and implement policies and security frameworks to ensure precise and secure delivery of knowledge and information. Perform modeling of data sources and flows, wo...

Open Systems Technologies
Alpharetta, Georgia

Data architects to create platform level data models and database designs. Understands XML/JSON and schema development/reuse, database concepts, database designs, Open Source and NoSQL concepts. Metadata integration in data pipelines. Understanding of big data technology and NOSQL design and develop...

QTS Data Centers
Suwanee, Georgia

In this role, the Security Operations Engineer will provide organizational expertise in usage of security equipment, train and monitor utilization and support physical sites as required. Work closely with co-workers, maintenance personnel, project managers, building managers, engineers, and contract...

Headway tek
Georgia, USA

Job Title: Big Data Engineer</b></p> <p><b>Job Location: Atlanta, GA (Onsite Day one)</b></p> <p><b>Experience : 8years </b></p> <p> </p> <p><b> </b></p> <p><b><u>Job Descripti...

QTS Data Centers
Suwanee, Georgia
Remote

But where does all that information go? Enter the world of data centers. Data centers are experiencing once-in-a-generation demand growth, driven by cloud adoption and the AI revolution,” Jon Gray, President & COO of Blackstone. In the fast-paced world of data, QTS is dedicated to leading the indust...

merchant e-Solutions
Alpharetta, Georgia

Build the reporting data model and help the data engineering team with creating views, SQL scripts. Provide data engineering with functional and technical requirements to improve efficiency of data pipelines. Perform dataflow, system and data analysis and develop meaningful and useful presentation o...

Penske Transportation Solutions
Duluth, Georgia

Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility and foster data-driven decision making across the organization. Develop and maintain scalable data pipelines and build out new API integrations to support continuin...