Talent.com
Data Engineer

Data Engineer

Spectraforce TechnologiesRaleigh, NC, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Data Engineer

6 months with the possibility of an extension

Work Type : REMOTE (EST hours)

Note : There is an On Call Rotation to cover Production Support coverage (target rotation is every 4-6 weeks, for one full week), depending on staffing availability while working remotely, candidates should have reliable high-speed internet and end client will provide an Azure Virtual Desktop. The Client Developer Virtual Desktop Infrastructure allows entitled users to access a virtual computer asset to complete tasks and processes relative to their role and responsibilities. Candidate needs to have a Windows laptop / desktop to log into their assigned Client Virtual Desktop. This PC must have a currently supported operating system, which is regularly patched, and has updated commercial anti-malware software. To efficiently do the work, an additional monitor, camera, and a headset are required.

Technical Skills and Qualifications :

  • Years of Experience : 3+ years of professional experience
  • Education Level : 4-Year Bachelor's Degree

Must have :

  • Google Pub / Sub
  • BigQuery
  • Google Dataform
  • Data ingestion to Big Query experience
  • Google Cloud Storage
  • Cloud Composer
  • GitHub
  • SQL
  • Good to have :

  • Cloud Data fusion
  • DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)
  • Experience calling RESTful API's and SOAP Webservices
  • Experience integrating with other Google resources, databases, and services
  • Jira
  • Confluence
  • Position Purpose : Implements simple to complex data ingestion and pipeline processes on Google Cloud Platform using industry-standard best practices. Designs, develops, configures, tests, debugs, and documents these processes based on business requirements and technical architecture specifications. Supports and troubleshoots existing ingestion and pipeline processes and data.

    Responsibilities :

  • Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
  • Works independently and collaboratively with team; keeping the project team and leaders in the loop.
  • Prepares detailed specifications from which data ingestion and pipeline processes are developed.
  • Develops and implements technical solutions by code development and tool configuration.
  • Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects / bugs.
  • Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
  • Participates in project planning and development or assumes responsibility for a project of limited scope.
  • Provides options for and estimates of possible coding.
  • May be responsible for the completion of a phase of a project or small projects depending on complexity.
  • Estimates and tracks time required to complete work, for project budgeting and financial tracking.
  • Conducts and participates in reviews of solution designs, configurations and code.
  • Provides technical expertise for project and baseline support teams.
  • Adheres to security standards to comply in the handling / processing / storing of sensitive data.
  • Adheres to development standards and provides development standards recommendations.
  • Join an On Call Rotation to cover Production Support coverage (target rotation is every 4-6 weeks, for one full week), depending on staffing availability.
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • Raleigh, NC, United States