Sr Data Engineer

InterSources
NY, US
Full-time

Job Title : Sr Data Engineer

Job Location : Remote

Job Type : Contract

Required Skills :

  • 3+ years of AWS Console, S3, Lambda, Kinesis, Glue, and CloudWatch.
  • 3+ years of Kafka streams experience.
  • 5+ years of data engineering, data pipeline development, and ETL experience using Python, SQL, and Snowflake
  • Experience requesting, transforming, and ingesting data from REST and SOAP APIs
  • Proficiency in the Python scripting language, SQL, Cloud databases, and ETL development processes & tools
  • Strong understanding of traditional relational databases, data and dimensional modeling principles, and data normalization techniques
  • Ability to initiate, drive, and manage projects with competing priorities.
  • Ability to communicate effectively with business leaders, IT leadership, and engineers.
  • Must have a passion for data and helping the business turn data into information and action.

Bonus Skills :

  • Experience with data streaming technologies like PySpark
  • Experience with pipeline technologies like DBT, Apache Airflow or FiveTran
  • Experience with MPP technologies and databases
  • Experience with data visualization tools like Tableau or Sigma
  • Experience with container orchestration tools like Docker or Kubernetes
  • Experience with Azure data product offerings and platform
  • Experience working with Salesforce and SAP data.
  • Experience using Terraform or other infrastructure as code tools.

Required Education :

  • Bachelor's degree in information systems, computer science, or related technical field.
  • 30+ days ago
Related jobs
Promoted
Capital One
Queens, New York

Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve re...

Promoted
Capital One
Bronx, New York

Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve re...

Promoted
Capital One
Brooklyn, New York

Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve re...

CVS Health
New York, New York

Within the data engineering department ('Analytics & Behavior Change'), you'll have the opportunity to drive the next level of Medicare product and service quality and member experience at a leading national B2C healthcare brand. We're looking for aspiring data enthusiasts to drive member engagement...

Synkriom Inc
New York, New York
Remote

Healthcare Data Engineer Overall 10+ in IT Experience. Minimum of 8+ years of experience in Healthcare Domain Minimum of 8+ years of experience in Data Engineering. Implementation partner : Virtusa Location :NYC, NY (Remote) Job Description/Skills: Sr. Required technical skills: Py...

InterSources
NY, US

Strong understanding of traditional relational databases, data and dimensional modeling principles, and data normalization techniques. Must have a passion for data and helping the business turn data into information and action. Experience requesting, transforming, and ingesting data from REST and SO...

Ampcus
New York, New York

Duration: Months assignment with the possibility of extension.Location: Mclean, VA/ Richmond, VA/ Plano, TX/ NYC, NY.Python, PySpark, AWS (EMR, Lambda, Step functions, Glue, Dynamo DB, SQS, S)....

Kohler Co.
New York, New York

Data Engineer - Kohler Ventures. In your role as Senior Data Engineer at Kohler Ventures you will:. Design and Implement Data Systems: You will design and implement systems that handle the generation, ingestion, storage, transformation, and serving of data1. Data Lifecycle Management: Manage the com...

Capital One
New York, New York

As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Sno...

GEICO
New York, New York

Strong knowledge of data formats such as Parquet, Avro, ORC, XML, JSON, data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool) or Databricks, and AI/machine learning infrastructure needs. An ideal candidate will have deep expertise in DevOps and a good understanding of...