Sr Data Engineer

InterSources
NY, US
Full-time

Job Title : Sr Data Engineer

Job Location : Remote

Job Type : Contract

Required Skills :

  • 3+ years of AWS Console, S3, Lambda, Kinesis, Glue, and CloudWatch.
  • 3+ years of Kafka streams experience.
  • 5+ years of data engineering, data pipeline development, and ETL experience using Python, SQL, and Snowflake
  • Experience requesting, transforming, and ingesting data from REST and SOAP APIs
  • Proficiency in the Python scripting language, SQL, Cloud databases, and ETL development processes & tools
  • Strong understanding of traditional relational databases, data and dimensional modeling principles, and data normalization techniques
  • Ability to initiate, drive, and manage projects with competing priorities.
  • Ability to communicate effectively with business leaders, IT leadership, and engineers.
  • Must have a passion for data and helping the business turn data into information and action.

Bonus Skills :

  • Experience with data streaming technologies like PySpark
  • Experience with pipeline technologies like DBT, Apache Airflow or FiveTran
  • Experience with MPP technologies and databases
  • Experience with data visualization tools like Tableau or Sigma
  • Experience with container orchestration tools like Docker or Kubernetes
  • Experience with Azure data product offerings and platform
  • Experience working with Salesforce and SAP data.
  • Experience using Terraform or other infrastructure as code tools.

Required Education :

  • Bachelor's degree in information systems, computer science, or related technical field.
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
New York, New York

Computer Science or similar technical fieldExperience as a professional software engineer with expertise in JavaExperience in building large-scale distributed systems and working with databasesStrong AWS knowledge and architectural experienceStrong ownership mentality and drive to solve important pr...

mavinsys
New York, New York

AWS,Azure,DataEngineering,Data Modelling,DataPipelines,SQL,Hadoop,Python,Hive,Spark,Scala,NoSQL,Snowflake. A resultoriented Professional with8 years of experience in Big Data development along with Dataadministration and proposing effective. Excellence in using Use Apache Hadoop to workwith Big Data...

GoodRx
New York, New York

Collaborate with product managers, data scientists, data analysts and engineers to define requirements and data specifications. GoodRx is looking for extremely smart and curious data engineers, who are deft at working with a wide variety of languages, a variety of raw data formats, such as parquet, ...

S&P Global
New York, New York

To provide technical expertise in the resolution of data-related issues, including data quality, data lineage, and data processing errors. In this role, Data Engineers are expected to work collaboratively and efficiently, ensuring that the data needs of the team are met and maintaining the highest s...

Synkriom Inc
New York, New York
Remote

Healthcare Data Engineer Overall 10+ in IT Experience. Minimum of 8+ years of experience in Healthcare Domain Minimum of 8+ years of experience in Data Engineering. Implementation partner : Virtusa Location :NYC, NY (Remote) Job Description/Skills: Sr. Required technical skills: Py...

Ampcus
New York, New York

Duration: Months assignment with the possibility of extension.Location: Mclean, VA/ Richmond, VA/ Plano, TX/ NYC, NY.Python, PySpark, AWS (EMR, Lambda, Step functions, Glue, Dynamo DB, SQS, S)....

Kohler Co.
New York, New York

Data Engineer - Kohler Ventures. In your role as Senior Data Engineer at Kohler Ventures you will:. Design and Implement Data Systems: You will design and implement systems that handle the generation, ingestion, storage, transformation, and serving of data1. Data Lifecycle Management: Manage the com...

Intone Networks
New York, New York

KFORCE URGENT REQUIREMENT Looking for candidates regarding the following: POSITION Sr Data Engineer LOCATION Remote DURATION 3+ Months CTH INTERVIEW TYPE Video VISA RESTRICTIONS Independent Consultants only REQUIRED SKILLS Healthcare IDMC (Informatica) AWS Snowfl...

Jobot
New York, New York

Electrical Engineer PE (Data Centers/Mission Critical) - Competitive Salary, Bonus, Benefits, Work/Life Balance!!!. Electrical Engineer with Data Center / Mission Critical Project Experience. Experience filling the role of data center design engineer for concurrent projects. We are an award winning ...

Early Warning Services
New York, New York

This position functions as a strategic individual contributor expected to solve enterprise-wide engineering problems in a fast-paced and collaborative environment. Consults and collaborates closely with Engineering leaders, Architecture, Security, and potentially external collaboration partners (FIs...