Search jobs > New York, NY > Sr engineer

Sr. Engineer, Analytics (Streaming)

Purple Fly Solutions
New York, NY, United States
Full-time
Quick Apply

Job Summary :

  • Role : Sr. Engineer, Analytics (Streaming)
  • Location : Remote
  • Duration : Full-time
  • Involved in designing, building, and maintaining real-time analytics infrastructure
  • Works with data scientists, product managers, and other engineers to develop and deploy data pipelines

Responsibilities :

  • Design, build, and maintain large-scale data pipelines using technologies such as Apache Beam, Kafka, Kinesis, Google Cloud Pub / Sub, and DataFlow
  • Develop and implement streaming data processing jobs using Java or Python
  • Collaborate with data scientists and product managers to develop and deploy real-time analytics applications
  • Collaborate with other engineers to integrate data pipelines with data warehouse and data lake
  • Work with cloud providers such as Google Cloud Platform (GCP), Amazon Web Services (AWS), or Microsoft Azure
  • Monitor and troubleshoot streaming pipelines to ensure high availability and performance
  • Implement DevOps principles for efficient and reliable deployment of batch processing systems
  • Knowledge of containerization technologies such as Docker and Kubernetes

Requirements :

  • Bachelor's degree in computer science or a related field
  • Minimum of 5 years of experience in software engineering with focus on data pipelines and analytics
  • Proficient in Java or Python programming
  • Experience with a public cloud provider, preferably GCP
  • Experience with messaging / stream processing systems such as Apache Kafka, Apache Kinesis, Google Cloud Pub / Sub, and Google Cloud DataFlow
  • Experience with data warehousing and data lake technologies
  • Strong understanding of data modeling, data governance, and data security
  • Excellent problem-solving skills and can work independently and collaboratively
  • Excellent communication skills, ability to explain complex technical concepts to non-technical stakeholders
  • Experience with machine learning and data science technologies is a plus
  • Certification in a public cloud provider or a relevant technology is a plus.
  • 3 days ago
Related jobs
Promoted
VirtualVocations
Queens, New York

A company is looking for a Senior Analytics Engineer. ...

Promoted
Amazon
New York, New York

The Analytics Team supporting the Ad Tech Sales and Services organization seeks a Senior Business Intelligence Engineer to join our team in New York City. You will collaborate with a highly technical team of business intelligence and data engineers to deliver solutions to stakeholders across the glo...

Purple Fly Solutions
New York, New York

Engineer, Analytics (Streaming)<br /> - Location: Remote<br /> - Duration: Full-time<br /> - Involved in designing, building, and maintaining real-time analytics infrastructure<br /> - Works with data scientists, product managers, and other engineers to develop and deploy dat...

Early Warning
New York, New York

Engineering at Early Warning (EWS) is a blend of teams organized around many different platforms, capabilities and products that are brought together to power core capabilities at the biggest banks in America – this includes ubiquitous products like Zelle and Paze. The Senior Software Engineer in Te...

DApp360 Workforce LLC
New York, New York

DevOps Engineer, Advanced Analytics. The DevOps Engineer embedded on the company's Advanced Analytics team is responsible for innovating novel approaches to enriching public blockchain data and coordinating fusions of data across the data lake. The DevOps Engineer embedded on an Advanced Analyt...

Amazon.com Services LLC
New York, New York

The Analytics Team supporting the Ad Tech Sales and Services organization seeks a Senior Business Intelligence Engineer to join our team in New York City. You will collaborate with a highly technical team of business intelligence and data engineers to deliver solutions to stakeholders across the glo...

Vimeo
New York, US

Vimeo is looking for an experienced Senior Data Engineer - Analytics to join our Data Architecture & Analytics Engineering team & work closely with Data Analysts & Data Scientists to create & maintain robust, scalable, & sustainable data models that provide decision-making insights for senior leader...

Amazon.com Services LLC
New York, New York

As BIE, you will be be working with product managers and engineers to design and develop new business intelligence solutions using large scale data technologies and drive better decision for Amazon and for the customers. The ideal candidate for this role will have extensive experience in data wareho...

Disney Entertainment & ESPN Technology
New York, New York

Are you passionate about video encoding technologies and optimizing video streaming systems? As a Senior Media Streaming Engineer at Disney, you will be part of the Media Delivery Live team, which is responsible for the entire audio and video encoding supply chain from content acquisition to deliver...

Promoted
VirtualVocations
Queens, New York

A company is looking for a Data Science Analyst. ...