Search jobs > New York, NY > Sr data engineer

Sr. Data Engineer

Capital One
New York, NY
$165.1K-$188.5K a year
Full-time
Part-time

Plano 3 (31063), United States of America, Plano, TexasSr. Data EngineerWe are looking for driven individuals to join our team of passionate data engineers in creating Capital One’s next generation of data products and capabilities.

  • You will build data pipeline frameworks to automate high-volume and real-time data delivery for our Hadoop and streaming data hub
  • You will build data APIs and data delivery services that support critical operational and analytical applications for our internal business operations, customers and partners
  • You will transform complex analytical models into scalable, production-ready solutions
  • You will continuously integrate and ship code into our on premise and cloud Production environments
  • You will develop applications from ground up using a modern technology stack such as Scala, Spark, Postgres, Angular JS, and NoSQL
  • You will work directly with Product Owners and customers to deliver data products in a collaborative and agile environment

Responsibilities :

  • Develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers
  • Master new technologies rapidly as needed to progress varied initiatives
  • Break down complex data issues and resolve them
  • Builds robust systems with an eye on the long term maintenance and support of the application
  • Broader knowledge sharing
  • Understands complex multi-tier, multi-platform systems

Basic Qualifications :

  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 1 year of experience in big data technologies

Preferred Qualifications :

  • Master's Degree
  • 6+ years of experience in application development (Python, SQL, Scala, or Java)
  • 4+ years of experience in big data technologies
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years experience with Distributed data / computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX / Linux including basic commands and shell scripting
  • 4+ years of experience with Agile engineering practices

At this time, Capital One will not sponsor a new applicant for employment authorization for this position.

The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting.

Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.

New York City (Hybrid On-Site) : $165,100 - $188,500 for Senior Data Engineer

30+ days ago
Related jobs
Promoted
VirtualVocations
New York, New York

...

Promoted
Medix Technology
New York, New York

Data Center Infrastructure Engineer onto their team due to growth, and an internal promotion! This person will be responsible for supporting and overseeing various data center and infrastructure projects, and providing configuration/troubleshooting. Senior Data Center Infrastructure Engineer - 23217...

Promoted
Planet Technology
New York, New York

Leading client is looking for a Sr Data Engineer. You will join an existing team of database engineers working to move towards an Azur platform. Strong knowledge of the Microsoft Azure Data Platform. ...

Promoted
Pumex Computing, LLC
New York, New York

Your primary responsibility will be designing, developing, and maintaining robust data pipelines using dbt (Data Build Tool), while ensuring the delivery of clean, transformed data that fuels our data-driven initiatives. In this role, you'll join the AI & Data (AI&D) group as a key member of the Ana...

Capital One
New York, New York

We are looking for driven individuals to join our team of passionate data engineers in creating Capital One's next generation of data products and capabilities. You will build data pipeline frameworks to automate high-volume and real-time data delivery for our Hadoop and streaming data hub. You will...

Intone Networks
New York, New York

Data Engineer LOCATION Remote DURATION 3-6 month contract to hire INTERVIEW TYPE Video VISA RESTRICTIONS None REQUIRED SKILLS Must be very senior/architect level Solid understanding of Data Modeling (can build without ETL tools) Kimball methodology S...

Ampcus
New York, New York

Duration: Months assignment with the possibility of extension.Location: Mclean, VA/ Richmond, VA/ Plano, TX/ NYC, NY.Python, PySpark, AWS (EMR, Lambda, Step functions, Glue, Dynamo DB, SQS, S)....

Kohler Co.
New York, New York

Data Engineer - Kohler Ventures. In your role as Senior Data Engineer at Kohler Ventures you will:. Design and Implement Data Systems: You will design and implement systems that handle the generation, ingestion, storage, transformation, and serving of data1. Data Lifecycle Management: Manage the com...

InterSources
NY, US

Experience and detailed knowledge with ETL, Data Quality, metadata management, Data Engineering, streaming data loads. End to end Cloud Data Lake architecture design & implementation including data ingestion, data modeling and data distribution. Good understanding of data warehousing concepts, data ...

GoodRx
New York, New York

Collaborate with product managers, data scientists, data analysts and engineers to define requirements and data specifications. GoodRx is looking for extremely smart and curious data engineers, who are deft at working with a wide variety of languages, a variety of raw data formats, such as parquet, ...