Sr. Data Engineer
Job Title : Sr. Data Engineer
Location : NYC, NY
Job Type : Contract
Duration : 6 months
Hours : 8.00am 5.00pm
Pay Rate - $36 - $39 / hr on W-2 (No 1099 or C2C)
Job Summary :
Our Client is looking for a Senior Data Engineer to help organize, standardize, and gain insights from the tremendous amount of data generated from the community and auction marketplace.
The ideal candidate has experience across the full stack, and is a self-starter who loves to code, is certified to work with Amazon Web Services (AWS).
Job Duties :
- Develop and maintain data pipelines and warehouses / storage infrastructure via automation
- Maintain current infrastructure while leading the charge as we migrate to AWS
- Develop applications which help software engineers do their jobs at a faster pace with less
overhead
Work closely with development teams to architect and implement applications in a secure
and highly available manner
- Continued support and modernization of WordPress Bring A Trailer website and backends
- Troubleshoot and identify root cause of issues in a complex environment
- Provide 24 / 7 on-call support on a rotating basis
Experience and skills :
Minimum 8 years professional experience deploying and supporting high traffic, scalable
web applications / services
Build data pipelines based on Amazon Kinesis, AWS Lambda, Amazon Glue, and Amazon
Athena
- Build data normalization, transformation, and cleansing processes
- Contribute to the development and maintain data dictionaries, catalogs, schemas, and
metadata
- Design a Data Lake for Analytics, Business Intelligence, and ML use cases
- Proficient in database management systems (SQL and NoSQL)
- Create reports and visualizations suited for different personas
- Familiarity with data engineering and analytics industry best practices and tools such as
DAGs, data modeling, data dictionaries, data governance practices, data QA and
monitoring, etc.
Expertise with the following AWS Services :
- DynamoDB
- Kinesis
- Lambda
- DataLake Formation
- Athena
- SageMaker
- RedShift
- AWS Glue
- QuickSight
We would be thrilled if you have...
- Experience in a consumer-focused technology company.
- Experience with or domain knowledge in the automotive industry, with two-sided markets,
or ecommerce generally
The following benefits are offered for this position : medical, dental, & vision insurance, short-term disability, life and AD&D insurance, and a 401(k) retirement plan.
Everest Consultants is an equal opportunity employer and does not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other characteristic protected by applicable local, state, or federal civil rights laws. #IND
Sr. Data Engineer
We are looking for driven individuals to join our team of passionate data engineers in creating Capital One’s next generation of data products and. You will build data pipeline frameworks to automate high-volume and real-time data delivery for our Hadoop and streaming data hub . You will build data...
Sr. Data Engineer, Amazon Shopping Videos
As a Data Engineer on the Amazon Video Shopping team, you will lead the design and implementation of systems capable of processing, storing and querying large datasets. You will partner with product managers and engineers to help build and support data needs of partner teams, reporting solutions, ma...
Sr Lead Data Platform Engineer, Shopping (remote-eligible)
Sr Lead Data Platform Engineer, Shopping (Remote-Eligible). We are seeking Full Stack Software Engineers who are passionate about marrying data with emerging technologies. Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, col...
Sr Software Engineer, Data Platform
We are seeking a talented Software Engineer to join our dynamic Streaming Compute Team. As a Software Engineer, with your technical expertise you will manage project priorities, deadlines, and deliverables. Collaborate with cross-functional teams to integrate feature service solutions into the broad...
Sr. Data Engineer
Duration: Months assignment with the possibility of extension.Location: Mclean, VA/ Richmond, VA/ Plano, TX/ NYC, NY.Python, PySpark, AWS (EMR, Lambda, Step functions, Glue, Dynamo DB, SQS, S)....
Sr. Data Engineer - Kohler Ventures
Data Engineer - Kohler Ventures. In your role as Senior Data Engineer at Kohler Ventures you will:. Design and Implement Data Systems: You will design and implement systems that handle the generation, ingestion, storage, transformation, and serving of data1. Data Lifecycle Management: Manage the com...
Sr Data Engineer - SQL & Scala (remote)
Work with analytics, data science, and wider engineering teams to help with automating data analysis and visualization needs, advise on transformation processes to populate data models, and explore ways to design and develop data infrastructure. Primary responsibility will be to work closely with th...
Sr. Data Engineer (Platform)
Collaborate with product managers, data scientists, data analysts and engineers to define requirements and data specifications. GoodRx is looking for extremely smart and curious data engineers, who are deft at working with a wide variety of languages, a variety of raw data formats, such as parquet, ...
Sr Data Engineer
KFORCE URGENT REQUIREMENT Looking for candidates regarding the following: POSITION Sr Data Engineer LOCATION Remote DURATION 3+ Months CTH INTERVIEW TYPE Video VISA RESTRICTIONS Independent Consultants only REQUIRED SKILLS Healthcare IDMC (Informatica) AWS Snowfl...
Sr Data Science Engineer
Architect data ingestion, data transformation, data consumption, data governance frameworks. Are you driven to use your expertise in data science engineering to drive the next stage of growth at Adobe? The Customer Analytics & GTM team is focused on using the power of data to deliver optimized exper...