Sr Data Engineer
Hello
We are from MavinsysTalent Acquisition team based on One World Trade Centre New York.We are specializing in IT services and staffing majorly in lateralhiring / contract.
Below is one of our requirement to fillimmediately if youre interested please share your candidature to
Job Title : Sr. DataEngineer
Location : NewYork NY
Duration : 12months
- JobDescription;
- A resultoriented Professional with8 years of experience in Big Data development along with Dataadministration and proposing effective
solutions through an analyticalapproach with a track record of building largescale systems usingBig Data technologies.
- Proficient in cloud platforms such asMicrosoft Azure and AWS harnessing their capabilities for scalableand secure data storage and processing.
- Expertise in diverse data processingframeworks including Spark Apache Flink Apache NiFi and ApacheMapReduce ensuring efficient data
manipulation andanalysis.
- Excellence in using Use Apache Hadoop to workwith Big Data and analyse large data sets.
- Handson experience in ecosystems like HiveSqoop MapReduce Flume and Oozie.
- Proficient in containerization strategiesleveraging Azure Containers and Kubernetes enhancing deployment andscalability of application.
- Work with Data Lakes and Big Data ecosystems(Hadoop Spark Hortonworks Cloudera).
- Track record of results in an Agilemethodology using datadriven analytics.
- Load and transform large sets of structuredsemistructured and unstructured data working with data on AmazonRedshift Apache Cassandra
and HDFS in Hadoop DataLake.
- Proficient in managing databases such asMicrosoft SQL Server and NoSQL (Cassandra) to ensure effective dataorganization and accessibility.
- Skilled with BI tools like Tableau and PowerBI data interpretation modelling data analysis and reporting withthe ability to assist in directing
planning based oninsights.
- Skilled in HDFS Spark Hive Sqoop HBase FlumeOozie and Zookeeper
- Strong scripting skills in SQL Python andScala facilitating the development of efficient data pipelines andanalytics workflows.
- Apply indepth understanding / knowledge ofHadoop architectures and various components such as HDFS MapReduceSpark and Hive.
- Create Spark Core ETL processes to automateusing a workflow scheduler.
- Proficiency in reporting tools like SSRS forgenerating comprehensive and visually appealingreports.
- Experiencedin utilizing various datarelated technologies including ApacheKafka Apache Beam Apache Avro Airflow Snowflake SSMS ERD
AzureADLS and Trifacta to optimize data workflows and analyticsprocesses.
Gained experience in applying techniques tolive data streams from big data sources using Spark andScala.
experience in AWS,Azure,DataEngineering,Data Modelling,DataPipelines,SQL,Hadoop,Python,Hive,Spark,Scala,NoSQL,Snowflake.
Sr. Data Architect - Engineer 3
Expert in engineering data pipelines using various data technologies - ETL/ELT, big data technologies (Hive, Spark) on large-scale data sets demonstrated through years of experience. At least 10 years in-depth, data engineering experience and execution of data pipelines, data ops, scripting and SQL ...
Sr. Data Engineer - DataOps.
Data Engineer to join our dynamic Data Ops team. As part of our team, you'll be shaping the future of data in our organization, crafting scalable data systems that can keep pace with our rapid growth. Partner with analytics leaders & analysts to ensure adherence to data governance & data modeling be...
Sr. Data Architect - Engineer 3
Expert in engineering data pipelines using various data technologies - ETL/ELT, big data technologies (Hive, Spark) on large-scale data sets demonstrated through years of experience. At least 10 years in-depth, data engineering experience and execution of data pipelines, data ops, scripting and SQL ...
Sr Data Science Engineer
Architect data ingestion, data transformation, data consumption, data governance frameworks. Are you driven to use your expertise in data science engineering to drive the next stage of growth at Adobe? The Customer Analytics & GTM team is focused on using the power of data to deliver optimized exper...
Sr. Data Engineer I
Collaborate with product managers, data scientists, data analysts and engineers to define requirements and data specifications. GoodRx is looking for extremely smart and curious data engineers, who are deft at working with a wide variety of languages, a variety of raw data formats, such as parquet, ...
Sr Data Engineer
Within the data engineering department ('Analytics & Behavior Change'), you'll have the opportunity to drive the next level of Medicare product and service quality and member experience at a leading national B2C healthcare brand. We're looking for aspiring data enthusiasts to drive member engagement...
Sr. Data Engineer
Data Engineer to manage and optimize our vector databases and data stores, such as Elastic Search and AWS OpenSearch. The ideal candidate will have a strong background in cloud platforms and SRE principles and experience leading data infrastructure migrations. Manage and maintain vector databases an...
Sr Data Engineer
Leading client is looking for a Sr Data Engineer. You will join an existing team of database engineers working to move towards an Azur platform. Strong knowledge of the Microsoft Azure Data Platform. ...
Sr. Azure Data Engineer
Azure Data Factory, Databricks, Data Lake, and Power BI. Azure Data Engineer: Design, implement, and maintain data solutions using Azure cloud services. Knowledge of data cataloging, data lineage, and metadata management is also important. Azure Databricks Data Engineer Professional Certificate is r...
Sr Data Engineer
Strong understanding of traditional relational databases, data and dimensional modeling principles, and data normalization techniques. Must have a passion for data and helping the business turn data into information and action. Experience requesting, transforming, and ingesting data from REST and SO...