Job Summary :
For a complete understanding of this opportunity, and what will be required to be a successful applicant, read on.
We are seeking a skilled and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support data-driven decision-making.
You will collaborate with data scientists, analysts, and other stakeholders to ensure data is readily available, reliable, and of high quality.
Key Responsibilities :
Experience is a MUST with last 3-4 years Should have experience in using Pyspark Working experience on KUSTO for telemetry data Should be able to write python code in Azure Synapse Notebook.
Good understanding working experience of Azure Synapse end-to-end. Should have experience in working with Spark structured streaming data possibly from Event hubs Should have experience in handing large volume of data possibly in 100s of GB Should be able to debug and fine tune the jobs note book for optimum memory consumption and processing.
Should have knowledge of Data warehousing, data management for efficient data handling. Should have good knowledge of data modeling data engineering work Experience working with large data sets using SQLAzure Data LakePySparkADFSynapse, etc.
to derive actionable insights is highly desirable. They should be productive soonest possible post joining. Nice To Have Local Redmond resourcePST working hour resource Microsoft ecosystem knowledge.
Azure Devops Azure WebAppsfunctions Azure Cosmos Dbeventhub
1.) To be responsible for providing technical guidance or solutions ;define, advocate, and implement best practices and coding standards for the team.
2.) To develop and guide the team members in enhancing their technical capabilities and increasing productivity
3.) To ensure process compliance in the assigned module, and participate in technical discussionsorreview as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4.) To prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.
J-18808-Ljbffr
Lead Data Management Engineer (Intelligence Center) - Security Clearance Required
The ideal candidate has a deep understanding of data management, experience developing data management plans, strategies, and policies, and brings the ability to explain and implement the best data practices found in the government, public, and private sectors while being an objective, informed part...
Data Engineer, Technical Lead
The National Security Sector at Leidos is hiring for a Data Engineer, Technical Lead to lead the design, development, and implementation of a new data warehouse, ensuring it effectively aggregates data from diverse sources within the the Agency's operational ecosystem. The successful candidate will ...
Technical Lead Data Engineer
As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support data-driven decision-making. To ensure process compliance in the assigned module, and participate in technical discussionsorreview as a technical consultant fo...
Software Engineer Technical Lead
A company is looking for a Software Engineer Technical Lead to lead engineering teams in transforming their application landscape. ...
Logistics Technical Data Analyst Lead - Washington, D.C.
As a Logistics Technical Data Analyst Lead you will be on a dynamic team, supporting Team Submarine and provide logistic and maintenance support to one of our customers with the U. Oversee and manage VIRGINIA Class logistics technical data (LTD) products. Integrate safety, obsolescence, and engineer...
Lead Digital Data Engineer
A company is looking for a Lead Digital Data Engineer to oversee data architecture and optimization efforts. ...
Lead Data Engineer (Python, AWS, Kafka)
Lead Data Engineer (Python, AWS, Kafka). As a Capital One Lead Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data Engineer. Utilize programming languages like Java, Scala,...
Lead Data Scientist/Machine Learning Engineer (Singapore-based, relocation provided)
Our ultimate goal is to enable and increase the use of data in the company through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. As part of the Data Science and Machine Learning (AI...
Technical Lead – ERP Data Integrations
Technical Lead – ERP Data Integrations and Data Management to develop solutions for the movement of data between systems, data storage, and data integrity. Optimize data analysis and testing of data transformations, ensuring accuracy and quality of data. Experience must include a minimum of: 5 years...
Data Engineer, Lead
As a lead big data engineer at Booz Allen, you’ll use your expertise to lead data engineering activities on some of the most mission-driven projects in the industry. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. Here, you’...