Key Accountabilities :
- Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting
- If necessary, create prototypes to validate proposed ideas and solicit input from stakeholders
- Grasp of and expertise with test-driven development and continuous integration processes
- Analysis and Design - Converts high-level design to low-level design and implements it
- Collaborate with Team Leads to define / clarify business requirements, estimate development costs, and finalize work plans
- Run unit and integration tests on all created code - Create and run unit and integration tests throughout the development lifecycle
- Benchmark application code proactively to prevent performance and scalability concerns
- Collaborate with the Quality Assurance Team on issue reporting, resolution, and change management
- Support and Troubleshooting - Assist the Operations Team with any environmental issues that arise during application deployment in the Development, QA, Staging, and Production environments
- Assist other teams in resolving issues that may develop as a result of applications or the integration of multiple components
Knowledge and Experience :
- Understanding of design concepts and architectural basics
- Knowledge of performance engineering
- Understanding of quality processes and estimate methods
- Fundamental grasp of the project domain
- The ability to transform functional and nonfunctional needs into system requirements.
- The ability to develop and code complicated applications is required.
- The ability to create test cases and scenarios based on specifications.
- Solid knowledge of SDLC and agile techniques
- Knowledge of current technology and trends
- Logical thinking and problem-solving abilities, as well as the capacity to collaborate
- Primary skills : Cloud Platform, Azure, Databricks, ADF, ADO
- Sought : SQL, Python, PowerBI
- General Knowledge : PowerApps, Java
- Some hands-on software development experience thru internships with exposure to cloud computing required
Education :
- Bachelor of Science in Computer Science, Engineering, Statistics or related technical field
Data Center Engineer - TS/SCI CI Poly
Zachary Piper is seeking a Data Center Engineer- TS/SCI CI Poly in the Raleigh-Durham, North Carolina area for a leading global technology organization. The Data Center Engineer - TS/SCI CI Poly must work onsite in the SCIF 5 days a week. The Data Center Engineer must hold an active TS/SCI with CI P...
Palantir Foundry Data Engineer
A company is looking for a Palantir Foundry Data Engineer (remote). ...
Junior Data Scientist/Analyst/Engineer - Remote
Currently, we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Data Engineers, Machine Learning engineers for full time positions with clients. We want Data Science/Machine learning/Data Analyst and Java Full stac...
Data Ops Engineer
A company is looking for a DataOps Engineer to build and support data teams for rapid and quality-controlled data analytics. ...
Azure Data Engineer (DataBricks/Synapse)
In this role, you will work directly with the clients to lead critical modules in the Data Engineering program, which will include metadata management, data catalog, data quality, process/workflow definition implementation, Reporting, Delivery, etc. At least 2 years of experience in designing, imple...
Apache NiFi Data Engineer
A company is looking for an Apache NiFi Data Engineer to design and manage data flows within Apache NiFi. ...
Senior Software Development Engineer, Developer Experience
We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security expert...
ITPROUS_PS_NC_102324_749832_ Data Engineer
The work involves developing and maintaining data models, schemas, and databases to support data conversion needs. The Department of Health and Human Services (DHHS) requires the assistance of contract resources to serve as Data Engineers. The primary purpose of these positions is to analyze, map, b...
Azure Databricks - Data Engineer
At least 2 years of experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Azure Synapse AnalyticsHands on experience in end-to-end implementation of data warehouse and data martsExperience in writing SQL queries to analysis Ty...
Analytic Data Engineer – Databricks
This role within the 'Data Engineering & Self-Service Products' team involves architecting and engineering analytic data solutions, including designing and developing data marts in Databricks using PySpark or Spark SQL, building interactive Power BI dashboards to visualize KPIs and trends, and creat...