Microsoft Fabric ETL Senior Developer

Role : Microsoft Fabric ETL Senior Developer

Location : Washington, District of Columbia Remote

Duration : 4 Months

• Design, implement, and optimize ETL processes using Microsoft Fabric for a new major application, working closely with an established, globally distributed development team to understand the application architecture, tools, and the processes, established during the build of MVP.
• Ensure that data is efficiently and accurately processed from source systems into the Microsoft Fabric data layer and transformed across the various levels of transformation inside Fabric.
• Collaborate with business analysts and business stakeholders to understand data requirements, transformation rules, and relevant accounting business logic.
• Develop transformation logic to clean, enrich, aggregate, and otherwise modify data to meet business needs. Implement data validation and error handling procedures to ensure data integrity.
• Implement processes to load processed data into Microsoft Fabric data storage or previously worked in technologies like Azure Synapse, Azure Data Lake, etc.

Optimize data loading processes to ensure performance and scalability.

• Design and deploy ETL pipelines using Python and Pyspark within Microsoft Fabric.
• Collaborate with data architects to design the data architecture and models that align with the accounting application requirements.

Implement data schemas, star / snowflake schema designs for data warehouses, and OLAP cubes, as necessary.

• Optimize ETL processes for performance and resource utilization. Implement indexing, partitioning, and other performance enhancements to handle large volumes of data efficiently.
• Develop and execute unit tests, integration tests, and end-to-end tests for ETL processes. Troubleshoot and resolve issues, making improvements and adjustments as needed.
• Validate data accuracy and consistency throughout the ETL lifecycle.
• Create and maintain comprehensive documentation for ETL processes, data sources, data flow diagrams, and data models.
• Ensure documentation is up-to-date and accessible to relevant stakeholders.
• Ensure all data processing complies with relevant policies and standards.
• High proficiency in Microsoft Fabric and related ETL tools (e.g., Azure Data Factory)
• Knowledge of database systems (e.g., SQL Server, Azure SQL Database, Synapse Analytics) and understanding of data warehousing concepts and architecture.
• Experience with data modeling and schema design.
• Familiarity with programming languages used in ETL processes (e.g., Python, Pyspark).
• Strong understanding of data engineering principles, including data modeling, data transformation, and data optimization.
• Strong SQL skills for data extraction, transformation, and querying.
• Knowledge of accounting principles and logic is highly beneficial.

Certifications are nice to have, not required :

• Microsoft Certified : Fabric Analytics Engineer Associate (strongly preferred)
• Microsoft Certified : Azure Data Engineer Associate
• Microsoft Certified : Azure Developer Associate
• Microsoft Certified : Azure Solutions Architect Expert

Additional Skills :

• High proficiency in Microsoft Fabric and related ETL tools (e.g., Azure Data Factory)
• Knowledge of database systems (e.g., SQL Server, Azure SQL Database, Synapse Analytics) and understanding of data warehousing concepts and architecture.
• Experience with data modeling and schema design.
• Familiarity with programming languages used in ETL processes (e.g., Python, Pyspark).
• Strong understanding of data engineering principles, including data modeling, data transformation, and data optimization.
• Strong SQL skills for data extraction, transformation, and querying.
• Knowledge of accounting principles and logic is highly beneficial.
2 days ago