Search jobs > Chicago, IL > Data architect

Data Architect with Medallion Architecture Exp

Magicforce
Chicago, Illinois, USA
Full-time

As a Data Architect you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.

Responsibilities :

Design and architect scalable highperformance and costeffective cloudbased solutions using Azure services and Databricks.

Develop comprehensive architecture blueprints that include data pipelines data warehousing and advanced analytics solutions.

Architect and implement big data processing solutions using Databricks leveraging Apache Spark for data transformation ETL processes and machine learning workflows.

Design data pipelines that handle largescale data ingestion processing and storage.

Implement data security data governance and compliance measures within the Databricks environment using Unity Catalog.

Work closely with Data engineers DevOps teams and other stakeholders to ensure seamless integration of solutions. Collaborate with project managers and business analysts to gather and interpret requirements ensuring technical feasibility and alignment with business objectives.

Analyze and optimize system performance identifying bottlenecks and implementing solutions to enhance processing speed and efficiency.

Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments.

Ensure that all solutions adhere to security best practices and compliance requirements including data encryption access control and logging.

Implement strategies to protect sensitive data and ensure compliance with relevant regulations such as GDPR HIPAA etc.

Deep understanding of Azure services including but not limited to Azure Data Factory Azure Storage Azure SQL Azure Functions etc.

Proficiency in Databricks Apache Spark and related big data technologies.

Strong scripting skills in Python SQL and experience with Terraform or CloudFormation.

Excellent problemsolving skills and the ability to work in a fastpaced environment.

Experience with Kubernetes Docker and containerized applications. Familiarity with data lake architectures Delta Lake and advanced analytics solutions.

Strong understanding of CI / CD pipelines DevOps practices and Infrastructure as Code (IaC).

AZURE, Medallion Architecture, SQL, Databricks and Data Lake

30+ days ago
Related jobs
Promoted
Magicforce
Chicago, Illinois

Architect and implement big data processing solutions using Databricks leveraging Apache Spark for data transformation ETL processes and machine learning workflows. Implement data security data governance and compliance measures within the Databricks environment using Unity Catalog. AZURE, Medallion...

Magicforce
Chicago, Illinois

Architect and implement big data processing solutions using Databricks leveraging Apache Spark for data transformation ETL processes and machine learning workflows. Implement data security data governance and compliance measures within the Databricks environment using Unity Catalog. AZURE, Medallion...

Magicforce
Chicago, Illinois

Architect and implement big data processing solutions usingDatabricks leveraging Apache Spark for data transformation ETLprocesses and machine learning workflows. Implement data security data governance andcompliance measures within the Databricks environment using UnityCatalog. AZURE, Medallion Arc...

Promoted
Photon
Chicago, Illinois

Azure infrastructure Architect with AHA (Auto Healing Architecture) JD. Expertise in Auto Healing Architecture (AHA). Experience with cloud security and governance. Azure Solutions Architect Expert). ...

Promoted
Capgemini
Chicago, Illinois

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future. Well versed with performance testing project activities including requirements gathering, planning, designing scripts and creating test data, executing load tests, reporting observations, serv...

Promoted
Diverse Lynx
Chicago, Illinois

Design and implement ETL processes for data transactions related to Enterprise Data Warehouse, Operational Data Store (ODS), and other data structures to support our Business Intelligence operations. Design and implement ETL processes for data transactions related to Enterprise Data Warehouse, Opera...

Promoted
Fortinet
Chicago, Illinois

Manage various cloud data management systems, including relational databases such as MySQL, time-series datastores such as Influx or similar systems, and in-memory data stores such as Redis. The Cloud Data Storage Engineer is responsible for the design, implementation, and management of FortiMonitor...

Promoted
Hispanic Technology Executive Council
Chicago, Illinois

Data Management and Governance provides direction of data assets and is responsible for data strategy, quality, standards and service levels. Analyst, Salesforce Strategy, Support, and Data Maintenance will perform an integral role in implementation and maintenance of Salesforce processes in additio...

Promoted
Omniscius Consulting
Chicago, Illinois

Our customer is seeking a Data Extraction and Conversion Analyst to support a federal financial investigative unit by performing data extraction, analysis, and conversion to support live investigations in Chicago, IL. Ability to utilize data extraction software to extract/capture data from various f...

Promoted
Intel Corporation
Chicago, Illinois

One of your primary responsibilities as a Solutions Architect will be to help us understand our clients needs and then develop and deploy solutions that will help them grow their businesses. We are currently hiring for the position of Entry Level Solutions Architect. Design and develop solutions tha...