Talent.com
Lead Databricks Data Architect

Lead Databricks Data Architect

Purple DriveAtlanta, GA, Georgia, USA
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Title : Lead Databricks Data Architect

Location : Atlanta, GA (Onsite / Hybrid / Remote as per requirement)

Experience : 8 – 10 Years

Job Type : Full Time

Job Overview

We are seeking an experienced Lead Databricks Data Architect to design and implement robust, scalable, and secure cloud-based data solutions. This role involves working with Azure cloud services, leading development of data ingestion pipelines, and optimizing data architecture to meet evolving business needs.

Key Responsibilities

  • Architect and build end-to-end data solutions using Azure Databricks, Azure Data Factory, and Azure SQL Database.
  • Lead the development of real-time and batch data pipelines using Delta Live Tables (DLT) and Structured Streaming.
  • Collaborate with stakeholders to translate business requirements into scalable data warehouse solutions on Azure.
  • Provide strategic leadership for large-scale data programs and ensure alignment with organizational goals.
  • Drive performance optimization of Spark jobs and Databricks workflows through advanced tuning techniques.
  • Build and maintain metadata-driven ingestion frameworks to support automation and scalability.
  • Work cross-functionally with data scientists, analysts, and other stakeholders to deliver business-aligned data solutions.
  • Implement data governance, quality checks, and security measures to maintain data integrity and compliance.
  • Monitor and enhance cloud-based data infrastructure for performance and cost-efficiency.
  • Lead or support migration and upgrade efforts of legacy applications (e.g., .NET Framework) to cloud platforms.
  • Utilize Azure DevOps tools including Git, pipelines, and work item management.
  • Troubleshoot issues on Windows Server environments (e.g., IIS, Event Viewer, Performance Monitor).
  • Participate in Agile / Scrum ceremonies including sprint planning, retrospectives, and daily standups.

Technical Skills Required

  • Strong proficiency in :

    • Azure Databricks, ADF, Azure SQL

  • Apache Spark (job tuning and internals)
  • Structured Streaming, Delta Live Tables
  • Experience in :
  • .NET Frameworks 4.8.2 and Core 6 / 8
  • ASP.NET MVC, Blazor, WebForms
  • Web services & API integrations
  • Microsoft SQL Server (DDL, DML, stored procedures)
  • Nota Fiscal integration (Preferred in finance / logistics / related domains)
  • Familiarity with :

    • Azure authentication and key vault

  • Agile / Lean methodologies

    • Preferred Qualifications

  • Proven experience designing and delivering enterprise-level cloud data platforms.
  • Ability to lead cross-functional teams and mentor junior developers.
  • Excellent communication, documentation, and stakeholder management skills.

    • Familiarity with CI / CD and infrastructure-as-code in cloud environments.

    serp_jobs.job_alerts.create_a_job

    Data Architect • Atlanta, GA, Georgia, USA

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Director of Data, Analytics & AI

    Director of Data, Analytics & AI

    SageNet LLCMarietta, GA, US
    serp_jobs.job_card.full_time
    Empowering Connections, Inspiring Possibility.SageNet is a leading managed services provider specializing in connectivity, digital signage and cybersecurity. The company connects, manages and protec...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Medical Device Sales – Paid Internship

    Medical Device Sales – Paid Internship

    Medical Sales CollegeGriffin, Georgia, US
    serp_jobs.job_card.internship
    Description Medical Device Sales - Paid Internship Looking for a rewarding and lucrative career in the medical sales industry? Our paid Internship may be the right path for you! Here are just some ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Algebra Private Tutoring Jobs Stonecrest

    Algebra Private Tutoring Jobs Stonecrest

    SuperprofStonecrest, GA, United States
    serp_jobs.job_card.full_time +1
    Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Information Technology Professional

    Information Technology Professional

    U.S. NavyMableton, GA, United States
    serp_jobs.job_card.full_time +1
    To be eligible to enlist in the U.Navy, candidates must be between the ages of 18-34.At any given moment, hundreds of complex networked computer systems are operating in tandem to keep ships and su...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Cloud Architect

    Senior Cloud Architect

    Apex InformaticsAtlanta, GA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    The Senior Technical Architect is responsible for participating in the working with GTA to design, develop and implement IT architecture to meet application Migrations and AWS cloud implementations...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Scribe

    Scribe

    Ankle and Foot Centers of GeorgiaPeachtree City, GA, US
    serp_jobs.job_card.full_time
    Medical Scribes are individuals who assist a physician throughout their shift.The primary goal of a Medical Scribe is to increase the efficiency and the productivity of the physician they are worki...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Area Manager (ATL7), ATL7

    Area Manager (ATL7), ATL7

    AmazonUnion City, GA, US
    serp_jobs.job_card.full_time
    Our WW Operations network delivers millions of packages and smiles to Amazon customers every day.We are looking for motivated, customer-focused individuals who want to join our team as an Area Mana...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Sr. Data Architect

    Sr. Data Architect

    Sunrise SystemsAtlanta, Georgia, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Location : Atlanta, GA (Hybrid).Duration : 08 months of contract.Plans and schedules team resources, status reporting and completion of required documentation for team assignment and projects.Analyze...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.new
    Data Automation Architect

    Data Automation Architect

    Techcliff GroupAtlanta, GA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    MessageBody"> About the Role : We are seeking an experienced Data Automation Architect to design and implement scalable data arc...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Warehouse Manager

    Warehouse Manager

    Beverage SouthGriffin, GA, US
    serp_jobs.job_card.full_time
    Warehouse Manager reports directly to the General Sales Manager.Responsible for organizing and managing the warehouse operations and warehouse personnel to be efficient and minimize the cost of the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Architect (Microsoft Fabric & Azure Databricks)

    Data Architect (Microsoft Fabric & Azure Databricks)

    Sunrise SystemsAtlanta, Georgia, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Data Architect (Microsoft Fabric & Azure Databricks).Location : Atlanta, Georgia (Hybrid).Duration : 06 months of contract. Supervises the coordination of design and security for comput...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    A48.Business Intelligence Architect / Developer ID 64220

    A48.Business Intelligence Architect / Developer ID 64220

    FHRAtlanta, GA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Our direct client has an opening for an Business Intelligence Architect / Developer ID 64220.This position is 14 months with the option of extension, and the client is in. Review and analyze the curre...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Cloud Architect

    Senior Cloud Architect

    Apidel TechnologiesAtlanta, GA, US
    serp_jobs.job_card.full_time
    The Senior Technical Architect is responsible for participating in the working with GTA to design, develop and implement IT architecture to meet application Migrations and AWS cloud implementations...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Cloud Application Architect

    Senior Cloud Application Architect

    Sunrise SystemsAtlanta, Georgia, United States
    serp_jobs.job_card.temporary
    serp_jobs.filters_job_card.quick_apply
    Job Title : Senior Cloud Application Architect.Location : Atlanta, GA (Hybrid).As a Senior Cloud Application Architect, you will be at the forefront of designing and implementing scalable, efficient,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    AWS Data Architect

    AWS Data Architect

    ProArchAtlanta, GA, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Seeking an experienced AWS Data Architect to lead the architecture and evolution of our Enterprise Unified Data Platform (UDP). This platform is a core enabler of healthcare data modernization, focu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Sales Consultant

    Sales Consultant

    Haverty's Furniture Company, Inc.McDonough, GA, US
    serp_jobs.job_card.full_time
    Havertys is actively seeking individuals who wish to pursue a successful and gratifying career in the retail furniture industry. Retail Furniture Sales Consultant.The ideal candidate is highly drive...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    FT Day Lead Rad Tech 3

    FT Day Lead Rad Tech 3

    Wellstar Health Systems, Inc.Austell, GA, United States
    serp_jobs.job_card.full_time
    How would you like to work in a place where your contributions and ideas are valued? A place where you can serve with compassion, pursue excellence and honor every voice? At Wellstar, our mission i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Leader - AI / ML and Data Analytics Transformation

    Senior Leader - AI / ML and Data Analytics Transformation

    E-SolutionsAtlanta, GA, US
    serp_jobs.job_card.full_time
    Senior Leader - AI / ML And Data Analytics Transformation.Location : Atlanta, GA or Dallas, TX (Hybrid Preferred).Job Type : Full-time With IT Convergence Experience.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days