Talent.com
Databricks Engineer

Databricks Engineer

Inherent TechnologiesSan Francisco, CA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

As a Databricks Engineer, you will play a pivotal role in crafting and optimizing Microsoft Azure solutions to meet dynamic client needs. This position offers the opportunity to leverage your expertise in Azure technologies to drive impactful projects that align with the company's strategic objectives. Your work will significantly contribute to enhancing data-driven decision-making and operational efficiency across diverse business units.

DETAILED RESPONSIBILITIES :

  • Design and develop software solutions to implement innovative features and support existing applications.
  • Ingest and integrate data from various source systems into the Azure Analytics Platform using Azure Databricks and Azure Data Factory.
  • Construct robust Azure Data Factory (ADF) pipelines to facilitate efficient data ingestion and transformation processes.
  • Collaborate with the technical team to provide design and coding support, ensuring project deliverables are met.
  • Engage with clients to gather and interpret business requirements, translating them into actionable solutions.

SKILL REQUIREMENTS :

  • Demonstrated technical proficiency with the Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS).
  • Expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage / Data Lake.
  • Experience with ETL processes and strong analytical skills for report development.
  • Proficiency in relational databases and SQL language.
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • OTHER REQUIREMENTS (OPTIONAL) :

  • Experience with Python scripting and Spark APIs is highly desirable.
  • Previous experience in a client-facing role will be advantageous.
  • Familiarity with agile development methodologies and practices.
  • Skill Matrix : Skill or Category

    Mandatory / Non-Mandatory

    Evaluation Focus

    Minimum Rating Scale (0-5)

    Microsoft Azure Stack

    Mandatory

    Evaluate technical proficiency in T-SQL, SSIS, SSAS, and SSRS

    Azure Data Factory

    Mandatory

    Assess ability to construct robust ADF pipelines for data ingestion and transformation

    Azure Databricks

    Mandatory

    Experience in ingesting and integrating data into the Azure Analytics Platform

    Azure Synapse Analytics

    Mandatory

    Capability to optimize Azure solutions for enhanced decision-making

    Azure DevOps

    Mandatory

    Evaluate experience in using Azure DevOps for project deliverables

    Azure Storage / Data Lake

    Mandatory

    Proficiency in managing data storage solutions

    ETL Processes

    Mandatory

    Experience with ETL processes and report development

    Relational Databases and SQL

    Mandatory

    Proficiency in relational databases and SQL language

    Python Scripting and Spark APIs

    Non-Mandatory

    Assess experience with Python scripting and Spark APIs

    Client-Facing Experience

    Non-Mandatory

    Evaluate previous client engagement experience

    Agile Development Methodologies

    Non-Mandatory

    Familiarity with agile development practices

    Bachelor's Degree

    Mandatory

    Possession of a degree in Computer Science, Information Technology, or related field

    serp_jobs.job_alerts.create_a_job

    Engineer • San Francisco, CA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Principal Data Engineer - Databricks, Data Platforms

    Principal Data Engineer - Databricks, Data Platforms

    Internetwork ExpertSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Simple Machines ANZ – Job Ad – Principal Data Engineer.Position : Principal Data Engineer.Location : Darlinghurst, Sydney. Simple Machines is a leading independent boutique technology firm with a glob...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Software Engineer, Data Infrastructure - Research

    Software Engineer, Data Infrastructure - Research

    OpenAISan Francisco, CA, United States
    serp_jobs.job_card.full_time
    The Workload team is responsible for designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive scale. Our systems unify how researchers train an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer : 24-02782 (No C2C)

    Data Engineer : 24-02782 (No C2C)

    Akraya IncSunnyvale, California, United States
    serp_jobs.job_card.temporary
    serp_jobs.filters_job_card.quick_apply
    Tableau (Advanced), Python (Advanced), SQL (Expert), Spark (Intermediate), BI Reporting (Intermediate).Sunnyvale, CA (Hybrid - 3 Days Onsite). One of the FAANG client's Infrastructure Automation tea...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    CGSSan Francisco, California, United States, 94102
    serp_jobs.job_card.full_time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    AWS Data Engineer

    AWS Data Engineer

    GlobalchannelmanagementSan Francisco, California, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing.Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and pro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff Data Engineer, Merchandising Catalog & Taxonomy (IC)

    Staff Data Engineer, Merchandising Catalog & Taxonomy (IC)

    Attachments KingSan Francisco, CA, US
    serp_jobs.job_card.full_time
    Attachments King is an eCommerce startup in the Heavy Equipment Industry developing proprietary software that flexibly discovers compatibility between equipment and host machine components.We&rsquo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Full Stack Engineer (PostgreSQL, Elastic, Data Modeling) at Human Capital Solutions, Inc[...]

    Senior Full Stack Engineer (PostgreSQL, Elastic, Data Modeling) at Human Capital Solutions, Inc[...]

    Itlearn360San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Senior Full Stack Engineer (PostgreSQL, Elastic, Data Modeling) job at Human Capital Solutions, Inc.San Francisco, CA (On-site, Bay Area candidates strongly preferred). We are seeking a seasoned Sen...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Databricks SME / Architect

    Databricks SME / Architect

    Tiger AnalyticsPalo Alto, CA, United States
    serp_jobs.job_card.full_time
    Tiger Analytics is an advanced analytics consulting firm.We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data.Our consultants b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer

    Data Engineer

    VDart IncMountain View, CA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Data Engineer Job Location : Mountain View,CA job Type : 6 Months + Possible extension Job Description : <...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Infra / Platform Engineer

    Infra / Platform Engineer

    Approach VentureBerkeley, CA, US
    serp_jobs.job_card.full_time
    Infrastructure Engineer – Build Data Platforms & Internal Tools for Robotics!.An early-stage robotics startup is creating the foundation for general-purpose robotics by developing the inf...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr. Data Analytics Engineer - Databrick - Power BI

    Sr. Data Analytics Engineer - Databrick - Power BI

    Ajmera Infotech Inc.San Jose, CA, us
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Analytics Engineer - Databricks & Power BI.Texas (Remote-first, flexible across U.Contract - 1099 (Independent Contractor). We deliver innovative, data-driven solutions that empower strateg...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Sr. Software Engineer - Data Engineer

    Sr. Software Engineer - Data Engineer

    FyrFly Venture PartnersPleasanton, CA, United States
    serp_jobs.job_card.full_time
    Software Engineer - Data Engineer.Senior Software Engineer – Data Engineer.This role will focus on building and optimizing data pipelines, integrating multiple data sources, and enabling advanced a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Senior Data Engineer : 24-01769 (No C2C)

    Senior Data Engineer : 24-01769 (No C2C)

    Akraya IncSunnyvale, California, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Primary Skills : SQL (Expert), Data Modeling (Advanced), Python (Advanced), AWS (Intermediate), Data Visualization (Intermediate). Duration : 11+ Months (Possible Extension).Location : Sunnyvale, CA (H...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Analysis Engineer (Python / Tableau ON-SITE) (Cupertino)

    Data Analysis Engineer (Python / Tableau ON-SITE) (Cupertino)

    OSI EngineeringCupertino, CA, US
    serp_jobs.job_card.part_time
    Seeking a Data Analysis Engineer.The role involves building Tableau dashboards, Python scripting, and working with hardware-generated data. This role will focus on building interactive Tableau dashb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Staff Data Engineer

    Staff Data Engineer

    TwilioSan Francisco, California, United States
    serp_jobs.job_card.full_time
    At Twilio, we're shaping the future of communications, all from the comfort of our homes.We deliver innovative solutions tohundreds of thousands of businessesand empower millions of developers worl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Senior Staff Software Engineer (Data) - Activision Blizzard Media

    Senior Staff Software Engineer (Data) - Activision Blizzard Media

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time +1
    Senior Staff Software Engineer (Data) - Activision Blizzard Media.We are seeking a Senior Staff Software Engineer (Data) in our Ads Engineering team, crafting groundbreaking mobile advertising tech...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Analysis Engineer (Python / Tableau ON-SITE)

    Data Analysis Engineer (Python / Tableau ON-SITE)

    OSI EngineeringCupertino, CA, US
    serp_jobs.job_card.full_time
    Seeking a Data Analysis Engineer.The role involves building Tableau dashboards, Python scripting, and working with hardware-generated data. This role will focus on building interactive Tableau dashb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Software Engineer - Data and Integrations

    Software Engineer - Data and Integrations

    Nue.io CareersSan Mateo, CA, US
    serp_jobs.job_card.full_time
    Why you'll love this NUE opportunity!.Join our dynamic and innovative team to help shape the future of revenue lifecycle intelligence. We are seeking a talented Data and Integrations Software En...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day