Responsibilities : Architecture and Design : Design and implement scalable and efficient data processing architectures using Databricks.
Make strategic decisions regarding data organization, storage, and processing. Team Leadership : Lead and mentor a team of data engineers and data scientists.
Provide technical guidance and support to ensure the team's success. Implementation : Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks.
Write code, configure Databricks clusters, and ensure adherence to best practices. Performance Optimization : Optimize the performance of big data processing tasks and analytics jobs.
Identify and implement improvements to enhance resource efficiency. Collaboration : Collaborate with cross-functional teams, including data science, business intelligence, and infrastructure teams.
Ensure seamless integration of data pipelines with various systems. Best Practices and Standards : Establish and enforce best practices and coding standards.
Ensure consistency, quality, and maintainability of the codebase. Troubleshooting and Support : Provide technical support for the team in troubleshooting issues.
Optimize queries and resolve technical challenges during development and production. Project Management : Manage the technical aspects of projects, including timelines and resource allocation.
Coordinate with stakeholders to ensure project goals are met. Qualifications : Bachelor's or Master's degree in Computer Science, Data Science, or other related IT field.
Proven experience as a Technical Lead with a focus on Databricks and big data technologies. In-depth knowledge of Apache Spark and Databricks architecture.
Strong programming skills in languages such as Python or Scala. Experience with data engineering concepts, ETL processes, and data modeling.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform. Excellent leadership and communication skills.
Ability to thrive in a fast-paced, collaborative environment. Due to the nature of the work we support, all candidates in consideration for this role must be U.
S. Citizens willing to undergo the government issued background investigation process. Ardent is an equal opportunity employer.
We will not discriminate and will take affirmative action measures to ensure against discrimination in employment, recruitment, advertisements for employment, compensation, termination, upgrading, promotions, and other conditions of employment against any employee or job applicant on the bases of race, color, gender, national origin, age, religion, creed, disability, veteran's status, sexual orientation, gender identity or gender expression.