Below covers everything you need to know about what this opportunity entails, as well as what is expected from applicants.
Hope you are doing well?
I am looking for a candidate with experience as Databrick Engineer.
Role : Databrick Engineer
Location : Quincy, MA
Duration : Long term
Must be on our W2
Key skill- Databrick, AWS, Pyspark, Scala,
Education and experience Qualification
Bachelor’s degree in Computer Science, Information Systems, or equivalent education or work experience
Around 5+ years of experience as a developer on cloud technologies
Any AWS and / or Databricks certification will be a plus
Roles & Responsibilities
Recognize the current application infrastructure and suggest new concepts to improve performance
Document the best practices and strategies associated with application deployment and infrastructure support
Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies
Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis / Kafka and Lambda to build serverless applications
Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks / AWS
Comfortable to work on tight timelines, when required.
Skill Sets Required
Good decision-making and problem solving skills
Solid understanding of Databricks fundamentals / architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
Knowledge on medallion architecture, DLT and unity catalog within Databricks.
Experience in migrating data from on-prem Hadoop to Databricks / AWS
Understanding of core AWS services, uses, and AWS architecture best practices
Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
Solid knowledge on Airflow
Solid knowledge on CI / CD pipeline in AWS technologies
Application migration of RDBMS, java / python applications, model code, elastic etc.
Solid programming background on scala, python
Experience with Docker and Kubernetes is a plus
Databrick Engineer
Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse). I am looking for a candidate with experience as Databrick Engineer. Develop Data Engineering and ML pipel...
Databrick Engineer
Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse). I am looking for a candidate with experience as Databrick Engineer. Develop Data Engineering and ML pipel...
Databrick Engineer
Role: Databrick EngineerLocation: Quincy, MADuration: Long term Must be on our W2 Key skill- Databrick, AWS, Pyspark, Scala,Education and experience Qualification Bachelor’s degree in Computer Science, Information Systems, or equivalent education or work experience Around 5+ years of experience as a...
Senior Data Engineer, Databricks on AWS, AVP - Onsite
Design, develop, and maintain scalable data pipelines using pyspark on Databricks, adhering to best practices and emphasizing software engineering principles. Data Engineering specializing in modern data management, you will be at the forefront of our efforts to transition our data ecosystem to a mo...
Databrick Engineer
Role: Databrick EngineerLocation: Quincy, MADuration: Long term Must be on our W2 Key skill- Databrick, AWS, Pyspark, Scala,Education and experience Qualification Bachelor’s degree in Computer Science, Information Systems, or equivalent education or work experience Around 5+ years of experience as a...
Analytic Data Engineer – Databricks
This role within the 'Data Engineering & Self-Service Products' team involves architecting and engineering analytic data solutions, including designing and developing data marts in Databricks using PySpark or Spark SQL, building interactive Power BI dashboards to visualize KPIs and trends, and creat...
Sr. Databricks Data Engineer, Onsite AVP
Strong knowledge on Databricks SQL/Scala - Data engineering pipeline. This is a hands-on Data Engineer position in State Street Global Technology Services. We are looking for candidate with good knowledge on Bigdata technology and strong development experience with Databricks. Databricks hands on ex...
DATA ANALYST, Global Development Policy Center
Databases include China's Overseas Development Finance (CODF) Database, the Chinese Loans to Africa (CLA) Database, the Chinese Loans to Latin America and the Caribbean (CLLAC) Database, the Chinese Global Energy Finance (CGEF) Database, and China's Global Power (CGP) Database. The Global China Init...
Senior Software Engineer, DevOps - Capital One
Ave (22130), United States of America, New York, New YorkSenior Software Engineer, DevOpsDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll b...
Senior Software Engineer/C++ Qt Developer *PC 1137
The Software Engineer, C++/Qt will design and develop user-interface (UI) software for instrument control and analysis software for instruments within the analysis instrument software (AISW) department. Senior Software Engineer I/C++ QT Developer. The UI software will enable users to configure and e...