We are seeking an experienced Senior Data Engineer to join our client's team. The ideal candidate will have a strong background in designing and implementing scalable data solutions, along with expertise in data warehousing, ETL processes, and data pipeline architecture.
Experience with Azure Databricks is also required. As a Senior Data Engineer, you will play a key role in developing and maintaining our data infrastructure, ensuring data quality, reliability, and accessibility for our analytics and machine learning initiatives.
Please read the information in this job post thoroughly to understand exactly what is expected of potential candidates.
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes to support data ingestion, transformation, and storage using Azure Databricks.
- Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
- Optimize and tune data pipelines for performance, scalability, and reliability within the Azure Databricks environment.
- Implement data governance and security measures to ensure data integrity and compliance with regulatory requirements.
- Develop and maintain data models and schemas to support reporting and analytics needs.
- Evaluate and implement new technologies and tools, with a focus on Azure Databricks, to enhance data engineering capabilities.
- Mentor and guide junior data engineers, providing technical leadership and best practices in data engineering.
- Participate in code reviews, documentation, and knowledge sharing activities within the data engineering team.
Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- Proven experience 8+ years in data engineering, with expertise in data warehousing, ETL processes, and data pipeline development.
- Proficiency in programming languages such as Python, Java, or Scala for data processing and scripting.
- Strong SQL skills and experience with relational and NoSQL databases.
- Hands-on experience with cloud platforms such as Azure, AWS, or Google Cloud Platform, with specific experience in Azure Databricks.
- Familiarity with big data technologies and frameworks such as Hadoop, Spark, Kafka, etc.
- Excellent problem-solving skills and the ability to work effectively in a fast-paced environment.
- Strong communication and collaboration skills, with the ability to work closely with stakeholders across different teams.
J-18808-Ljbffr
GCP Security Engineer/Architect - Remote EST hours- W2 Only - $65/hr-$85/hr
GCP Security Engineer/Architect - Remote EST hours- W2 Only - $65/hr-$85/hr. Candidate must be able to work on the client's W2 without future sponsorship, vendor or employer. Length: 6 months Contract to Hire - W2. ...
AWS Data Engineer (Senior)
AWS Data Engineer (Senior) with skills Data Engineering, Python, AWS - CloudFormation, Lambda Test, Data Modeling, ETL, Kafka Streaming, Snowflake, SQL, CI/CD, AWS DBA, Redshift for location Gurugram, India. Experience with Python for data engineering and automation. Primary Skill: Data Engineering....
Senior Data Engineer
If you are a Senior Data Scientist with a passion for solving complex business problems using machine learning and data science, we want to hear from you! Join our team and help us build innovative solutions that drive our business forward. We are seeking a highly skilled Senior Data Scientist to jo...
Senior Data Engineer
Work closely with other data engineers, software engineers, data scientists, data managers and business partners. Design, develop, and deliver large-scale data ingestion, data processing, and data transformation projects on Azure. Deep and hands-on experience (typically 5+ years) designing, planning...
Senior Azure Data Engineer
We are expanding our Data Engineering practice and looking for Azure Data Engineers to join our growing team of analytics experts. The right candidate will have strong analytical skills and the ability to combine data from different sources and will strive for efficiency by aligning data systems wit...
Senior Software Engineer
As a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. Key Responsibilities Analyze, design, develop, and test software modules in support of clients' software application deve...
Senior Data Engineer (Remote - California)
Job Title: Senior Data Engineer (Remote - California). Collaborate with data scientists and analysts to support data-driven decision-making. We are an innovative technology company revolutionizing data solutions. ETL processes, and ensure the integrity of our data architecture. ...
Riser Engineer II, Senior - For Contractor Only
Minimum Fifteen () years of related engineering experience in a shipyard, design/consulting office, shipping/oil company, or a classification society; or three () years minimum as a Senior Engineer. The Senior Engineer II will establish policies, procedures, and standards and is responsible for the ...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Senior Data Engineer
Scope key business challenges, identify the right data and provide direction to data analysts, data analytics product managers, data scientists, data engineers and business stakeholders. As a Senior Data Engineer, you be responsible for the design and development of data pipelines, automation, and v...