Data Engineer

Job Description

Job Description

We are looking for an experienced Data Engineer to join our team in Johns Creek, Georgia, on a Contract to permanent basis. This position offers an exciting opportunity to design and optimize data pipelines, manage cloud systems, and contribute to the scalability of our Azure environment. The ideal candidate will bring advanced technical skills and a collaborative mindset to support critical data infrastructure initiatives.

Responsibilities :

• Develop and enhance data pipelines using Azure Data Factory to ensure efficient data processing and integration.
• Manage and administer Azure Managed Instances to support database operations and ensure system reliability.
• Implement real-time data replication from on-premises systems to cloud environments to support seamless data accessibility.
• Utilize advanced ETL tools and processes to transform and integrate complex data workflows.
• Collaborate with cross-functional teams to ensure data integration across systems, with a preference for experience in Salesforce integration.
• Leverage real-time streaming technologies such as Confluent Cloud or Apache Kafka to support dynamic data environments.
• Optimize data workflows using tools like Apache Spark and Hadoop to enhance processing performance.
• Troubleshoot and resolve database-related issues to maintain system stability and performance.
• Work closely with stakeholders to understand data requirements and provide innovative solutions.
• Proficiency in Azure Data Factory and managing Azure Managed Instances.
• Hands-on experience with ETL processes and tools such as SSIS.
• Expertise in real-time streaming technologies, including Apache Kafka or Confluent Cloud.
• Strong programming skills in Python for data manipulation and automation.
• Familiarity with big data tools such as Apache Spark and Hadoop.
• Solid understanding of database administration and troubleshooting.
• Excellent problem-solving skills and ability to work collaboratively in a team environment.
• Experience with Salesforce integration is a plus.