Linux Applications Administrator

Overview

In search of a self-motivated Linux Applications Engineer. The Linux Applications Administrator is responsible for designing, implementing, and supporting the Kafka platform within the organization.

They will oversee the deployment, configuration, tuning, maintenance, and troubleshooting of Kafka clusters, ensuring optimal performance and availability.

This role requires a deep understanding of Kafka architecture, strong analytical skills, and the ability to collaborate effectively with cross-functional teams.

Primary Functions / Job Description

• Design, deploy, and maintain Kafka infrastructure, including clusters and topics.
• Configure and fine-tune Kafka brokers, producers, and consumers for optimal performance.
• Monitor and troubleshoot Kafka cluster issues, system alerts, and event-driven workflows.
• Collaborate with development teams to establish best practices for Kafka development and integration.
• Optimize Kafka cluster security, including access controls, authentication, and encryption.
• Implement disaster recovery and high availability strategies for Kafka deployments.
• Collaborate with infrastructure teams to plan and execute Kafka capacity planning and scaling.
• Install and configure Kafka connectors and other ecosystem tools.
• Automate routine administration tasks using scripting and automation tools.
• Stay up-to-date with the latest Kafka releases, patches, and security vulnerabilities.
• Develop and maintain documentation related to Kafka infrastructure, configurations, and processes.
• Conduct performance analysis and optimization of Kafka workloads and data pipelines.
• Provide technical guidance and support to internal teams for Kafka-related projects.
• Collaborate with vendor support teams to resolve complex Kafka-related issues.
• Ensure compliance with security and data governance policies for Kafka deployments.

Preferred Skills

• Proven experience as a Kafka Administrator or similar role.
• Strong knowledge of Kafka architecture, design patterns, and best practices.
• Proficiency in Kafka installation, configuration, and management.
• Experience with Kafka security and authentication mechanisms, such as SSL and SASL.
• Solid understanding of Linux / Unix system administration and networking.
• Strong scripting and automation skills using Shell, Python, or similar languages.
• Experience with Kafka ecosystem tools, such as Kafka Connect, Kafka Streams, and Schema Registry.
• Familiarity with message queuing systems and event-driven architectures.
• Hands-on experience with monitoring tools like Prometheus, Grafana, and ELK stack.
• Experience in virtual machines systems such as VMware and containerized systems such as Docker / Kubernetes.
• Server configuration tools using Chef, Puppet, etc.
• Strong experience with one of : Ruby, PHP, Python, Perl, etc.
• Intermediate knowledge of Windows Server systems

Job Description - Requirements

• Minimum of 5 years Linux administration experience or cloud operations role
• As minimum 2 years of experience working as Kafka administrator.
• Minimum of 3 years scripting experience (Chef, Python, Shell, PowerShell, etc)
• Experience in other messaging systems such as IBM MQ or Rabbit MQ.
• Experience in the search engine such as Elasticsearch.
• Experience with Linux based OS configuration, automation (CI / CD Tools), and management
• Proficient in shell scripting, cron jobs, user account management, analyzing logs, configuration of network and mail services
• Problem troubleshooting and solving ability
• Excellent written and oral communication skills including documentation
• Ability to work in team environment and individually
4 days ago