Senior Site Reliability Engineer (Remote)
Join to apply for the Senior Site Reliability Engineer (Remote) role at XCEL Engineering
Company overview
XCEL Engineering, Inc. is an award-winning small business that provides trusted information technology, engineering, consulting and project management solutions and services to federal agencies and organizations. Originally founded in 1971 by professional engineers at the University of Tennessee, XCEL was acquired in 2003 by U.S. Army and Navy veterans and in 2023 became a MartinFed company. XCEL Engineering is a part of IT Lab Partners (ITLP) which was created to support a leading research facility in the East Tennessee region in recruiting the best and the brightest technical talent.
Job overview
XCEL Engineering is seeking a qualified applicant for a Senior Site Reliability Engineer role. As a Senior Site Reliability Engineer, you\'ll play a key role in the HPC Infrastructure and Platforms group, ensuring the reliability and performance of the supercomputer center. The container orchestration platform built on Kubernetes and Red Hat OpenShift powers both critical operational applications and user-managed persistent applications running alongside supercomputers and HPC clusters.
Essential functions
- Lead ongoing improvements in reliability and scalability for our Kubernetes and Linux based applications and services.
- Contribute as senior technical resource to define and implement best practices and standards for the center.
- Provide primary operational support and engineering for production applications.
- Define and implement KPIs, processes and drive continuous improvement.
- Influence the architecture and implementation of solutions.
- Tune operating systems and applications to increase performance and reliability of services.
- Mentor junior staff and enable them for success.
- Diagnose system operational problems quickly and effectively.
- Participate in on-call rotation providing 24-hour, 7-day support and off-hours maintenance windows.
- Coordinate with vendors to resolve hardware and software problems.
- Deliver ORNL's mission by aligning behaviors, priorities, and interactions with our core values of Impact, Integrity, Teamwork, Safety, and Service. Promote diversity, equity, inclusion, and accessibility by fostering a respectful workplace.
Qualifications
Basic Qualifications
United States citizen with the ability to obtain a security clearance.Bachelor's degree in Computer Science, Information Technology or a related technical field.A minimum of eight (8) years of relevant experience, or an equivalent combination of education and experience.Desired Qualifications
Strong working knowledge of Unix system fundamentals and common network protocols.Experience managing Linux / UNIX operating systems in a heterogeneous environment.Solid understanding of networked computing environment concepts.Excellent understanding of networking, particularly Linux and Kubernetes networking.Experience with instrumenting bare metal and VMware infrastructure.Ability to develop and maintain programs and scripts that aid in the operation and automation using various shell (primarily bash) and high-level languages (Python or Go).Ability to proactively identify performance issues, problems, and areas for improvement.Ability to identify requirements and to define, plan, and implement requisite solutions.Ability to plan, organize, prioritize tasks, and complete assigned projects with minimal supervision.Experience with continuous integration and continuous deployment software methodologies and how they apply to SRE / systems engineering.An understanding of code review and familiarity with tools like GitHub and GitLab.Experience using tools such as Nagios, Grafana and Prometheus to monitor systems, metrics, and create dashboards.Experience designing and implementing highly available systems / services utilizing virtual machines and Kubernetes resources.Experience participating in an open-source community with patches accepted upstream.Experience deploying and maintaining automated configuration management software such as Puppet or Ansible.Experience implementing systems-level security technologies like SELinux and following security best practices.J-18808-Ljbffr