MRC Confluent Kafka Senior Architect
Ness Digital EngineeringChicago, IL, United Statesjob_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_descriptionWe need someone who's good at setting up CI / CD pipelines using DevOps tools like Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness. It's also important that DevOps Architect has experience with deploying the applications on Kubernetes using Rancher, Helm Charts and Harness. Plus, he / she should know about deploying Kafka MRC or CFK and the use of monitoring tools like Logic Monitor and Splunk. And it'd be great if he / she has experience with AWS services and on-prem as hybrid environment, especially setting up Confluent CFK or MRC, and know how to do S3 replication with Cloudian. Kubernetes Administration : Helm CRDs K8 Operators All general things in K8 including PVCs CFK Administration : Kafka Kraft / Zookeeper Kafka Connect Kafka Monitoring like consumer lag, broker health, topics growth, etc. Kafka Cluster Management (Topics, Partitions, Brokers, etc.) Kafka Backup Solution and Support Pilot Kafka data replication between AWS and On-Prem Experience with Rancher RKE2 K8s clusters and orchestration platform K8S cluster management, Monitoring, operational tools integration K8s cluster and secrets management integration K8s CSI plug-ins with object, file and block storage vendors Kubernetes backup solution and support S3 / Cloudian object storage for shared infrastructure Specializing in Cloud Infrastructure Modernization, virtualization, data center setup, DR & BC Strategies, and DevOps Experience in on-premises data center operations, AWS hosted data center and operations management Hands on experience with migrations tools Experience with continuous deployment tools, techniques, and automation frameworks - especially Terraform Enterprise and Ansible. Hands-on experience writing testable scripts using Python or other languages. Experience managing helm charts and deploying into Kubernetes (K8s) Expertise with monitoring related tools and frameworks like Splunk, LogicMonitor, SignalFX, and Prometheus. Worked on projects involving deployment and management of micro services, and hybrid cloud / on-prem infrastructure Intermediate working knowledge of development tools like Maven / Gradle, Java, and distributed message brokers like Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis, etc. Good to Have Knowledge of setting up CI / CD pipelines for streaming Flink based applications is an added advantage
Description
Position at Ness Digital Engineering
Ness is seeking an DevOps Architect with Confluent Kafka (MRC / CFK), Kubernetes expertise. Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal datacenter ("On-Prem") and to be able to switch all production functionality running through On-Prem within the predefined SLA. The newly developed clearing and risk systems takes advantage of scalability, ease of provision, and the reduced cost offered by cloud services (AWS) and the cloud offered Multi-Region as Disaster Recovery (DC) strategy.
Responsibilities :
- As a DevOps Architect, setup CI / CD pipeline for application deployment in Kubernetes
- Setup Confluent Kafka (MRC or CFK) across all the regions in hybrid environment
- Setup Rancher and downstream Kubernetes clusters in multiple environments and regions
- Setup IaC pipelines using TFE and Ansible to automate the Kafka cluster deployments
- Setup IaC pipelines using TFE and Ansible to automate the Rancher and downstream K8 cluster deployments
- Work in the DevOps team, to build new shared infrastructure services for on premises failover environment : S3, Confluent Kafka, Data Store
- Work with DevOps team to establish connectivity between new failover shared services and existing shared services : Secret, identity, LDA, DNS, Artifactory, Jenkins, Splunk services
- Work with DevOps team to automate deployment DR strategy Automation of data replication between Cloud and failover environment required between all applications and shared services CI / CD deployment tools
- Continuously improve the processes and the DevOps team using thoughtful, calculated approaches to identify opportunities, and challenge those around you to strive for perfection.
- Ideate solutions to complex technical challenges; code, test, troubleshoot, debug, and document the solutions you develop. Use agile software development model to produce well-designed programs, scripts, and tools required to provision, configure, and monitor new shared infrastructure services for on premises failover environment
Must have :
serp_jobs.job_alerts.create_a_job
Senior Architect • Chicago, IL, United States
Job_description.internal_linking.related_jobs
Design and implement Kafka based EDA (Event Driven Architecture) platform to support various integration use cases ensuring high performance , scalability, and reliability.Experience defining large...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Designing data models, Planning databases, Ensuring data security, Improving databases, Creating a data catalog, Staying current 5+ years of experience with testing tools related to big data techno...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Senior Solutions Architect - UiPath, IXP, GenAi.This is not a traditional RPA developer role-it's a high-impact position focused on architecting business-driven, scalable, and maintainable automati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Are you ready to make an impact?.Technology and Experience (TechEx).From designing customer-facing software to integrating complex platforms and leveraging actionable data, we partner with our clie...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Federal Reserve Bank of Chicago.The Senior Solution Architect is responsible for researching, analyzing, proposing, and architecting requirements-based products and solutions that align with the bu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Design and implement Kafka based EDA (Event Driven Architecture) platform to support various integration use cases ensuring high performance , scalability, and reliability.Experience defining large...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Senior Architect AI and Cloud (Azure) Solutions.In this role, you will be a key leader in designing and building the next generation of our AI-driven products and services.You will bridge the gap b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are a global collective of innovators applying the New every day to improve the way the world works and lives.New doesn't mean being ahead of the curve.
new is pushing forward the curve, riding ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Ness is seeking an DevOps Architect with Confluent Kafka (MRC / CFK), Kubernetes expertise.Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
As the commercial vehicle industry undertakes its most significant transformation in a century, International stands at the forefront, focused on a mission to redefine transportation.International ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The Solution Architect will be responsible for designing, implementing, and optimizing technology solutions.Lead the architectural design and technical strategy for the migration of Teradata worklo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Responsible for promoting use of industry and Company technology standards.Monitors emerging technologies / technology practices for potential use within the company.
Designs and develops updated infr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
North America, Japan and the United Kingdom.At Grainger, We Keep the World Working by serving more than 4.Known for its commitment to service and award-winning culture, the Company had 2024 revenue...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
In this high-impact leadership position, you will design, develop, and implement secure, scalable integration solutions across batch, real-time, and API-driven environments.Leveraging technologies ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Work Location Type : Hybrid About Grainger : W.North America, Japan and the United Kingdom.At Grainger, We Keep the World Working® by serving more than 4.
Known for its commitment to service and awa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Responsible for promoting use of industry and Company technology standards.Monitors emerging technologies / technology practices for potential use within the company.
Designs and develops updated infr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Insight Global is seeking a Kinaxis Solution Architect to join a leading supply chain software company on a remote basis.
The Solution Architect plays a critical role in supporting clients through t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
As the commercial vehicle industry undertakes its most significant transformation in a century, International stands at the forefront, focused on a mission to redefine transportation.International ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
The KPMG Advisory practice is currently our fastest growing practice.We are seeing tremendous client demand, and looking forward we dont anticipate that slowing down.
In this ever-changing market en...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Senior Kafka Architect
Tekfortune IncBolingbrook, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solution Architect
Tekfortune IncChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solution Architect
CoSourcing PartnersChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Integration Architect, US
West MonroeChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solutions Architect
Federal Reserve BankChicago, IL, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
Kafka Architect
Omni InclusiveBolingbrook, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Architect AI and Cloud (Azure) Solutions
Publicis SapientChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Kinaxis Planning Integration Architect
AccentureChicago, IL, United Statesserp_jobs.job_card.full_time
MRC Confluent Kafka Senior Architect
Ness Digital EngineeringChicago, IL, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solution Architect - MDM
International MotorsLisle, IL, United Statesserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Senior Solutions Architect - Midwest
ElasticChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solution Architect
TEKRRA1Chicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Architect 6, Enterprise Architecture
XfinityChicago, IL, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solutions Architect
Zoro ToolsLake Forest, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Integration Architect
Equity ResidentialChicago, IL, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solutions Architect
Grainger BusinessesLake Forest, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Architect 6, Enterprise Architecture
ComcastChicago, IL, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Kinaxis Solution Architect
Insight GlobalChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Solution Architect - MDM
International UTC of ColumbusLisle, IL, United Statesserp_jobs.job_card.permanent
- serp_jobs.job_card.promoted
Manager, Solution Architect
KPMGChicago, IL, United Statesserp_jobs.job_card.full_time