Talent.com
MRC Confluent Kafka Senior Architect

MRC Confluent Kafka Senior Architect

Ness Digital EngineeringDallas, TX, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Description

Ness is seeking an DevOps Architect with Confluent Kafka (MRC / CFK), Kubernetes expertise. Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal datacenter (“On-Prem”) and to be able to switch all production functionality running through On-Prem within the predefined SLA. The newly developed clearing and risk systems takes advantage of scalability, ease of provision, and the reduced cost offered by cloud services (AWS) and the cloud offered Multi-Region as Disaster Recovery (DC) strategy. Responsibilities :

  • As a DevOps Architect, setup CI / CD pipeline for application deployment in Kubernetes
  • Setup Confluent Kafka (MRC or CFK) across all the regions in hybrid environment
  • Setup Rancher and downstream Kubernetes clusters in multiple environments and regions
  • Setup IaC pipelines using TFE and Ansible to automate the Kafka cluster deployments
  • Setup IaC pipelines using TFE and Ansible to automate the Rancher and downstream K8 cluster deployments
  • Work in the DevOps team, to build new shared infrastructure services for on premises failover environment : S3, Confluent Kafka, Data Store
  • Work with DevOps team to establish connectivity between new failover shared services and existing shared services : Secret, identity, LDA, DNS, Artifactory, Jenkins, Splunk services
  • Work with DevOps team to automate deployment DR strategy Automation of data replication between Cloud and failover environment required between all applications and shared services CI / CD deployment tools
  • Continuously improve the processes and the DevOps team using thoughtful, calculated approaches to identify opportunities, and challenge those around you to strive for perfection.
  • Ideate solutions to complex technical challenges; code, test, troubleshoot, debug, and document the solutions you develop. Use agile software development model to produce well-designed programs, scripts, and tools required to provision, configure, and monitor new shared infrastructure services for on premises failover environment

Must have :

  • We need someone who's good at setting up CI / CD pipelines using DevOps tools like Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness. It's also important that DevOps Architect has experience with deploying the applications on Kubernetes using Rancher, Helm Charts and Harness. Plus, he / she should know about deploying Kafka MRC or CFK and the use of monitoring tools like Logic Monitor and Splunk. And it'd be great if he / she has experience with AWS services and on-prem as hybrid environment, especially setting up Confluent CFK or MRC, and know how to do S3 replication with Cloudian.
  • Kubernetes Administration :
  • Helm
  • CRDs
  • K8 Operators
  • All general things in K8 including PVCs
  • CFK Administration :
  • Kafka
  • Kraft / Zookeeper
  • Kafka Connect
  • Kafka Monitoring like consumer lag, broker health, topics growth, etc.
  • Kafka Cluster Management (Topics, Partitions, Brokers, etc.)
  • Kafka Backup Solution and Support
  • Pilot Kafka data replication between AWS and On-Prem
  • Experience with Rancher RKE2 K8s clusters and orchestration platform
  • K8S cluster management, Monitoring, operational tools integration
  • K8s cluster and secrets management integration
  • K8s CSI plug-ins with object, file and block storage vendors
  • Kubernetes backup solution and support
  • S3 / Cloudian object storage for shared infrastructure
  • Specializing in Cloud Infrastructure Modernization, virtualization, data center setup, DR & BC Strategies, and DevOps
  • Experience in on-premises data center operations, AWS hosted data center and operations management
  • Hands on experience with migrations tools
  • Experience with continuous deployment tools, techniques, and automation frameworks – especially Terraform Enterprise and Ansible.
  • Hands-on experience writing testable scripts using Python or other languages.
  • Experience managing helm charts and deploying into Kubernetes (K8s)
  • Expertise with monitoring related tools and frameworks like Splunk, LogicMonitor, SignalFX, and Prometheus.
  • Worked on projects involving deployment and management of micro services, and hybrid cloud / on-prem infrastructure
  • Intermediate working knowledge of development tools like Maven / Gradle, Java, and distributed message brokers like Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis, etc.
  • Good to Have
  • Knowledge of setting up CI / CD pipelines for streaming Flink based applications is an added advantage
    • serp_jobs.job_alerts.create_a_job

    Senior Architect • Dallas, TX, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Solutions Architect - QA

    Senior Solutions Architect - QA

    PerficientPlano, TX, US
    serp_jobs.job_card.full_time
    Perficient is a global AI-first consultancy.Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Lead Platform Architect

    Senior Lead Platform Architect

    Signia by Hilton AtlantaAddison, TX, United States
    serp_jobs.job_card.full_time
    Senior Lead Platform Architect.This is your chance to be a part of an in-house Technology team that's creating consumer-facing, cutting-edge technologies revolutionizing the hospitality industry ar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Confluent Kafka Administrator

    Confluent Kafka Administrator

    C4 Technical ServicesPlano, TX, United States
    serp_jobs.job_card.full_time
    Confluent Kafka Administrator with the following Profile : .Experience with Confluent Kafka deployment in Kubernetes.Experience with Confluent Kafka geo-red deployment using Cluster-linking and Mirro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Lead Platform Architect

    Senior Lead Platform Architect

    HiltonAddison, TX, United States
    serp_jobs.job_card.full_time
    This role is based at one of our corporate offices in Memphis, TN, McLean, VA, or Dallas, TX • • •.This is your chance to be a part of an in-house Technology team that's creating consumer-facing, cutt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Data Architect / W2 Contract

    Senior Data Architect / W2 Contract

    Axiom Software Solutions LimitedDallas, TX, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Work location : Bellevue WA / Atlanta GA / Dallas TX / Overland Park KS (Onsite).We are seeking an experienced and strategic Solution Architect with expertise in cloud technologies to design and imp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior SAP S / 4HANA Architect

    Senior SAP S / 4HANA Architect

    Pipe RecruitDallas, TX, United States
    serp_jobs.job_card.full_time
    About the job Senior SAP S / 4HANA Architect.Dallas, TX (Hybrid 3 days onsite).SAP S / 4HANA solutions, ensuring scalability, efficiency, and innovation. Problem-Solving & Risk Management.Team Mentorshi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senor Solutions Architect

    Senor Solutions Architect

    ZipRecruiterPlano, TX, United States
    serp_jobs.job_card.full_time
    Job DescriptionJob Description.Senior Solutions Architect – Cloud &.This role involves close collaboration with cross-functional teams to understand business requirements, propose scalable and secu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Solutions Architect

    Senior Solutions Architect

    Marsh LLCAddison, TX, United States
    serp_jobs.job_card.full_time
    Award-winning, inclusive, Top Workplace culture doesn’t happen overnight.It’s a result of hard work by extraordinary people. More than 11,000 of the industry’s brightest talent drive our efforts to ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Partner Senior Solutions Architect

    Partner Senior Solutions Architect

    ElasticDallas, TX, United States
    serp_jobs.job_card.full_time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Senior Cloud Architect

    Senior Cloud Architect

    VeracityDallas, TX, United States
    serp_jobs.job_card.full_time
    Alpharetta, GA, Berkeley Heights, NJ, Dallas, TX (100% Onsite).AWS, Microservices, Scala / Akka framework, Pulsar / Kafka and Messaging technologies. Client, document and define the target state and tra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Solution Architect Operational Technologies - & Co.

    Senior Solution Architect Operational Technologies - & Co.

    Burns & McDonnellDallas, TX, United States
    serp_jobs.job_card.full_time
    Burns & McDonnell, is seeking a Senior Solution Architect focused on Operational Technologies to provide utility grid modernization consulting services for our electric utility clients.The selected...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Solution Architect

    Senior Solution Architect

    Molina HealthcareDallas, TX, United States
    serp_jobs.job_card.full_time
    Leads in the creation and solution design of architectures for delivery, development, and support of projects.Must have experience integrating multiple applications and varied Databases (such as SQ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Manager, Solution Architect

    Manager, Solution Architect

    KPMGDallas, TX, United States
    serp_jobs.job_card.full_time
    The KPMG Advisory practice is currently our fastest growing practice.We are seeing tremendous client demand, and looking forward we dont anticipate that slowing down. In this ever-changing market en...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Java Integration Architect

    Senior Java Integration Architect

    Damco SolutionsLewisville, TX, United States
    serp_jobs.job_card.full_time
    Role : Senior Java Integration Architect.Location : Hybrid - Lewisville, TX.You'll be hands-on as we design and implement RESTful APIs and Kafka consumers and producers using Java and following best ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Sr. Integration Architect : Rexel Holdings

    Sr. Integration Architect : Rexel Holdings

    ShiftCode AnalyticsDallas, TX, United States
    serp_jobs.job_card.full_time
    Visa : All apart from h1b and cpt.This is hybrid from day-1 ( Candidate must be local to Dallas ).Bachelor's Degree in Engineering, Computer Science, or related field. TIBCO, Mulesoft, or Dell Boomi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Kafka Architect

    Kafka Architect

    StarTekkPlano, TX, United States
    serp_jobs.job_card.full_time
    StarTekk's adoption of Digital Transformation is to accelerate organizational growth, increase efficiencies and help Star Workforce achieve focused business goals. The Employee will help our organiz...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senor Solutions Architect

    Senor Solutions Architect

    YohPlano, TX, United States
    serp_jobs.job_card.full_time
    Senior Solutions Architect - Cloud &.This role involves close collaboration with cross-functional teams to understand business requirements, propose scalable and secure technical architectures, and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Boomi Integration Architect

    Senior Boomi Integration Architect

    ShiftCode AnalyticsDallas, TX, United States
    serp_jobs.job_card.full_time
    Skills : API Management, enterprise level design and architecture, canonical design.Experience : 5-10 years architecture experience including with Boomi. Preferably a background with ESB's like Tibco ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30