Hadoop Engineer/Dev Ops Engineer

Snipebridge
Dallas, TX, US
Full-time

Job Description

Job Description

CLIENT

As the market leader in decision management software, our client helps the world's largest companies in digitally transforming their integrated business planning, revenue management and supply chain management functions.

It's platform puts the right information in front of the right people at the right time, so that everyone in a company can make smarter decisions, faster.

They offer a cloud-based platform that connects the supply chain end-to-end through use of technologies like AI / ML and NLP.

With a global presence across NA, Europe and Asia-Pac, the company provides services in multiple industries and to some of the biggest brands in the world.

It runs as a flat organization with a very strong entrepreneurial culture (and no corporate politics).

POSITION SUMMARY

ROLE & RESPONSIBILITIES

  • Work with customers / technical consultants to devise and recommend big data solution architecture based on requirements
  • Analyze complex distributed production deployments, and make recommendations to optimize performance
  • Able to document and present complex architectures for the customers technical teams
  • Work closely with o9 Dev, Devops and project teams at all levels to help ensure the success of projects
  • Help design and implement Hadoop architectures and configurations for customers working with Cloud deployments
  • Write and produce technical documentation and manual to be provided to customer
  • Keep current with the Hadoop Big Data ecosystem technologies

EXPERIENCE, EXPERTISE & EDUCATION REQUIREMENTS

  • More than three years of DevOps experience, architecting large scale storage, data center and / or globally distributed solutions
  • Experience designing and deploying production large-scale Hadoop solutions
  • Ability to understand and translate customer requirements into technical requirements
  • Experience designing data queries against data in a Hadoop environment using tools such as Apache Hive, Apache Druid, Apache Phoenix or others.
  • Experience installing, administering and tuning multi-node Hadoop clusters
  • Strong experience implementing software and / or solutions in Cloud (Azure, AWS, GCP)
  • Strong understanding with various enterprise security solutions such as LDAP and / or Kerberos
  • Strong understanding of network configuration, devices, protocols, speeds and optimizations
  • Strong understanding of the Java development, debugging & profiling
  • Significant previous work writing to network-based APIs, preferably REST / JSON or XML / SOAP
  • Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
  • Experience implementing MapReduce jobs
  • Solid background in Database administration and design, along with Data Modelling.
  • Experience in architecting data centre solutions properly selecting server and storage hardware based on performance, availability and ROI requirements
  • Demonstrated experience implementing big data use-cases, understanding of standard design patterns commonly used in Hadoop-based deployments.
  • Excellent verbal and written communications
  • Demonstrable experience using R and the algorithms.
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
Carrollton, Texas

A company is looking for a Lead Azure Operations Engineer. ...

Promoted
CoreLogic
Dallas, Texas

Work closely with architects, developers, data science and data engineers to gather system requirements. Experience in implementation of few of the following: Networking, DevOps, Security, Compute, Storage, Containers, Kubernetes. CoreLogic is committed to cultivating a diverse and inclusive work cu...

Promoted
VirtualVocations
Mesquite, Texas

A company is looking for a Senior II Software Engineer - OpsKey Responsibilities:Architect, deploy, and maintain a highly available and scalable multi-tenant SaaS environment in AWSImplement and manage infrastructure as code using tools such as Terraform or CloudFormationSet up and manage comprehens...

Amazon Development Center U.S., Inc.
Dallas, Texas

We are looking for an experienced software developer with an interest in practical cryptography to join us in building the most secure services in AWS. Along with senior leaders, principal engineers, and security specialists you will discover and solve the new interesting challenges of growing and o...

Promoted
VirtualVocations
Carrollton, Texas

A company is looking for a Software Engineer - Cloud Ops [IC3] position. Key Responsibilities:Develop inter-cloud connectivity solutions for enterprise customers using Sourcegraph CloudBuild a control plane to manage a fleet of single-tenant Sourcegraph Cloud instancesExpose complex infrastructure a...

Amazon.com Services LLC
Dallas, Texas

World Wide OPS Finance S&A (Standardize & Automate) team is looking for a customer focused, analytically and technically skilled Business Intelligence Engineer (BIE) to join the team. Business Intelligence Engineer in WW Ops S&A works on building high accuracy robust dataset to drive automation and ...

Aditi Consulting
Virtual, TX

As a Software Engineer, you will collaborate with Data Engineers, Software Development Managers and other SDEs across the company to develop, test, and launch. The Content Platform team is looking for a Software Development Engineer. Your solutions will impact on our customers directly! Primary resp...

Splunk Inc
Texas, United States

Learn more about Splunk careers and how you can become a part of our journey!Role:Splunk is looking for a TechOps Engineer with the ability to provide day-to-day technical expertise for our Splunk Cloud Azure TechOps team and the Splunk organization. As a TechOps Engineer, you will be interfacing wi...

Presidio, Inc.
Irving, Texas

Infrastructure Engineer, Platform Ops. Infrastructure Engineer in Platform Ops with Presidio, you will be responsible for maintaining and supporting the Data Collection Appliance (DCA) environment, with a strong emphasis on managing and securing the underlying Cisco networking and Palo Alto firewall...

eTeam
Dallas, Texas
Remote

Gather and analyze system requirements, document specifications, and develop software solutions to meet client needs and data. Modify existing programs to new standards and conduct unit testing of developed programs. ...