Job Description
Please Note : This position will include supporting our US Federal Government Cloud Infrastructure.
This position requires passing a ServiceNow background screening, USFedPASS (US Federal Personnel Authorization Screening Standards).
This includes a credit check, criminal / misdemeanor check and taking a drug test. Any employment is contingent upon passing the screening.
Due to Federal requirements, only US citizens, US naturalized citizens or US Permanent Residents, holding a green card, will be considered.
As a Staff DevOps Engineer-Hadoop Admin on our Big Data Federal Team you will help deliver 24x7 support for our Government Cloud infrastructure.
The Federal Big Data Team has 3 shifts that provide 24x7 production support for our Big Data Government cloud infrastructure.
Below are some highlights.
4 Day work week (Wednesday to Saturday OR Sunday to Wednesday)
No on-call rotation
Shift Bonuses for 2nd and 3rd shifts
This is a 2nd Shift position with work hours from 3 pm - 2 am Pacific Time
The Big Data team plays a critical and strategic role in ensuring that ServiceNow can exceed the availability and performance SLAs of the ServiceNow Platform powered Customer instances - deployed across the ServiceNow cloud and Azure cloud. Our mission is to :
Deliver state-of-the-art Monitoring, Analytics and Actionable Business Insights by employing new tools, Big Data systems, Enterprise Data Lake, AI, and Machine Learning methodologies that improve efficiencies across a variety of functions in the company : Cloud Operations, Customer Support, Product Usage Analytics, Product Upsell Opportunities enabling to have a significant impact both on the top-line and bottom-line growth.
The Big Data team is responsible for :
Collecting, storing, and providing real-time access to large amount of data
Provide real-time analytic tools and reporting capabilities for various functions including :
Monitoring, alerting, and troubleshooting
Machine Learning, Anomaly detection and Prediction of P1s
Capacity planning
Data analytics and deriving Actionable Business Insights
What you get to do in this role
Responsible for deploying, production monitoring, maintaining and supporting of Big Data infrastructure, Applications on ServiceNow Cloud and Azure environments.
Architect and drive the end-end Big Data deployment automation from vision to delivering the automation of Big Data foundational modules (Cloudera CDP), prerequisite components and Applications leveraging Ansible, Puppet, Terraform, Jenkins, Docker, Kubernetes to deliver end-end deployment automation across all ServiceNow environments.
Automate Continuous Integration / Continuous Deployment (CI / CD) data pipelines for applications leveraging tools such as Jenkins, Ansible, and Docker.
Performance tuning and troubleshooting of various Hadoop components and other data analytics tools in the environment : HDFS, YARN, Hive, HBase.
Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue, Kerberos, Tableau, Grafana, MariaDB, and Prometheus.
Provide production support to resolve critical Big Data pipelines and application issues and mitigating or minimizing any impact on Big Data applications.
Collaborate closely with Site Reliability Engineers (SRE), Customer Support (CS), Developers, QA and System engineering teams in replicating complex issues leveraging broad experience with UI, SQL, Full-stack and Big Data technologies.
Responsible for enforcing data governance policies in Commercial and Regulated Big Data environments.
Principal Big Data Engineer
Having the dynamic ability to adapt to conventional big-data frameworks and tools with the use-cases required by the project. Design and implement different architectural models for our scalable data processing, as well as scalable data storage. BS in Computer Science/Engineering, or equivalent 5+ e...
Principal Big Data Engineer:24-02560
We are seeking a Principal Big Data Engineer to leverage your expertise in handling vast datasets and crafting innovative data processing architectures. Primary Skills: Big Data, Data Processing, Java, Dataflow, GKE. The ideal candidate should have 5+ years of hands-on experience with large-scale da...
Staff Machine Learning & Data Engineer
Collaborate with data scientists, software engineers, and stakeholders to identify and prioritize data engineering and machine learning projects. Develop and maintain robust data architectures and infrastructure, including data storage, data processing, and data retrieval systems. Conduct code revie...
Senior, Software Engineer - Backend Big Data
Proficient in real-time & batch data pipelines using big data technologies (i. Big Data engineering experiences. Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineer...
Sr./Staff Software Engineer, Big Data
ShareThis, a Predactiv Company is a big data company that owns online behavior data of 1b+ users globally. We are developing an audience intelligence platform with cutting edge big data technologies. You will be responsible for big data software and platform architecture and development. Working kno...
Staff Engineer Software (Data Engineering)
We are seeking an experienced Big Data Software Engineer to design, develop and deliver next-generation technologies within our SASE team. Understanding of message queuing, stream processing, and highly scalable ‘big data’ data stores. Familiarity in Big Data technologies like Hive, Kafk...
Staff Software Engineer, Data
As a data engineer, you should have strong analytical skills and the ability to combine data from different sources to power machine learning that solves cybersecurity issues faced by diverse businesses today. To excel in this role, you must be excited about designing, building and optimizing the da...
Staff Process Engineer - Alternate Night Shift
A2 Shift: Sunday – Tuesday with Alternative Wednesday/ B2 Shift: Thursday through Saturday with Alternative Wednesday). Provide off-shift coverage of all process engineering activities across multiple functional areas for fuel cell manufacturing. A2 Shift: Sunday – Tuesday with Alternative Wednesday...
Senior Technical Staff Engineer-Product Marketing (Tier 1 Data Center Accounts)
Create key deliverables such as RFQ responses, Pricing strategy, Market & Competitive analysis and working with product management to produce compelling product collateralCandidate must possess excellent and effective oral and written communication skills, including the ability to express ideas clea...
Staff Security Engineer (SIEM & Data Management)
In this role, you will be responsible for executing security-related data engineering programs and managing data management & SIEM platforms. Integrate new data sources into the SIEM platform and ensure all relevant security data is captured and analyzed. SIEM engineering, and/or data analysis i...