Platform Engineer - Data Replication

Costco IT is responsible for the technical future of Costco Wholesale , the third largest retailer in the world with wholesale operations in fourteen countries.

Despite our size and explosive international expansion, we continue to provide a family, employee centric atmosphere in which our employees thrive and succeed.

As proof, Costco ranks Eighth in Forbes World’s Best Employers .

This is an environment unlike anything in the high-tech world and the secret of Costco’s success is its culture. The value Costco puts on its employees is well documented in articles from a variety of publishers including Bloomberg and Forbes.

Our employees and our members come FIRST. Costco is well known for its generosity and community service and has won many awards for its philanthropy.

The company joins with its employees to take an active role in volunteering by sponsoring many opportunities to help others.

Come join the Costco Wholesale IT family . Costco IT is a dynamic, fast-paced environment, working through exciting transformation efforts.

We are building the next generation retail environment where you will be surrounded by dedicated and highly professional employees.

Platform Enginee rs translate high level platform design into low level technical design and are responsible for implementing, administering, supporting, and patching their corresponding platforms.

Platform Engineers work closely with Solution Architects to enable the capabilities defined on roadmaps and blueprints supporting platform programs and initiatives.

Platform Engineers are well versed in modern data, infrastructure and integration platforms, industry / technology best practices, and actively work on improving the reliability and scalability of infrastructure.

The Platform Engineer in data replication is responsible for creating and maintaining our essential data ingest platforms that enable our enterprise data and analytics products.

This involves working with cloud-based and on-premise resources, developing automation scripts, alerting and ensuring platform optimization for performance, stability, and scalability.

The data replication team administers configurations for different environments ensuring smooth operations of our data replication platforms.

Our Platform Engineers work closely with diverse teams on the data source side, as well as teams that consume that data we deliver to ensure data is being delivered with high quality.

Our Platform Engineers interact with the consumers of our data products, stakeholders, and management translating technical details into business-friendly language.

ROLE

Collaborates with delivery pods and Architects to improve production deployments, platform operations, and environment stability.

Assesses technical components, translates high level design into low level technical design, and executes updates based on SLAs.

Manages the platform on an ongoing basis while performing typical run functions like monitoring, patching, and support.

Leads and conducts code reviews, design reviews, testing, and debugging activities at the application level.

Conducts regular platform checkups and report inefficiencies to relevant business and technology stakeholders.

Collaborates with infrastructure and / or provisioning groups to stand up the platform.

Develops and instruments monitoring dashboards depicting platform health and performance.

Develops and builds scalable and generalized frameworks to support the integration of internal and third-party APIs.

Performs analysis on existing platform components to identify improvements to software development processes.

Develops and implements Platform as a Service (PaaS) Solutions.

Remediates platform issues and bottlenecks impacting software development activities.

Participates in the creation of documentation and artifacts used to describe the mechanisms used for deployment, monitoring, and maintenance.

Collaborates with Architects and technology team members to define development tasks and activities within technical user stories to support the implementation of Infrastructure as a code solution.

Performs coding tests to validate hardware design correctness, and creates software regression tests to ensure its reliability.

Plans and Implements arrangements for Disaster Recovery and conducts related testing of recovery procedures.

Delivers against business objectives by effectively managing and partnering with technology vendors.

Conducts research and makes recommendations on standards, products, and services.

Tests diagnostics, including automated regression testing.

Develops and executes integration testing plans, as needed.

Authors and executes test cases related to supporting the implementation of platform development work.

Maintains the catalog of services for the platform in collaboration with the Architects.

Ensures application and infrastructure architectural solutions are stable, secure, and compliant with company standards and practices, as well as regulatory requirements.

Implements and maintains system configurations and baselines to support secure application development software control best practices and standards.

Implements service monitoring across all platforms to ensure continuous availability and operational continuity of critical systems.

Evaluates and documents all operating systems according to required standards.

Participates in the development of continuous integration / continuous development frameworks in support of DevOps and Agile practices.

Develops and operationalizes data ingestion pipelines to bring data into the various environments used for the consumption of our certified data sets.

Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality, and orchestration.

Designs, develops, and implements integration processes using Oracle Golden Gate, IBM InfoSphere, Informatica PowerExchange, Azure Data Factory, AWS Glue, and other integration products.

Uses Azure services, such as Azure SQL DW (Synapse), ADLS, Azure Event Hub, Cosmos, Databricks, DeltaLake to improve and speed delivery of our data products and services.

Identifies, designs, and implements internal process improvements : automating manual processes, optimizing data delivery.

Identifies ways to improve data reliability, efficiency, and quality of data.

Communicates technical concepts to non-technical audiences both in written and verbal form.

Performs peer reviews for other platform engineers’ work.

REQUIRED

5+ years’ experience engineering and operationalizing data ingestion pipelines with large and complex datasets.

5+ years’ experience with Data Integration efforts bringing data from a variety of sources both on-premise and cloud to targets both on-premise and cloud.

3+ years’ experience working with Cloud technologies, such as ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB, and other big data technologies.

2+ years’ hands-on experience with Oracle GoldenGate, IBM InfoSphere, Qlik, AWS Glue or other data replication or integration tools.

Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON).

Experience implementing data integration techniques, such as event / message based integration (Kafka, Azure Event Hub), ETL.

Advanced SQL skills; solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.

Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).

Experience with Git / Azure DevOps.

Able to work in a fast-paced agile development environment.

Recommended

Familiarity with methods and tools to replicate data from a variety of data sources to cloud and on-premise targets.

Required Documents

Cover Letter

Resume

California applicants, please click to review the Costco Applicant Privacy Notice.

Pay Ranges :

Level 2 - $105,000 - $135,000

Level 3 - $130,000 - $160,000

Level SR - $150,000 - $190,000, Bonus and Restricted Stock Unit (RSU) eligible

We offer a comprehensive package of benefits including paid time off, health benefits - medical / dental / vision / hearing aid / pharmacy / behavioral health / employee assistance, health care reimbursement account, dependent care assistance plan, short-term disability and long-term disability insurance, AD&D insurance, life insurance, 401(k), stock purchase plan to eligible employees.

If hired, you will be required to provide proof of authorization to work in the United States. In some cases, applicants and employees for selected positions will not be sponsored for work authorization, including, but not limited to H1-B visas.