Search jobs > Redmond, WA > Remote > Senior data engineer

Senior Data Engineer (Remote)

Comptech Associates Inc.
Redmond , WA
Remote
Full-time

Job Title : Senior Data Engineer (Remote)

Location : Redmond, WA / Remote

Duration : Long Term

No. of Positions : 1

JOB DESCRIPTION :

Candidate Location Requirements : Offsite Remote; Highly preferred to have a candidate in Silicon Valley, California for a hybrid schedule (not required)

If hybrid, # of days contractor will be required to work onsite : N / A

Daily Schedule & OT estimate : 40.00 hrs / week; NO OT

Chance for Extension (Y / N) : Yes; Sponsor s team has assignments get extended quarterly

Equipment or Software Required : Supplier Provided; Laptop, Headset, Mouse

Attestation Required / Type (if applicable) : N / A

Motivators for this need : This role has been opened due to finding someone with all the right skills

If the candidate has prior experience with Microsoft (18 Months), they need to have at-least 7 months of access break.

TYPICAL DAY IN THE ROLE

Purpose of the Team : The purpose of this team is working with the Mixed Reality Product Analytics team, which develops data collection and processing systems to improve the product capabilities

Key projects : This role will contribute to working with multiple disparate datasets, coming from different teams and locations, and will be standing up secure services to optimize data consumption and analytics.

Typical task breakdown and operating rhythm : The role will consist of :

20-30min Daily Team Sync

First : Coming up with diagrams for how the system is supposed to work

Second : Implementing it within the Azure tool and environment.

Depending on the day : C sharp or Python coding work that would be done to configure Azure functions or to set up automated processes.

Finally : Customer support issues, outages, new feature requests, more interrupt programming depending on what needs to be done.

COMPELLING STORY & CANDIDATE VALUE PROPOSITION

What makes this role interesting? - This role is aligned well : Microsoft infrastructure, using Microsoft tool chain and working at Microsoft (not a lot of third-party tools).

The role itself is related to hardware and process capability and data analytics for real products

Unique Selling Points : Contributing to making hardware for augmented reality and improving it using a hardware engineering focused view of the program in all of the data that's required to do so.

CANDIDATE REQUIREMENTS

Years of Experience Required : 8+ overall years of experience in the field.

Experience with data interpretation layers : Azure Synapse, Azure security settings, Azure blob storage, Azure Function Apps, Azure SQL, PowerBI, JMP

Microsoft synapse or Microsoft SQL Azure based tools

Performance Indicators : Performance will be assessed and tracked using ADO, quality of work and timelines

TOP 3 HARD SKILLS REQUIRED + YEARS OF EXPERIENCE

  • 8-10+ Years of Experience with data pipeline development, ETL, data warehouse design, preference for experience in using Azure Synapse, Azure Data Factory, Azure SQL
  • 8-10+ Years of experience with a programing language, Python or C#
  • Experience troubleshooting and resolving complex issues

HARD SKILLS ASSESSMENTS

Expected Dates that Hard Skills Assessments will be scheduled : ASAP

Hard Skills Assessment Process : The assessment process will include Panel with 3 people on the team, 45mins-1hr

Required Candidate Preparation : Candidates should be prepared to talk about their previous work

SUMMARY : The main function of the Engineer is to design, collect, and process data within Azure. This role involves the development of data acquisition tooling and reporting to derive product insights and better align the product to its design specifications.

JOB RESPONSIBILITIES :

  • Attend and contribute to daily team syncs
  • Takes ownership of data analytics projects and drives adoption and insights to our data consumers.
  • Design, develop, document robust data flow processes
  • Build and manage data pipelines using Azure Data Factory and Azure Synapse.
  • Monitor and optimize the performance of data systems to ensure they operate efficiently and securely.
  • Provide support for customer issues, outages, and new feature requests.
  • Collaborate with cross-functional teams to integrate disparate datasets into a common data view
  • Responsible for system health and monitoring and ETL development and support
  • Contribute clear and accurate documentation and user guides to enable data consumers
  • Strong ability to use azure tooling to create data pipelines, security configurations, and automation. C# or Python coding work that would be done to configure Azure functions or to set up automated processes.

Azure Synapse understanding would be necessary for ADF pipeline functions

SKILLS :

  • Creativity, verbal and written communication skills, analytical and problem-solving ability.
  • Team player and detail oriented.
  • 4-5+ years of experience with Azure data infrastructure, including Azure Synapse, Azure Data Factory, and Azure SQL,
  • Experience understanding and performing azure process optimization
  • 8-10+ years of experience with file formatting (CSV, JSON, HTML) and data transport into SQL databases.
  • Strong analytical and problem-solving abilities.

EDUCATION / EXPERIENCE :

8-10 years of experience in data engineering or a related field.

DRUG SCREEN

2 hours ago
Related jobs
Promoted
Amazon
Seattle, Washington

As a Senior Data Engineer, you will work in one of the world's largest and most complex data warehouse environments, partnering with other engineers, Scientists, and Program Managers to develop scalable and maintainable data pipelines on both structured and/or unstructured data. Senior Data Engineer...

Promoted
Nordstrom Inc
Seattle, Washington

Design and develop distributed data processing pipelines in the Big Data ecosystem in the Cloud, apply data concept, modeling, structures, and infrastructure technologies and adhere to good engineering practices. The Insights Delivery Team delivers data and insights that enables Nordstrom data analy...

Hydrogen Group
Seattle, Washington
Remote

NOTE: 100% remote but MUST currently reside within Colorado State, or be willing to re-locate to Colorado. Bachelor’s or Master’s degree in Electrical Engineering, Computer Science, or related field. ...

Databricks
Seattle, Washington

As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...

Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council )
Seattle, Washington
Remote

Proven experience in systems engineering, with a focus on hybrid cloud platforms, automated storage systems, and data protection technologies. We are seeking a Systems Engineer who will be responsible for designing, implementing, and maintaining IT infrastructure, focusing on HPE GreenLake, VLM, and...

Amazon Data Services, Inc.
Seattle, Washington

Amazon is seeking an experienced, results-oriented, Senior Software Dev Engineer. Why now? As we expand the reach of our algorithms and services, we need to scale and are looking for a talented software development engineer that wants to get experience with Software Defined Networking (SDN), hyper s...

Bill & Melinda Gates Foundation
Seattle, Washington

You will work with a team consisting of business partners, business and data analysts, solution architects, data architects, data and infrastructure engineers, quality engineers and other technical roles in an Agile delivery environment. Lead data storage solutions, including data lakes, data wareho...

Disney Entertainment & ESPN Technology
Seattle, Washington

You will be able to own the entire lifecycle of data pipelines, communicate your requirements with upstream DATA teams, bring your data engineering skills and ideas into life by engineering efficient data pipelines, and help supporting the feature requirements by the ML engineers/data scientists. In t...

Planate
Redmond, Washington
Remote

Use computer-assisted engineering software (AutoCAD, coordination studies load analysis) to perform engineering tasks as assigned. Planate Management Group (PMG) is a Service-Disabled Veteran-Owned Small Business (SDVOSB) headquartered in Alexandria, Virginia, and Orlando, Florida USA with a technic...

Luxus
Seattle, Washington
Remote

Senior Mechanical Engineer (Hybrid-Remote): Shape the Future of Sustainable Design at Glumac. As a senior engineer, you will mentor and guide junior team members, fostering their technical skills and professional development. As the Engineer of Record, you will foster seamless communication with cli...