Search jobs > New York, NY > Remote > Principal data engineer

Principal Data Engineer (Remote)

World Education Services
New York, NY, USA
$120K-$125K a year
Remote
Full-time

Title : Principal Data Engineer

Department : Technology

Salary : $120K - $125K USD

Location : Remote (Candidates based in the US)

Description :

The Principal Data Engineer will be responsible for designing, developing, and maintaining our data architecture, with a focus on Snowflake and ETL processes.

The ideal candidate will have a deep background in data engineering, expertise with Snowflake's cloud data platform, and highly proficient in ETL tools and methodologies.

As part of our data team, you will play a crucial role in elevating our data infrastructure, ensuring scalability, reliability, and efficiency in handling large volumes of data.

Duties included but not limited to :

  • Integrate diverse data sources by designing and implementing scalable high performance data pipelines, architecture and infrastructure.
  • Build and implement ETL processes using a variety of methods to facilitate efficient movement of data between systems
  • Develop culture to incorporate best practices to ensure data pipelines are robust and include error handling and alerting
  • Design data models that turn complex organizational data into easy to use data structures ensuring seamless flow for WES’S operational, analytics and reporting needs
  • Use DBT or Snowflake native capabilities to transform data and ensure data is accurate and up to date
  • Optimize data structures and queries to ensure efficient data storage and retrieval.
  • Implement and enforce data quality standards to ensure the accuracy and reliability of educational data used in academic assessments globally.
  • Collaborate with cross-functional teams, including analysts and business stakeholders, to understand unique data requirements for data processing or analytics needs
  • Implement and maintain data security measures to protect sensitive information, ensuring compliance with international data privacy regulations.
  • Develop and maintain practices for effective data warehousing, transformations, data sharing, and structured management
  • Create and maintain comprehensive documentation for data engineering processes, systems, and workflows
  • Provide technical leadership and mentorship to junior members of the data engineering team, fostering a collaborative environment dedicated to excellence in handling educational data
  • Utilize Tableau to deliver data insights using impactful visualizations in a meaningful and actionable manner

Requirements :

  • Education : in Computer Science, Information Technology, or a related field, with a strong emphasis on Data related technologies
  • 8+ years’ experience in a data engineering role, with a focus on designing and implementing scalable data solutions
  • Highly proficient in programming languages such as Python, Java, or Scala.
  • Expertise in working with both SQL and NoSQL databases, with hands-on experience in database design and optimization. Proficiency in Snowflake is required
  • Expertise in Snowflake for effective data warehousing, transformations, data sharing, and structured management in a cloud-based environment
  • Well versed in Machine Learning concepts and commitment to growth in this area.
  • Proficient with cloud platforms like Azure, AWS, or Google Cloud Platform
  • Experienced using Azure for Data Engineering tasks i.e. function apps and other Azure functionality that can be used to build data pipelines a plus
  • Knowledge of version control systems like Git or Azure DevOps for managing the codebase
  • Strong analytical and problem-solving skills to address complex data engineering challenges specific to educational data
  • Excellent communication skills to effectively collaborate with cross-functional teams and non-technical stakeholders
  • Ability to adapt to evolving technologies and industry best practices in the field of data engineering
  • Experience using TIBCO EBX a plus
  • Experience using Boomi or other low code ETL tools a plus

EOE Statement : World Education Services provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity or expression, veteran status, or genetics.

In addition to federal law requirements, World Education Services complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

30+ days ago
Related jobs
Promoted
Capital One
New York, New York

Principal Associate, Data Loss Prevention Engineer (CASB). As a member of the Data Loss Prevention (DLP) engineering team, you will play a key role on a team of cyber technicians and engineers to create, implement, and maintain DLP Controls using SaaS and IaaS based solutions to reduce risk and enfo...

Promoted
VirtualVocations
Queens, New York

A company is looking for a Principle Data Engineer to build and manage data solutions and applications for business decisions. ...

GoodRx
New York, New York
Remote

Experience related to data privacy like CCPA & GDPR (Data deletion, data de-identification, Right to forget and such). GoodRx is looking for a Principal Software Engineer to join our Architecture team. Experience with data processing frameworks such as Spark, Databricks and Kafka Streams. Experience...

GEICO
New York, New York
Remote

Collaborate intensively with network engineering to optimize data center functionality, considering the impact of hardware integration and firmware compatibility. Industry certifications that endorse expertise in hardware engineering, firmware management, or data center operations are highly benefic...

GlobalFoundries
New York, New York
Remote

Education - Bachelor's degree, or foreign equivalent, in Statistics, Computer Science, Engineering or similar field. Requires 5 years of experience with: (1) Pivot Tables, recording, editing, and modifying macros and VBA programming; (2) Oracle or Anaplan Planning software; (3) Build and maintain co...

GEICO
New York, New York
Remote

Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool) or Databricks. We are seeking experienced eng...

Capital One Careers
New York, New York

West 19th Street (22008), United States of America, New York, New YorkPrincipal Associate, Data Loss Prevention Engineer (CASB). As a member of the Data Loss Prevention (DLP) engineering team, you will play a key role on a team of cyber technicians and engineers to create, implement, and maintain DL...

Promote Project
Queens, New York

LeafLink is seeking a Principal Data Engineer to join our remote-friendly team, headquartered in NYC, who is passionate about working with teams that solve interesting, large-scale problems rapidly. Help define, document, evolve, and evangelize high engineering standards, best practices, tenants, an...

Capital One
New York, New York

West 19th Street (22008), United States of America, New York, New YorkPrincipal Associate, Data Loss Prevention Engineer (CASB). As a member of the Data Loss Prevention (DLP) engineering team, you will play a key role on a team of cyber technicians and engineers to create, implement, and maintain DL...

FactSet
New York, New York

Data Solutions Engineering team, part of a major initiative within the Data Solutions (DS) business unit. Fine-tune Snowflake database performance, managing partition keys and indexes while minimizing costs and optimizing data consumption for applications. Build data pipelines for applications, incl...