Search jobs > New York, NY > Remote > Principal data engineer

Principal Data Engineer (Remote)

World Education Services
New York, NY, USA
$120K-$125K a year
Remote
Full-time

Title : Principal Data Engineer

Department : Technology

Salary : $120K - $125K USD

Location : Remote (Candidates based in the US)

Description :

The Principal Data Engineer will be responsible for designing, developing, and maintaining our data architecture, with a focus on Snowflake and ETL processes.

The ideal candidate will have a deep background in data engineering, expertise with Snowflake's cloud data platform, and highly proficient in ETL tools and methodologies.

As part of our data team, you will play a crucial role in elevating our data infrastructure, ensuring scalability, reliability, and efficiency in handling large volumes of data.

Duties included but not limited to :

  • Integrate diverse data sources by designing and implementing scalable high performance data pipelines, architecture and infrastructure.
  • Build and implement ETL processes using a variety of methods to facilitate efficient movement of data between systems
  • Develop culture to incorporate best practices to ensure data pipelines are robust and include error handling and alerting
  • Design data models that turn complex organizational data into easy to use data structures ensuring seamless flow for WES’S operational, analytics and reporting needs
  • Use DBT or Snowflake native capabilities to transform data and ensure data is accurate and up to date
  • Optimize data structures and queries to ensure efficient data storage and retrieval.
  • Implement and enforce data quality standards to ensure the accuracy and reliability of educational data used in academic assessments globally.
  • Collaborate with cross-functional teams, including analysts and business stakeholders, to understand unique data requirements for data processing or analytics needs
  • Implement and maintain data security measures to protect sensitive information, ensuring compliance with international data privacy regulations.
  • Develop and maintain practices for effective data warehousing, transformations, data sharing, and structured management
  • Create and maintain comprehensive documentation for data engineering processes, systems, and workflows
  • Provide technical leadership and mentorship to junior members of the data engineering team, fostering a collaborative environment dedicated to excellence in handling educational data
  • Utilize Tableau to deliver data insights using impactful visualizations in a meaningful and actionable manner

Requirements :

  • Education : in Computer Science, Information Technology, or a related field, with a strong emphasis on Data related technologies
  • 8+ years’ experience in a data engineering role, with a focus on designing and implementing scalable data solutions
  • Highly proficient in programming languages such as Python, Java, or Scala.
  • Expertise in working with both SQL and NoSQL databases, with hands-on experience in database design and optimization. Proficiency in Snowflake is required
  • Expertise in Snowflake for effective data warehousing, transformations, data sharing, and structured management in a cloud-based environment
  • Well versed in Machine Learning concepts and commitment to growth in this area.
  • Proficient with cloud platforms like Azure, AWS, or Google Cloud Platform
  • Experienced using Azure for Data Engineering tasks i.e. function apps and other Azure functionality that can be used to build data pipelines a plus
  • Knowledge of version control systems like Git or Azure DevOps for managing the codebase
  • Strong analytical and problem-solving skills to address complex data engineering challenges specific to educational data
  • Excellent communication skills to effectively collaborate with cross-functional teams and non-technical stakeholders
  • Ability to adapt to evolving technologies and industry best practices in the field of data engineering
  • Experience using TIBCO EBX a plus
  • Experience using Boomi or other low code ETL tools a plus

EOE Statement : World Education Services provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity or expression, veteran status, or genetics.

In addition to federal law requirements, World Education Services complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

30+ days ago
Related jobs
Promoted
Clari Inc.
New York, New York
Remote

Query Manager is a part of Clari's Data Platform team, and is the interface that allows application and API developers to easily and efficiently retrieve data across hundreds of databases and billions of rows of data that comprise our ever-evolving Data Platform. Learn and contribute to all aspects ...

Promoted
VirtualVocations
New York, New York
Remote

A company is looking for a Principal Software Engineer - REMOTE. ...

Promoted
HappyFunCorp
New York, New York
Remote

We are looking for an experienced technologist with a blend of Data Engineering and Data Analysis skills who is comfortable working in a large cloud-based data environment. Data Engineer / Analyst - Remote - Contract. You will need to become familiar with and extract data from a large data lake whic...

Promoted
VirtualVocations
Queens, New York
Remote

A company is looking for a Principal Software Engineer - Frontend SPA (Remote). ...

Tiger Analytics
New York, New York

Extensive experience in data engineering, data analysis, and machine learning. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Developing intera...

CLEAR
New York, US

As a Principal Engineer for our Data Platform team, you will be responsible for modernizing our data platform & practice. Data Engineer, focusing on building scalable data solutions. You will work cross-functionally with multiple engineering teams, providing leadership & advice & helping teams integ...

Ichor Strategies
New York, New York

Deep knowledge and experience with architectures for modern data infrastructure including data lakes, data warehouses, ETL pipelines, physical and logical data formats, data processing systems, data reliability, security, governance, and performance. Ichor Strategies seeks a Principal Data Engineer ...

Outcome Logix ( A Tech 50 Finalist company 2022, by Pittsburgh Technology Council )
New York, New York
Remote

Proven experience in systems engineering, with a focus on hybrid cloud platforms, automated storage systems, and data protection technologies. We are seeking a Systems Engineer who will be responsible for designing, implementing, and maintaining IT infrastructure, focusing on HPE GreenLake, VLM, and...

Hiscox
New York, New York

A robust understanding of core data engineering topics – ETL vs ELT, structured and unstructured data, data quality and data governance. Participating in code reviews for data engineering practice and as a principal ensuring that all engineers conduct such reviews to a high standard. While you will ...

Capital One
New York, New York
Remote

Sr Lead Data Platform Engineer, Shopping (Remote-Eligible). We are seeking Full Stack Software Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Software Engineer, you’ll have the opportunity to be on the forefront of driving a major transforma...