As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining the company's data infrastructure. You will work closely with data scientists, analysts, and engineers to build robust and scalable data pipelines that power the company's decision-making processes. Be...
As a Data Mining Engineer at HELLRAISERS, LLC, you will focus on developing and optimizing data mining models and algorithms to uncover actionable insights, supporting data-driven strategies across our client projects. Proven experience in data mining, data engineering, or data science roles. We are...
Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets. Build processes supporting data transformation, data structures, metadata management, dependency, and workload management. Advanced working SQL knowledge and experience working with relational databases, quer...
This person will build dashboards/reports and create custom business applications (Power Apps) from source data, including requirements capturing, data identification and structure, extracting the data and crafting dashboards, scorecards, and reports. Experience working with Data Warehousing, dimens...
Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and other Azure data services. As an Azure Data Engineer specializing in Copilot implementation, you will play a crucial role in designing, developing, and deploying data solutions that integrate with Microsoft Copilot. Develop...
Proven track record as a data engineer, crafting new solutions and re-platforming legacy data products. ETL (snaplogic or Informatica), Relational databases (Oracle, PostgreSQL, etc. NoSQL databases (DynamoDB, Elastic search), python, AWS. Experience in Kafka Data Streaming (or other streaming/messa...
Develop and optimize SQL queries and views for data analysis. Collaborate with E&P business stakeholders to identify reporting needs and resolve data issues. Create and maintain dashboards in Power BI to visualize data insights. Take ownership of data quality and accuracy, proactively addressing any...
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Provide technical leadership and mentorship to data engineering teams, advocating for best practices in data engineering, data quality, and data management to foster a culture of excellence. Lead initiatives to modernize data architecture, including the transition to cloud-based data solutions and t...
Min 4 years of core development experience in below stacks:•Deep expertise in Scala or Python for Spark application development•Strong knowledge and hands-on experience in SQL, Unix shell scripting•Experience in end-to-end implementation of projects using Cloudera Hadoop, Spark, Hive, HBase, Sqoop, ...
Provide technical leadership and mentorship to data engineering teams, advocating for best practices in data engineering, data quality, and data management to foster a culture of excellence. Lead initiatives to modernize data architecture, including the transition to cloud-based data solutions and t...
Data Protection Solutions: Proficiency in designing data protection solutions, such as data security posture management (DSPM), data loss prevention (DLP) systems, encryption technologies, and data masking/anonymization techniques. We ask that you have expertise in data security, security engineerin...
Performs modeling of data sources and flows, works with data management staff to define an operational framework that will define, develop and implement policies and security frameworks to ensure precise and secure delivery of knowledge and information. Perform modeling of data sources and flows, wo...
You will be responsible for leading the data engineering team to innovate and implement the newest data engineering trends and best practices to create complex data pipelines withing UT’s cloud data ecosystem in support of academic and administrative needs. The Principal Data Engineer for the UT Dat...
This role within the 'Data Engineering & Self-Service Products' team involves architecting and engineering analytic data solutions, including designing and developing data marts in Databricks using PySpark or Spark SQL, building interactive Power BI dashboards to visualize KPIs and trends, and creat...
We are seeking a Principal Data Engineer to support an R&D Data science group. This position will require extensive prior knowledge and experience with data engineering in an enterprise environment, specifically with a data warehouse/lakehouse. This includes an understanding of different ETL & data ...
Scope key business challenges, identify the right data and provide direction to data analysts, data analytics product managers, data scientists, data engineers and business stakeholders. As a Senior Data Engineer, you be responsible for the design and development of data pipelines, automation, and v...
Design and manage REDCap projects and data storage systems, including relational databases, NoSQL databases, and data warehouses. The Data Engineer will play a crucial role in advancing the CDC Foundation's mission by designing, building, and maintaining data infrastructure for a public health organ...
Hands-on experience engineering, deploying, and running cloud solutions on Azure services like Azure SQL, Azure Service Bus, HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Stream Analytics, Azure Data Factory, Synapse, CosmosDB , Azure databricks, Azure Analysis Services, Power BI S...
We're looking for a highly skilled experienced engineers to design and build high-scale, cloud-based data processing systems that can handle massive amounts of data with low latency. As part of this team, you will accelerate several architectural efforts - achieve orders of magnitude data processing...
Ability to securely ingest data from public and other Toyota sources to better insights</li> </ul> <div><b><u>Technical Skills:</u> </b></div> <ul> <li><b>Cloud Platforms: </b>AWS (EC2, S3, RDS, Lambda, CloudFormation, VPC, IAM...
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies. Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technica...
At least 2 years of experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Azure Synapse AnalyticsHands on experience in end-to-end implementation of data warehouse and data martsExperience in writing SQL queries to analysis Ty...
The Software Engineer Lead IT is responsible for leading the design of technology solutions to ensure they meet all resiliency, stability, non-functional, functional and operational readiness use cases. Minimum of 2 years working in a distributed cloud data environment. Experience with multiple data...
Extensive experience with AWS components like S3, Athena, EMR, Glue, Redshift, Kinesis and Sage maker</li> <li>Experience in Automating ETL process with Python and Automation around AWS Data & Infrastructure</li> <li>Extensive Experience with SQL/Unix/Linux scripting is a...