Senior Data Engineer
Job Description
Job Description
Salary : The role
The role
VeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments.
VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.
Its application suite employs multiple large data environments (including relational, graph and elastic search) to conduct its business.
The company is looking for a hands-on data engineer to take a leadership role in building a next-generation version of its analytics toolbox for use by customers with moderate skills in Big Data analysis and our own analysts and data scientists.
Key responsibilities include :
- Defining and implementing effective & scalable distributed data infrastructure solutions using best-in-class standard tools.
- Selecting & implementing continuous data quality management & improvement solutions within and across Graph and relational environments.
- Selecting & integrating next get BI solution(s) to enable efficient, effective selection, consumption and presentation of data to users.
- Discovering and exploring new technologies, tools, and data sources with curiosity and creativity.
- Managing requirements throughout the data asset development lifecycle.
Qualifications :
- 5+ years of experience developing and managing large distributed databases building analytical platforms and constructing complex extracts.
- Experience working with leading-edge distributed database solutions like Apache Spark, Apache Arrow, Dremio, Databricks, and similar tools.
- Experience customising analytical and visualisation tools like Apache Superset for end-user consumption and display.
- Familiarity with data science, statistics, and search (e.g. Elastic Search) methods & technologies is important.
- Proficient in Java or Python in an Agile enterprise software development environment preferred.
- Cloud services knowledge and experience are a plus.
Senior Data Engineer - Contract
Key Responsibilities:Data Architecture DesignETL ManagementData Security and ComplianceRequired Qualifications:Production experience on Cloud Providers (AWS, Azure)Data Modeling and Warehousing Tools and TechniquesDatabase Management and SQL (MS SQL, MySQL)ETL Tools and TechniquesData Security and C...
Senior Data Warehouse Engineer(Only W2 Position)
Experience on design and development of Data Warehouse Architecture for Enterprise Data Warehouse (EDW), Operational data Store (ODS), Operational Data Marts and Data Marts. Clientl is undergoing a major modernization of their business applications and is seeking a Data Warehouse Developer (Develope...
Senior Data Engineer
Work with the team for technical implementation of Data Engineering projects including data streaming, data transformation and aggregation pipelines. Must have experience with big data and streaming technologies like Apache Spark, Apache Kafka and Data Warehouse. At adMarketplace, we create best of ...
Senior Data Solution and Delivery Engineer
The State of Connecticut is embarking upon a digital transformation to uplift the lives and well-being of our residents, businesses, and employees.Our goal is to improve access to our programs and services, making interaction with government easier.When you join the Connecticut Digital Service, you'...
Senior Data Engineer, Data Ingestion
How you’ll make an impact: In this role you will be a member of a team responsible for designing and developing a data ecosystem to promote an environment of data democratization and utilization across SiriusXM and Pandora. This role will report to a Director of Data Engineering. Strengthen corporat...
Senior Software Engineer - Data Capture Team
As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...
Senior Data Engineer - Enterprise Identity Services
The data operations team will be responsible for data engineer and analysis, quality measures and improvement, data flows and forecasting, and managing our relationship with our customers. This role will join a Data Operations team directly responsible for improving the accuracy and understanding of...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Senior Software Engineer - Data Capture Team
Communicate and work with multi-functional business partners, including product, design, and backend engineering. ...
Senior Software Engineer - Data Services.
Fastly helps people stay better connected with the things they love.Fastlys edge cloud platform enables customers to create great digital experiences quickly, securely, & reliably by processing, serving, & securing our customers applications as close to their end-users as possible at the edge of the...