Data Engineer
Insight Global is looking for a remote Data Engineer for one of their premier clients. The Data Engineer will help streamline current infrastructure and help mature the streaming transport & transformation layer to enable the entire engineering & technology organization to utilize low-latency data.
He / She will also provide oversight and expertise in Data Modeling and Database Design. The Data Engineer will Architect and develop data models, ETL packages, OLAP cubes, and reports utilizing SSMS, SSIS, SSAS, and SSRS applying best practices through the development lifecycle.
The ideal candidate will identify areas of improvement to optimize data flows. This person needs to have excellent communication, leadership and eagerness to thrive in a team-oriented environment
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.
We are an equal opportunity / affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.
If you need assistance and / or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy : https : / / insightglobal.
com / workforce-privacy-policy / .
- Experience with Docker & k8s
- Experience with streaming transport (e. g. Kafka, Pub / Sub) and stream processing
- Expertise with CDC fundamentals and database replication
- Experience programming in any language in a collaborative engineering environment, Python preferred
- Familiarity with infrastructure as code (e. g. Terraform, Pulumi)
- Strong SQL skills (especially tuning for performance and cost on OLAP query engines)
- Deep experience with at least one OLAP processing engine such as Spark, Snowflake, BigQuery, Clickhouse, etc
- Experience with public clouds (e. g. AWS, Azure, GCP, or DO)
- Ability to reason about and develop designs for data systems and pipelines
- Experience dealing with governance and security for data infrastructure