Data Engineer/ETL
Data Engineer / ETL
Location : Pittsburgh, PA
Contract for 12+ months
Description :
Data Engineer - ETL with Python, Hadoop & Snowflake
Responsibilities
- Organize business needs into ETL / ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions
- Craft and implement data pipelines utilizing Glue, Lambda, Spark, and Python
- Define and deliver reusable components for ETL / ELT framework.
- Define optimal data flow for system integration and data migration
- Integrate new data management technologies and software engineering tools into existing structures
Supplier Call Notes :
They are looking for a true data engineer / ETL
Top 5 Skills are Python, Snowflake, Airflow, Spark, SQL
Primary skills are spark and Python Must be strong here
Must be good with Airflow (scheduling tool)
Need good skills with Hadoop and Snowflake MUST have very good experience in Snowflake
They will be using some SQL and Kubernetes on the job as well
Will be building out ETL pipelines, data pipelines, regulatory requirements 100% ETL work, no data modeling
Looking for 6-7+ years experience minimum 100% engineering role
ETL Ab Initio Data Validation Engineer (SDET)
Aptos,sans-serif"><b>Job Title: </b><b>ETL Ab Initio Data Validation Engineer (SDET)</b></span></span></p> <p><span style="font-size:11pt"><span style="font-family:Aptos,sans-serif"><b>Primary skills: </...
Data Analyst (Reg FT)
The data analyst will expand data availability in the college, playing a significant role in making sure that data and information produced is delivered accurately and efficiently. Able to clean, debug, and analyze complex datasets that link data from a variety of sources and rapidly create ad hoc d...
Senior Associate, Data Management Analyst
Perform data analysis, interpretation, data modelling and transformation of incoming/outgoing OTC data messages to support trade lifecycle management workflow and internal and client external reporting. Troubleshoot and resolve issues pertaining to data quality, ensuring the integrity of static, mar...
Senior Data Analyst
Federal Home Loan Bank of Pittsburgh (Pittsburgh, PA) to be rspnsble for trnsltng data reqs into applcts tht emply apprprte data mdls & ETL sltns; anlyzng, definng, dvlpng, & maintnng cmplx databse strctrs & ETL archtctrs & applctns; dvlpng & implmntng data validtn, auditng, recnciltn, tstng mthdlgy...
Data Quality Analyst
Coordinate Data Quality activities with the Data Management team / Data Governance Committee and Data Quality Working Groups). We would like to have a future team member in the role of Data Quality Analyst join our Enterprise Data Governance team. Collibra (Data Quality Data Catalog, Business Glossa...
SQL Developer
SQL developers are responsible for the design, creation, and maintenance of SQL databases. Database development: Writing SQL queries, procedures, and triggers for application development. ...
ETL Informatica Developer (PowerExchange)
Job Title: ETL Informatica Developer (PowerExchange). We are seeking an experienced ETL Informatica Developer with specialized experience in PowerExchange to join our data management team. Minimum of 3-5 years of experience with Informatica PowerCenter and at least 2 years of experience with Informa...
Data Engineer (Databricks with Snowflake)
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. Experience handling l...
Informatica Developer
Years of experience in Informatica Development. Expert level knowledge of Informatica tools - extensive hands-on experience with all concepts including data profiling, obfuscation/masking, data sub-setting, provisioning, gold-copy creation, synthetic data generation, self-service etc. ...
SQL ETL Developer
SQL and ETL along with SSRS and SSIS +. Database Skills: Understanding databases (such as SQL Server) is crucial for storing and retrieving data in your applications. ...