Airflow Data Engineer

VirtualVocations
Bronx, New York, United States
Full-time

A company is looking for an Airflow Data Engineer to enhance and automate data workflows.Key Responsibilities : Set up and configure Astronomer Airflow, ensuring operational connections and componentsMigrate existing workflows to the Astronomer Airflow platform and optimize their performanceEstablish monitoring tools and alerts for workflow performance and create documentation for best practicesRequired Qualifications : Proven experience with Astronomer Airflow and data workflow orchestrationStrong understanding of CI / CD pipelines and version control systems like GitHubExperience with cloud platforms, particularly Azure, and integrating external servicesProficiency in Python and SQLExperience with Databricks and Snowflake is preferred

5 days ago
Related jobs
Promoted
VirtualVocations
The Bronx, New York

A company is looking for an Airflow Data Engineer to enhance and automate data workflows. ...

Promoted
Sun Pharmaceutical Industries, Inc.
Mamaroneck, New York

Conducts analyses based on operational, market, economic and/or financial data in order to build business cases and models to derive business insights and inform decisions. Builds the business cases for presentation to management/leadership to identify and/or improve OTC portfolio and commercial bus...

Promoted
Capital One
Queens, New York

Center 2 (19050), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of ...

Promoted
VirtualVocations
Queens, New York

A company is looking for an Airflow Data Engineer to enhance and automate data workflows. ...

Promoted
Two95 International Inc.
New York, New York

Location: New York, NY/ Chicago, IL.Bachelor’s degree in Computer Science or related field preferred.Strong troubleshooting skills .Excellent communication skills.Note: If interested please send your updated resume and include your rate requirement along with your contact details with a suitable tim...

Promoted
Syntricate Technologies Inc
New York, New York

Scripting Resources (Perl/Shell/JS): Medium amount of profiles request.Strong programming skills in Perl, Shell / Korn Shell, Java Scripts.Experience with writing and testing code, debugging for various projects.Familiarity with distributed storage systems like DB2, Sybase / Sybase IQ, MongoDB.Famil...

Promoted
Dfbooking Recruitment Services
New York, New York

A seasoned software developer is needed to join this team. Develop solutions using Python, Hadoop, Spark, and HIVE/SQL. Work on projects that require deep knowledge of Python and Spark and the ability to deliver custom solutions to big data in a performant manner. At least three (3) years of recent ...

Promoted
SynergisticIT
New York, New York
Remote

Currently, We are looking for entry-level software programmers, Java full-stack developers, Python/Java developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Experience in programming language Java and understanding of the software dev...

Promoted
Northwell Health
Lake Success, New York

Maintains data acquisition process and data pipelines; verifies data quality, and/or ensures it via data cleaning and processing. Works directly with the Data Science and Predictive Analytics team to advance data engineering and infrastructure within Northwell, as well as migrate and support machine...

Promoted
Morgan Stanley
New York, New York

Our team is looking for a dynamic, self-motivated, highly driven and technology savvy individual to fill the role of Business Analyst. Partner with Technology, Business and Operations partners to understand and elaborate requirements. Experienced understanding of business line and discipline. Bachel...