Synechron

English

English  |   Dutch
 
Technology Airflow Developer New York & Jersey, NJ, USA
Job Description

We are looking for an experienced Airflow Developer to work for our client in the New York or New Jersey office.

Responsibilities
  • Develop guidelines for Airflow cluster and DAG's. Performance tuning of the DAG's and task implementation.
  • Develop DAG - data pipeline to on-board and change management of datasets.
  • Implement CI/CD for Airflow DAG deployment and test automation frameworks.
  • Build DAG to orchestrate augmented pipeline implementing models in pipeline, running reconciliation, DQ, etc.  
  • Orchestrating the Airflow / workflow in hybrid cloud environment is big plus
  • Working in a hybrid cloud environment.
  • Develop and contribute across the stack (Javascript/React, Java back end).
  • Developing hooks, templates, Alerts and scheduling for pipelines in Airflow.
Requirements
  • Minimum 2-3 years of experience on Apache Airflow in recent project.
  • Python & Pandas, with demonstrated experience in ETL.
  • Ability to maintain clean and secure data environments.
  • Experience in setting and Schedulers: celery, Dask, Mesos.
  • Well-versed with messaging queue : RabbitMQ or Redis.
  • Understanding of airflow rest services and integration of airflow of platform eco-system.
  • Experience working in an Agile or iterative approach to delivery preferred.
  • Experience with Apache Airflow, including installing, configuring and monitoring Airflow cluster.
/ / SOCIAL

Share this job

Are you legally authorized to work in the United States on a full-time, regular basis?
Will you now, or in the future, require sponsorship for employment visa status (e.g. H-1B visa status)?
Are you ready to relocate for the job in the United States?
First Name
Last Name
Contact Number
Description
One file only.
100 MB limit.
Allowed types: pdf doc docx.
Image CAPTCHA
Enter the characters shown in the image.

Disclaimer

Synechron, Inc. and/or its affiliates and group companies takes your privacy seriously. By providing your information, you are signing up to receive information about Synechron services and related marketing. Your personal data will be protected in accordance with Synechron's Privacy Policy. By filling out this form, you are giving Synechron your consent so that we may communicate relevant information to you via email, telephone, invitations, and other digital notifications. If at any time you would like to withdraw your consent or update your profile and preferences, you can do so by clicking here or by contacting us directly.