Table of ContentsHightouch provides an Airflow Operator for triggering a sync via Airflow. Our git repo contains the latest code as well as example dags to help you get started.The first step is to create an API Token in your workspace settings. Once you click the Create API Key button, you'll be prompted for a name and presented with an API key. You'll need to save this key and enter it in the Airflow connections window as shown in the next step.
In Airflow, create a new connection by going to Admin > Connections and clicking the + to add a new connection. Name the connection
This API Token should be kept secure. You can always revoke it and create a new one as needed.
hightouch_defaultand set the host to
https://api.hightouch.io.Enter the token from Step 1 in the Password fieldWithin the Hightouch Sync page, click the sync you wish to trigger, then click on Schedule. The Sync ID will be displayed, you will use this in your Operator.While the details will vary for your particular Airflow installation, the simplest way to install our package is through pip
The last step is to add the operator to a DAG and add the Sync ID from Step 3. When the task is run, Airflow will send a call to the Hightouch API to trigger a run which will complete asynchronously.Alternatively, you may choose to send a synchronous request and await the results of the sync before completing the task. For a full description of the operator parameters, view the source code on our Github page.pip install airflow-provider-hightouch
If you have any questions or issues, feel free to reach out via the Chat window, Github issues, or email. We welcome feedback and feature requests!from airflow_provider_hightouch.operators.hightouch \import HightouchTriggerSyncOperatorwith DAG(....) as dag:...# This task will submit the request but not wait for completion of the# sync before completing.my_async_task = HightouchTriggerSyncOperator(task_id="run_my_sync", sync_id=1234)# This task will wait for the sync status to complete or error before# completing. Warnings can be treated as errors or successes depending# on your use case.my_sync_task = HightouchTriggerSyncOperator(task_id="run_sync", sync_id=123, synchronous=True, error_on_warning=True)