Skip to content

Commit bd1f1c1

Browse files
authored
Merge pull request scribd#50 from bartdegoede/patch-3
Minor typo
2 parents dee00c9 + 17fe4b4 commit bd1f1c1

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

_posts/2020-03-02-breaking-up-the-dag-repo.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ store, but in order to support our desired multi-repo approach DAGs, we needed
5656
to build our own tooling to coordinate synchronizing the local DAG store with
5757
S3 objects from the multiple DAG repositories.
5858

59-
The tool we build, [objinsync](https://github.com/scribd/objinsync) [^1], is a
59+
The tool we built, [objinsync](https://github.com/scribd/objinsync) [^1], is a
6060
stateless DAG sync daemon, which is deployed as a sidecar container. From
6161
Airflow’s point of view, the DAG folder is just a magical local folder that
6262
always contains the up to date DAG definitions assembled from multiple Git
@@ -106,12 +106,12 @@ environment variables injected by the CI/CD system.
106106
Our airflow clusters are orchestrated using both ECS fargate and EKS. ECS is
107107
used to run Airflow web server and scheduler while EKS is what’s powering
108108
Airflow’s Kubernetes executor. Due to differences in different Airflow
109-
components, we need to run `objinsync` binary in two container orchestration
109+
components, we need to run the `objinsync` binary in two container orchestration
110110
platforms with slightly different setups.
111111

112112
For daemon Airflow components like web server and scheduler, we run
113113
`objinsync` in a continuous sync mode where it pulls incremental updates from
114-
S3 to local filesystem every 5 seconds. This is implemented using sidecar
114+
S3 to local filesystem every 5 seconds. This is implemented usingt the sidecar
115115
container pattern. The DAG folder is mounted as a shared volume between the
116116
Airflow web/scheduler container and objinsync container. The sidecar
117117
objinsync container is setup to run the following command:
@@ -157,7 +157,7 @@ primitives from the Go runtime for better performance.
157157
Engineering is all about making the right trade-offs. I won’t claim what we have
158158
is the perfect solution for everyone, but I do believe it strikes a good
159159
balance between productivity, operability, and availability. If you have any
160-
question regarding the setup, I am available in Airflow’s
160+
questions regarding the setup, I am available in Airflow’s
161161
[#airflow-creative](https://apache-airflow.slack.com/messages/airflow-creative)
162162
slack channel under the handle "QP." If you are not already part of the Airflow
163163
Slack community, you can get access via

0 commit comments

Comments
 (0)