티스토리 뷰

공부

[airflow] docker compose (AIRFLOW__CORE__LOAD_EXAMPLES: false)

승가비 2022. 11. 24. 01:09
728x90
AIRFLOW__CORE__LOAD_EXAMPLES: false

https://stackoverflow.com/questions/43410836/how-to-remove-default-example-dags-in-airflow

 

How to remove default example dags in airflow

I am a new user of Airbnb's open source workflow/datapipeline software airflow. There are dozens of default example dags after the web UI is started. I tried many ways to remove these dags, but I've

stackoverflow.com

  environment:
    ...
    
    AWS_ACCESS_KEY_ID:
    AWS_SECRET_ACCESS_KEY: 
    AWS_DEFAULT_REGION: ap-northeast-2

https://betterprogramming.pub/apache-airflow-on-docker-with-aws-s3-3abaf6874a49

 

Apache Airflow on Docker With AWS S3

Write your first DAG

betterprogramming.pub

https://tech.socarcorp.kr/data/2022/11/09/advanced-airflow-for-databiz.html?fbclid=IwAR3r2fW1M3s1JZTwJ5q7Ib1AhFTTg9KB5XtixU72aEKmTPsQ1mkBnsLWy0c 

 

전사 구성원들이 사용하는 배치 데이터 플랫폼 만들기 - Airflow Advanced

Airflow 운영 고도화를 위한 고군분투기

tech.socarcorp.kr

https://github.com/Leo200467/data-engineering-project/blob/6a6014f4626833aa36a21decf1b9ba7968996cd1/airflow/docker-compose.yml

 

GitHub - Leo200467/data-engineering-project

Contribute to Leo200467/data-engineering-project development by creating an account on GitHub.

github.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[aws] s3 life cycle rule  (0) 2022.11.25
[aws] cli  (0) 2022.11.24
[aws] s3 life cycle multiple rules (비용 감소하는 쪽으로 적용됨)  (0) 2022.11.24
[CDC] Change Data Capture (Debezium, Hudi, Iceberg)  (0) 2022.11.24
[cURL] urlencode  (0) 2022.11.24
댓글