[aws] cli

https://gist.github.com/seunggabi/f8224d33b81dca80ded01b9a5888030c aws-cli-configure.sh aws-cli-configure.sh. GitHub Gist: instantly share code, notes, and snippets. gist.github.com brew install awscli #aws configure #AWS Access Key ID [None] : [발급받은 IAM의 Access Key ID] #AWS Secret Access Key [None] : [발급받은 IAM의 Secret Access Key] #Default region name [None] : ap-northeast-2[서울 리전] #Default outp..
공부 2022. 11. 24. 14:30
[airflow] docker compose (AIRFLOW__CORE__LOAD_EXAMPLES: false)

AIRFLOW__CORE__LOAD_EXAMPLES: false https://stackoverflow.com/questions/43410836/how-to-remove-default-example-dags-in-airflow How to remove default example dags in airflow I am a new user of Airbnb's open source workflow/datapipeline software airflow. There are dozens of default example dags after the web UI is started. I tried many ways to remove these dags, but I've stackoverflow.com environm..
공부 2022. 11. 24. 01:09
[aws] s3 life cycle multiple rules (비용 감소하는 쪽으로 적용됨)

https://docs.aws.amazon.com/ko_kr/AmazonS3/latest/userguide/lifecycle-configuration-examples.html#lifecycle-config-conceptual-ex4 S3 수명 주기 구성의 예제 - Amazon Simple Storage Service 동일한 규칙에 Days 및 ExpiredObjectDeleteMarker 태그를 모두 지정할 수는 없습니다. Days 태그를 지정하면 삭제 마커의 기간이 사용 기간 기준을 충족할 때 Amazon S3가 자동으로 ExpiredObjectDeleteMarker 정리 docs.aws.amazon.com
공부 2022. 11. 24. 01:01
[CDC] Change Data Capture (Debezium, Hudi, Iceberg)

https://hudi.apache.org/cn/blog/2022/01/14/change-data-capture-with-debezium-and-apache-hudi/ Change Data Capture with Debezium and Apache Hudi | Apache Hudi As of Hudi v0.10.0, we are excited to announce the availability of Debezium sources for Deltastreamer that provide the ingestion of change capture data (CDC) from Postgres and Mysql databases to your data lake. For more details, please refe..
공부 2022. 11. 24. 01:00
[cURL] urlencode

HTTP POST default curl \ --data-urlencode "paramName=value" \ --data-urlencode "secondParam=value" \ http://example.com curl --get \ --data-urlencode "p1=value 1" \ --data-urlencode "p2=value 2" \ http://example.com # http://example.com?p1=value%201&p2=value%202 https://stackoverflow.com/questions/296536/how-to-urlencode-data-for-curl-command How to urlencode data for curl command? I am trying t..
공부 2022. 11. 24. 00:46
[airflow] helm chart

https://artifacthub.io/packages/helm/airflow-helm/airflow airflow 8.6.1 · airflow-helm/airflow-helm Airflow Helm Chart (User Community) - the standard way to deploy Apache Airflow on Kubernetes with Helm artifacthub.io
공부 2022. 11. 24. 00:43
[Windows 10] WSL2

https://www.lainyzine.com/ko/article/how-to-install-wsl2-and-use-linux-on-windows-10/ [Windows 10] WSL2 설치 및 사용법 Microsoft에서는 2020년 5월 리눅스를 윈도우와 통합해서 사용할 수 있는 WSL2를 발표했습니다. 이 글에서는 WSL2를 설치하고 사용하는 방법을 소개합니다 www.lainyzine.com
공부 2022. 11. 24. 00:43
1
728x90
728x90