가비로그

https://stackoverflow.com/questions/45271532/in-airflow-is-there-a-good-way-to-call-another-dags-task In airflow, is there a good way to call another dag's task? I've got dag_prime and dag_tertiary. dag_prime: Scans through a directory and intends to call dag_tertiary on each one. Currently a PythonOperator. dag_tertiary: Scans through the directory p... stackoverflow.com

https://stackoverflow.com/questions/54598163/airflow-task-failure-retry-workflow Airflow Task failure/retry workflow I have retry logic for tasks and it's not clear how Airflow handles task failures when retries are turned on. Their documentation just states that on_failure_callback gets triggered when a task fa... stackoverflow.com https://github.com/apache/airflow/discussions/29201 [failover] ..

https://lemontia.tistory.com/1062 [log4j] SLF4J: Class path contains multiple SLF4J bindings. 에러 log4j2 를 버전업 하는데 다음의 문제가 발생한다. build.gradle (Gradle로 설정) ... implementation group: 'org.apache.logging.log4j', name: 'log4j-core', version: "2.17.1" implementation group: 'org.apache.logging.log4j', name: 'log4j-api' lemontia.tistory.com

https://seamless.tistory.com/101 Spark에서 groupByKey 대신 reduceByKey 사용하기 이번 포스트에서는 스파크에서 빈번히 사용되는 transformation인 reduceByKey와 groupByKey의 동작에 대해 살펴보겠습니다. 먼저 스파크에서 reduceByKey와 groupByKey를 사용하여 단어 세기 예제를 작성해보도 seamless.tistory.com

message = "" if len(l) > 0: title = TableauService._title(TABLEAU["SERVER_URL"], l[0]["view"]) link = "".join([f"" for x in l]) message = title + "\n" + link slack_util.chat( slack_token, slack_channel, message ) ### permission - read: links - write: links https://ndjman7.github.io/2021/01/17/slack-bot-upload-multiple-files/ Slack Bot으로 파일 여러 개 업로드 하기 - Pando's Blog Slack Bot으로 파일 여러 개 업로드하기 ndj..

https://www.toptal.com/developers/keycode JavaScript Key Code Event Tool | Toptal® KeyCode.Info allows users to press any key and instantly get the JavaScript Key or Key Code KeyboardEvent. Check out the Tool and Event List. www.toptal.com

SHOW CREATE TABLE db.table AS SERDE https://stackoverflow.com/questions/68562219/error-in-performing-show-create-table-opencsv-serde-hive-table-in-databricks/69184738#69184738 Error in performing 'show create table' OpenCSV Serde Hive Table in Databricks I have created a table with OpenCSV Serde in Databricks below DDL :- CREATE TABLE db_name.table_name( col1 String, col2 String) ROW FORMAT SERD..

- pipe: atlassian/aws-s3-deploy:1.1.0 variables: AWS_ACCESS_KEY_ID: ${AWS_ACCESS_KEY_ID} AWS_SECRET_ACCESS_KEY: ${AWS_SECRET_ACCESS_KEY} AWS_DEFAULT_REGION: ${AWS_DEFAULT_REGION} S3_BUCKET: bucket_name/a/b/c/d LOCAL_PATH: bucket_name/a/b/c/d DELETE_FLAG: 'true' EXTRA_ARGS: '--exclude=e/* --exclude=e/f/*' https://stackoverflow.com/questions/32393026/exclude-multiple-folders-using-aws-s3-sync Excl..

for word in "$@"; do echo $word; done https://stackoverflow.com/questions/12314451/accessing-bash-command-line-args-vs Accessing bash command line args $@ vs $* In many SO questions and bash tutorials I see that I can access command line args in bash scripts in two ways: $ ~ >cat testargs.sh #!/bin/bash echo "you passed me" $* echo "you passed me" $@ stackoverflow.com

[*.{kt,kts}] disabled_rules = import-ordering https://stackoverflow.com/questions/60829868/android-studio-does-not-rearrange-import-in-lexicographic-order Android Studio does not rearrange import in lexicographic order Given the following imports import javax.inject.Inject import kotlinx.android.synthetic.main.fragment.* Android Studio rearrange to the following when pressing control + option + ..

https://magpienote.tistory.com/255 Hive 테이블 문제점 및 대체제 알아보기 Hudi vs Iceberge vs delta lake 이해하고 비교해보기 이전 글에서 HQL을 사용해보았고 Compaction에 대해 포스팅을 할려고 했으나 compaction 시 에로사항이 많아서 포스팅을 하지 못한다고 판단하였고 대신에, hive 테이블의 문제점과 대체제에 대해 알아 magpienote.tistory.com https://www.onehouse.ai/blog/apache-hudi-vs-delta-lake-vs-apache-iceberg-lakehouse-feature-comparison Apache Hudi vs Delta Lake vs Apache Iceberg - Lakeho..