배우기를 멈추는 사람은 20세건 80세건 늙은 것이다.

CREATE DATABASE airflow; CREATE USER 'admin'@'%' IDENTIFIED BY 'admin'; GRANT ALL PRIVILEGES ON airflow.* TO admin@'%'; https://bcdragonfly.tistory.com/27 [Django] _mysql' is not defined 호환에러 해결하기 [파이썬 장고] _mysql' is not defined 호환에러 해결하기 [Django] _mysql' is not defined 호환에러 해결하기 [Python Django] _mysql' is not defined 호환에러 해결하기 ＃ERROR version_info, _mysql.version_info, _mysql.__file__ NameE bcdr..

airflow users create \ --username airflow \ --firstname airflow \ --lastname airflow \ --role Admin \ --email seunggabi@naver.com https://dydwnsekd.tistory.com/33 Airflow 2.0 설치하기(2) 지난 글에서 Airflow를 설치하는 것까지 완료했다 오늘은 Airflow db 생성, user생성, webserver실행까지 진행해보도록 하자 2021.01.27 - [BigData/Airflow] - Airflow 2.0 설치하기(1) airflow를 실행하기 위해서 먼저 d dydwnsekd.tistory.com ```

brew install ruby echo 'export PATH="/opt/homebrew/opt/ruby/bin:$PATH"' >> ~/.zshrc\n export LDFLAGS="-L/opt/homebrew/opt/ruby/lib" export CPPFLAGS="-I/opt/homebrew/opt/ruby/include"\n brew cleanup ruby sudo gem install cocoapods https://jetalog.net/85 macOS에서 Ruby 버전 관리하기 macOS는 기본적으로 Ruby가 설치되어 있습니다. 하지만 여러 이유로 다양한 버전의 Ruby를 설치해놓고 그 때 그 때 버전을 변경하며 사용하거나, 가상환경을 설정해야 할 수 있습니다. macOS에서 rbenv jeta..

https://intellij-support.jetbrains.com/hc/en-us/community/posts/207070755-whats-the-keyboard-shortcut-for-Go-to-Line-

https://jaemunbro.medium.com/spark-executor-%EA%B0%9C%EC%88%98-%EC%A0%95%ED%95%98%EA%B8%B0-b9f0e0cc1fd8 [Apache Spark] Executor 사이즈와 개수 정하기 Holden Karau-High Performance Spark(Jpub) 정리 jaemunbro.medium.com https://data-flair.training/blogs/apache-spark-performance-tuning https://m.blog.naver.com/PostView.naver?isHttpsRedirect=true&blogId=8x8x8x8x8x8&logNo=220751971662 Spark 성능에 관한 고려사항 참고 : 러닝 스..

i match { case 1 => println("January") case 2 => println("February") case 3 => println("March") case 4 => println("April") case 5 => println("May") case 6 => println("June") case 7 => println("July") case 8 => println("August") case 9 => println("September") case 10 => println("October") case 11 => println("November") case 12 => println("December") // catch the default with a variable so you can..

https://dwgeek.com/hive-insert-into-partition-table-and-examples.html/ Hive Insert into Partition Table and Examples - DWgeek.com Hive Insert into Partition Table, Syntax, Examples, Named insert data into Hive Table, Hive Table partition, insert records dwgeek.com

https://learn.microsoft.com/ko-kr/azure/databricks/kb/clusters/spark-shows-less-memory Apache Spark UI가 총 노드 메모리보다 작음 표시 - Azure Databricks Spark UI가 노드에서 실제로 사용할 수 있는 것보다 적은 메모리를 표시하는 경우 수행할 작업을 알아봅니다. learn.microsoft.com https://sparkbyexamples.com/spark/spark-submit-command/ Spark Submit Command Explained with Examples - Spark By {Examples} The spark-submit command is a utility to run or subm..

https://docs.aws.amazon.com/ko_kr/glue/latest/dg/glue-specifying-resource-arns.html AWS Glue 리소스 ARN 지정 - AWS Glue Data Catalog 리소스에 대해 수행된 모든 작업에는 리소스와 해당 리소스의 모든 상위 항목에 대한 권한이 필요합니다. 예를 들어, 테이블에 대한 파티션을 생성하려면 해당 테이블, 데이터베이스 docs.aws.amazon.com https://docs.aws.amazon.com/glue/latest/dg/glue-specifying-resource-arns.html Specifying AWS Glue resource ARNs - AWS Glue All operations performed on a..

https://cbea.ms/git-commit/ How to Write a Git Commit Message Commit messages matter. Here's how to write them well. cbea.ms https://gist.github.com/joshbuchea/6f47e86d2510bce28f8e7f42ae84c716 Semantic Commit Messages Semantic Commit Messages. GitHub Gist: instantly share code, notes, and snippets. gist.github.com https://gist.github.com/seunggabi/87f8c722d35cd07deb3f649d45a31082 semantic-branch..

https://hamait.tistory.com/859 파이썬에서의 믹스인 (Mixin) Python 과 Mixin 파이썬은 다중 상속을 지원하며 그것에 의해 Mixins 를 만들 수 있다. Mixin 은 클래스에 추가적인 속성이나 메소드를 제공하는 것을 말하는데, 스칼라는 traits 를 통해서 제공하며, 루 hamait.tistory.com

https://leetcode.com/problems/best-time-to-buy-and-sell-stock-with-cooldown/description/ Best Time to Buy and Sell Stock with Cooldown - LeetCode Best Time to Buy and Sell Stock with Cooldown - You are given an array prices where prices[i] is the price of a given stock on the ith day. Find the maximum profit you can achieve. You may complete as many transactions as you like (i.e., buy one and se..

# 설치 후 재부팅 필수 https://airflow.apache.org/docs/apache-airflow-providers/packages-ref.html#providers-packages-reference Providers packages reference — apache-airflow-providers Documentation airflow.apache.org pip3 install apache-airflow-providers-airbyte pip3 install apache-airflow-providers-alibaba pip3 install apache-airflow-providers-amazon pip3 install apache-airflow-providers-apache-beam[goog..

https://wiki.kicco.com/space/ATLC/334856452 https://wiki.kicco.com/space/ATLC/334856452 wiki.kicco.com

CREATE TABLE fruits( id SERIAL PRIMARY KEY, name VARCHAR NOT NULL ); https://semtax.tistory.com/15 PostgreSQL에서 AUTO INCREMENT 사용하기 개요 이번 문서에서는 mysql에 있는 AUTO INCREMENT와 유사한 기능을 PostgreSQL에서는 어떻게 사용하는지 알아 보도록 하겠다. PostgreSQL Serial Type PostgreSQL에서는 auto increment가 지원이 되는 Sequence 라는 타 semtax.tistory.com

https://stackoverflow.com/questions/66467585/airflow-ssh-connection-connection-type-not-displaying airflow ssh connection , connection type not displaying I am trying to add connection to the airflow server. I wanted to have ssh added. only the below listed 5 is being displayed. Can you point me how to add the ssh connection ? stackoverflow.com

https://www.postgresqltutorial.com/postgresql-administration/postgresql-show-databases/ PostgreSQL Show Databases In this tutorial, you will learn how to show databases in a PostgreSQL database server. In MySQL, you can show all databases in the database server using SHOW DATABASES statement. PostgreSQL does not directly support the SHOW DATABASES statement but offers www.postgresqltutorial.com

https://stackoverflow.com/questions/769683/postgresql-show-tables-in-postgresql PostgreSQL: Show tables in PostgreSQL What's the equivalent to show tables (from MySQL) in PostgreSQL? stackoverflow.com

https://stackoverflow.com/questions/10335561/use-database-name-command-in-postgresql "use database_name" command in PostgreSQL I am beginner to PostgreSQL. I want to connect to another database from the query editor of Postgres - like the USE command of MySQL or MS SQL Server. I found \c databasename by searching the In... stackoverflow.com

https://docs.aws.amazon.com/ko_kr/toolkit-for-visual-studio/latest/user-guide/tkv-create-ami-from-instance.html Amazon EC2 인스턴스에서 AMI 생성 - AWS Toolkit for Visual Studio 재부팅 안 함을 선택하는 경우 생성된 이미지의 파일 시스템 무결성을 보장할 수 없습니다. docs.aws.amazon.com https://support.bespinglobal.com/ko/support/solutions/articles/73000524755--aws-ec2-%EC%9D%B8%EC%8A%A4%ED%84%B4%EC%8A%A4-%EC%A4%91%EC%A7%80-%EC%97%86%EC%9D%B4-..

https://velog.io/@coastby/Docker-gradle%EB%A1%9C-%EB%B9%8C%EB%93%9C%ED%95%98%EC%97%AC-%EB%8F%84%EC%BB%A4%EB%A1%9C-%EB%B0%B0%ED%8F%AC%ED%95%98%EA%B8%B0 [Docker] gradle로 빌드하여 도커로 배포하기 이전에 maven으로 빌드할 때는 maven을 설치하고 .jar 파일을 이용하여 이미지를 생성하였다. 그러나 gradle은 버전 문제로 강사님이 Dockerfile을 작성하고 배포 연습을 하였다. 일단 그 과정만 기록을 velog.io https://inma.tistory.com/148 [SpringBoot] Docker 컨테이너 배포 (with. Gradle) SpringBoot 앱..

docker build -t seunggabi-config:latest -f seunggabi-config/Dockerfile . docker stop seunggabi-config docker rm seunggabi-config docker run -i -t \ --name seunggabi-config \ --env PROFILE=dev \ --env CONTEXT=seunggabi \ --env DB_HOST=jdbc:mysql://host.docker.internal:3306/seunggabi_config \ --env DB_USER=admin \ --env DB_PASSWORD=admin \ -p 80:80 \ seunggabi-config:latest https://velog.io/@kshir..

https://stackoverflow.com/questions/45271532/in-airflow-is-there-a-good-way-to-call-another-dags-task In airflow, is there a good way to call another dag's task? I've got dag_prime and dag_tertiary. dag_prime: Scans through a directory and intends to call dag_tertiary on each one. Currently a PythonOperator. dag_tertiary: Scans through the directory p... stackoverflow.com

https://stackoverflow.com/questions/54598163/airflow-task-failure-retry-workflow Airflow Task failure/retry workflow I have retry logic for tasks and it's not clear how Airflow handles task failures when retries are turned on. Their documentation just states that on_failure_callback gets triggered when a task fa... stackoverflow.com https://github.com/apache/airflow/discussions/29201 [failover] ..

https://lemontia.tistory.com/1062 [log4j] SLF4J: Class path contains multiple SLF4J bindings. 에러 log4j2 를 버전업 하는데 다음의 문제가 발생한다. build.gradle (Gradle로 설정) ... implementation group: 'org.apache.logging.log4j', name: 'log4j-core', version: "2.17.1" implementation group: 'org.apache.logging.log4j', name: 'log4j-api' lemontia.tistory.com

https://seamless.tistory.com/101 Spark에서 groupByKey 대신 reduceByKey 사용하기 이번 포스트에서는 스파크에서 빈번히 사용되는 transformation인 reduceByKey와 groupByKey의 동작에 대해 살펴보겠습니다. 먼저 스파크에서 reduceByKey와 groupByKey를 사용하여 단어 세기 예제를 작성해보도 seamless.tistory.com

message = "" if len(l) > 0: title = TableauService._title(TABLEAU["SERVER_URL"], l[0]["view"]) link = "".join([f"" for x in l]) message = title + "\n" + link slack_util.chat( slack_token, slack_channel, message ) ### permission - read: links - write: links https://ndjman7.github.io/2021/01/17/slack-bot-upload-multiple-files/ Slack Bot으로 파일 여러 개 업로드 하기 - Pando's Blog Slack Bot으로 파일 여러 개 업로드하기 ndj..