배우기를 멈추는 사람은 20세건 80세건 늙은 것이다.

https://dydwnsekd.tistory.com/62 Airflow에서 Jinja template 사용하기 Airflow에서는 Jinja2 template를 내장하고 있어 이를 활용할 수 있는데, Jinja2 template에 대한 자세한 내용은 Jinja Document를 참고하기 바란다. https://jinja.palletsprojects.com/en/3.0.x/ Jinja2 template를 활용할 수 있 dydwnsekd.tistory.com yesterday = date_utils.date_to_string(kwargs['logical_date'].in_timezone("Asia/Seoul")) today = date_utils.add_date(yesterday, 1)

https://stackoverflow.com/questions/49234471/when-to-execute-refresh-table-my-table-in-spark/72970987#72970987 When to execute REFRESH TABLE my_table in spark? Consider a code; import org.apache.spark.sql.hive.orc._ import org.apache.spark.sql._ val path = ... val dataFrame:DataFramew = ... val hiveContext = new org.apache.spark.sql.hive.HiveContext( stackoverflow.com

SELECT column FROM table AS T1 INNER JOIN Params AS P1 ON T1.column LIKE '%' + P1.param + '%'; https://stackoverflow.com/questions/4612282/dynamic-like-statement-in-sql Dynamic Like Statement in SQL I've been racking my brain on how to do this for a while, and i know that some genius on this site will have the answer. Basically i'm trying to do this: SELECT column FROM table WHERE [tabl... stack..

https://bitbucket.org/atlassian/aws-s3-deploy/src/master/ Bitbucket bitbucket.org sub path 없는 경우.. 무한 pending .. (dir 많은 경우) 꼭 붙이자..

https://stackoverflow.com/questions/42723604/how-to-set-spark-job-staging-location How to set Spark job staging location My spark job is failing because the user doesn't have access to directory where spark is trying to write staging or temp dataset. 2017-03-10 10:25:47,0928 ERROR JniCommon fs/client/fileclient... stackoverflow.com https://doc.hcs.huawei.com/en-us/usermanual/mrs/mrs_03_0298.html..

f"{{{{jinja}}}}_{python}" https://stackoverflow.com/questions/63788781/use-python-f-strings-and-jinja-at-the-same-time Use Python f-strings and Jinja at the same time I am trying to write a concise SQL query string in Python, to make use of both f-strings and Jinja at the same time. Background info: I am writing a query used in Airflow. This did not work: query_... stackoverflow.com

spark.sql("refresh TABLE schema.table") https://stackoverflow.com/questions/73294636/spark-refresh-delta-table-in-s3 Spark: refresh Delta Table in S3 how can I run the refresh table command on a Delta Table in S3? When I do deltatable = DeltaTable.forPath(spark, "s3a://test-bucket/delta_table/") spark.catalog.refreshTable(deltatable) ... stackoverflow.com https://stackoverflow.com/questions/4923..

deactivate https://stackoverflow.com/questions/990754/how-to-leave-exit-deactivate-a-python-virtualenv How to leave/exit/deactivate a Python virtualenv I'm using virtualenv and the virtualenvwrapper. I can switch between virtualenv's just fine using the workon command. me@mymachine:~$ workon env1 (env1)me@mymachine:~$ workon env2 (env2)me@mymachin... stackoverflow.com

https://ovso.github.io/blog/2018/04/18/gradle-dependencies-exclude/ Gradle dependencies exclude(Gradle 의존성 제거) Gradle 의존성 제거 ovso.github.io

SELECT DATE_FORMAT(event_time, "yyyy-MM-dd'T'HH:mm:ss'Z'") event_time https://stackoverflow.com/questions/66679640/convert-timestamp-format-to-iso-time-format-in-pyspark convert timestamp format to iso time format in pyspark I have a pyspark dataframe that has a field, time, that has timestamps in two formats, "11-04-2019,00:32:13" and "2019-12-05T07:57:16.000Z" How can I convert all the timesta..

https://airflow.apache.org/docs/apache-airflow/1.10.13/_api/airflow/operators/index.html airflow.operators — Airflow Documentation airflow.apache.org

https://www.jenkins.io/doc/book/pipeline/syntax/#parameters Pipeline Syntax Scripted Pipeline, like Declarative Pipeline, is built on top of the underlying Pipeline sub-system. Unlike Declarative, Scripted Pipeline is effectively a general-purpose DSL built with Groovy. Most functionality provided by the Groovy language is made av www.jenkins.io https://waspro.tistory.com/554 [Jenkins] Pipeline ..

https://techblog.woowahan.com/2646/ 좌충우돌 Terraform 입문기 | 우아한형제들 기술블로그 {{item.name}} 안녕하세요, 저는 신사업부문의 오지산이라고 합니다. 저희 신사업부문은 배달의민족과는 조금 다른… 시장의 문제를 해결하기 위해 다양한 신규 서비스들이 개발되는 곳입니다. 그 techblog.woowahan.com https://velog.io/@khyup0629/Terraform-CloudTrail-%EC%9D%B4%EB%B2%A4%ED%8A%B8-%EB%A1%9C%EA%B7%B8%EB%A5%BC-CloudWatch-Logs%EB%A1%9C-%EB%AA%A8%EB%8B%88%ED%84%B0%EB%A7%81%ED%95%98%EB%8A%94-%EC%9D%B8%E..

mongosh use admin db.createUser({ user: "user" , pwd: "1234", roles: [ "readWrite", "dbAdmin" ] }) use metadata db.createCollection("product") # mongodb://user:1234@localhost:27017/metadata https://stackoverflow.com/questions/22418052/connect-to-a-specific-database-by-default-in-mongodb/74636800#74636800 Connect to a specific database by default in mongodb I am running a mongodb on a linux box. ..

https://stackoverflow.com/questions/32788322/how-to-add-a-constant-column-in-a-spark-dataframe How to add a constant column in a Spark DataFrame? I want to add a column in a DataFrame with some arbitrary value (that is the same for each row). I get an error when I use withColumn as follows: dt.withColumn('new_column', 10).head(5) ---------... stackoverflow.com

def my_func(a, *args, **kwargs): saved_args = locals() print("saved_args is", saved_args) local_var = 10 print("saved_args is", saved_args) print("But locals() is now", locals()) my_func(20, 30, 40, 50, kwarg1='spam', kwarg2='eggs') saved_args is {'a': 20, 'args': (30, 40, 50), 'kwargs': {'kwarg1': u'spam', 'kwarg2': u'eggs'}} saved_args is {'a': 20, 'args': (30, 40, 50), 'kwargs': {'kwarg1': u'..

import inspect arg_keys = inspect.getfullargspec({method})[0] >>> def foo(a, b, c=4, *arglist, **keywords): pass >>> inspect.getfullargspec(foo) (['a', 'b', 'c'], 'arglist', 'keywords', (4,)) https://stackoverflow.com/questions/218616/how-to-get-method-parameter-names How to get method parameter names? Given the Python function: def a_method(arg1, arg2): pass How can I extract the number and nam..

// package.json { "type": "module" } https://stackoverflow.com/questions/58384179/syntaxerror-cannot-use-import-statement-outside-a-module SyntaxError: Cannot use import statement outside a module I've got an ApolloServer project that's giving me trouble, so I thought I might update it and ran into issues when using the latest Babel. My "index.js" is: require('dotenv').config() imp... stackoverf..