배우기를 멈추는 사람은 20세건 80세건 늙은 것이다.

https://ivyit.tistory.com/298 윈도우11 정품인증 방법 (Windows를 정품인증 합니다. 메세지 삭제) 기본적으로 정품 윈도우를 사용하다가 업그레이드를 하면 기존의 인증되어있는 그대로 인증이 가능합니다. 하지만, 윈도우를 재설치하시거나 인증이 되어있지 않으면 윈도우를 설치하고 일정 ivyit.tistory.com

https://nightlies.apache.org/flink/flink-docs-master/docs/concepts/flink-architecture/ Flink Architecture Flink Architecture # Flink is a distributed system and requires effective allocation and management of compute resources in order to execute streaming applications. It integrates with all common cluster resource managers such as Hadoop YARN and Kubernetes, nightlies.apache.org https://nightl..

version: "3.9" services: zookeeper: platform: linux/x86_64 image: wurstmeister/zookeeper container_name: seunggabi-zookeeper restart: always ports: - 2181:2181 networks: seunggabi-net: ipv4_address: 172.16.240.17 kafka: platform: linux/x86_64 image: confluentinc/cp-kafka container_name: seunggabi-kafka restart: always depends_on: - zookeeper ports: - 9092:9092 environment: KAFKA_ZOOKEEPER_CONNEC..

curl -L https://github.com/stedolan/jq/releases/download/jq-1.6/jq-linux64 -o ./jq chmod a+x ./jq ./jq -V export USER=seunggabi export BITBUCKET_TOKEN=### brew install jq mkdir -p ~/workspace cd ~/workspace curl -v --cookie "cloud.session.token=$BITBUCKET_TOKEN" https://bitbucket.org/\!api/internal/workspaces/asdf/projects/ASDF/repositories\?page\=1\&pagelen\=100\&sort\=name | jq -r ".values[].n..

@Test fun toObject() { // given val expected = mapOf( "a" to 1, "b" to 2, ) val json = "{\"a\":1,\"b\":2}" // when val map: Map = json.toObject() // then assertEquals(expected, map) } @Test fun toJson() { // given val expected = "{\"a\":1,\"b\":2}" val obj = mapOf( "a" to 1, "b" to 2, ) // when val json = obj.toJson(false) // then assertEquals(expected, json) } inline fun String.toObject(): T { ..

https://stackoverflow.com/questions/50218508/pull-request-template-for-bitbucket Pull request template for Bitbucket For github we have a great feature for pull requests that is explained here https://help.github.com/articles/creating-a-pull-request-template-for-your-repository/ and a good example is here https:// stackoverflow.com https://bitbucket.org/blog/save-time-with-default-pull-request-d..

Preferences -> Tools -> Terminal -> Application Settings -> Shell path Replace /bin/sh with /bin/zsh https://stackoverflow.com/questions/51006002/how-do-i-get-intellij-terminal-to-work-properly-with-oh-my-zsh/66479094#66479094 How do I get IntelliJ Terminal to work properly with Oh My Zsh? I love Oh My Zsh, but it has never worked properly in the JetBrains product's Terminals: cannot find execut..

package main import ( "fmt" "strings" ) func main() { strtmp := "alfa bravo charlie delta echo foxtrot golf" slice := strings.Split(strtmp, " ") for _, str := range slice { fmt.Println(str) } } https://ponyozzang.tistory.com/467 Golang 문자열 분할 Split 함수 사용 예제 문자열로 나열된 값을 자르고 싶은 경우가 있습니다. Go에서도 Split 함수를 사용해 문자열을 슬라이스에 대입할 수 있습니다. Split 사용 예제 package main import ( "fmt" "strings" ) func main() { st..

for k, v := range b { a[k] = v } https://stackoverflow.com/questions/22621754/how-can-i-merge-two-maps-in-go How can I merge two maps in go? I have a recursive function that creates objects representing file paths (the keys are paths and the values are info about the file). It's recursive as it's only meant to handle files, so if a dire... stackoverflow.com

version: "3.9" services: kafka: platform: linux/x86_64 image: confluentinc/cp-kafka container_name: ads-kafka restart: always depends_on: - zookeeper ports: - 9092:9092 environment: KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://ads-kafka:29092,PLAINTEXT_HOST://localhost:9092 KAFKA..

https://haerong22.tistory.com/54 Maven - Spring Project : STS설치, Tomcat서버 설정 STS 설치 https://spring.io/ 3 버전은 아래 쪽에서 받을 수 있음 https://github.com/spring-projects/toolsuite-distribution/wiki/Spring-Tool-Suite-3 버전 선택 하여 다운로드 관리자 권한으로 실행 Tomc.. haerong22.tistory.com

preferences > java > installed JREs https://ssj9902.tistory.com/36 STS - 스트링부트 openJDK 설정 ( 미설치 버전 ) - 1. openJDK 다운로드 & 압축 풀기 ※ 위치는 원하는 곳으로 ... 2. 메뉴 > window > Preferences 클릭 3. Java > Installed JREs > Add 클릭 4. Standard VM 선택 후, Next 5. openJDK 위치 지정 후, Finish 6... ssj9902.tistory.com

https://velog.io/@developerjhp/s3-%EB%B0%B0%ED%8F%AC%EC%9E%90%EB%8F%99%ED%99%94%EC%8B%9C-The-bucket-does-not-allow-ACLs s3 배포자동화시 The bucket does not allow ACLs The bucket does not allow ACLs! 버킷의 ACL권한을 안줘서그렇다..! s3로 가서 해당버킷의 이름을 누른후 권한 -> ACL권한 설정을 해주자!!42번의 시도끝에 성공!!역시 에러핸들링이 제일 재밌다. 결국엔 내 velog.io

일반적으로 파티션의 개수를 늘리는 것은 오버헤드가 너무 많아지는 수준이 되기 전까지는 성능을 높여준다. 최소한 총코어 개수 이상의 파티션을 사용해야 한다. 각 Executor에서 스파크가 한 번에 처리하는 양이 적어지므로 메모리 부족 오류를 줄이는데 도움을 준다. 파티션이 부족한 것보다는 차라리 조금 더 많은 것이 낫다. MapReduce에서 보수적으로 task의 수를 늘려나가는 것과는 가이드가 다른데, 이는 MapReduce는 각 task의 스타트업 오버헤드가 큰 반면 스파크는 그렇지 않기 때문이다. 파티션의 메타데이터를 보관 Driver memory errors & Driver overhead errors를 유발할 수 있다. 작은 사이즈의 파일들을 생성하기 위한 I/O가 많이 발생하며, 이 시간 또한..

restart taskmanger, jobmanager https://stackoverflow.com/questions/58587153/question-about-noresourceavailableexception-in-flink Question about NoResourceAvailableException in Flink Here is the error message: 2019-10-27 05:32:57,087 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (34/40) (95aac9e47f777ddc73c7a29cc1091911) switched from CREA... stackoverflow.com

1. Lack of visibility into accounts 2. Overallocated privileges 3. Poor data security management https://www.techtarget.com/searchsecurity/tip/How-to-overcome-3-multi-tenancy-security-issues How to overcome 3 multi-tenancy security issues Companies that use the cloud often face multi-tenancy security issues. Learn how to correct three challenges that arise as a result of cloud sprawl. www.techta..

python3 -m celery -A reminders worker -l INFO --detach – https://stackoverflow.com/questions/70618461/zsh-command-not-found-celery zsh: command not found: celery Whenever I run celery -A reminders worker -l INFO --detach, I get the following error: zsh: command not found: celery My assumption is that the bug lies in my path variable because that's where these stackoverflow.com

Data lineage uncovers the life cycle of data—it aims to show the complete data flow, from start to finish. Data lineage is the process of understanding, recording, and visualizing data as it flows from data sources to consumption. https://www.imperva.com/learn/data-security/data-lineage/ What is Data Lineage | Examples of Tools and Techniques | Imperva Data lineage is the process of understandin..

A consistent distributed systems are those in which all nodes see the same data at the same time. Eventual Consistency Hence eventual consistency is a consistency model used to achieve high availability and is a weak consistency model. offers high availability(low latency) at the risk of returning stale data. Strong Consistency will always return the updated value. offers low availability(high l..

import com.amazonaws.auth.AWSStaticCredentialsProvider import com.amazonaws.auth.BasicAWSCredentials import com.amazonaws.services.s3.AmazonS3 import com.amazonaws.services.s3.AmazonS3ClientBuilder import com.amazonaws.services.s3.model.PutObjectRequest import com.amazonaws.services.s3.model.S3Object import se.ohou.ads.batch.model.S3 object S3Util { private fun client( accessKey: String, secretK..

The Kafka max message size is 1MB. In this lesson we will look at two approaches for handling larger messages in Kafka. https://www.conduktor.io/kafka/how-to-send-large-messages-in-apache-kafka How to send Large Messages in Apache Kafka? Learn about the Kafka Max Message Size and How to Send Large Messages in Kafka with the two approaches covered in this advanced Kafka tutorial. www.conduktor.io

hive.metastore.warehouse.dir EXTERNAL & LOCATION DESCRIBE EXTENDED table; https://sungwookkang.com/1447 Hive 매니지드 테이블 및 외부 테이블 Hive 매니지드 테이블 및 외부 테이블 · Version : Hive 하이브에는 매니지드 테이블과 외부 테이블이라고 불리는 테이블 저장 방식이 있다. 이 둘의 차이점은 데이터 소유자가 하이브이냐, sungwookkang.com

https://knight76.tistory.com/entry/flask-request의-getjsonforceTrue-추가 [flask] request의 get_json(force=True) 추가 flask 코드에서 post 바디에 있는 json을 출력하는 코드이다. 요청의 헤더가 content-type:text/html이라면 아래 코드에서 request.get_json()의 값은 None이 된다. from flask import Flask, request import json.. knight76.tistory.com `Content-Type` independency

https://stackoverflow.com/questions/38485607/mount-host-directory-with-a-symbolic-link-inside-in-docker-container Mount host directory with a symbolic link inside in docker container I mounted the container with this parameter: -v /home/test/:/home/test Inside /home/test in the host there is a symbolic link pointing to a /mnt/ folder. But that link, although can be seen wh... stackoverflow.com d..

fun read( clazz: Class, name: String, extension: String, path: String = extension ): String { return inputStream(clazz, name, extension, path) .readAllBytes() .decodeToString() } fun inputStream( clazz: Class, name: String, extension: String, path: String = extension ): InputStream { val file = "/$path/$name.$extension" .replace(ConstUtil.DOT2 + ConstUtil.SLASH, "") return clazz.getResourceAsStr..

https://hadoop.apache.org/docs/r2.7.1/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml

https://stackoverflow.com/questions/71190928/error-org-apache-kafka-common-errors-timeoutexception-timed-out-waiting-for-a-n ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment - Error while installing kafka 3. I am trying to setup kafka 3.1.0 with java 11 on my local machine. However, while listing existing topics, I am getting timeout exception. Steps..

https://zapier.com/help/doc/tips-formatting-your-slack-messages Tips for Formatting Slack Messages You can format Slack messages in Zaps to add styling, user mentions, and channel and workspace notifications. zapier.com Text Bold text: wrap your text with asterisks (*). *bold* Italic text: wrap your text with underscores (_). _italic_ Strikethrough text: wrap your text with tildes (~). ~striketh..

version: "3.9" services: zookeeper: platform: linux/x86_64 image: wurstmeister/zookeeper container_name: ads-zookeeper restart: always ports: - 2181:2181 networks: ads-net: ipv4_address: 172.16.240.17 kafka: platform: linux/x86_64 image: confluentinc/cp-kafka container_name: ads-kafka restart: always depends_on: - zookeeper ports: - 9092:9092 environment: KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 ..

function toJsonBy($form){ var arr = $form.serializeArray(); var map = {}; $.map(arr, function(n, i){ map[n['name']] = n['value']; }); return map; } var $form = $("#form"); var data = toJsonBy($form); https://stackoverflow.com/questions/11338774/serialize-form-data-to-json