import com.amazonaws.auth.AWSStaticCredentialsProvider import com.amazonaws.auth.BasicAWSCredentials import com.amazonaws.services.s3.AmazonS3 import com.amazonaws.services.s3.AmazonS3ClientBuilder import com.amazonaws.services.s3.model.CannedAccessControlList import com.amazonaws.services.s3.model.PutObjectRequest import com.amazonaws.services.s3.model.S3Object object S3Util { fun client( acces..
[kafka] send large message (video, image)
The Kafka max message size is 1MB. In this lesson we will look at two approaches for handling larger messages in Kafka. https://www.conduktor.io/kafka/how-to-send-large-messages-in-apache-kafka How to send Large Messages in Apache Kafka? Learn about the Kafka Max Message Size and How to Send Large Messages in Kafka with the two approaches covered in this advanced Kafka tutorial. www.conduktor.io
hive.metastore.warehouse.dir EXTERNAL & LOCATION DESCRIBE EXTENDED table; https://sungwookkang.com/1447 Hive 매니지드 테이블 및 외부 테이블 Hive 매니지드 테이블 및 외부 테이블 · Version : Hive 하이브에는 매니지드 테이블과 외부 테이블이라고 불리는 테이블 저장 방식이 있다. 이 둘의 차이점은 데이터 소유자가 하이브이냐, sungwookkang.com
https://knight76.tistory.com/entry/flask-request의-getjsonforceTrue-추가 [flask] request의 get_json(force=True) 추가 flask 코드에서 post 바디에 있는 json을 출력하는 코드이다. 요청의 헤더가 content-type:text/html이라면 아래 코드에서 request.get_json()의 값은 None이 된다. from flask import Flask, request import json.. knight76.tistory.com `Content-Type` independency
https://stackoverflow.com/questions/38485607/mount-host-directory-with-a-symbolic-link-inside-in-docker-container Mount host directory with a symbolic link inside in docker container I mounted the container with this parameter: -v /home/test/:/home/test Inside /home/test in the host there is a symbolic link pointing to a /mnt/ folder. But that link, although can be seen wh... stackoverflow.com d..
fun read( clazz: Class, name: String, extension: String, path: String = extension ): String { return inputStream(clazz, name, extension, path) .readAllBytes() .decodeToString() } fun inputStream( clazz: Class, name: String, extension: String, path: String = extension ): InputStream { val file = "/$path/$name.$extension" .replace(ConstUtil.DOT2 + ConstUtil.SLASH, "") return clazz.getResourceAsStr..
https://stackoverflow.com/questions/71190928/error-org-apache-kafka-common-errors-timeoutexception-timed-out-waiting-for-a-n ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment - Error while installing kafka 3. I am trying to setup kafka 3.1.0 with java 11 on my local machine. However, while listing existing topics, I am getting timeout exception. Steps..
https://zapier.com/help/doc/tips-formatting-your-slack-messages Tips for Formatting Slack Messages You can format Slack messages in Zaps to add styling, user mentions, and channel and workspace notifications. zapier.com Text Bold text: wrap your text with asterisks (*). *bold* Italic text: wrap your text with underscores (_). _italic_ Strikethrough text: wrap your text with tildes (~). ~striketh..
version: "3.9" services: zookeeper: platform: linux/x86_64 image: wurstmeister/zookeeper container_name: ads-zookeeper restart: always ports: - 2181:2181 networks: ads-net: ipv4_address: 172.16.240.17 kafka: platform: linux/x86_64 image: confluentinc/cp-kafka container_name: ads-kafka restart: always depends_on: - zookeeper ports: - 9092:9092 environment: KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 ..
function toJsonBy($form){ var arr = $form.serializeArray(); var map = {}; $.map(arr, function(n, i){ map[n['name']] = n['value']; }); return map; } var $form = $("#form"); var data = toJsonBy($form); https://stackoverflow.com/questions/11338774/serialize-form-data-to-json
* insert into on duplicate key update를 실행했을 때 return값 - 1: insert 됐을 때 (duplicate key가 아닐때) - 2: duplicate key라 update가 됐을 때 - 0: 변경된 내용이 없을 때 https://pingukim.tistory.com/7 [JAVA] MySQL executeUpdate 사용 시 리턴값 Java에서 MySQL을 사용하던 중 executeUpdate() 를 사용했을 때 insert, update, delete는 해당 쿼리문이 수행된 행의 수가 return되는데 insert into on duplicate key update를 사용했을 때는 어떤 수가 return.. pingukim.tistory.com
import com.fasterxml.jackson.core.type.TypeReference import com.fasterxml.jackson.databind.DeserializationFeature import com.fasterxml.jackson.databind.ObjectMapper import com.fasterxml.jackson.databind.SerializationFeature import com.fasterxml.jackson.datatype.jsr310.JavaTimeModule import com.fasterxml.jackson.datatype.jsr310.deser.LocalDateDeserializer import com.fasterxml.jackson.datatype.jsr..
https://english.stackexchange.com/questions/106938/why-is-it-loggable-rather-than-logable Why is it "loggable" rather than "logable"? I am using 'loggable' in the name of an interface written in a .NET programming language. It is among the many words that make sense in a programming context but aren't (yet) listed in English english.stackexchange.com
https://stackoverflow.com/questions/27592500/prepared-statement-parameter-index-out-of-range-0-1 Prepared statement Parameter index out of range (0 < 1 ) Am not expert on web application, recently am writing a small webapp for my mobile app using servlets. My agenda is to receive data from client, and to put it into db. everything is running fine ex... stackoverflow.com
sudo pmset -c disablesleep 1 sudo pmset -c disablesleep 0 https://our-ef.tistory.com/entry/%EB%A7%A5%EB%B6%81-%ED%99%94%EB%A9%B4%EB%9A%9C%EA%BB%91-%EB%8D%AE%EC%96%B4%EB%8F%84-%EC%95%88%EA%BA%BC%EC%A7%80%EA%B2%8C-%EC%84%A4%EC%A0%95%ED%95%98%EB%8A%94%EB%B2%95-%EC%9E%A0%EC%9E%90%EA%B8%B0-%EB%B0%A9%EC%A7%80 맥북 화면/뚜껑 덮어도 안꺼지게 설정하는법 (잠자기 방지) 자리를 옮겨야 하는데다운로드가 생각보다 오래걸린적이 있었다. 이때 노트북 인터넷 연결을 핫스팟으로 변경하고..
### repartition Node 1 = 1,2,3 Node 2 = 4,5,6 Node 3 = 7,8,9 Node 4 = 10,11,12 ### coalesce: minimize data movement Node 1 = 1,2,3 + (10,11,12) Node 3 = 7,8,9 + (4,5,6) https://stackoverflow.com/questions/31610971/spark-repartition-vs-coalesce Spark - repartition() vs coalesce() According to Learning Spark Keep in mind that repartitioning your data is a fairly expensive operation. Spark also has..