티스토리 뷰

공부

[Kafka] Producer TimeoutException: Expiring 1 record(s) & Network Exception

승가비 2020. 9. 12. 13:40
728x90
props.put(ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG, "3000");
props.put(ProducerConfig.LINGER_MS_CONFIG, "10");
props.put(ProducerConfig.BATCH_SIZE_CONFIG, "163840");

https://stackoverflow.com/questions/46649748/kafka-producer-timeoutexception-expiring-1-records/48034089

 

Kafka producer TimeoutException: Expiring 1 record(s)

I am using Kafka with Spring-boot: Kafka Producer class: @Service public class MyKafkaProducer { @Autowired private KafkaTemplate<string, string=""> kafkaTemplate; private static</string,>

stackoverflow.com

https://stackoverflow.com/questions/53223129/kafka-producer-timeoutexception

 

Kafka Producer TimeOutException

I am running a Samza stream job that is writing data to Kafka topic. Kafka is running a 3 node cluster. Samza job is deployed on yarn. We are seeing lot of these exceptions in container logs : I...

stackoverflow.com

https://medium.com/@unicorn.banachi/resolved-networkexception-when-using-kafka-producer-fa3910d9aa54

 

Resolved NetworkException when using Kafka producer

I encounter this exception when write history of data from a big file to Kafka, and would like to share this experience.

medium.com

https://medium.com/real-time-streaming/apache-kafka-best-practices-d9fac5c483c0

 

Apache Kafka Best Practices

Java Version

medium.com

https://cwiki.apache.org/confluence/display/KAFKA/KIP-91+Provide+Intuitive+User+Timeouts+in+The+Producer#KIP91ProvideIntuitiveUserTimeoutsinTheProducer-TestPlan

 

KIP-91 Provide Intuitive User Timeouts in The Producer - Apache Kafka - Apache Software Foundation

Status Current state: Adopted Discussion thread: [DISCUSS] KIP-91 Vote thread: [VOTE] KIP-91 JIRA: KAFKA-5886 Release: 2.1.0 Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast). Motivati

cwiki.apache.org

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Spark] streaming initial offset step by step  (0) 2020.09.12
[Kafka] Message Size over 1MB  (0) 2020.09.12
[Sh] if  (0) 2020.08.28
[Logstash] basic  (0) 2020.08.28
GSLB(Global Service Load Balancing)  (0) 2020.08.28
댓글