티스토리 뷰

공부

[Kafka] Reassign partitions & Preferred Replica Election

seunggabi 승가비 2020. 12. 24. 02:37
728x90

last week, I had a traffic issue in kafka.

Traffic of kafka has increase tenfold.

I increased partition size.(6 -> 12 -> 20), but 20 partitions is not enough.

I can not increase more than 20, beacause this traffic is temporal. (This traffic lasted 5 days.)

 

When traffic is recovers, I put annother 8 kafka-consumer in a day.

 

My kafka lag message of consumer recovered. but, partition skewed.

I do `Reassign partitions` & `Preferred Replica Election`

 

https://always-kimkim.tistory.com/entry/%EC%B9%B4%ED%94%84%EC%B9%B4-%EC%9A%B4%EC%98%81-Preferred-Replica-Election

 

카프카 운영 - Preferred Replica Election

들어가며  브로커의 장애는 카프카 운영에서 발생하는 가장 흔한 장애입니다. 이번 글은 브로커 장애로 발생할 수 있는 복제 파티션의 역할 변경과 Preferred Replica Election 방법에 대해 설명합니다

always-kimkim.tistory.com

 

728x90
댓글
댓글쓰기 폼