[Kafka] Reassign partitions & Preferred Replica Election

last week, I had a traffic issue in kafka.

Traffic of kafka has increase tenfold.

I increased partition size.(6 -> 12 -> 20), but 20 partitions is not enough.

I can not increase more than 20, beacause this traffic is temporal. (This traffic lasted 5 days.)

 

When traffic is recovers, I put annother 8 kafka-consumer in a day.

 

My kafka lag message of consumer recovered. but, partition skewed.

I do `Reassign partitions` & `Preferred Replica Election`

 

https://always-kimkim.tistory.com/entry/%EC%B9%B4%ED%94%84%EC%B9%B4-%EC%9A%B4%EC%98%81-Preferred-Replica-Election

카프카 운영 - Preferred Replica Election