공부
[Airflow] kafka producer flush() not working (solution: instanciate object in execute)
승가비
2022. 5. 7. 18:46
728x90
https://github.com/confluentinc/confluent-kafka-python/issues/1122
Flush() call getting stuck inside celery task no messages being produced. · Issue #1122 · confluentinc/confluent-kafka-python
Description Unable to publish messages when using the library inside a celery worker in airflow. Here is the debug information coming from the librdkafka lib on the worker logs. We are following th...
github.com
728x90