esgf_core_utils.models.kafka.producer

Attributes

logger

Classes

BaseProducer	Base Producer
DummyProducer	Dummy Producer
KafkaProducer	Kafka Producer

Module Contents

esgf_core_utils.models.kafka.producer.logger

class esgf_core_utils.models.kafka.producer.BaseProducer

Bases: abc.ABC

Base Producer

abstractmethod produce(topic: str, key: AnyStr, value: AnyStr) → Any

Publish message

Args:

topic (str): topic to post message to key (AnyStr): message key value (AnyStr): message

class esgf_core_utils.models.kafka.producer.DummyProducer

Bases: BaseProducer

Dummy Producer

produce(topic: str, key: AnyStr, value: AnyStr) → None

Publish message

Args:

topic (str): topic to post message to key (AnyStr): message key value (AnyStr): message

class esgf_core_utils.models.kafka.producer.KafkaProducer

Bases: BaseProducer

Kafka Producer

settings

producer

produce(topic: str, key: AnyStr, value: AnyStr) → list[tuple[confluent_kafka.KafkaError | None, confluent_kafka.Message]]

Publish message

Args:

topic (str): topic to post message to key (AnyStr): message key value (AnyStr): message

error(key: AnyStr, value: AnyStr) → list[tuple[confluent_kafka.KafkaError | None, confluent_kafka.Message]]

Post an message to the error event stream

Args:

key (AnyStr): message key value (AnyStr): message

Returns:

list[tuple[KafkaError, Message]]: delivery reports

success(key: AnyStr, value: AnyStr) → list[tuple[confluent_kafka.KafkaError | None, confluent_kafka.Message]]

Post an message to the success event stream

Args:

key (AnyStr): message key value (AnyStr): message

Returns:

list[tuple[KafkaError, Message]]: delivery reports