Description

Build Kafka specific config.

Usages

Configuration options

KeyKindTypeDescription
acksVALUEStringThe number of acknowledgments the producer requires the leader to have received before considering a request complete
auto-offset-resetVALUEi.h.m.c.k.K.AutoOffsetResetWhat to do when there is no initial offset in Kafka or if the current offset does not exist any more on the server (e.g
batch-sizeVALUEIntegerThe producer will attempt to batch records together into fewer requests whenever multiple records are being sent to the same partition
bootstrap-serversVALUEStringA list of host/port pairs to use for establishing the initial connection to the Kafka cluster
buffer-memoryVALUELongThe total bytes of memory the producer can use to buffer records waiting to be sent to the server
compression-typeVALUEStringThe compression type for all data generated by the producer
dlq-topicLISTStringNames of the "dead letter queue" topics to be used in case message is nacked
enable-auto-commitVALUEBooleanIf true the consumer's offset will be periodically committed in the background
group-idVALUEStringA unique string that identifies the consumer group this consumer belongs to
key-deserializerVALUEClassDeserializer class for key that implements the org.apache.kafka.common.serialization.Deserializer interface
key-serializerVALUEClassSerializer class for key that implements the org.apache.kafka.common.serialization.Serializer interface
period-executionsVALUELongPeriod between successive executions of polling loop
poll-timeoutVALUELongThe maximum time to block polling loop in milliseconds
retriesVALUEIntegerSetting a value greater than zero will cause the client to resend any record whose send fails with a potentially transient error
topicLISTStringNames of the topics to consume from
topic-patternVALUEPatternPattern for topic names to consume from
value-deserializerVALUEClassDeserializer class for value that implements the org.apache.kafka.common.serialization.Deserializer interface
value-serializerVALUEClassSerializer class for value that implements the org.apache.kafka.common.serialization.Serializer interface

See the manifest for all available types.