Basic Configuration
In this page we list the Camel Kafka Configuration which are not part of the camel-catalog material and are not part of the kafka connect framework. For the specific connector configuration you can have a look at the single documentation pages.
For a Sink connector the basic options are:
| Name | Description | Default | Priority |
|---|---|---|---|
camel.sink.marshal |
The camel dataformat name to use to marshal data to the destination |
null |
HIGH |
camel.sink.unmarshal |
The camel dataformat name to use to unmarshal data from the topic |
null |
HIGH |
camel.sink.contentLogLevel |
Log level for the record’s content. Valid values: TRACE, DEBUG, INFO, WARN, ERROR, OFF. |
OFF |
HIGH |
camel.beans.aggregate |
A reference to an aggregate bean, in the form of #class: |
null |
MEDIUM |
camel.aggregation.size |
The size of the aggregation, to be used in combination with camel.beans.aggregate |
10 |
MEDIUM |
camel.aggregation.timeout |
The timeout of the aggregation, to be used in combination with camel.beans.aggregate |
500L |
MEDIUM |
camel.error.handler |
The error handler to use: possible value are 'no' or 'default' |
default |
MEDIUM |
camel.error.handler.max.redeliveries |
The maximum redeliveries to be use in case of Default Error Handler |
0 |
MEDIUM |
camel.error.handler.redelivery.delay |
The initial redelivery delay in milliseconds in case of Default Error Handler |
1000L |
MEDIUM |
camel.remove.headers.pattern |
The pattern of the headers we want to exclude from the exchange |
null |
MEDIUM |
camel.idempotency.enabled |
If idempotency must be enabled or not |
false |
LOW |
camel.idempotency.repository.type |
The idempotent repository type to use, possible values are memory and kafka |
memory |
LOW |
camel.idempotency.expression.type |
How the idempotency will be evaluated: possible values are body and header |
body |
LOW |
camel.idempotency.expression.header |
The header name that will be evaluated in case of camel.idempotency.expression.type equals to header |
null |
LOW |
camel.idempotency.memory.dimension |
The Memory dimension of the in memory idempotent Repository |
100 |
LOW |
camel.idempotency.kafka.topic |
The Kafka topic name to use for the idempotent repository |
kafka_idempotent_repository |
LOW |
camel.idempotency.kafka.bootstrap.servers |
A comma-separated list of host and port pairs that are the addresses of the Kafka brokers where the idempotent repository should live |
localhost:9092 |
LOW |
camel.idempotency.kafka.max.cache.size |
Sets the maximum size of the local key cache |
1000 |
LOW |
camel.idempotency.kafka.poll.duration.ms |
Sets the poll duration (in milliseconds) of the Kafka consumer |
100 |
LOW |
For a Source connector the basic options are:
| Name | Description | Default | Priority |
|---|---|---|---|
camel.source.marshal |
The camel dataformat name to use to marshal data to the destination |
null |
HIGH |
camel.source.unmarshal |
The camel dataformat name to use to unmarshal data from the topic |
null |
HIGH |
camel.source.contentLogLevel |
Log level for the record’s content. Valid values: TRACE, DEBUG, INFO, WARN, ERROR, OFF. |
OFF |
HIGH |
camel.source.maxBatchPollSize |
The max number of messages retrieved in a single poll() |
1000L |
MEDIUM |
camel.source.maxPollDuration |
The maximum time in milliseconds spent in a single call to poll() |
1000L |
MEDIUM |
camel.source.pollingConsumerQueueSize |
The queue size for the internal hand-off queue between the polling consumer, and producers sending data into the queue. |
1000L |
MEDIUM |
camel.source.pollingConsumerBlockTimeout |
To use a timeout (in milliseconds) when the producer is blocked if the internal queue is full. If the value is 0 or negative then no timeout is in use. |
0L |
MEDIUM |
camel.source.pollingConsumerBlockWhenFull |
Whether to block any producer if the internal queue is full. |
true |
MEDIUM |
camel.source.camelMessageHeaderKey |
The name of a camel message header containing an unique key that can be used as a Kafka message key. If this is not specified, then the Kafka message will not have a key. |
null |
MEDIUM |
camel.beans.aggregate |
A reference to an aggregate bean, in the form of #class: |
null |
MEDIUM |
camel.aggregation.size |
The size of the aggregation, to be used in combination with camel.beans.aggregate |
10 |
MEDIUM |
camel.aggregation.timeout |
The timeout of the aggregation, to be used in combination with camel.beans.aggregate |
500L |
MEDIUM |
camel.error.handler |
The error handler to use: possible value are 'no' or 'default' |
default |
MEDIUM |
camel.error.handler.max.redeliveries |
The maximum redeliveries to be use in case of Default Error Handler |
0 |
MEDIUM |
camel.error.handler.redelivery.delay |
The initial redelivery delay in milliseconds in case of Default Error Handler |
1000L |
MEDIUM |
camel.remove.headers.pattern |
The pattern of the headers we want to exclude from the exchange |
null |
MEDIUM |
camel.idempotency.enabled |
If idempotency must be enabled or not |
false |
LOW |
camel.idempotency.repository.type |
The idempotent repository type to use, possible values are memory and kafka |
memory |
LOW |
camel.idempotency.expression.type |
How the idempotency will be evaluated: possible values are body and header |
body |
LOW |
camel.idempotency.expression.header |
The header name that will be evaluated in case of camel.idempotency.expression.type equals to header |
null |
LOW |
camel.idempotency.memory.dimension |
The Memory dimension of the in memory idempotent Repository |
100 |
LOW |
camel.idempotency.kafka.topic |
The Kafka topic name to use for the idempotent repository |
kafka_idempotent_repository |
LOW |
camel.idempotency.kafka.bootstrap.servers |
A comma-separated list of host and port pairs that are the addresses of the Kafka brokers where the idempotent repository should live |
localhost:9092 |
LOW |
camel.idempotency.kafka.max.cache.size |
Sets the maximum size of the local key cache |
1000 |
LOW |
camel.idempotency.kafka.poll.duration.ms |
Sets the poll duration (in milliseconds) of the Kafka consumer |
100 |
LOW |
For more options related to single connector you can have a look at Connectors list.