aws kinesis firehose sink AWS Kinesis Firehose Sink

Provided by: "Apache Software Foundation"

Support Level for this Kamelet is: "Preview"

Send message to an AWS Kinesis Firehose Stream

Configuration Options

The following table summarizes the configuration options available for the aws-kinesis-firehose-sink Kamelet:

Property Name Description Type Default Example

accessKey *

Access Key

The access key obtained from AWS

string

region *

AWS Region

The AWS region to connect to

string

"eu-west-1"

secretKey *

Secret Key

The secret key obtained from AWS

string

streamName *

Stream Name

The name of the stream we want to send to data to

string
Fields marked with (*) are mandatory.

Usage

This section summarizes how the aws-kinesis-firehose-sink can be used in various contexts.

Knative Sink

The aws-kinesis-firehose-sink Kamelet can be used as Knative sink by binding it to a Knative object.

aws-kinesis-firehose-sink-binding.yaml
apiVersion: camel.apache.org/v1alpha1
kind: KameletBinding
metadata:
  name: aws-kinesis-firehose-sink-binding
spec:
  source:
    ref:
      kind: Channel
      apiVersion: messaging.knative.dev/v1
      name: mychannel
  sink:
    ref:
      kind: Kamelet
      apiVersion: camel.apache.org/v1alpha1
      name: aws-kinesis-firehose-sink
    properties:
      accessKey: "The Access Key"
      region: "eu-west-1"
      secretKey: "The Secret Key"
      streamName: "The Stream Name"

Make sure you have Camel K installed into the Kubernetes cluster you’re connected to.

Save the aws-kinesis-firehose-sink-binding.yaml file into your hard drive, then configure it according to your needs.

You can run the sink using the following command:

kubectl apply -f aws-kinesis-firehose-sink-binding.yaml

Dependencies

The Kamelet needs the following dependencies:

  • camel:aws2-kinesis

  • camel:kamelet

Binding to Knative using the Kamel CLI:

The procedure described above can be simplified into a single execution of the kamel bind command:

kamel bind channel:mychannel aws-kinesis-firehose-sink -p "sink.accessKey=The Access Key" -p "sink.region=eu-west-1" -p "sink.secretKey=The Secret Key" -p "sink.streamName=The Stream Name"

This will create the KameletBinding under the hood and apply it to the current namespace in the cluster.

Kafka Sink

The aws-kinesis-firehose-sink Kamelet can be used as Kafka sink by binding it to a Kafka topic.

aws-kinesis-firehose-sink-binding.yaml
apiVersion: camel.apache.org/v1alpha1
kind: KameletBinding
metadata:
  name: aws-kinesis-firehose-sink-binding
spec:
  source:
    ref:
      kind: KafkaTopic
      apiVersion: kafka.strimzi.io/v1beta1
      name: my-topic
  sink:
    ref:
      kind: Kamelet
      apiVersion: camel.apache.org/v1alpha1
      name: aws-kinesis-firehose-sink
    properties:
      accessKey: "The Access Key"
      region: "eu-west-1"
      secretKey: "The Secret Key"
      streamName: "The Stream Name"

Ensure that you’ve installed Strimzi and created a topic named my-topic in the current namespace. Make also sure you have Camel K installed into the Kubernetes cluster you’re connected to.

Save the aws-kinesis-firehose-sink-binding.yaml file into your hard drive, then configure it according to your needs.

You can run the sink using the following command:

kubectl apply -f aws-kinesis-firehose-sink-binding.yaml

Binding to Kafka using the Kamel CLI:

The procedure described above can be simplified into a single execution of the kamel bind command:

kamel bind kafka.strimzi.io/v1beta1:KafkaTopic:my-topic aws-kinesis-firehose-sink -p "sink.accessKey=The Access Key" -p "sink.region=eu-west-1" -p "sink.secretKey=The Secret Key" -p "sink.streamName=The Stream Name"

This will create the KameletBinding under the hood and apply it to the current namespace in the cluster.

Kamelet source file

Have a look at the following link:

https://github.com/apache/camel-kamelets/blob/main/aws-kinesis-firehose-sink.kamelet.yaml

Back to top