CDR ASN.1 Streamer Performance Tuning

The CDR ASN.1 Streamer application performance can be adjusted in several ways.

Throughput can be significantly improved by adjusting the number of threads in the container running the streamer application. The default number of threads is 1. Specify the number of threads with the following property:

spring.kafka.streams.properties.num.stream.threads

You can also add more containers, as long as each container has a unique application ID. Specify an application ID for each container with the following property:

spring.kafka.streams.application-id

The following is an example of a Kubernetes ConfigMap that sets these properties:

cdr-asn1-streamer.yaml: |-
   spring:
      kafka:
         streams:
            application-id: streamer1
            properties:
               num.stream.threads: 2

Increasing the number of Kafka topic partitions can also improve performance, especially in conjunction with increasing the number of containers and threads available in each container.