Feed Applications

This section allows configuring feed applications and their corresponding parameters to establish data input sources.

 "feedApplications": [
            {
                "logLevel": "INFO",
                "name": "Ericsson Usage"
            },
            {
                "logLevel": "INFO",
                "name": "Topup Demo"
            },
            {
                "kafkaSinkBatchSize": 1,
                "kafkaSourceSettings": {
                    "batchSize": 1,
                    "epochSize": 1,
                    "topicName": "RECHARGE"
                },
                "logLevel": "DEBUG",
                "name": "Recharge",
                "numParallelChannels": 1,
                "parameters": [
                    {
                        "name": "bootstrapServers",
                        "stringListValue": {
                            "values": [
                                "127.0.0.1:9092"
                            ]
                        }
                    },
                    {
                        "name": "groupId",
                        "stringValue": "group-hcl"
                    },
                    {
                        "name": "schemaRegistryUrl",
                        "stringValue": ""
                    },
                    {
                        "name": "saslKerberosKeytab",
                        "stringValue": ""
                    },
                    {
                        "name": "saslKerberosPrincipal",
                        "stringValue": ""
                    },
                    {
                        "name": "saslKerberosServiceName",
                        "stringValue": ""
                    },
                    {
                        "name": "saslMechanism",
                        "stringValue": ""
                    },
                    {
                        "name": "schemaFile",
                        "stringValue": ""
                    },
                    {
                        "name": "securityProtocol",
                        "stringValue": ""
                    }
                ]
            },
            {
                "name": "Customer Profile Refresh",
                "numParallelChannels": 1,
                "parameters": [
                    {
                        "name": "inputFileDelimiter",
                        "stringValue": "~"
                    },
                    {
                        "int32Value": 33,
                        "name": "numOfFields"
                    },
                    {
                        "name": "periodInSeconds",
                        "stringValue": "2"
                    },
                    {
                        "boolValue": true,
                        "name": "skipCampaignActuator"
                    }
                ],
                "postAggregationEnricherBatchSize": 500,
                "preAggregationEnricherBatchSize": 500
            }
        ]

logLevel: configure the level of log information required from the feed application. You can set any one of the following options:

CRITICAL: logs only critical information.
DEBUG: logs all the information including critical, error and warning.
ERROR: logs only error message.
INFO: logs basic execution information.
WARNING: logs only warning messages.

name: configure the feed application name. The name should match with the solution file name that is deployed in the code base.

parameters: define parameter name and value to be passed to the feed application. The value type can be stringValue, stringListValue, boolValue, and int32Value.

Kafka Settings

For Kafka, there are few additional fields to be configured.

kafkaSinkBatchSize: Specify the maximum number of processed records that feed applications will push to internal Kafka topics in a single batch.

batchSize: define the maximum number of records to be read at a time in single batch.

epochSize: configure the maximum number of records to be committed in Kafka topics in single batch after reading them.

topicName: set the topic name that is configured in the source Kafka topic.

numParallelChannels: set the number of parallel processing channels to process Kafka topics.

"postAggregationEnricherBatchSize", "preAggregationEnricherBatchSize": Configure the batch size for non-real-time feed applications that process data in batches rather than a continuous stream. This setting determines the number of records bundled together before sending to Kafka topics.