Post: Upload Data by Kafka

Fetch datasets from Kafka topics and converts messages to CSV format, and uploads them as the dataset for a usecase version

Endpoint:

data_upload/kafka

Input Parameters:

  • usecaseId (string, required): Unique identifier of the use case
  • usecaseVersion (integer, default: 1): Version of the use case
  • Topic(string, required): Kafka topic name is required
  • Totaldatapoints(integer, optional, default:1, min:1, max:1000): Number of messages to fetch
  • SID(integer, optional, default:1): Kafka broker setting ID
  • consumerconfig(iKafkaConsumerConfig body,required): Kafka consumer configuration

Output:Returns metadata about the uploaded file, such as status, file_name, file_location.