Get: Consume Topic Without Explode Flatten

Endpoint: /pyspark_data_ingestion/ingest/kafka_topic_without_explode_flatten

Consumes messages from a Kafka topic and writes them as a CSV file to the specified directory.

Input Parameters:

  • topic_name (string, required): Name of the Kafka topic to consume
  • output_dir (string, optional): Output directory to save the consumed data
        • Default value: /home/aionuser/mountpoint/HCLT/data/storage/dataset/ecom/

Output:

Returns a status message indicating the success of the Kafka data consumption and file creation.

A screenshot of a computer AI-generated content may be incorrect.