Valeurs de paramètres paramétrables de configuration minimales et recommandées

Deux configurations des valeurs des paramètres paramétrables NiFi sont présentées, une valeur minimale et une valeur optimale.

Un ensemble de valeurs de traitement optimales pour la configuration minimale pour NiFi et Elasticsearch est fourni. Il s'est des valeurs par défaut pour le déploiement HCL Commerce. Elles sont suffisantes pour un index type comptant jusqu'à 300 000 articles de catalogue. La deuxième configuration fournit un traitement optimal de la configuration recommandée pour NiFi et Elasticsearch. Voici les valeurs recommandées fournies pour le déploiement d'HCL Commerce. Elles sont suffisantes pour un index type comptant jusqu'à 1 million d'articles de catalogue.

Tailles de segment

Valeurs optimales :

NiFi heap – 9GB
Elasticsearch heap - 12GB

Valeurs recommandées :

NiFi heap – 12GB 
Elasticsearch heap - 16GB

Modifications d'unité d'exécution des groupes de processeurs

Flux NiFi>>Service de journalisation

Valeurs optimales :

Nifi Flow>>Logging Service>>Generate Log Message: Configuration/Concurrent Tasks = 4 
Nifi Flow>>Logging Service>>Batch Bulk Document – Log: Configuration/Concurrent Tasks = 4

Valeurs recommandées :

Nifi Flow>>Logging Service>>Generate Log Message: Configuration/Concurrent Tasks = 8 
Nifi Flow>>Logging Service>>Batch Bulk Document – Log: Configuration/Concurrent Tasks = 8
All other processors are set at Concurrent Tasks= 1

Tous les autres processeurs sont définis sur Tâches simultanées = 1

Flux NiFi>>Service en masse – Produit

Valeurs optimales :

Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Track Bulk Request: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Post Bulk Elasticsearch-Product: Configuration/Concurrent Tasks = 16`
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Set stage.end.time : Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Analyze Bulk Response: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search> Post Refresh Elasticsearch: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Retry Flow File: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Retry Flow File: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Route On Environment: Configuration/Concurrent Tasks = 4

Valeurs recommandées :

Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Track Bulk Request: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Post Bulk Elasticsearch-Product: Configuration/Concurrent Tasks = 32
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Set stage.end.time : Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Analyze Bulk Response: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search> Post Refresh Elasticsearch: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Retry Flow File: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Retry Flow File: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Product>>Bulk Elastic Search>Route On Environment: Configuration/Concurrent Tasks = 8

Flux NiFi>>Service en masse – Prix

Valeurs optimales :

Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search> Post Bulk Elasticsearch-Price: Configuration/Concurrent Tasks = 16
Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search> Set stage.end.time: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search> Analyze Bulk Response: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search>Route On Environment: Configuration/Concurrent Tasks = 4

Valeurs recommandées :

Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search> Post Bulk Elasticsearch-Price: Configuration/Concurrent Tasks = 32
Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search> Set stage.end.time: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search> Analyze Bulk Response: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Price>>Bulk Elastic Search>Route On Environment: Configuration/Concurrent Tasks = 8

Flux NiFi>>Service en masse – Stock

Valeurs optimales :

Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search>Track Bulk Request: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search> Post Bulk Elasticsearch-Inventory: Configuration/Concurrent Tasks = 16
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search> Set stage.end.time: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search> Analyze Bulk Response: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search>Route On Environment: Configuration/Concurrent Tasks = 4
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search>Retry Flow File: Configuration/Concurrent Tasks = 4

Valeurs recommandées :

Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search>Track Bulk Request: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search> Post Bulk Elasticsearch-Inventory: Configuration/Concurrent Tasks = 32
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search> Set stage.end.time: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search> Analyze Bulk Response: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search>Route On Environment: Configuration/Concurrent Tasks = 8
Nifi Flow>>Bulk Service – Inventory >>Bulk Elastic Search>Retry Flow File: Configuration/Concurrent Tasks = 8

Flux NiFi>>Service NLP

Valeurs optimales :

Nifi Flow>>NLP Service>>Parse NLP Messages>>SCROLL Elasticsearch>>Generate Query: Configuration/Concurrent Tasks = 6
Nifi Flow>>NLP Service>>Parse NLP Messages>>SCROLL Elasticsearch>>GET Elasticsearch: Configuration/Concurrent Tasks = 6
Nifi Flow>>NLP Service>>Parse NLP Messages>>SCROLL Elasticsearch>> SCROLL Elasticsearch: Configuration/Concurrent Tasks = 6
Nifi Flow>>NLP Service>>Parse NLP Messages>>NLP Processor>>Transform Document-CoreNLP Ingest Processor: Configuration/Concurrent Tasks = 16
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Track Bulk Request: Configuration/Concurrent Tasks = 4
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Post Bulk Elasticsearch: Configuration/Concurrent Tasks = 16
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Analyze Bulk Response: Configuration/Concurrent Tasks = 4
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Retry Flow File: Configuration/Concurrent Tasks = 4

Valeurs recommandées :

Nifi Flow>>NLP Service>>Parse NLP Messages>>SCROLL Elasticsearch>>Generate Query: Configuration/Concurrent Tasks = 16
Nifi Flow>>NLP Service>>Parse NLP Messages>>SCROLL Elasticsearch>>GET Elasticsearch: Configuration/Concurrent Tasks = 16
Nifi Flow>>NLP Service>>Parse NLP Messages>>SCROLL Elasticsearch>> SCROLL Elasticsearch: Configuration/Concurrent Tasks = 16
Nifi Flow>>NLP Service>>Parse NLP Messages>>NLP Processor>>Transform Document-CoreNLP Ingest Processor: Configuration/Concurrent Tasks = 16
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Track Bulk Request: Configuration/Concurrent Tasks = 8
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Post Bulk Elasticsearch: Configuration/Concurrent Tasks = 32
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Analyze Bulk Response: Configuration/Concurrent Tasks = 8
Nifi Flow>>NLP Service>>Parse NLP Messages>>Bulk Elasticsearch>> Retry Flow File: Configuration/Concurrent Tasks = 8

Changements de la taille du compartiment

1i

Optimale :

Nifi Flow> live reindex- DatabaseProductStage1i: Variables:scroll.bucket.size=5000

Recommandation :

Nifi Flow> live reindex- DatabaseProductStage1i: Variables:scroll.bucket.size=5000

1e

Optimale :

Nifi Flow> live reindex- DatabaseProductStage1e: Variables:scroll.bucket.size=5000

Recommandation :

Nifi Flow> live reindex- DatabaseProductStage1e: Variables:scroll.bucket.size=5000

Modification de l'intervalle d'actualisation.

NiFi Flow> live reindex- StoreSchema >> Setup Elasticsearch Index Schema : Populate Store Index Schema

Note: Pour modifier cette valeur, arrêtez le processeur, cliquez sur l'objet json et éditez-le, et remplacez la valeur refresh_interval.