Configuring for a content source | HCL Digital Experience
Configure the Schedulers, Filters, and Security from the respective tabs in the Create a New Content Source page.
Configuring the scheduler
To configure the schedule, click the Scheduler tab to display the
following options:
- Define Schedule
- From this box update, the date, time, and interval and click Create to add new schedule.
- Scheduled updates
- The schedule updates of the crawls are displayed.
Note: The time interval between the crawler runs must be more than the maximum execution time.
A crawler cannot be started if it is running. If a crawler job is started while the crawler is
running, this execution is ignored and the crawler is only started at the next scheduled time.
Configuring the Filters
The crawler filters control the crawler progress and the type of documents that are indexed and
cataloged. Crawler filters are divided into the following two types:
- URL filters
- These filters control which documents are crawled and indexed, based on the URL where the documents are found.
- Type filters
- These filters control which documents are crawled and indexed, based on the document type.
To configure filters, click the Filters tab. The defined filters are listed in the Filtering Rules box.
- Define Filter Rules
- You can define new filters in the Define Filter Rules box.
- Rule Name
- Provide a Rule Name in this mandatory field.
Configure the settings for when to apply rule, set the rule type, and basis and click Create . The defined filters are displayed in the Filtering Rules box.
When you configure the followings setting:
- Apply rule while: Collecting documents
- Rule type: Include
Configuring security for a content source
You can configure the security for indexing secured content sources and repositories that require
authentication. Click the Security tab to display the following two boxes:
- Define security realm
- This box is used to add new secured content sources.
- Security realms
- This box displays a list of existing security realms. You can edit or delete a Security realm as needed.