Configuring a crawler to search your local portal site | HCL Digital Experience
Configure and run a search crawler on your local portal site to gather information and create a search collection that enables your users to search your portal site.
About this task
Procedure
-
Set the crawler user ID. Set a dedicated crawler user ID for crawling the portal site
content source:
-
Start the initial crawl. Start the initial crawl on the portal site content
source:
- To open the Manage Search portlet, click the Administration menu icon. Then, click .Then, click Search Collections.
- In the search collection list, click Default Search Collection.
- Click the Start Crawler icon next to the Portal content source name.
-
Configure regular crawls. If you want regular crawls on the portal site content source,
do either of the following tasks:
- Enable the default scheduler:
- Click the View Content Source Schedulers icon next to the collection name.
- In the Manage Schedulers page, click Disabled. This action changes the status of the scheduler to Enabled and displays a confirmation message.
- Set up your own scheduler:
- Click the Edit icon for the content source.Note: You can have only one schedule at a time. Therefore, to create your own schedule, you first must delete the existing schedule.
- Select the Schedulers tab.
- Configure your own scheduler as needed. For more information, see Manage Search portlet help.
- Click Save to save your changes.
- Click the Edit icon for the content source.
- Enable the default scheduler:
Example
- The local portal site is visible through a service that requires SSL. Therefore, if your portal is configured with a web server and you configure the content source root URL through the web server, you must configure the web server for SSL.
- By default, items in the result lists from portal site searches provide no summary information. If users use the Search and Browse portlet, they can refer to the information given under Description: for information about the search result list item. If you want to have the summary information that is added, configure the portlet with the summary parameter enabled as follows: PortalCollectionSummarizer=on.
- When you crawl a portal site, be aware that a Portal Search crawl can use extended memory and time, depending on your Portal Search environment and configuration. For details, see the topic about Hints and tips for Portal Search crawls.
- Do not change the default value of
1
for the option Levels of links to follow. Changing this value initiates web crawling logic and might result in unexpected results. For example, crawler might trigger unwanted in some of the administration portlets. - The portal site search collection is created when an administrator goes to the Manage Search portlet. However, you must start the crawl for users to be able to search the portal site. Depending on your portal configuration and environment and possible customization, you might need to reset the portal site search collection that was created. For details about such scenarios and the necessary tasks to perform see the topic about Resetting the default search collection.
- If your users search the portal site search collection on a secured portal site, refer to the topic Enabling search on a secured portal site with the default configuration.
- The portal search crawler indexes static content pages and all pages that include portlets.
- The Public or anonymous portal pages are pages that users can view without
authentication by user ID and password. The crawler can crawl public pages on the portal
site on which it is located, or on a remote portal.
If you want anonymous users to be able to search the public pages of your portal site, see Enabling anonymous users to search public pages of your portal.
- The secured portal pages are pages that users can view only if they authenticate
themselves to the portal by logging in to the portal with a user ID and password. For
details, see configuring search on a secured portal site. Note: You can crawl, index, and search secured portal pages only on your local portal installation. For security reasons, you cannot crawl secured pages of one portal site from another portal site.
If you customize search on your portal site, you might find useful information under the topics about configuring the default location for search collections and Resetting the default search collection.
If your portal site is multilingual and your users use different languages to search your portal, see the topic about Crawling a multilingual portal site.