Main Settings (Content Crawler Web Service)

To learn about crawlers and Content Crawler Web Services, click here.

To specify the location of your Content Crawler Web Service, specify time-outs, and enable or disable the crawlers associated with this Web Service:

1. Under Server Information, you can establish and manage remote server associations for this Web Service:

• To associate a remote server (or to change an existing association):
1. Click Browse.
2. In the Choose Remote Server dialog box, select the remote server you want to associate and click OK.

The associated remote server displays to the right of Remote Server, and the location of that remote server in the administrative directory displays to the right of Remote Server Path.

• To remove the remote server association, click Remove.

2. Under Content Crawler Web Service Settings, specify the path and time-out settings for this Web Service:

1. In the Container URL box, type the path to the crawl provider, which tells the portal how to navigate through the content hierarchy. If you associated a remote server, the base URL displays to the left of the box. You can either type a relative path, finishing the path that starts with the base URL (/myCrawlerWebService/ContainerProvider.asmx), or you can type an absolute path, ignoring the base URL (http://myServer/myCrawlerWebService/ContainerProvider.asmx).

2. In the Document URL box, type the path to the document provider, which tells the portal how to get information from a document of this type. If you associated a remote server, you can type a relative path or an absolute path.

3. In the Upload URL box, type the path to the upload provider, which tells the portal how to copy a document into the Document Repository. If you associated a remove server, you can type a relative path or an absolute path.

4. For each time-out setting, specify how long you want the portal to try to get content from the computer hosting the Web Service. If the host computer does not return content before this time-out period ends, the crawl fails.
   
   In each time-out text box, type the number of seconds or minutes you want the portal to wait; then, in the drop-down list, click Second(s) or Minute(s).

• The SOAP Timeout setting applies only to non-gatewayed content. You probably want to set a relatively long time-out (maybe as much as 90 seconds) because the crawler might need to contact a slow back-end system (for example, Exchange).

• The Gateway Timeout setting applies only to gatewayed content. You can probably set a slightly longer time here than for the SOAP Timeout because gatewayed content is often secured or of a more complicated nature and therefore you want to allow the server more time to try to get the content.

3. Under Status of Web Service, specify what should happen when a user tries to run a crawler or submit a document from this Web Service:

• To allow this Web Service to crawl content, click Enabled.

• To disallow this Web Service to crawl content and display a message to users when they try to crawl or submit content, click Disabled with message and type a message in the box.

You can toggle the status of this Web Service at any time. For example, you might want to disable a Web Service if you need to do maintenance on the host computer or on the Web Service itself.

• To display the page associated with this help topic:

1. Click Administration.
2. Open the Content Crawler Web Service Editor:
• To create a new Content Crawler Web Service:
1. Open an administrative folder.
2. In the Create Object menu, click Web Service - Crawler.
• To edit an existing crawler Web Service:
1. Navigate to the Content Crawler Web Service you want to edit.
2. Click the Content Crawler Web Service name.