Through this page, you can configure the Catalog Agent including with which CSID to register the resulting catalog information, the "starting point" URLs from where to start the Catalog Agent, and a few parameters which tailer the behavior of the Catalog Agent.
The Catalog Agent has two parts:
Speed | Concurrent Retrievals | Server Delay |
---|---|---|
1 | 1 | 60 |
2 | 1 | 30 |
3 | 1 | 15 |
4 | 1 | 5 |
5 | 1 | 1 |
6 | 2 | 0 |
7 | 4 | 0 |
8 | 8 | 0 |
9 | 12 | 0 |
10 | 16 | 0 |
WARNING: the Catalog Agent can process a large number of URLs very quickly, and may cause a large amount of network and server usage. The strict-order flag determines how strict the Catalog Agent will adhere to the policy decisions above. When set to false, the Catalog Agent only adheres loosely to the policy decisions, always trading off for using less resources. When set to true, the Catalog Agent will always adhere to the policy decisions. Specify a valid Internet email address for the Catalog Agent to use if it is prompted for an identity. For example, this email address will be sent in the From: field of HTTP headers. Specify a user name for the Catalog Agent to use when it is prompted for authorization. Typically, the user is anonymous for FTP URLs. Specify the password associated with the username above. Typically, the password is a valid Internet email address for FTP URLs.