This section explains each of the properties in the configuration blade.
Refer to Collections and Stream Hosts to understand more about Collections.
For more details regarding CSS Selector, click here.
Last updated
| Property | Description |
|---|---|
| Property | Description |
|---|---|
| Property | Description |
|---|---|
| Name | Description |
|---|---|
Collection
This associates the Agent to a specific Collection (default to that of the current Data Stream).
Polling Interval (seconds)
A timespan to specify how often should the Agent check for new data/changes or update its cache.
Url
The URL of the Web Site to scrape.
License Key
The IronWebScraper license key.
Container Selector
The CSS Selector that identifies the first element node to match in the HTML document, which locates the container.
Item Selector
The CSS Selector to filter the node retrieved from the Container Selector to locate the elements.
Elements Grid (Name, Selector, Type)
Define the elements to scrape and how they will appear in the output payload.
The attribute name should combine words or use a _, rather than a space.
The selector of the HTML element to retrieve within the Item Selector node.
The attribute data types used for the output payload are String, Long, Double, Boolean, DateTime, or Integer.
Output
An event per poll will be made available on this endpoint, with attributes as defined in the Elements Grid.
Error
Errors encountered during the execution of this Agent will be published on this endpoint.
