Comment on page

Configuration

This section explains each of the properties in the configuration blade.
General
Property
Description
Collection
This associates the Agent to a specific Collection (default to that of the current Data Stream).
Polling Interval (seconds)
A timespan to specify how often should the Agent check for new data/changes or update its cache.
Refer to Collections and Stream Hosts to understand more about Collections.
Website Details
Property
Description
Url
The URL of the Web Site to scrape.
License Key
The IronWebScraper license key.
Selectors
Property
Description
Container Selector
The CSS Selector that identifies the first element node to match in the HTML document, which locates the container.
Item Selector
The CSS Selector to filter the node retrieved from the Container Selector to locate the elements.
Elements Grid 
(Name, Selector, Type)
Define the elements to scrape and how they will appear in the output payload.
The attribute name should combine words or use a _, rather than a space.
The selector of the HTML element to retrieve within the Item Selector node.
The attribute data types used for the output payload are String, Long, Double, Boolean, DateTime, or Integer.
For more details regarding CSS Selector, click here.
Endpoints
Name
Description
Output
An event per poll will be made available on this endpoint, with attributes as defined in the Elements Grid.
Error
Errors encountered during the execution of this Agent will be published on this endpoint.

Property	Description
Collection	This associates the Agent to a specific Collection (default to that of the current Data Stream).
Polling Interval (seconds)	A timespan to specify how often should the Agent check for new data/changes or update its cache.

Property	Description
Url	The URL of the Web Site to scrape.
License Key	The IronWebScraper license key.

Property	Description
Container Selector	The CSS Selector that identifies the first element node to match in the HTML document, which locates the container.
Item Selector	The CSS Selector to filter the node retrieved from the Container Selector to locate the elements.
Elements Grid (Name, Selector, Type)	Define the elements to scrape and how they will appear in the output payload. The attribute name should combine words or use a _, rather than a space. The selector of the HTML element to retrieve within the Item Selector node. The attribute data types used for the output payload are String, Long, Double, Boolean, DateTime, or Integer.

Name	Description
Output	An event per poll will be made available on this endpoint, with attributes as defined in the Elements Grid.
Error	Errors encountered during the execution of this Agent will be published on this endpoint.

How to use? - Previous

Example

Next - How to use?

Release Notes

Last modified 4mo ago