WebScraper
HomeContact Support
  • WebScraper
  • How to use?
    • Example
    • Configuration
Powered by GitBook
On this page
  • Step 1: Add the Agent
  • Step 2: Configure General
  • Step 3: Configure the Website Details
  • Step 4: Configure Selectors
  • Step 5: View Results
  • Files
  1. How to use?

Example

PreviousWebScraperNextConfiguration

Last updated 2 months ago

This example Data Stream demonstrates how to use this Context Provider to retrieve specific data from the .

Refer to to understand all configuration options of this Agent.

Step 1: Add the Agent

Drag the Web Scraper Context Provider onto the canvas, link the output endpoint to the printer, rename it, and save the Data Stream.

Step 2: Configure General

Select the Agent and click Configure.

In this case, keep the default Collection and polling interval.

Step 3: Configure the Website Details

Select the Url and License Keys.

Step 4: Configure Selectors

Enter the Container Selector and Item Selector.

In this case, set the Container Selector to '#row-1234365377' and Item Selector to '#col-2010014477 > div'.

Configure the Elements Grid. Click + to add a row to the grid and add the following rows:

Name
Selector
Data Type

Heading

div > h1

String

Sub Heading

div > h

String

Details

#text-4143654336 > p

String

Step 5: View Results

Apply the changes, save the Data Stream, and publish it.

Let's look at the Live Data View. Observe that the details from the web page are printed every 10 seconds.

Files

File
Link
Security Key

Data Stream

C0mp|ex123

See the article for steps to import a Data Stream.

Import, Export, and Clone - XMPro
XMPro home page
configuration
Web Scraper CP Example.xuc