Manage Data Streams

A Data Stream is a visual representation of a flow of data, which is depicted by the use of Agents that are connected by arrows that allow data to flow from one Agent to the next. Data streams are built in an interactive canvas environment that allows you to drag Agents from the toolbox to a drawing area. These Agents allow you to complete certain actions on the data. This includes aggregating, filtering, displaying, or re-saving the data into another database.

It is recommended that you read the article listed below to improve your understanding of Data Streams.

Data Stream

How to Create a Data Stream

To create a Data Stream, follow the steps below:

Open the New Data Streams page from the left-hand menu.
Give the Data Stream a name.
Enter the type (streaming or recurring).
Enter the category under which the Data Stream is found in the Data Stream list.
Give the Data Stream an icon. Sample icons can be found in the Icon Library.
Enter the Collection the Data Stream will have.
Enter a description.
Click on Save.

How to Open a Data Stream

Data Streams can be opened via the Data Streams Page on the left-hand menu, or via the main page that contains the list of Categories.

To open Data Streams from the left-hand menu:

Open the Data Streams page from the left-hand menu.
Select the Data Stream you want to open.

To open Data Streams from the list of categories:

Click on the Logo to open the main page.
Click on the Category of the Data Stream.

3. Click the Data Stream you want to open.

Adding Agents to the Canvas

To add Agents to the canvas, drag and drop Agents from the left-hand toolbox to make up the data flow for your Data Stream. See the Agents article for more information on Agents.

Expand an Agent category to view the list of Agents.
Click and drag an agent onto the Canvas.
To connect Agents, click on an output endpoint and drag it to an input endpoint for the Agent you want to connect to.

Copying and Pasting Stream Objects

Stream Objects that are in the Data Stream can be copied and pasted using keyboard shortcuts. To copy a Stream object:

Select an Agent to highlight it.
To highlight multiple Agents, hold the ctrl key while you are selecting them.
Once the Stream Object/s are highlighted in yellow, press and hold ctrl + C.
To paste the Stream Object that was just copied, press and hold ctrl + P.

You can also copy a Stream Object from one Data Stream and paste it into a different Data Stream.

Deleting Stream Objects

To delete a Stream Object on the canvas, follow the steps below:

Select a Stream Object by clicking on it.
Click on Delete.

You can also delete Stream Objects that are on the Data Stream canvas by using the 'delete' keyboard shortcut.

Select an Agent to highlight it.
To highlight multiple Agents, hold the ctrl key while you are selecting them.
Once the Stream Object/s are highlighted in yellow, click on the delete key on the keyboard.

Data Streams can be shared between users. See the Manage Access article to read more about managing access to users. To share a Data Stream, follow the steps below:

Click on Manage Access.
Click on Add.
Enter the user you want to share the Stream with.
Choose between read, write, or co-owner permissions.
Click on Ok.

To change permissions of existing users, follow the steps below:

Click on Manage Access.
Select the user.

3. Change their permissions. 4. Or, delete permissions for the user.

To remove the permissions for multiple users, follow the steps below:

Click on Share.
Click on Multiple Select.
Select multiple users.
Click on Delete.

Cloning Data Streams

To clone a Data Stream, follow the steps below:

From within the Data Stream canvas, click on “Properties“.
Click on “Clone“. This button may not initially be visible on the Properties page but can be found in the menu that appears if you hover with your mouse cursor over the “More” button.
Specify a name for the Data Stream.
Choose a category to copy the Data Steam to. Please note that this should not be the same as the category of the original Data Stream.
Click Save.