Visualize Pipelines

The pipeline is a series of processes or stages through which data flow systematically and efficiently. It helps to visualize the flow between nodes, rules, and filters applied for the data flow.

Creating a Pipeline

Click on the Explore Option from the top menu and click on Pipelines

Navigating to Pipeline Page

Hover on the Actions and click on Visualize Pipeline

Hover over the Actions button on the top-right

On click of the Visualize Pipeline button, a new dialog opens, select the desired date-time range, select the desired namespace along with the linked applications, and click Create to create a new pipeline view.

On click of the Visualize Pipeline button a new pipeline tab will get added with the pipeline view as shown below

Pipeline View: The pipeline view shows the data flow between the nodes. each node is connected with the edges to show the data flow between the nodes. The node will have the following details.

1. Name of the node 2. Total number of Events 3. Total volume size of the events 4. Total savings for application and target node Minimap: Minimap is a tool for quick preview and exploration of large graphs. Time Range Slider: Helps to select the time range between the selected date and time Zoom In/Out: Tool to zoom in and zoom out the graph Side Bar: Helps to make the following changes 1. Change the theme 2. Change the default title of the pipeline tab 3. Select a different date time range 4. Select a different namespace, can do multi-select 5. Shows the overall EPS and Valume savings.

Add/Choose the existing Pipeline for Dataflow.

Click the + icon to create or choose the existing Pipeline

Add/Choose existing Pipeline

On click of + icon, Configure Pipeline dialog will show, with the options 1. Choose Existing Pipeline 2. Create New Pipeline

Select the Choose Existing Pipeline to choose an existing Pipeline for the Dataflow

Choose Existing Pipeline

Select the Pipelines that will be applied to the Dataflow and click on the Blue arrow button to add them to dataflow

Click on the Delete Icon on the right side will disassociate it from the Dataflow. Once done click on the Close button on the dialog to apply the changes.

Select Create New Pipeline button to create new Pipeline for the namespace and application

Enter the Pipeline name and click on Next Button

Create New Pipeline

Rules sections the user will be able to configure the Rules and click on the Save button

Add Rule(Forwarder)

Before adding the forwarder rule, create a forwarder and map the forwarder in the data flow tab.

Map a forwarder

After adding the forwarder the new node will be added as below

Pipeline with the forwarder