The pipeline is a series of processes or stages through which data flow systematically and efficiently. It helps to visualize the flow between nodes, rules, and filters applied for the data flow.
Last updated
Was this helpful?
Creating a Pipeline
Click on the Explore Option from the top menu and click on Pipelines
Hover on the Actions and click on Visualize Pipeline
On click of the Visualize Pipeline button, a new dialog opens, select the desired date-time range, select the desired namespace along with the linked applications, and click Create to create a new pipeline view.
On click of the Visualize Pipeline button a new pipeline tab will get added with the pipeline view as shown below
Pipeline View: The pipeline view shows the data flow between the nodes. each node is connected with the edges to show the data flow between the nodes. The node will have the following details.
1. Name of the node 2. Total number of Events 3. Total volume size of the events 4. Total savings for application and target node Minimap: Minimap is a tool for quick preview and exploration of large graphs. Time Range Slider: Helps to select the time range between the selected date and time Zoom In/Out: Tool to zoom in and zoom out the graph Side Bar: Helps to make the following changes 1. Change the theme 2. Change the default title of the pipeline tab 3. Select a different date time range 4. Select a different namespace, can do multi-select 5. Shows the overall EPS and Valume savings.
Click the + icon to create or choose the existing Pipeline
On click of + icon, Configure Pipeline dialog will show, with the options 1. Choose Existing Pipeline 2. Create New Pipeline
Select the Choose Existing Pipeline to choose an existing Pipeline for the Dataflow
Select the Pipelines that will be applied to the Dataflow and click on the Blue arrow button to add them to dataflow
Click on the Delete Icon on the right side will disassociate it from the Dataflow. Once done click on the Close button on the dialog to apply the changes.
Select Create New Pipeline button to create new Pipeline for the namespace and application
Enter the Pipeline name and click on Next Button
Rules sections the user will be able to configure the Rules and click on the Save button
Before adding the forwarder rule, create a forwarder and map the forwarder in the data flow tab.
After adding the forwarder the new node will be added as below
