Data Deletion

Deleting Raw Data for a Metric or a Set of Metrics​

This API call is for deleting raw data from an IRONdb node for a specific metric or for a set of metrics (when wildcards or a tag query are specified). It will remove raw data which has not been rolled up from the beginning of time up until the end time provided by the user for that metric(s).

When used for deletion of a single metric, this call will return an empty array on success. If there is an error, it will return a JSON object with the error.

When used with wildcards or a tag query, this call always returns a JSON object which describes the matching metrics and the actions taken or errors received on the deletion. For safety, explicit confirmation is required in the headers to actually force the data deletion. A list of the possible result statuses for each metric and what they mean can be found here.

It is highly recommended to perform the deletion API call without confirmation as a first step, in order to review what would actually be deleted (and hopefully avoid accidentally deleting more data than intended).

Deletion is currently only supported on a single node per API call. To delete data from the entire cluster, issue the same API call to each node.

Description​

URI​

/raw/<uuid>/<metric>

-OR-

/raw/<uuid>/<metric_pattern_including_wildcards>

-OR-

/raw/tags?query=<query>

Method​

DELETE

Inputs​

• uuid : The UUID of the check to which the metric belongs.

• metric : The name of the metric from which data is deleted.

• metric_pattern_including_wildcards : A metric naming pattern string including wildcards.

• query : See Tag Queries for more info on tag queries.

Headers​

• x-snowth-delete-time: <end> (required)

  • end The end timestamp for the delete operation. All data before this specified time is deleted (if wildcards or a tag query are specified, data will only be located and deletion will not occur unless confirmation is given). Time is represented in seconds since the epoch.

Used only with wildcards or tag query:

• x-snowth-account-id: <account_id> (required)

  • account_id The account to be searched using the wildcard pattern

• x-snowth-advisory-limit: <integer> (optional, defaults to no limit if not present)

  • integer A positive integer specifying the number of matching results to delete. If the header is unset, or set to -1 or "none", the service will not limit the result set.

• x-snowth-confirm-delete: <0 or 1> (optional, must be present and set to 1 to actually confirm and process the deletion)

Single Metric Example​

curl -X DELETE \
     -H 'x-snowth-delete-time: 1527811200' \
     http://127.0.0.1:8112/raw/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/example

In this example:

• raw : This tells the system that raw data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• example : Metric name

• 1527811200 : Delete all data for this metric before this time

Sample Output for Single Metric Example​

[]

Wildcard Metric Example​

curl -X DELETE \
     -H 'x-snowth-delete-time: 1527811200' \
     -H 'x-snowth-account-id: 1234' \
     -H 'x-snowth-confirm-delete: 1' \
     http://127.0.0.1:8112/raw/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/multiple_example*

In this example:

• raw : This tells the system that raw data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• multiple_example* : Metric name pattern including wildcard

• 1527811200 : Delete all data for matching metrics before this time

• 1234 : Delete data only for the given account id

• 1 : Confirm to actually commit to the deletion (we highly recommend omitting this header at first, to examine what will be deleted)

Sample Output for Wildcard Metric Example​

[ {"metric_name":"multiple_example_cpuutil_server1","delete_result":"not local","payload":""},
  {"metric_name":"multiple_example_cpuutil_server2","delete_result":"deleted","payload":""},
  ...
]

Deleting Text Data for a Metric or a Set of Metrics​

This API call is for deleting text data from the IRONdb cluster for a specific metric or for a set of metrics (when wildcards or a tag query are specified). It will remove text data from the beginning of time up until the end time provided by the user for that metric(s).

When used for deletion of a single metric, this call will return an empty array on success. If there is an error, it will return a JSON object with the error.

When used with wildcards or a tag query, this call always returns a JSON object which describes the matching metrics and the actions taken or errors received on the deletion. For safety, explicit confirmation is required in the headers to actually force the data deletion. A list of the possible result statuses for each metric and what they mean can be found here.

It is highly recommended to perform the deletion API call without confirmation as a first step, in order to review what would actually be deleted (and hopefully avoid accidentally deleting more data than intended).

Deletion of a single metric can optionally be journaled and replicated to all nodes using the X-Snowth-Full-Delete setting given for the headers below. However, wildcard or tag query deletion is currently only supported on a single node per API call. To use wildcards or a tag query to remove data across the cluster, issue the same API call to each node.

Description​

URI​

/text/<uuid>/<metric>

-OR-

/text/<uuid>/<metric_pattern_including_wildcards>

-OR-

/text/tags?query=<query>

Method​

DELETE

Inputs​

• uuid : The UUID of the check to which the metric belongs.

• metric : The name of the metric from which data is deleted.

• metric_pattern_including_wildcards : A metric naming pattern string including wildcards.

• query : See Tag Queries for more info on tag queries.

Headers​

• x-snowth-delete-time: <end> (required)

  • end The end timestamp for the delete operation. All data before this specified time is deleted (if wildcards or a tag query are specified, data will only be located and deletion will not occur unless confirmation is given). Time is represented in seconds since the epoch.

Used only with wildcards or tag query:

• x-snowth-account-id: <account_id> (required)

  • account_id The account to be searched using the wildcard pattern

• x-snowth-advisory-limit: <integer> (optional, defaults to no limit if not present)

  • integer A positive integer specifying the number of matching results to delete. If the header is unset, or set to -1 or "none", the service will not limit the result set.

• x-snowth-confirm-delete: <0 or 1> (optional, must be present and set to 1 to actually confirm and process the deletion)

Used only without wildcards or tag query:

• x-snowth-full-delete: <value> (optional)

  • value Determines whether the delete operation is local to the receiving node (0) or journaled to all other nodes as well (1). The default, if not specified, is 0 (local-only delete). This setting means perform the delete across all nodes, and is not to be confused with the full delete API.

Single Metric Example​

curl -X DELETE \
     -H 'X-Snowth-Delete-Time: 1527811200' \
     http://127.0.0.1:8112/text/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/example

In this example:

• text : This tells the system that text data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• example : Metric name

• 1527811200 : Delete all data for this metric before this time

Sample Output for Single Metric Example​

[]

Wildcard Metric Example​

curl -X DELETE \
     -H 'x-snowth-delete-time: 1527811200' \
     -H 'x-snowth-account-id: 1234' \
     -H 'x-snowth-confirm-delete: 1' \
     http://127.0.0.1:8112/text/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/multiple_example*

In this example:

• text : This tells the system that text data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• multiple_example* : Metric name pattern including wildcard

• 1527811200 : Delete all data for matching metrics before this time

• 1234 : Delete data only for the given account id

• 1 : Confirm to actually commit to the deletion (we highly recommend omitting this header at first, to examine what will be deleted)

Sample Output for Wildcard Metric Example​

[ {"metric_name":"multiple_example_cpuutil_server1","delete_result":"not local","payload":""},
  {"metric_name":"multiple_example_cpuutil_server2","delete_result":"deleted","payload":""},
  ...
]

Deleting Text Data for a Check​

This API call is for deleting text data from the IRONdb cluster for an entire check. It will remove data from the beginning of time up until the time provided by the user for every text metric that is part of the given check UUID.

This call always returns a JSON object which describes the matching metrics and the actions taken or errors received on the deletion. For safety, explicit confirmation is required in the headers to actually force the data deletion. A list of the possible result statuses for each metric and what they mean can be found here.

It is highly recommended to perform the deletion API call without confirmation as a first step, in order to review what would actually be deleted (and hopefully avoid accidentally deleting more data than intended).

Deletion is currently only supported on a single node per API call. To delete data from the entire cluster, issue the same API call to each node.

Description​

URI​

/text/<uuid>

Method​

DELETE

Inputs​

• uuid : The UUID of the check.

Headers​

• x-snowth-delete-time: <end> (required)

  • end The end timestamp for the delete operation. All data before this specified time is deleted. Time is represented in seconds since the epoch.

• x-snowth-account-id: <account_id> (required)

  • account_id The account to be searched using the wildcard pattern

• x-snowth-confirm-delete: <0 or 1> (optional, must be present and set to 1 to actually confirm and process the deletion)

Examples​

curl -X DELETE \
     -H 'x-snowth-delete-time: 1527811200' \
     -H 'x-snowth-account-id: 1234' \
     -H 'x-snowth-confirm-delete: 1' \
     http://127.0.0.1:8112/text/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12

In this example:

• text : This tells the system that text data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• 1527811200 : Delete all data for this check before this time

Output​

[ {"metric_name":"multiple_example_cpuutil_server1","delete_result":"not local","payload":""},
  {"metric_name":"multiple_example_cpuutil_server2","delete_result":"deleted","payload":""},
  ...
]

Deleting Histogram Data for a Metric or a Set of Metrics​

This API call is for deleting histogram rollup data from an IRONdb node for a specific metric or for a set of metrics (when wildcards or a tag query are specified). It will remove histogram data from the beginning of time up until the end time provided by the user for that metric(s).

The default behavior is deletion of data for all rollups, but it is possible also to specify particular rollups in the header given below, which may be used to remove data for specific rollup(s) which are not needed.

When used for deletion of a single metric, this call will return an empty array on success. If there is an error, it will return a JSON object with the error.

When used with wildcards or a tag query, this call always returns a JSON object which describes the matching metrics and the actions taken or errors received on the deletion. For safety, explicit confirmation is required in the headers to actually force the data deletion. A list of the possible result statuses for each metric and what they mean can be found here.

It is highly recommended to perform the deletion API call without confirmation as a first step, in order to review what would actually be deleted (and hopefully avoid accidentally deleting more data than intended).

Deletion of a single metric can optionally be journaled and replicated to all nodes using the X-Snowth-Full-Delete setting given for the headers below. However, wildcard or tag query deletion is currently only supported on a single node per API call. To use wildcards or a tag query to remove data across the cluster, issue the same API call to each node.

Description​

URI​

/histogram/<uuid>/<metric>

-OR-

/histogram/<uuid>/<metric_pattern_including_wildcards>

-OR-

/histogram/tags?query=<query>

Method​

DELETE

Inputs​

• uuid The UUID of the check to which the metric belongs.

• metric The name of the metric from which to delete data.

• metric_pattern_including_wildcards : A metric naming pattern string including wildcards.

• query : See Tag Queries for more info on tag queries.

Headers​

• x-snowth-delete-time: <end> (required)

  • end The end timestamp for the delete operation. All data before this specified time is deleted (if wildcards or a tag query are specified, data will only be located and deletion will not occur unless confirmation is given). Time is represented in seconds since the epoch.

• x-snowth-delete-rollups: <rollups> (optional, if omitted the default is ALL rollups)

  • rollups The rollups that should be included in the deletion operation, separated by commas

Used only with wildcards or tag query:

• x-snowth-account-id: <account_id> (required)

  • account_id The account to be searched using the wildcard pattern

• x-snowth-advisory-limit: <integer> (optional, defaults to no limit if not present)

  • integer A positive integer specifying the number of matching results to delete. If the header is unset, or set to -1 or "none", the service will not limit the result set.

• x-snowth-confirm-delete: <0 or 1> (optional, must be present and set to 1 to actually confirm and process the deletion)

Used only without wildcards or tag query:

• x-snowth-full-delete: <value> (optional)

  • value Determines whether the delete operation is local to the receiving node (0) or journaled to all other nodes as well (1). The default, if not specified, is 0 (local-only delete). This setting means perform the delete across all nodes, and is not to be confused with the full delete API.

Single Metric Example​

curl -X DELETE \
     -H 'X-Snowth-Delete-Time: 1527811200' \
     http://127.0.0.1:8112/histogram/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/example

In this example:

• histogram : This tells the system that histogram data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• example : Metric name

• 1527811200 : Delete all data for this metric before this time

Sample Output for Single Metric Example​

[]

Wildcard Metric Example​

curl -X DELETE \
     -H 'x-snowth-delete-time: 1527811200' \
     -H 'x-snowth-account-id: 1234' \
     -H 'x-snowth-confirm-delete: 1' \
     http://127.0.0.1:8112/histogram/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/multiple_example*

In this example:

• histogram : This tells the system that histogram data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• multiple_example* : Metric name pattern including wildcard

• 1527811200 : Delete all data for matching metrics before this time

• 1234 : Delete data only for the given account id

• 1 : Confirm to actually commit to the deletion (we highly recommend omitting this header at first, to examine what will be deleted)

Sample Output for Wildcard Metric Example​

[ {"metric_name":"multiple_example_cpuutil_server1","delete_result":"not local","payload":""},
  {"metric_name":"multiple_example_cpuutil_server2","delete_result":"deleted","payload":""},
  ...
]

Deleting Histogram Data for a Check​

This API call is for deleting histogram rollup data from the IRONdb cluster for an entire check. It will remove histogram data from the beginning of time up until the time provided by the user for every histogram metric that is part of the given check UUID.

The default behavior is deletion of data for all rollups, but it is possible also to specify particular rollups in the header given below, which may be used to remove data for specific rollup(s) which are not needed.

This call always returns a JSON object which describes the matching metrics and the actions taken or errors received on the deletion. For safety, explicit confirmation is required in the headers to actually force the data deletion. A list of the possible result statuses for each metric and what they mean can be found here.

It is highly recommended to perform the deletion API call without confirmation as a first step, in order to review what would actually be deleted (and hopefully avoid accidentally deleting more data than intended).

Deletion is currently only supported on a single node per API call. To delete data from the entire cluster, issue the same API call to each node.

Description​

URI​

/histogram/<uuid>

Method​

DELETE

Inputs​

• uuid The UUID of the check.

Headers​

• x-snowth-delete-time: <end> (required)

  • end The end timestamp for the delete operation. All data before this specified time is deleted. Time is represented in seconds since the epoch.

• x-snowth-account-id: <account_id> (required)

  • account_id The account to be searched using the wildcard pattern

• x-snowth-delete-rollups: <rollups> (optional, if omitted the default is ALL rollups)

  • rollups The rollups that should be included in the deletion operation, separated by commas

• x-snowth-confirm-delete: <0 or 1> (optional, must be present and set to 1 to actually confirm and process the deletion)

Examples​

curl -X DELETE \
     -H 'x-snowth-delete-time: 1527811200' \
     -H 'x-snowth-account-id: 1234' \
     -H 'x-snowth-confirm-delete: 1' \
     http://127.0.0.1:8112/histogram/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12

In this example:

• histogram : This tells the system that histogram data will be removed.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• 1527811200 : Delete all data for this check before this time

Output​

[ {"metric_name":"multiple_example_cpuutil_server1","delete_result":"not local","payload":""},
  {"metric_name":"multiple_example_cpuutil_server2","delete_result":"deleted","payload":""},
  ...
]

Deleting All Data for a Metric or a Set of Metrics​

This API call is for deleting all of the data from an IRONdb node for a specific metric or for a set of metrics (when a tag query is specified). It will remove data for the matching metric(s) throughout all timestamps and all rollups that have been provided by the user, no matter what the data type. In addition, it will remove all record of the metric name(s) with their tags and metadata. This call is intended for removing misnamed/experimental metrics or old metrics which are obsolete and can be safely removed.

When used for deletion of a single metric, this call will return a JSON object that reports if the request succeeded or not.

When used with wildcards or a tag query, this call always returns a JSON object which describes the matching metrics and the actions taken or errors received on the deletion. A list of the possible result statuses for each metric and what they mean can be found here. For safety, explicit confirmation is required in the headers to actually force the data deletion.

It is highly recommended to perform the deletion API call without confirmation as a first step, in order to review what would actually be deleted (and hopefully avoid accidentally deleting more data than intended).

Deletion is currently only supported on a single node per API call. To delete data from the entire cluster, issue the same API call to each node.

Description​

URI​

/full/canonical/<uuid>/<metric>

-OR-

/full/tags?query=<query>

Method​

DELETE

Inputs​

• uuid : The UUID of the check to which the metric belongs.

• metric : The full canonical name of the metric from which data is deleted, including tags.

• query : See Tag Queries for more info on tag queries.

Headers​

Used with all deletes:

• x-snowth-account-id: <account_id> (required)

  • account_id The account to be searched using the wildcard pattern Used only with tag query delete:

• x-snowth-advisory-limit: <integer>|none (optional, defaults to 100,000 if not present)

  • integer A positive integer specifying the number of matching results to delete. If the header is unset, the default of 100,000 will be used.

• x-snowth-confirm-delete: <0 or 1> (optional, must be present and set to 1 to actually confirm and process the deletion)

Single Metric Example​

curl -X DELETE \
     -H 'x-snowth-account-id: 1234' \
     http://127.0.0.1:8112/full/canonical/6f6bdc73-2352-4bdc-ab0e-72f66d0dee12/example

In this example:

• full : This tells the system that full data and metadata will be removed for the specified metric.

• canonical : This tells the system to delete a single metric that matches the given UUID and metric name.

• 1234 : Delete data only for the given account id

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12 : Check UUID

• example : Metric name

Sample Output for Single Metric Example​

{ "status": "succeeded" }

Query Example​

curl -X DELETE \
     -H 'x-snowth-account-id: 1234' \
     -H 'x-snowth-confirm-delete: 1' \
     http://127.0.0.1:8112/full/tags?query=and(__check_uuid:6f6bdc73-2352-4bdc-ab0e-72f66d0dee12,__name:multiple_example*)

In this example:

• full : This tells the system that all data and metadata for the matching metrics will be removed.

• tags : This tells the system that this is a tag query.

• 1234 : Delete data only for the given account id

• 1 : Confirm to actually commit to the deletion (we highly recommend omitting this header at first, to examine what will be deleted)

• query : See Tag Queries for more info on tag queries.

• 6f6bdc73-2352-4bdc-ab0e-72f66d0dee12: The UUID to match.

• multiple_example*: The metric name to match, with * denoting a wildcard.

Sample Output for Query Example​

[ {"metric_name":"multiple_example_cpuutil_server1","delete_result":"not local","payload":""},
  {"metric_name":"multiple_example_cpuutil_server2","delete_result":"ok","payload":""},
  ...
]

Wildcard, Tag Query and Check Delete Result Statuses​

When doing a delete which could affect multiple metrics, the returned JSON response will indicate the final status for each metric which matched the request. A list of these statuses and a description is given below. Note that, in many cases, the "payload' field will contain further details.

• Bad request : The URI did not conform to expected syntax or inputs for the API

• Deleted : Data was found and the deletion completed successfully

• Found : Data was found that can be deleted if request is submitted again with delete confirmation

• Invalid range : An argument is not within the proper range of allowable values

• No content : No data to be deleted was found (prior to the end time if not full delete)

• Not found : The metric name was not found

• Not implemented : The supplied request is not currently implemented

• Not local : The metric's data is not stored or replicated on this node of the cluster

• Redirected : The request for deletion was forwarded to another node(s)

• Server error : An error occurred while performing the deletion

• Unable busy : The deletion request cannot be performed currently, please try later

• Undefined : The result code is unknown and not valid