DPL Functions

DPL functions can be divided in three categories: transforms, evaluations, and aggregations.

Transforms can be used as they are or with evaluations and aggregations. Evaluations can be used with eval, fieldformat and where transform functions. Aggregations can be used with chart, stats and timechart transform functions.

DPL uses ISO 8601 as the default time format and provides an alternative default US time format for compatibility reasons.

Search Queries

With DPL, you can make data searches by using different kinds of criteria. Read more here.

The simplest DPL search contains only the dataset’s name.

%dpl
index=example

You can use wildcards to search from multiple datasets at the same time. However, we don’t recommend doing index=* search since it’s prone to slow down the performance with big data masses.

To narrow down the results, you can add date range by using either earliest, latest or both.

At the moment, if the earliest isn’t used, the earliest results that Teragrep will show will be from the beginning of previous midnight. This will be changed to be compatible in the future.

%dpl
index=example earliest=2020-01-01T00:00:00.000+03:00 latest=2021-12-01T00:00:00.000+03:00
example of earliest/latest search

You can also add keywords to narrow down the results. The following example uses keyword 50 which will fetch all records that contain it in the _raw table column.

%dpl
index=example earliest=2020-01-01T00:00:00.000+03:00 50
example of keyword

Pivot Tables

You can create pivot tables with chart, stats and timechart transform functions by using aggregations with them.

In the following example, we first search for all datasets that contain "join" in their names and limit the search to start 1.1.2021 at midnight. Then we used spath to extract JSON data from "success" and "operation" columns. As a last step, events in success and operation columns are counted with stats function.

%dpl
index=join* earliest=2021-01-01T00:00:00.000+03:00
| spath path=success
| spath path=operation
| stats count by success operation

DPL pivot table