- Troubleshooting
- Resources
startree-threshold-percentile
Description
Detect an anomaly if the metric is above a maximum threshold or below a minimum threshold. Aggregation function with 2 operands: PERCENTILETDIGEST, DISTINCTCOUNTHLL,etc…
Flowchart
Parameters
DATA
name | description | default data |
---|---|---|
aggregationColumn | The column to aggregate. Can be a derived metric. | – |
aggregationFunction | The aggregation function to apply on the aggregationColumn. Example: | – |
dataSource | The Pinot datasource to use. | – |
dataset | The dataset to query. | – |
monitoringGranularity | The period of aggregation of the timeseries. In ISO-8601 format. Example: | – |
timezone | Timezone used to group by time. In TZ-identifier format. For instance, | UTC |
timeColumn | TimeColumn used to group by time. If set to AUTO (the default value), the Pinot primary time column is used. | AUTO |
timeColumnFormat | Required if timeColumn is not AUTO. Learn more. | – |
completenessDelay | The time for your data to be considered complete and ready for anomaly detection. In ISO-8601 format. Example: | P0D |
queryFilters | Filters to apply when fetching data. Prefix with | – |
queryLimit | Maximum number of timeseries point to fetch. | 100000001 |
aggregationParameter | The second argument of the aggregationFunction. Example: for | – |
DETECTION
name | description | default value |
---|---|---|
max | If the current value is above this threshold, detect an anomaly. | – |
min | If the current value is below this threshold, detect an anomaly. | – |
name | description | default value |
---|---|---|
daysOfWeek | Used to ignore anomalies that happen at specific time periods. A list of days. Anomalies happening on these days are ignored if timeOfWeekIgnore is true. Example: | [] |
hoursOfDay | Used to ignore anomalies that happen at specific time periods. A list of hours. Anomalies happening on these hours are ignored. Example: | [] |
dayHoursOfWeek | Used to ignore anomalies that happen at specific time periods. A mapping of | [] |
Guardrail metric
name | description | default value |
---|---|---|
guardrailMetricMin | Used to ignore anomalies that don’t meet the guardrail threshold. Minimum threshold of the guardrail metric. If | -1 |
guardrailMetricMax | Used to ignore anomalies that don’t meet the guardrail threshold. Maximum threshold of guardrailMetric. If | -1 |
guardrailMetric | Used to ignore anomalies that don’t meet the guardrail threshold. Metric to use as a threshold guardrail. Example: | COUNT(*) |
Special events
name | description | default value |
---|---|---|
eventFilterSqlFilter | Used to ignore anomalies that happen during events. Sql filter to apply on the events. Learn more | – |
eventFilterLookaround | Used to ignore anomalies that happen during events. Offset to apply on startTime and endTime to look around the timeframe. In ISO-8601 format. Example: | P2D |
eventFilterTypes | Used to ignore anomalies that happen during events. List of event types to fetch by. Example: | [‘__NO_EVENTS’] |
eventFilterBeforeEventMargin | Used to ignore anomalies that happen during events. A period in ISO-8601 format that corresponds to a period that is also impacted by the event. Example: if beforeEventMargin is | P0D |
eventFilterAfterEventMargin | Used to ignore anomalies that happen during events. Same as eventFilterBeforeEventMargin at the end of the event. | P0D |
name | description | default value |
---|---|---|
mutabilityPeriod | Use if your data is mutable. ThirdEye will maintain the detection results up to date on the mutable period. For instance, if your last 10 days of data is mutable, set | P0D |
reNotifyPercentageThreshold | For detection replay when data is mutable. If the percentage difference between an existing anomaly and a new anomaly on the same time frame is above this threshold, renotify. Combined with | -1 |
reNotifyAbsoluteThreshold | For detection replay when data is mutable. If the absolute difference between an existing anomaly and a new anomaly on the same time frame is above this threshold, renotify. Combined with | -1 |
Anomaly merger
name | description | default value |
---|---|---|
mergeMaxGap | Maximum gap between 2 anomalies for anomalies to be merged. In ISO-8601 format. Example: | – |
mergeMaxDuration | Maximum duration of an anomaly merger. At merge time, if an anomaly merger would get bigger than this limit, the anomalies are not merged. In ISO-8601 format. Example: | – |
RCA
name | description | default value |
---|---|---|
rcaAggregationFunction | The aggregation function to use for RCA. If the detection metric name is known to ThirdEye, this parameter is optional. | – |
rcaIncludedDimensions | List of the dimensions (columns in the dataset) to use in RCA drill-downs. If not set or empty, all dimensions of the table are used. Learn more. | [] |
rcaExcludedDimensions | List of dimensions (columns in the dataset) to ignore in RCA drill-downs. If not set or empty, all dimensions of the table are used. rcaExcludedDimensions and rcaIncludedDimensions cannot be used at the same time. | [] |
rcaEventTypes | A list of type to filter on for RCA. Only events that match such types will be shown in the RCA related events tab. Learn more. | [] |
rcaEventSqlFilter | A Sql filter for RCA events. Only events that match the filter will be shown in the RCA related events tab. Learn more. | – |