"description":"Shows the number of active time series with new data points inserted during the last hour. High value may result in ingestion slowdown. \n\nSee more details here https://docs.victoriametrics.com/FAQ.html#what-is-an-active-time-series",
"description":"How many datapoints are inserted into storage per second",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":10,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":0,
"y":6
},
"id":106,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"uid":"$ds"
},
"editorMode":"code",
"expr":"sum(rate(vm_rows_inserted_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (type) > 0",
"format":"time_series",
"hide":false,
"intervalFactor":1,
"legendFormat":"__auto",
"range":true,
"refId":"A"
}
],
"title":"Datapoints ingestion rate ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"* `*` - unsupported query path\n* `/write` - insert into VM\n* `/metrics` - query VM system metrics\n* `/query` - query instant values\n* `/query_range` - query over a range of time\n* `/series` - match a certain label set\n* `/label/{}/values` - query a list of label values (variables mostly)",
"description":"Shows the number of active time series with new data points inserted during the last hour. High value may result in ingestion slowdown. \n\nSee following link for details:",
"description":"The less time it takes is better.\n* `*` - unsupported query path\n* `/write` - insert into VM\n* `/metrics` - query VM system metrics\n* `/query` - query instant values\n* `/query_range` - query over a range of time\n* `/series` - match a certain label set\n* `/label/{}/values` - query a list of label values (variables mostly)",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":10,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"s"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":12,
"y":14
},
"id":22,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"max(vm_request_duration_seconds{job=~\"$job\", instance=~\"$instance\", quantile=\"0.99\"}) by (path) > 0",
"description":"* `*` - unsupported query path\n* `/write` - insert into VM\n* `/metrics` - query VM system metrics\n* `/query` - query instant values\n* `/query_range` - query over a range of time\n* `/series` - match a certain label set\n* `/label/{}/values` - query a list of label values (variables mostly)",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":10,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":0,
"y":22
},
"id":35,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"exemplar":false,
"expr":"sum(rate(vm_http_request_errors_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (path) > 0",
"format":"time_series",
"interval":"",
"intervalFactor":1,
"legendFormat":"__auto",
"range":true,
"refId":"A"
}
],
"title":"Requests error rate ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"Shows the rate of logging the messages by their level. Unexpected spike in rate is a good reason to check logs.",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"bars",
"fillOpacity":100,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"auto",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"mappings":[],
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
}
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":12,
"y":22
},
"id":110,
"options":{
"legend":{
"calcs":[
"lastNotNull",
"mean",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"single",
"sort":"none"
}
},
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"sum(rate(vm_log_messages_total{job=~\"$job\", instance=~\"$instance\", level!=\"info\"}[$__rate_interval])) by (level, location) > 0",
"description":"Percentage of used RSS memory (resident).\nThe RSS memory shows the amount of memory recently accessed by the application. It includes anonymous memory and data from recently accessed files (aka page cache).\nThe application's performance will significantly degrade when memory usage is close to 100%.\n\nClick on the line and choose Drilldown to show memory usage per instance",
"description":"Share for memory allocated by the process itself. When memory usage reaches 100% it will be likely OOM-killed.\nSafe memory usage % considered to be below 80%\n\nClick on the line and choose Drilldown to show memory usage per instance",
"description":"Shows the percentage of open file descriptors compared to the limit set in the OS.\nReaching the limit of open files can cause various issues and must be prevented.\n\nSee how to change limits here https://medium.com/@muhammadtriwibowo/set-permanently-ulimit-n-open-files-in-ubuntu-4d61064429a",
"description":"Shows the rate and total number of new series created over last 24h.\n\nHigh churn rate tightly connected with database performance and may result in unexpected OOM's or slow queries. It is recommended to always keep an eye on this metric to avoid unexpected cardinality \"explosions\".\n\nThe higher churn rate is, the more resources required to handle it. Consider to keep the churn rate as low as possible.\n\nGood references to read:\n* https://www.robustperception.io/cardinality-is-key\n* https://www.robustperception.io/using-tsdb-analyze-to-investigate-churn-and-cardinality",
"description":"The percentage of slow inserts comparing to total insertion rate during the last 5 minutes. \n\nThe less value is better. If percentage remains high (>10%) during extended periods of time, then it is likely more RAM is needed for optimal handling of the current number of active time series. \n\nIn general, VictoriaMetrics requires ~1KB or RAM per active time series, so it should be easy calculating the required amounts of RAM for the current workload according to capacity planning docs. But the resulting number may be far from the real number because the required amounts of memory depends on many other factors such as the number of labels per time series and the length of label values. See also https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3976#issuecomment-1476883183",
"description":"Shows the percentage of used cache size from the allowed size by type. \nValues close to 100% show the maximum potential utilization.\nValues close to 0% show that cache is underutilized.",
"description":"VictoriaMetrics limits the number of labels per each metric with `-maxLabelsPerTimeseries` command-line flag.\n\nThis prevents from ingesting metrics with too many labels. The value of `maxLabelsPerTimeseries` must be adjusted for your workload.\n\nWhen limit is exceeded (graph is > 0) - extra labels are dropped, which could result in unexpected identical time series. See more details about dropped labels in logs.",
"description":"How many datapoints are inserted into storage per second",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":10,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":0,
"y":33
},
"id":10,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"sum(rate(vm_rows_inserted_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (type) > 0",
"format":"time_series",
"hide":false,
"intervalFactor":1,
"legendFormat":"{{type}}",
"range":true,
"refId":"A"
}
],
"title":"Datapoints ingestion rate ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"Shows the time needed to reach the 100% of disk capacity based on the following params:\n* free disk space;\n* row ingestion rate;\n* dedup rate;\n* compression.\n\nUse this panel for capacity planning in order to estimate the time remaining for running out of the disk space.\n\n",
"title":"Disk space usage - datapoints ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"How many datapoints are in RAM queue waiting to be written into storage. The number of pending data points should be in the range from 0 to `2*<ingestion_rate>`, since VictoriaMetrics pushes pending data to persistent storage every second.",
"description":"Data parts of LSM tree.\nHigh number of parts could be an evidence of slow merge performance - check the resource utilization.\n* `indexdb` - inverted index\n* `storage/small` - recently added parts of data ingested into storage(hot data)\n* `storage/big` - small parts gradually merged into big parts (cold data)",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":0,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":12,
"y":49
},
"id":36,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"expr":"sum(vm_parts{job=~\"$job\", instance=~\"$instance\"}) by (type)",
"format":"time_series",
"intervalFactor":1,
"legendFormat":"{{type}}",
"refId":"A"
}
],
"title":"LSM parts ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"Shows how many rows were ignored on insertion due to corrupted or out of retention timestamps.",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":10,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":0,
"y":57
},
"id":58,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true
},
"tooltip":{
"mode":"multi",
"sort":"none"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"exemplar":false,
"expr":"sum(increase(vm_rows_ignored_total{job=~\"$job\", instance=~\"$instance\"}[1h])) by (reason)",
"format":"time_series",
"hide":false,
"interval":"",
"intervalFactor":1,
"legendFormat":"{{reason}}",
"range":true,
"refId":"A"
}
],
"title":"Rows ignored for last 1h ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"The number of on-going merges in storage nodes. It is expected to have high numbers for `storage/small` metric.",
"description":"Shows how many ongoing insertions (not API /write calls) on disk are taking place, where:\n* `max` - equal to number of CPUs;\n* `current` - current number of goroutines busy with inserting rows into underlying storage.\n\nEvery successful API /write call results into flush on disk. However, these two actions are separated and controlled via different concurrency limiters. The `max` on this panel can't be changed and always equal to number of CPUs. \n\nWhen `current` hits `max` constantly, it means storage is overloaded and requires more CPU.\n\n",
"description":"99th percentile of number of series read per query.",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":0,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"decimals":2,
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":0,
"y":73
},
"id":99,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"histogram_quantile(0.99, sum(rate(vm_series_read_per_query_bucket{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (instance, vmrange))",
"format":"time_series",
"interval":"",
"intervalFactor":1,
"legendFormat":"{{instance}}",
"range":true,
"refId":"A"
}
],
"title":"Series read per query ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"99th percentile of number of raw samples read per queried series.",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":0,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"decimals":2,
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":12,
"y":73
},
"id":103,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"histogram_quantile(0.99, sum(rate(vm_rows_read_per_series_bucket{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (instance, vmrange))",
"format":"time_series",
"interval":"",
"intervalFactor":1,
"legendFormat":"{{instance}}",
"range":true,
"refId":"A"
}
],
"title":"Datapoints read per series ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"99th percentile of number of raw datapoints read per query.",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":0,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"decimals":2,
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":0,
"y":81
},
"id":122,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"histogram_quantile(0.99, sum(rate(vm_rows_read_per_query_bucket{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (instance, vmrange))",
"format":"time_series",
"interval":"",
"intervalFactor":1,
"legendFormat":"{{instance}}",
"range":true,
"refId":"A"
}
],
"title":"Datapoints read per query ($instance)",
"type":"timeseries"
},
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"description":"99th percentile of number of raw samples scanner per query.\n\nThis number can exceed number of RowsReadPerQuery if `step` query arg passed to [/api/v1/query_range](https://victoriametrics-datasource.io/docs/victoriametrics-datasource/latest/querying/api/#range-queries) is smaller than the lookbehind window set in square brackets of [rollup function](https://docs.victoriametrics.com/MetricsQL.html#rollup-functions). For example, if `increase(some_metric[1h])` is executed with the `step=5m`, then the same raw samples on a hour time range are scanned `1h/5m=12` times. See [this article](https://valyala.medium.com/how-to-optimize-promql-and-metricsql-queries-85a1b75bf986) for details.",
"fieldConfig":{
"defaults":{
"color":{
"mode":"palette-classic"
},
"custom":{
"axisCenteredZero":false,
"axisColorMode":"text",
"axisLabel":"",
"axisPlacement":"auto",
"barAlignment":0,
"drawStyle":"line",
"fillOpacity":0,
"gradientMode":"none",
"hideFrom":{
"legend":false,
"tooltip":false,
"viz":false
},
"lineInterpolation":"linear",
"lineWidth":1,
"pointSize":5,
"scaleDistribution":{
"type":"linear"
},
"showPoints":"never",
"spanNulls":false,
"stacking":{
"group":"A",
"mode":"none"
},
"thresholdsStyle":{
"mode":"off"
}
},
"decimals":2,
"links":[],
"mappings":[],
"min":0,
"thresholds":{
"mode":"absolute",
"steps":[
{
"color":"green",
"value":null
},
{
"color":"red",
"value":80
}
]
},
"unit":"short"
},
"overrides":[]
},
"gridPos":{
"h":8,
"w":12,
"x":12,
"y":81
},
"id":105,
"links":[],
"options":{
"legend":{
"calcs":[
"mean",
"lastNotNull",
"max"
],
"displayMode":"table",
"placement":"bottom",
"showLegend":true,
"sortBy":"Last *",
"sortDesc":true
},
"tooltip":{
"mode":"multi",
"sort":"desc"
}
},
"pluginVersion":"9.1.0",
"targets":[
{
"datasource":{
"type":"victoriametrics-datasource",
"uid":"$ds"
},
"editorMode":"code",
"expr":"histogram_quantile(0.99, sum(rate(vm_rows_scanned_per_query_bucket{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])) by (instance, vmrange))",
"format":"time_series",
"interval":"",
"intervalFactor":1,
"legendFormat":"{{instance}}",
"range":true,
"refId":"A"
}
],
"title":"Datapoints scanned per query ($instance)",
