dashboards/all: add new panel CPU spent on GC

It should help identifying cases when too much CPU is spent on garbage collection,
 and advice users on how this can be addressed.

Signed-off-by: hagen1778 <roman@victoriametrics.com>
This commit is contained in:
hagen1778 2024-02-02 16:21:21 +01:00
parent 29a9b31584
commit 487a94565b
No known key found for this signature in database
GPG key ID: 3BF75F3741CA9640
10 changed files with 1559 additions and 404 deletions

View file

@ -1448,8 +1448,7 @@
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
"color": "green"
},
{
"color": "red",
@ -1563,8 +1562,7 @@
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
"color": "green"
},
{
"color": "red",
@ -1651,6 +1649,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1664,6 +1663,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1693,7 +1693,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1701,7 +1702,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1709,7 +1711,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 14
"y": 3
},
"id": 66,
"links": [],
@ -1762,6 +1764,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1775,6 +1778,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1804,7 +1808,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1812,7 +1817,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1820,7 +1826,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 14
"y": 3
},
"id": 138,
"links": [],
@ -1872,6 +1878,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1885,6 +1892,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1914,7 +1922,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1922,7 +1931,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1930,7 +1940,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 22
"y": 11
},
"id": 64,
"links": [],
@ -1985,6 +1995,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1998,6 +2009,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2020,7 +2032,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2028,7 +2041,8 @@
}
]
},
"unit": "Bps"
"unit": "Bps",
"unitScale": true
},
"overrides": [
{
@ -2049,7 +2063,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 22
"y": 11
},
"id": 122,
"links": [],
@ -2120,6 +2134,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2133,6 +2148,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2157,7 +2173,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2165,7 +2182,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": [
{
@ -2189,7 +2207,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 30
"y": 19
},
"id": 117,
"links": [],
@ -2244,6 +2262,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2257,6 +2276,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2279,7 +2299,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2287,7 +2308,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": [
{
@ -2308,7 +2330,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 30
"y": 19
},
"id": 204,
"links": [],
@ -2378,6 +2400,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2391,6 +2414,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2415,7 +2439,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2423,7 +2448,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2431,7 +2457,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 38
"y": 27
},
"id": 68,
"links": [],
@ -2485,6 +2511,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2498,6 +2525,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2519,7 +2547,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2527,7 +2556,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2535,7 +2565,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 38
"y": 27
},
"id": 119,
"options": {
@ -2586,6 +2616,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2599,6 +2630,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2623,7 +2655,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2631,7 +2664,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2639,7 +2673,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 46
"y": 35
},
"id": 70,
"links": [],
@ -2693,6 +2727,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2706,6 +2741,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2727,7 +2763,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2735,7 +2772,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2743,7 +2781,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 46
"y": 35
},
"id": 120,
"options": {
@ -2782,6 +2820,115 @@
],
"title": "TCP connections rate ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 43
},
"id": 210,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(job)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
}
],
"title": "Resource usage ($job)",
@ -2882,7 +3029,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 15
"y": 23
},
"id": 102,
"options": {
@ -2996,7 +3143,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 15
"y": 23
},
"id": 108,
"options": {
@ -3097,7 +3244,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 23
"y": 31
},
"id": 142,
"links": [
@ -3209,7 +3356,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 23
"y": 31
},
"id": 107,
"options": {
@ -3310,7 +3457,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 31
"y": 39
},
"id": 170,
"links": [],
@ -3416,7 +3563,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 31
"y": 39
},
"id": 116,
"links": [],
@ -3518,7 +3665,7 @@
"h": 9,
"w": 12,
"x": 0,
"y": 39
"y": 47
},
"id": 144,
"options": {
@ -3621,7 +3768,7 @@
"h": 9,
"w": 12,
"x": 12,
"y": 39
"y": 47
},
"id": 58,
"links": [],
@ -3727,7 +3874,7 @@
"h": 6,
"w": 24,
"x": 0,
"y": 48
"y": 56
},
"id": 183,
"options": {
@ -3855,7 +4002,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 54
"y": 62
},
"id": 135,
"options": {
@ -3977,7 +4124,7 @@
"h": 9,
"w": 12,
"x": 0,
"y": 29
"y": 37
},
"id": 76,
"links": [],
@ -4093,7 +4240,7 @@
"h": 9,
"w": 12,
"x": 12,
"y": 29
"y": 37
},
"id": 86,
"links": [],
@ -4218,7 +4365,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 38
"y": 46
},
"id": 80,
"links": [],
@ -4323,7 +4470,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 38
"y": 46
},
"id": 78,
"links": [],
@ -4439,7 +4586,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 46
"y": 54
},
"id": 82,
"options": {
@ -4546,7 +4693,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 46
"y": 54
},
"id": 74,
"options": {
@ -4664,7 +4811,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 6
"y": 14
},
"id": 100,
"links": [],
@ -4775,7 +4922,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 6
"y": 14
},
"id": 113,
"links": [],
@ -4887,7 +5034,7 @@
"h": 7,
"w": 12,
"x": 0,
"y": 14
"y": 22
},
"id": 151,
"links": [],
@ -5032,7 +5179,7 @@
"h": 7,
"w": 12,
"x": 12,
"y": 14
"y": 22
},
"id": 167,
"links": [],
@ -5169,7 +5316,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 21
"y": 29
},
"id": 141,
"links": [
@ -5288,7 +5435,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 21
"y": 29
},
"id": 133,
"links": [
@ -5414,7 +5561,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 29
"y": 37
},
"id": 54,
"options": {
@ -5517,7 +5664,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 29
"y": 37
},
"id": 55,
"options": {
@ -5625,7 +5772,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 37
"y": 45
},
"id": 20,
"links": [],
@ -5758,7 +5905,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 37
"y": 45
},
"id": 22,
"links": [],
@ -5866,7 +6013,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 45
"y": 53
},
"id": 202,
"links": [],
@ -6002,7 +6149,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 45
"y": 53
},
"id": 14,
"links": [],
@ -6134,7 +6281,7 @@
"h": 8,
"w": 24,
"x": 0,
"y": 53
"y": 61
},
"id": 206,
"links": [],
@ -6270,7 +6417,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 42
"y": 50
},
"id": 92,
"links": [],
@ -6396,7 +6543,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 42
"y": 50
},
"id": 95,
"links": [],
@ -6518,7 +6665,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 50
"y": 58
},
"id": 163,
"links": [],
@ -6662,7 +6809,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 50
"y": 58
},
"id": 165,
"links": [],
@ -6802,7 +6949,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 58
"y": 66
},
"id": 178,
"links": [],
@ -6909,7 +7056,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 58
"y": 66
},
"id": 180,
"links": [],
@ -7016,7 +7163,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 66
"y": 74
},
"id": 179,
"links": [],
@ -7123,7 +7270,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 66
"y": 74
},
"id": 181,
"links": [],
@ -7241,7 +7388,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 74
"y": 82
},
"id": 93,
"links": [],
@ -7371,7 +7518,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 74
"y": 82
},
"id": 207,
"links": [],
@ -7507,7 +7654,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 43
"y": 51
},
"id": 97,
"links": [],
@ -7633,7 +7780,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 43
"y": 51
},
"id": 99,
"links": [],
@ -7757,7 +7904,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 51
"y": 59
},
"id": 185,
"links": [],
@ -7901,7 +8048,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 51
"y": 59
},
"id": 187,
"links": [],
@ -8041,7 +8188,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 59
"y": 67
},
"id": 139,
"links": [],
@ -8148,7 +8295,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 59
"y": 67
},
"id": 114,
"links": [],
@ -8263,7 +8410,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 67
"y": 75
},
"id": 208,
"links": [],
@ -8393,7 +8540,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 67
"y": 75
},
"id": 209,
"links": [],
@ -8512,7 +8659,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 75
"y": 83
},
"id": 88,
"links": [],
@ -8577,7 +8724,7 @@
"h": 2,
"w": 24,
"x": 0,
"y": 92
"y": 100
},
"id": 198,
"options": {
@ -8653,7 +8800,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 94
"y": 102
},
"id": 189,
"links": [],
@ -8754,7 +8901,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 94
"y": 102
},
"id": 190,
"links": [],
@ -8855,7 +9002,7 @@
"h": 7,
"w": 12,
"x": 0,
"y": 102
"y": 110
},
"id": 192,
"links": [],
@ -8962,7 +9109,7 @@
"h": 7,
"w": 12,
"x": 12,
"y": 102
"y": 110
},
"id": 196,
"links": [],
@ -9064,7 +9211,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 109
"y": 117
},
"id": 200,
"links": [],
@ -9165,7 +9312,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 109
"y": 117
},
"id": 201,
"links": [],
@ -9284,7 +9431,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 117
"y": 125
},
"id": 203,
"links": [],
@ -9514,4 +9661,4 @@
"uid": "oS7Bi_0Wz",
"version": 1,
"weekStart": ""
}
}

View file

@ -1529,6 +1529,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1542,6 +1543,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1565,7 +1567,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1573,7 +1576,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1581,7 +1585,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 31
"y": 3
},
"id": 112,
"links": [],
@ -1634,6 +1638,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1647,6 +1652,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1670,7 +1676,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1678,7 +1685,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": []
},
@ -1686,7 +1694,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 31
"y": 3
},
"id": 44,
"links": [],
@ -1789,6 +1797,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1802,6 +1811,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1825,7 +1835,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1833,7 +1844,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1841,7 +1853,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 39
"y": 11
},
"id": 123,
"links": [],
@ -1893,6 +1905,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1906,6 +1919,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1929,7 +1943,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1937,7 +1952,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1945,7 +1961,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 39
"y": 11
},
"id": 114,
"links": [],
@ -2000,6 +2016,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2013,6 +2030,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2037,7 +2055,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2045,7 +2064,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": [
{
@ -2069,7 +2089,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 47
"y": 19
},
"id": 75,
"links": [],
@ -2124,6 +2144,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2137,6 +2158,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2160,7 +2182,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2168,7 +2191,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": [
{
@ -2192,7 +2216,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 47
"y": 19
},
"id": 57,
"links": [],
@ -2257,6 +2281,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2270,6 +2295,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2294,7 +2320,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2302,7 +2329,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2310,7 +2338,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 55
"y": 27
},
"id": 47,
"links": [],
@ -2363,6 +2391,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2376,6 +2405,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2398,7 +2428,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2406,7 +2437,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": [
{
@ -2427,7 +2459,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 55
"y": 27
},
"id": 76,
"links": [],
@ -2492,6 +2524,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2505,6 +2538,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2529,7 +2563,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2537,7 +2572,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2545,7 +2581,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 63
"y": 35
},
"id": 48,
"links": [],
@ -2598,6 +2634,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2611,6 +2648,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2633,7 +2671,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2641,7 +2680,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": [
{
@ -2662,7 +2702,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 63
"y": 35
},
"id": 124,
"links": [],
@ -2732,6 +2772,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2745,6 +2786,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2768,7 +2810,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2776,7 +2819,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2784,7 +2828,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 71
"y": 43
},
"id": 49,
"links": [],
@ -2838,6 +2882,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2851,6 +2896,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2874,7 +2920,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2882,7 +2929,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2890,7 +2938,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 71
"y": 43
},
"id": 37,
"links": [],
@ -2931,6 +2979,115 @@
],
"title": "TCP connections ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 51
},
"id": 125,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(instance)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
}
],
"targets": [
@ -3023,7 +3180,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 8
"y": 16
},
"id": 66,
"options": {
@ -3135,7 +3292,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 8
"y": 16
},
"id": 68,
"links": [],
@ -3242,7 +3399,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 16
"y": 24
},
"id": 116,
"links": [],
@ -3347,7 +3504,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 16
"y": 24
},
"id": 60,
"links": [],
@ -3449,7 +3606,7 @@
"h": 9,
"w": 12,
"x": 0,
"y": 24
"y": 32
},
"id": 90,
"options": {
@ -3554,7 +3711,7 @@
"h": 9,
"w": 12,
"x": 12,
"y": 24
"y": 32
},
"id": 118,
"links": [],
@ -3660,7 +3817,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 33
"y": 41
},
"id": 120,
"options": {
@ -3787,7 +3944,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 33
"y": 41
},
"id": 74,
"links": [],
@ -3918,7 +4075,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 33
"y": 41
},
"id": 10,
"links": [],
@ -4024,7 +4181,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 33
"y": 41
},
"id": 73,
"links": [],
@ -4131,7 +4288,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 41
"y": 49
},
"id": 53,
"links": [],
@ -4281,7 +4438,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 41
"y": 49
},
"id": 34,
"links": [],
@ -4414,7 +4571,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 49
"y": 57
},
"id": 30,
"links": [],
@ -4531,7 +4688,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 49
"y": 57
},
"id": 36,
"links": [],
@ -4634,7 +4791,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 57
"y": 65
},
"id": 58,
"links": [],
@ -4741,7 +4898,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 57
"y": 65
},
"id": 62,
"options": {
@ -4856,7 +5013,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 65
"y": 73
},
"id": 59,
"links": [],
@ -4971,7 +5128,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 65
"y": 73
},
"id": 64,
"options": {
@ -5072,7 +5229,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 73
"y": 81
},
"id": 99,
"links": [],
@ -5179,7 +5336,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 73
"y": 81
},
"id": 103,
"links": [],
@ -5286,7 +5443,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 81
"y": 89
},
"id": 122,
"links": [],
@ -5393,7 +5550,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 81
"y": 89
},
"id": 105,
"links": [],
@ -5596,4 +5753,4 @@
"uid": "wNf0q_kZk",
"version": 1,
"weekStart": ""
}
}

View file

@ -1449,8 +1449,7 @@
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
"color": "green"
},
{
"color": "red",
@ -1564,8 +1563,7 @@
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
"color": "green"
},
{
"color": "red",
@ -1652,6 +1650,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1665,6 +1664,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1694,7 +1694,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1702,7 +1703,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1710,7 +1712,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 14
"y": 3
},
"id": 66,
"links": [],
@ -1763,6 +1765,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1776,6 +1779,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1805,7 +1809,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1813,7 +1818,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1821,7 +1827,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 14
"y": 3
},
"id": 138,
"links": [],
@ -1873,6 +1879,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1886,6 +1893,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1915,7 +1923,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1923,7 +1932,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1931,7 +1941,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 22
"y": 11
},
"id": 64,
"links": [],
@ -1986,6 +1996,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1999,6 +2010,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2021,7 +2033,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2029,7 +2042,8 @@
}
]
},
"unit": "Bps"
"unit": "Bps",
"unitScale": true
},
"overrides": [
{
@ -2050,7 +2064,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 22
"y": 11
},
"id": 122,
"links": [],
@ -2121,6 +2135,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2134,6 +2149,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2158,7 +2174,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2166,7 +2183,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": [
{
@ -2190,7 +2208,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 30
"y": 19
},
"id": 117,
"links": [],
@ -2245,6 +2263,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2258,6 +2277,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2280,7 +2300,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2288,7 +2309,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": [
{
@ -2309,7 +2331,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 30
"y": 19
},
"id": 204,
"links": [],
@ -2379,6 +2401,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2392,6 +2415,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2416,7 +2440,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2424,7 +2449,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2432,7 +2458,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 38
"y": 27
},
"id": 68,
"links": [],
@ -2486,6 +2512,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2499,6 +2526,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2520,7 +2548,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2528,7 +2557,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2536,7 +2566,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 38
"y": 27
},
"id": 119,
"options": {
@ -2587,6 +2617,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2600,6 +2631,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2624,7 +2656,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2632,7 +2665,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2640,7 +2674,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 46
"y": 35
},
"id": 70,
"links": [],
@ -2694,6 +2728,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2707,6 +2742,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2728,7 +2764,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2736,7 +2773,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2744,7 +2782,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 46
"y": 35
},
"id": 120,
"options": {
@ -2783,6 +2821,115 @@
],
"title": "TCP connections rate ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 43
},
"id": 210,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(job)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
}
],
"title": "Resource usage ($job)",
@ -2883,7 +3030,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 15
"y": 23
},
"id": 102,
"options": {
@ -2997,7 +3144,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 15
"y": 23
},
"id": 108,
"options": {
@ -3098,7 +3245,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 23
"y": 31
},
"id": 142,
"links": [
@ -3210,7 +3357,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 23
"y": 31
},
"id": 107,
"options": {
@ -3311,7 +3458,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 31
"y": 39
},
"id": 170,
"links": [],
@ -3417,7 +3564,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 31
"y": 39
},
"id": 116,
"links": [],
@ -3519,7 +3666,7 @@
"h": 9,
"w": 12,
"x": 0,
"y": 39
"y": 47
},
"id": 144,
"options": {
@ -3622,7 +3769,7 @@
"h": 9,
"w": 12,
"x": 12,
"y": 39
"y": 47
},
"id": 58,
"links": [],
@ -3728,7 +3875,7 @@
"h": 6,
"w": 24,
"x": 0,
"y": 48
"y": 56
},
"id": 183,
"options": {
@ -3856,7 +4003,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 54
"y": 62
},
"id": 135,
"options": {
@ -3978,7 +4125,7 @@
"h": 9,
"w": 12,
"x": 0,
"y": 29
"y": 37
},
"id": 76,
"links": [],
@ -4094,7 +4241,7 @@
"h": 9,
"w": 12,
"x": 12,
"y": 29
"y": 37
},
"id": 86,
"links": [],
@ -4219,7 +4366,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 38
"y": 46
},
"id": 80,
"links": [],
@ -4324,7 +4471,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 38
"y": 46
},
"id": 78,
"links": [],
@ -4440,7 +4587,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 46
"y": 54
},
"id": 82,
"options": {
@ -4547,7 +4694,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 46
"y": 54
},
"id": 74,
"options": {
@ -4665,7 +4812,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 6
"y": 14
},
"id": 100,
"links": [],
@ -4776,7 +4923,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 6
"y": 14
},
"id": 113,
"links": [],
@ -4888,7 +5035,7 @@
"h": 7,
"w": 12,
"x": 0,
"y": 14
"y": 22
},
"id": 151,
"links": [],
@ -5033,7 +5180,7 @@
"h": 7,
"w": 12,
"x": 12,
"y": 14
"y": 22
},
"id": 167,
"links": [],
@ -5170,7 +5317,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 21
"y": 29
},
"id": 141,
"links": [
@ -5289,7 +5436,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 21
"y": 29
},
"id": 133,
"links": [
@ -5415,7 +5562,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 29
"y": 37
},
"id": 54,
"options": {
@ -5518,7 +5665,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 29
"y": 37
},
"id": 55,
"options": {
@ -5626,7 +5773,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 37
"y": 45
},
"id": 20,
"links": [],
@ -5759,7 +5906,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 37
"y": 45
},
"id": 22,
"links": [],
@ -5867,7 +6014,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 45
"y": 53
},
"id": 202,
"links": [],
@ -6003,7 +6150,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 45
"y": 53
},
"id": 14,
"links": [],
@ -6135,7 +6282,7 @@
"h": 8,
"w": 24,
"x": 0,
"y": 53
"y": 61
},
"id": 206,
"links": [],
@ -6271,7 +6418,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 42
"y": 50
},
"id": 92,
"links": [],
@ -6397,7 +6544,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 42
"y": 50
},
"id": 95,
"links": [],
@ -6519,7 +6666,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 50
"y": 58
},
"id": 163,
"links": [],
@ -6663,7 +6810,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 50
"y": 58
},
"id": 165,
"links": [],
@ -6803,7 +6950,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 58
"y": 66
},
"id": 178,
"links": [],
@ -6910,7 +7057,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 58
"y": 66
},
"id": 180,
"links": [],
@ -7017,7 +7164,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 66
"y": 74
},
"id": 179,
"links": [],
@ -7124,7 +7271,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 66
"y": 74
},
"id": 181,
"links": [],
@ -7242,7 +7389,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 74
"y": 82
},
"id": 93,
"links": [],
@ -7372,7 +7519,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 74
"y": 82
},
"id": 207,
"links": [],
@ -7508,7 +7655,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 43
"y": 51
},
"id": 97,
"links": [],
@ -7634,7 +7781,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 43
"y": 51
},
"id": 99,
"links": [],
@ -7758,7 +7905,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 51
"y": 59
},
"id": 185,
"links": [],
@ -7902,7 +8049,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 51
"y": 59
},
"id": 187,
"links": [],
@ -8042,7 +8189,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 59
"y": 67
},
"id": 139,
"links": [],
@ -8149,7 +8296,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 59
"y": 67
},
"id": 114,
"links": [],
@ -8264,7 +8411,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 67
"y": 75
},
"id": 208,
"links": [],
@ -8394,7 +8541,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 67
"y": 75
},
"id": 209,
"links": [],
@ -8513,7 +8660,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 75
"y": 83
},
"id": 88,
"links": [],
@ -8578,7 +8725,7 @@
"h": 2,
"w": 24,
"x": 0,
"y": 92
"y": 100
},
"id": 198,
"options": {
@ -8654,7 +8801,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 94
"y": 102
},
"id": 189,
"links": [],
@ -8755,7 +8902,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 94
"y": 102
},
"id": 190,
"links": [],
@ -8856,7 +9003,7 @@
"h": 7,
"w": 12,
"x": 0,
"y": 102
"y": 110
},
"id": 192,
"links": [],
@ -8963,7 +9110,7 @@
"h": 7,
"w": 12,
"x": 12,
"y": 102
"y": 110
},
"id": 196,
"links": [],
@ -9065,7 +9212,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 109
"y": 117
},
"id": 200,
"links": [],
@ -9166,7 +9313,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 109
"y": 117
},
"id": 201,
"links": [],
@ -9285,7 +9432,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 117
"y": 125
},
"id": 203,
"links": [],
@ -9515,4 +9662,4 @@
"uid": "oS7Bi_0Wz_vm",
"version": 1,
"weekStart": ""
}
}

View file

@ -1530,6 +1530,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1543,6 +1544,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1566,7 +1568,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1574,7 +1577,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1582,7 +1586,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 31
"y": 3
},
"id": 112,
"links": [],
@ -1635,6 +1639,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1648,6 +1653,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1671,7 +1677,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1679,7 +1686,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": []
},
@ -1687,7 +1695,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 31
"y": 3
},
"id": 44,
"links": [],
@ -1790,6 +1798,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1803,6 +1812,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1826,7 +1836,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1834,7 +1845,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1842,7 +1854,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 39
"y": 11
},
"id": 123,
"links": [],
@ -1894,6 +1906,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1907,6 +1920,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1930,7 +1944,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1938,7 +1953,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1946,7 +1962,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 39
"y": 11
},
"id": 114,
"links": [],
@ -2001,6 +2017,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2014,6 +2031,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2038,7 +2056,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2046,7 +2065,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": [
{
@ -2070,7 +2090,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 47
"y": 19
},
"id": 75,
"links": [],
@ -2125,6 +2145,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2138,6 +2159,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2161,7 +2183,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2169,7 +2192,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": [
{
@ -2193,7 +2217,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 47
"y": 19
},
"id": 57,
"links": [],
@ -2258,6 +2282,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2271,6 +2296,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2295,7 +2321,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2303,7 +2330,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2311,7 +2339,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 55
"y": 27
},
"id": 47,
"links": [],
@ -2364,6 +2392,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2377,6 +2406,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2399,7 +2429,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2407,7 +2438,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": [
{
@ -2428,7 +2460,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 55
"y": 27
},
"id": 76,
"links": [],
@ -2493,6 +2525,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2506,6 +2539,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2530,7 +2564,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2538,7 +2573,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2546,7 +2582,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 63
"y": 35
},
"id": 48,
"links": [],
@ -2599,6 +2635,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2612,6 +2649,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2634,7 +2672,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2642,7 +2681,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": [
{
@ -2663,7 +2703,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 63
"y": 35
},
"id": 124,
"links": [],
@ -2733,6 +2773,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2746,6 +2787,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2769,7 +2811,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2777,7 +2820,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2785,7 +2829,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 71
"y": 43
},
"id": 49,
"links": [],
@ -2839,6 +2883,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2852,6 +2897,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2875,7 +2921,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2883,7 +2930,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2891,7 +2939,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 71
"y": 43
},
"id": 37,
"links": [],
@ -2932,6 +2980,115 @@
],
"title": "TCP connections ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 51
},
"id": 125,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(instance)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
}
],
"targets": [
@ -3024,7 +3181,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 8
"y": 16
},
"id": 66,
"options": {
@ -3136,7 +3293,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 8
"y": 16
},
"id": 68,
"links": [],
@ -3243,7 +3400,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 16
"y": 24
},
"id": 116,
"links": [],
@ -3348,7 +3505,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 16
"y": 24
},
"id": 60,
"links": [],
@ -3450,7 +3607,7 @@
"h": 9,
"w": 12,
"x": 0,
"y": 24
"y": 32
},
"id": 90,
"options": {
@ -3555,7 +3712,7 @@
"h": 9,
"w": 12,
"x": 12,
"y": 24
"y": 32
},
"id": 118,
"links": [],
@ -3661,7 +3818,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 33
"y": 41
},
"id": 120,
"options": {
@ -3788,7 +3945,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 33
"y": 41
},
"id": 74,
"links": [],
@ -3919,7 +4076,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 33
"y": 41
},
"id": 10,
"links": [],
@ -4025,7 +4182,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 33
"y": 41
},
"id": 73,
"links": [],
@ -4132,7 +4289,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 41
"y": 49
},
"id": 53,
"links": [],
@ -4282,7 +4439,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 41
"y": 49
},
"id": 34,
"links": [],
@ -4415,7 +4572,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 49
"y": 57
},
"id": 30,
"links": [],
@ -4532,7 +4689,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 49
"y": 57
},
"id": 36,
"links": [],
@ -4635,7 +4792,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 57
"y": 65
},
"id": 58,
"links": [],
@ -4742,7 +4899,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 57
"y": 65
},
"id": 62,
"options": {
@ -4857,7 +5014,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 65
"y": 73
},
"id": 59,
"links": [],
@ -4972,7 +5129,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 65
"y": 73
},
"id": 64,
"options": {
@ -5073,7 +5230,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 73
"y": 81
},
"id": 99,
"links": [],
@ -5180,7 +5337,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 73
"y": 81
},
"id": 103,
"links": [],
@ -5287,7 +5444,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 81
"y": 89
},
"id": 122,
"links": [],
@ -5394,7 +5551,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 81
"y": 89
},
"id": 105,
"links": [],
@ -5597,4 +5754,4 @@
"uid": "wNf0q_kZk_vm",
"version": 1,
"weekStart": ""
}
}

View file

@ -1593,6 +1593,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1606,6 +1607,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1635,7 +1637,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1643,7 +1646,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1651,7 +1655,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 11
"y": 3
},
"id": 109,
"links": [],
@ -1706,6 +1710,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1719,6 +1724,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1748,7 +1754,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1756,7 +1763,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1764,7 +1772,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 11
"y": 3
},
"id": 111,
"links": [],
@ -1817,6 +1825,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1830,6 +1839,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1858,7 +1868,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1866,7 +1877,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": [
{
@ -1887,7 +1899,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 19
"y": 11
},
"id": 81,
"links": [],
@ -1957,6 +1969,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1970,6 +1983,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1992,7 +2006,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2000,7 +2015,8 @@
}
]
},
"unit": "bps"
"unit": "bps",
"unitScale": true
},
"overrides": [
{
@ -2021,7 +2037,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 19
"y": 11
},
"id": 7,
"options": {
@ -2084,6 +2100,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2097,6 +2114,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2121,7 +2139,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2129,7 +2148,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -2137,7 +2157,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 27
"y": 19
},
"id": 83,
"links": [],
@ -2188,6 +2208,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2201,6 +2222,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2225,7 +2247,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2233,7 +2256,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2241,7 +2265,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 27
"y": 19
},
"id": 39,
"links": [],
@ -2286,12 +2310,14 @@
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2305,6 +2331,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2329,7 +2356,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2337,7 +2365,116 @@
}
]
},
"unit": "short"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 27
},
"id": 135,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(job)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2345,7 +2482,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 35
"y": 27
},
"id": 41,
"links": [],

View file

@ -1392,6 +1392,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1405,6 +1406,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1428,7 +1430,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1436,7 +1439,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1444,7 +1448,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 33
"y": 3
},
"id": 37,
"links": [
@ -1503,6 +1507,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1516,6 +1521,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1539,7 +1545,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1547,7 +1554,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": []
},
@ -1555,7 +1563,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 33
"y": 3
},
"id": 57,
"links": [
@ -1614,6 +1622,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1627,6 +1636,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1650,7 +1660,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1658,7 +1669,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1666,7 +1678,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 41
"y": 11
},
"id": 35,
"links": [
@ -1727,6 +1739,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1740,6 +1753,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1763,7 +1777,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1771,7 +1786,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -1779,7 +1795,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 41
"y": 11
},
"id": 56,
"links": [
@ -1856,6 +1872,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1869,6 +1886,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1893,7 +1911,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1901,7 +1920,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1909,7 +1929,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 49
"y": 19
},
"id": 39,
"links": [],
@ -1961,6 +1981,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1974,6 +1995,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1998,7 +2020,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2006,7 +2029,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2014,7 +2038,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 49
"y": 19
},
"id": 41,
"links": [],
@ -2053,6 +2077,115 @@
],
"title": "Goroutines ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 27
},
"id": 59,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "victoriametrics-datasource",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(job)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
}
],
"targets": [
@ -2143,7 +2276,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 28
"y": 36
},
"id": 14,
"options": {
@ -2245,7 +2378,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 28
"y": 36
},
"id": 13,
"options": {
@ -2347,7 +2480,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 36
"y": 44
},
"id": 20,
"options": {
@ -2450,7 +2583,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 36
"y": 44
},
"id": 32,
"options": {
@ -2549,7 +2682,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 44
"y": 52
},
"id": 26,
"options": {
@ -2676,7 +2809,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 43
"y": 51
},
"id": 31,
"options": {
@ -2778,7 +2911,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 43
"y": 51
},
"id": 33,
"options": {
@ -2879,7 +3012,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 51
"y": 59
},
"id": 30,
"options": {
@ -3000,7 +3133,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 9
"y": 17
},
"id": 52,
"options": {
@ -3092,7 +3225,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 9
"y": 17
},
"id": 53,
"options": {
@ -3138,9 +3271,9 @@
"list": [
{
"current": {
"selected": false,
"text": "VictoriaMetrics - cluster",
"value": "VictoriaMetrics - cluster"
"selected": true,
"text": "VictoriaMetrics",
"value": "P4169E866C3094E38"
},
"hide": 0,
"includeAll": false,

View file

@ -1592,6 +1592,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1605,6 +1606,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1634,7 +1636,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1642,7 +1645,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1650,7 +1654,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 11
"y": 3
},
"id": 109,
"links": [],
@ -1705,6 +1709,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1718,6 +1723,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1747,7 +1753,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1755,7 +1762,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1763,7 +1771,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 11
"y": 3
},
"id": 111,
"links": [],
@ -1816,6 +1824,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1829,6 +1838,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1857,7 +1867,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1865,7 +1876,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": [
{
@ -1886,7 +1898,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 19
"y": 11
},
"id": 81,
"links": [],
@ -1956,6 +1968,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1969,6 +1982,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1991,7 +2005,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1999,7 +2014,8 @@
}
]
},
"unit": "bps"
"unit": "bps",
"unitScale": true
},
"overrides": [
{
@ -2020,7 +2036,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 19
"y": 11
},
"id": 7,
"options": {
@ -2083,6 +2099,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2096,6 +2113,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2120,7 +2138,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2128,7 +2147,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -2136,7 +2156,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 27
"y": 19
},
"id": 83,
"links": [],
@ -2187,6 +2207,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2200,6 +2221,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2224,7 +2246,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2232,7 +2255,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2240,7 +2264,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 27
"y": 19
},
"id": 39,
"links": [],
@ -2285,12 +2309,14 @@
"type": "prometheus",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -2304,6 +2330,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -2328,7 +2355,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2336,7 +2364,116 @@
}
]
},
"unit": "short"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 27
},
"id": 135,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(job)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2344,7 +2481,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 35
"y": 27
},
"id": 41,
"links": [],

View file

@ -1391,6 +1391,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1404,6 +1405,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1427,7 +1429,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1435,7 +1438,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1443,7 +1447,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 33
"y": 3
},
"id": 37,
"links": [
@ -1502,6 +1506,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1515,6 +1520,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1538,7 +1544,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1546,7 +1553,8 @@
}
]
},
"unit": "bytes"
"unit": "bytes",
"unitScale": true
},
"overrides": []
},
@ -1554,7 +1562,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 33
"y": 3
},
"id": 57,
"links": [
@ -1613,6 +1621,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1626,6 +1635,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1649,7 +1659,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1657,7 +1668,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1665,7 +1677,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 41
"y": 11
},
"id": 35,
"links": [
@ -1726,6 +1738,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1739,6 +1752,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1762,7 +1776,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1770,7 +1785,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -1778,7 +1794,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 41
"y": 11
},
"id": 56,
"links": [
@ -1855,6 +1871,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1868,6 +1885,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1892,7 +1910,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -1900,7 +1919,8 @@
}
]
},
"unit": "percentunit"
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
@ -1908,7 +1928,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 49
"y": 19
},
"id": 39,
"links": [],
@ -1960,6 +1980,7 @@
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
@ -1973,6 +1994,7 @@
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
@ -1997,7 +2019,8 @@
"mode": "absolute",
"steps": [
{
"color": "green"
"color": "green",
"value": null
},
{
"color": "red",
@ -2005,7 +2028,8 @@
}
]
},
"unit": "short"
"unit": "short",
"unitScale": true
},
"overrides": []
},
@ -2013,7 +2037,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 49
"y": 19
},
"id": 41,
"links": [],
@ -2052,6 +2076,115 @@
],
"title": "Goroutines ($instance)",
"type": "timeseries"
},
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"description": "Shows the percent of CPU spent on garbage collection.\n\nIf % is high, then CPU usage can be decreased by changing GOGC to higher values. Increasing GOGC value will increase memory usage, and decrease CPU usage.\n\nTry searching for keyword `GOGC` at https://docs.victoriametrics.com/troubleshooting/ ",
"fieldConfig": {
"defaults": {
"color": {
"mode": "palette-classic"
},
"custom": {
"axisBorderShow": false,
"axisCenteredZero": false,
"axisColorMode": "text",
"axisLabel": "",
"axisPlacement": "auto",
"barAlignment": 0,
"drawStyle": "line",
"fillOpacity": 0,
"gradientMode": "none",
"hideFrom": {
"legend": false,
"tooltip": false,
"viz": false
},
"insertNulls": false,
"lineInterpolation": "linear",
"lineWidth": 1,
"pointSize": 5,
"scaleDistribution": {
"type": "linear"
},
"showPoints": "never",
"spanNulls": false,
"stacking": {
"group": "A",
"mode": "none"
},
"thresholdsStyle": {
"mode": "off"
}
},
"decimals": 0,
"links": [],
"mappings": [],
"min": 0,
"thresholds": {
"mode": "absolute",
"steps": [
{
"color": "green",
"value": null
},
{
"color": "red",
"value": 80
}
]
},
"unit": "percentunit",
"unitScale": true
},
"overrides": []
},
"gridPos": {
"h": 8,
"w": 12,
"x": 0,
"y": 27
},
"id": 59,
"links": [],
"options": {
"legend": {
"calcs": [
"mean",
"lastNotNull",
"max"
],
"displayMode": "table",
"placement": "bottom",
"showLegend": true
},
"tooltip": {
"mode": "multi",
"sort": "desc"
}
},
"pluginVersion": "9.2.6",
"targets": [
{
"datasource": {
"type": "prometheus",
"uid": "$ds"
},
"editorMode": "code",
"expr": "max(\n rate(go_gc_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval]) \n / rate(process_cpu_seconds_total{job=~\"$job\", instance=~\"$instance\"}[$__rate_interval])\n ) by(job)",
"format": "time_series",
"interval": "",
"intervalFactor": 2,
"legendFormat": "__auto",
"range": true,
"refId": "A"
}
],
"title": "CPU spent on GC ($instance)",
"type": "timeseries"
}
],
"targets": [
@ -2142,7 +2275,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 28
"y": 36
},
"id": 14,
"options": {
@ -2244,7 +2377,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 28
"y": 36
},
"id": 13,
"options": {
@ -2346,7 +2479,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 36
"y": 44
},
"id": 20,
"options": {
@ -2449,7 +2582,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 36
"y": 44
},
"id": 32,
"options": {
@ -2548,7 +2681,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 44
"y": 52
},
"id": 26,
"options": {
@ -2675,7 +2808,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 43
"y": 51
},
"id": 31,
"options": {
@ -2777,7 +2910,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 43
"y": 51
},
"id": 33,
"options": {
@ -2878,7 +3011,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 51
"y": 59
},
"id": 30,
"options": {
@ -2999,7 +3132,7 @@
"h": 8,
"w": 12,
"x": 0,
"y": 9
"y": 17
},
"id": 52,
"options": {
@ -3091,7 +3224,7 @@
"h": 8,
"w": 12,
"x": 12,
"y": 9
"y": 17
},
"id": 53,
"options": {
@ -3137,9 +3270,9 @@
"list": [
{
"current": {
"selected": false,
"text": "VictoriaMetrics - cluster",
"value": "VictoriaMetrics - cluster"
"selected": true,
"text": "VictoriaMetrics",
"value": "P4169E866C3094E38"
},
"hide": 0,
"includeAll": false,

View file

@ -43,6 +43,7 @@ The v1.97.x line will be supported for at least 12 months since [v1.97.0](https:
* BUGFIX: fix `runtime error: slice bounds out of range` panic, which can occur during query execution. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5733). The bug has been introduced in `v1.97.0`.
* BUGFIX: [MetricsQL](https://docs.victoriametrics.com/MetricsQL.html): properly handle `avg_over_time({some_filter}[d]) keep_metric_names` queries, where [`some_filter`](https://docs.victoriametrics.com/keyconcepts/#filtering) matches multiple time series with multiple names, while `d` is bigger or equal to `3h`. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5556).
* BUGFIX: dashboards/single: fix typo in query for `version` annotation which falsely produced many version change events.
* BUGFIX: dashboards/all: add new panel `CPU spent on GC`. It should help identifying cases when too much CPU is spent on garbage collection, and advice users on how this can be addressed.
## [v1.97.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v1.97.0)

View file

@ -296,6 +296,12 @@ There are the following most commons reasons for slow data ingestion in Victoria
which exceeds the interval between ingested samples for the same time series (aka `scrape_interval`).
See [this comment](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3976#issuecomment-1476883183) for more details.
1. If you see constant and abnormally high CPU usage of VictoriaMetrics component, try checking `CPU spent on GC` panel
on the corresponding Grafana dasbhoard in `Resource usage` section. If percentage of CPU time spent on garbage collection
is high, then CPU usage of the component can be reduced in cost of memory by changing [GOGC](https://tip.golang.org/doc/gc-guide#GOGC) to higher values.
To change GOGC try setting `GOGC` environment variable to `100` or higher values. By default, VictoriaMetrics components
configured to run with `GOGC=30`. Please note, the higher is GOGC value, the higher will be memory consumption of the component.
## Slow queries
Some queries may take more time and resources (CPU, RAM, network bandwidth) than others.