Setting up monitoring using rrdtool (and rrdcollect) - Revision history

Zcrayfish: /* Install programs */ Add pkg template.

2023-09-06T05:28:50Z

Install programs: Add pkg template.

← Older revision		Revision as of 05:28, 6 September 2023
Line 1:		Line 1:
	== Install programs ==		== Install programs ==
	{{Cmd\|apk add rrdtool rrdcollect}}		{{Cmd\|apk add {{pkg\|rrdtool}} {{pkg\|rrdcollect}}}}

	== Create rrd-databases ==		== Create rrd-databases ==

Mhavela: This doc is confirmed to work (removing Draft notes)

2012-11-21T18:21:04Z

This doc is confirmed to work (removing Draft notes)

← Older revision		Revision as of 18:21, 21 November 2012
Line 1:		Line 1:
	~~[[Category:Monitoring]]~~
	~~{{draft}}~~
	~~{{todo\|Create/Modify/Verify rrdcollect and move it from 'testing' to 'main'}}~~
	== Install programs ==		== Install programs ==
	{{Cmd\|apk add rrdtool rrdcollect}}		{{Cmd\|apk add rrdtool rrdcollect}}
Line 153:		Line 150:
	HRULE:0#000000		HRULE:0#000000
	</pre>		</pre>

			[[Category:Monitoring]]

Mhavela: Preparing graphics for rrdcollect modifications

2012-03-21T16:11:24Z

Preparing graphics for rrdcollect modifications

← Older revision		Revision as of 16:11, 21 March 2012
Line 103:		Line 103:
	-a PNG -t "Memory" --vertical-label "" \		-a PNG -t "Memory" --vertical-label "" \
	-w 1260 -h 400 -r \		-w 1260 -h 400 -r \
			DEF:mem_total=/var/lib/rrdtool/memory.rrd:mem_total:AVERAGE \
	DEF:mem_used=/var/lib/rrdtool/memory.rrd:mem_used:AVERAGE \		DEF:mem_used=/var/lib/rrdtool/memory.rrd:mem_used:AVERAGE \
	DEF:mem_free=/var/lib/rrdtool/memory.rrd:mem_free:AVERAGE \		DEF:mem_free=/var/lib/rrdtool/memory.rrd:mem_free:AVERAGE \
	DEF:mem_shared=/var/lib/rrdtool/memory.rrd:mem_shared:AVERAGE \		DEF:mem_shared=/var/lib/rrdtool/memory.rrd:mem_shared:AVERAGE \
	DEF:mem_buffers=/var/lib/rrdtool/memory.rrd:mem_buffers:AVERAGE \		DEF:mem_buffers=/var/lib/rrdtool/memory.rrd:mem_buffers:AVERAGE \
	DEF:~~mem_cached~~=/var/lib/rrdtool/memory.rrd:~~mem_cached~~:AVERAGE \		DEF:swap_total=/var/lib/rrdtool/memory.rrd:swap_total:AVERAGE \
	DEF:swap_used=/var/lib/rrdtool/memory.rrd:swap_used:AVERAGE \		DEF:swap_used=/var/lib/rrdtool/memory.rrd:swap_used:AVERAGE \
	~~AREA~~:mem_used#D7CC00:mem_used \		DEF:swap_free=/var/lib/rrdtool/memory.rrd:swap_free:AVERAGE \
	~~AREA~~:~~mem_free~~#~~D7CC00~~:mem_free \		CDEF:mem_total_x=mem_total,1024,\* \
	LINE2:~~mem_shared~~#D73600:mem_shared \		CDEF:mem_used_x=mem_used,1024,\* \
	LINE2:~~mem_buffers~~#D73600:mem_buffers \		CDEF:mem_free_x=mem_free,1024,\* \
	LINE2:~~mem_cached~~#0101D6:~~mem_cached~~ \		CDEF:mem_shared_x=mem_shared,1024,\* \
	LINE2:~~swap_used~~#0101D6:~~swap_used~~		CDEF:mem_buffers_x=mem_buffers,1024,\* \
			CDEF:swap_total_x=swap_total,1024,\* \
			CDEF:swap_used_x=swap_used,1024,\* \
			CDEF:swap_free_x=swap_free,1024,\* \
			LINE1:mem_total_x#000000:mem_total \
			LINE2:mem_used_x#D7CC00:mem_used \
			LINE2:mem_free_x#00CC00:mem_free \
			LINE2:mem_shared_x#D73600:mem_shared \
			LINE2:mem_buffers_x#D73600:mem_buffers \
			LINE2:swap_total_x#000000:swap_total \
			LINE2:swap_used_x#0101D6:swap_used \
			LINE2:swap_free_x#0101D6:swap_free
	</pre>		</pre>

Mhavela: /* memory.rrd */ Preparing some updates on rrdcollect default config

2012-03-21T15:52:01Z

memory.rrd: Preparing some updates on rrdcollect default config

← Older revision		Revision as of 15:52, 21 March 2012
Line 33:		Line 33:
	rrdtool create /var/lib/rrdtool/memory.rrd \		rrdtool create /var/lib/rrdtool/memory.rrd \
	--step 60 \		--step 60 \
			DS:mem_total:GAUGE:120:0:U \
	DS:mem_used:GAUGE:120:0:U \		DS:mem_used:GAUGE:120:0:U \
	DS:mem_free:GAUGE:120:0:U \		DS:mem_free:GAUGE:120:0:U \
	DS:mem_shared:GAUGE:120:0:U \		DS:mem_shared:GAUGE:120:0:U \
	DS:mem_buffers:GAUGE:120:0:U \		DS:mem_buffers:GAUGE:120:0:U \
	DS:~~mem_cached~~:GAUGE:120:0:U \		DS:swap_total:GAUGE:120:0:U \
	DS:swap_used:GAUGE:120:0:U \		DS:swap_used:GAUGE:120:0:U \
			DS:swap_free:GAUGE:120:0:U \
	RRA:AVERAGE:0.5:1:360 \		RRA:AVERAGE:0.5:1:360 \
	RRA:AVERAGE:0.5:10:1008 \		RRA:AVERAGE:0.5:10:1008 \

Mhavela: /* eth0.rrd */ Typo fix

2012-03-21T15:21:07Z

eth0.rrd: Typo fix

← Older revision		Revision as of 15:21, 21 March 2012
Line 56:		Line 56:
	RRA:MAX:0.5:10:1008		RRA:MAX:0.5:10:1008
	</pre>		</pre>
	{{note\|If you chose to change the "--step 60" which specifies the base interval in seconds with which data will be fed into the RRD~~.<BR>~~		{{note\|If you chose to change the "--step 60" ''(which specifies the base interval in seconds with which data will be fed into the RRD)'' then make sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}
	~~Make~~ sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}
	{{tip\|In the above examples the first RRA in each .rrd is more precise (1min interval), but it holds data for shorter time. (1x360x60) equals 21600s/6h)<BR>		{{tip\|In the above examples the first RRA in each .rrd is more precise (1min interval), but it holds data for shorter time. (1x360x60) equals 21600s/6h)<BR>
	The second RRA evaluates 10 min interval and holds data for longer period. (10x1008x60 equals 604800s/168h/7d)}}		The second RRA evaluates 10 min interval and holds data for longer period. (10x1008x60 equals 604800s/168h/7d)}}

Mhavela: /* Create rrd-databases */ eth1 is no longer collected by default rrdcollect.conf

2012-03-21T15:19:27Z

Create rrd-databases: eth1 is no longer collected by default rrdcollect.conf

← Older revision		Revision as of 15:19, 21 March 2012
Line 56:		Line 56:
	RRA:MAX:0.5:10:1008		RRA:MAX:0.5:10:1008
	</pre>		</pre>
	~~''(The default rrdcollect.conf tries to fetch data for eth1. With small modifications of the above command can be used to create such 'eth1.rrd')''~~
	{{note\|If you chose to change the "--step 60" which specifies the base interval in seconds with which data will be fed into the RRD.<BR>		{{note\|If you chose to change the "--step 60" which specifies the base interval in seconds with which data will be fed into the RRD.<BR>
	Make sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}		Make sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}

Mhavela: /* Create rrd-databases */ Modify amount of data stored in rrd's and write a short info about how to calculate the amount data stored

2012-03-21T15:03:13Z

Create rrd-databases: Modify amount of data stored in rrd's and write a short info about how to calculate the amount data stored

← Older revision		Revision as of 15:03, 21 March 2012
Line 24:		Line 24:
	DS:swap_in:COUNTER:120:0:U \		DS:swap_in:COUNTER:120:0:U \
	DS:swap_out:COUNTER:120:0:U \		DS:swap_out:COUNTER:120:0:U \
	RRA:AVERAGE:0.5:1:~~720~~ \		RRA:AVERAGE:0.5:1:360 \
	RRA:MAX:0.5:1:~~720~~		RRA:AVERAGE:0.5:10:1008 \
			RRA:MAX:0.5:10:1008
	</pre>		</pre>

Line 38:		Line 39:
	DS:mem_cached:GAUGE:120:0:U \		DS:mem_cached:GAUGE:120:0:U \
	DS:swap_used:GAUGE:120:0:U \		DS:swap_used:GAUGE:120:0:U \
	RRA:AVERAGE:0.5:1:~~720~~ \		RRA:AVERAGE:0.5:1:360 \
	RRA:MAX:0.5:1:~~720~~		RRA:AVERAGE:0.5:10:1008 \
			RRA:MAX:0.5:10:1008
	</pre>		</pre>

Line 50:		Line 52:
	DS:bytes_out:COUNTER:120:0:U \		DS:bytes_out:COUNTER:120:0:U \
	DS:pkts_out:COUNTER:120:0:U \		DS:pkts_out:COUNTER:120:0:U \
	RRA:AVERAGE:0.5:1:~~720~~ \		RRA:AVERAGE:0.5:1:360 \
	RRA:MAX:0.5:1:~~720~~		RRA:AVERAGE:0.5:10:1008 \
			RRA:MAX:0.5:10:1008
	</pre>		</pre>
	''(The default rrdcollect.conf tries to fetch data for eth1. With small modifications of the above command can be used to create such 'eth1.rrd')''		''(The default rrdcollect.conf tries to fetch data for eth1. With small modifications of the above command can be used to create such 'eth1.rrd')''
	{{note\|If you chose to change the "--step 60" which specifies the base interval in seconds with which data will be fed into the RRD.<BR>		{{note\|If you chose to change the "--step 60" which specifies the base interval in seconds with which data will be fed into the RRD.<BR>
	Make sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}		Make sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}
			{{tip\|In the above examples the first RRA in each .rrd is more precise (1min interval), but it holds data for shorter time. (1x360x60) equals 21600s/6h)<BR>
			The second RRA evaluates 10 min interval and holds data for longer period. (10x1008x60 equals 604800s/168h/7d)}}

	== Gather information and put it in the RRD ==		== Gather information and put it in the RRD ==

Mhavela: /* stat.rrd */ Create more DS for cpu-info

2012-03-14T11:08:24Z

stat.rrd: Create more DS for cpu-info

← Older revision		Revision as of 11:08, 14 March 2012
Line 15:		Line 15:
	DS:cpu_system:COUNTER:120:0:U \		DS:cpu_system:COUNTER:120:0:U \
	DS:cpu_idle:COUNTER:120:0:U \		DS:cpu_idle:COUNTER:120:0:U \
			DS:cpu_iowait:COUNTER:120:0:U \
			DS:cpu_irq:COUNTER:120:0:U \
			DS:cpu_softirq:COUNTER:120:0:U \
	DS:ctxt:COUNTER:120:0:U \		DS:ctxt:COUNTER:120:0:U \
	DS:page_in:COUNTER:120:0:U \		DS:page_in:COUNTER:120:0:U \

Mhavela: /* Stat */ Fetch more cpu-info

2012-03-14T11:07:31Z

Stat: Fetch more cpu-info

← Older revision		Revision as of 11:07, 14 March 2012
Line 69:		Line 69:
	DEF:cpu_system=/var/lib/rrdtool/stat.rrd:cpu_system:AVERAGE \		DEF:cpu_system=/var/lib/rrdtool/stat.rrd:cpu_system:AVERAGE \
	DEF:cpu_idle=/var/lib/rrdtool/stat.rrd:cpu_idle:AVERAGE \		DEF:cpu_idle=/var/lib/rrdtool/stat.rrd:cpu_idle:AVERAGE \
			DEF:cpu_iowait=/var/lib/rrdtool/stat.rrd:cpu_iowait:AVERAGE \
			DEF:cpu_irq=/var/lib/rrdtool/stat.rrd:cpu_irq:AVERAGE \
			DEF:cpu_softirq=/var/lib/rrdtool/stat.rrd:cpu_softirq:AVERAGE \
	DEF:ctxt=/var/lib/rrdtool/stat.rrd:ctxt:AVERAGE \		DEF:ctxt=/var/lib/rrdtool/stat.rrd:ctxt:AVERAGE \
	DEF:page_in=/var/lib/rrdtool/stat.rrd:page_in:AVERAGE \		DEF:page_in=/var/lib/rrdtool/stat.rrd:page_in:AVERAGE \

Mhavela: Draft notes on rrdtool and rrdcollect

2012-03-14T06:11:45Z

Draft notes on rrdtool and rrdcollect

New page

[[Category:Monitoring]]
{{draft}}
{{todo|Create/Modify/Verify rrdcollect and move it from 'testing' to 'main'}}
== Install programs ==
{{Cmd|apk add rrdtool rrdcollect}}

== Create rrd-databases ==
As we will use rrdcollect to collect our data for us, we will create all databases that the default config for rrdcollect tries to use.
=== stat.rrd ===
<pre>
rrdtool create /var/lib/rrdtool/stat.rrd \
--step 60 \
DS:cpu_user:COUNTER:120:0:U \
DS:cpu_nice:COUNTER:120:0:U \
DS:cpu_system:COUNTER:120:0:U \
DS:cpu_idle:COUNTER:120:0:U \
DS:ctxt:COUNTER:120:0:U \
DS:page_in:COUNTER:120:0:U \
DS:page_out:COUNTER:120:0:U \
DS:processes:COUNTER:120:0:U \
DS:swap_in:COUNTER:120:0:U \
DS:swap_out:COUNTER:120:0:U \
RRA:AVERAGE:0.5:1:720 \
RRA:MAX:0.5:1:720
</pre>

=== memory.rrd ===
<pre>
rrdtool create /var/lib/rrdtool/memory.rrd \
--step 60 \
DS:mem_used:GAUGE:120:0:U \
DS:mem_free:GAUGE:120:0:U \
DS:mem_shared:GAUGE:120:0:U \
DS:mem_buffers:GAUGE:120:0:U \
DS:mem_cached:GAUGE:120:0:U \
DS:swap_used:GAUGE:120:0:U \
RRA:AVERAGE:0.5:1:720 \
RRA:MAX:0.5:1:720
</pre>

=== eth0.rrd ===
<pre>
rrdtool create /var/lib/rrdtool/eth0.rrd \
--step 60 \
DS:bytes_in:COUNTER:120:0:U \
DS:pkts_in:COUNTER:120:0:U \
DS:bytes_out:COUNTER:120:0:U \
DS:pkts_out:COUNTER:120:0:U \
RRA:AVERAGE:0.5:1:720 \
RRA:MAX:0.5:1:720
</pre>
''(The default rrdcollect.conf tries to fetch data for eth1. With small modifications of the above command can be used to create such 'eth1.rrd')''
{{note|If you chose to change the "--step 60" which specifies the base interval in seconds with which data will be fed into the RRD.<BR>
Make sure to change the 'step' value in /etc/rrdcollect/rrdcollect.conf to reflect your changes above.}}

== Gather information and put it in the RRD ==
{{cmd|rc-service rrdcollect start}}

== Create graphs based on the rrd's ==
In the below examples you will notice that the .png file is exported to "/var/www/localhost/htdocs/".<BR>
You would need to either create /var/www/localhost/htdocs/ or change the path for the images.
=== Stat ===
<pre>
rrdtool graph /var/www/localhost/htdocs/stat.png --start -1800 \
-a PNG -t "Stat" --vertical-label "bits/s" \
-w 1260 -h 400 -r \
DEF:cpu_user=/var/lib/rrdtool/stat.rrd:cpu_user:AVERAGE \
DEF:cpu_nice=/var/lib/rrdtool/stat.rrd:cpu_nice:AVERAGE \
DEF:cpu_system=/var/lib/rrdtool/stat.rrd:cpu_system:AVERAGE \
DEF:cpu_idle=/var/lib/rrdtool/stat.rrd:cpu_idle:AVERAGE \
DEF:ctxt=/var/lib/rrdtool/stat.rrd:ctxt:AVERAGE \
DEF:page_in=/var/lib/rrdtool/stat.rrd:page_in:AVERAGE \
DEF:page_out=/var/lib/rrdtool/stat.rrd:page_out:AVERAGE \
DEF:processes=/var/lib/rrdtool/stat.rrd:processes:AVERAGE \
DEF:swap_in=/var/lib/rrdtool/stat.rrd:swap_in:AVERAGE \
DEF:swap_out=/var/lib/rrdtool/stat.rrd:swap_out:AVERAGE \
AREA:cpu_user#D7CC00:cpu_user \
AREA:cpu_nice#D7CC00:cpu_nice \
LINE2:cpu_system#D73600:cpu_system \
LINE2:cpu_idle#D73600:cpu_idle \
LINE2:ctxt#0101D6:ctxt \
LINE2:page_in#0101D6:page_in \
LINE2:page_out#D73600:page_out \
LINE2:processes#D73600:processes \
LINE2:swap_in#D73600:swap_in \
LINE2:swap_out#D73600:swap_out
</pre>

=== Memory ===
<pre>
rrdtool graph /var/www/localhost/htdocs/memory.png --start -1800 \
-a PNG -t "Memory" --vertical-label "" \
-w 1260 -h 400 -r \
DEF:mem_used=/var/lib/rrdtool/memory.rrd:mem_used:AVERAGE \
DEF:mem_free=/var/lib/rrdtool/memory.rrd:mem_free:AVERAGE \
DEF:mem_shared=/var/lib/rrdtool/memory.rrd:mem_shared:AVERAGE \
DEF:mem_buffers=/var/lib/rrdtool/memory.rrd:mem_buffers:AVERAGE \
DEF:mem_cached=/var/lib/rrdtool/memory.rrd:mem_cached:AVERAGE \
DEF:swap_used=/var/lib/rrdtool/memory.rrd:swap_used:AVERAGE \
AREA:mem_used#D7CC00:mem_used \
AREA:mem_free#D7CC00:mem_free \
LINE2:mem_shared#D73600:mem_shared \
LINE2:mem_buffers#D73600:mem_buffers \
LINE2:mem_cached#0101D6:mem_cached \
LINE2:swap_used#0101D6:swap_used
</pre>

=== eth0 ===
<pre>
rrdtool graph /var/www/localhost/htdocs/eth0.png --start -1h \
-a PNG -t "eth0" --vertical-label "bits/s" \
-w 1260 -h 400 -r \
DEF:bytes_in=/var/lib/rrdtool/eth0.rrd:bytes_in:AVERAGE \
DEF:bytes_out=/var/lib/rrdtool/eth0.rrd:bytes_out:AVERAGE \
CDEF:bits_in=bytes_in,8,\* \
CDEF:bits_out=bytes_out,-8,\* \
AREA:bits_in#339933:bits_in \
AREA:bits_out#aa3333:bits_out \
HRULE:0#000000
</pre>
<pre>
rrdtool graph /var/www/localhost/htdocs/eth0pkt.png --start -1800 \
-a PNG -t "eth0" --vertical-label "packets" \
-w 1260 -h 400 -r \
DEF:pkts_in=/var/lib/rrdtool/eth0.rrd:pkts_in:AVERAGE \
DEF:pkts_out=/var/lib/rrdtool/eth0.rrd:pkts_out:AVERAGE \
CDEF:pkts_out_negative=pkts_out,-1,\* \
LINE2:pkts_in#006600:pkts_in \
LINE2:pkts_out_negative#D73600:pkts_out \
HRULE:0#000000
</pre>