Well, I have played with Splunk and the ELK (Elasticsearch - Logstash - Kibana) Stack for some time now; review these interesting Pages and Blogs:
both somehow, that was not sufficient. Recently i "stumpled" upon Grafana, a Graphic frontend for several Datasouces, including Elasticsearch (ES) from version 4.1.
There is a fine installation guide, but due to the fact I did not want to "pollude" my installation via the package system with "apt-get", i decided to get the tar file and unpack it into /data/grafana (see under Installing from binary tar file)
This is absolutly excellent and the server spun up and I could start using ES as a datasource at once.
The trouble began with I tried to set autostart up via the guide in http://docs.grafana.org/installation/debian/ - a lot of configurations was already saved under the manual startups adn workning, and several thing had to be corrected in the startup files to find these settings.
After a while I scratched it, and started with the generel method from https://gist.github.com/naholyr/4275302
Remember to add user:
useradd grafana
My service.sh - called /etc/init.d/grafana-server is like this (notice the 2 times cd /data/grafana):
#!/bin/sh
### BEGIN INIT INFO
# Provides: <NAME>
# Required-Start: $local_fs $network $named $time $syslog
# Required-Stop: $local_fs $network $named $time $syslog
# Default-Start: 2 3 4 5
# Default-Stop: 0 1 6
# Description: <DESCRIPTION>
### END INIT INFO
SCRIPT=./bin/grafana-server
RUNAS=grafana
PIDFILE=/var/run/grafana-server.pid
LOGFILE=/var/log/grafana.log
start() {
if [ -f /var/run/$PIDNAME ] && kill -0 $(cat /var/run/$PIDNAME); then
echo 'Service already running' >&2
return 1
fi
echo 'Starting service…' >&2
cd /data/grafana
local CMD="$SCRIPT &> \"$LOGFILE\" & echo \$!"
su -c "$CMD" $RUNAS > "$PIDFILE"
echo 'Service started' >&2
}
stop() {
if [ ! -f "$PIDFILE" ] || ! kill -0 $(cat "$PIDFILE"); then
echo 'Service not running' >&2
return 1
fi
echo 'Stopping service…' >&2
cd /data/grafana
kill -15 $(cat "$PIDFILE") && rm -f "$PIDFILE"
echo 'Service stopped' >&2
}
uninstall() {
echo -n "Are you really sure you want to uninstall this service? That cannot be undone. [yes|No] "
local SURE
read SURE
if [ "$SURE" = "yes" ]; then
stop
rm -f "$PIDFILE"
echo "Notice: log file is not be removed: '$LOGFILE'" >&2
update-rc.d -f <NAME> remove
rm -fv "$0"
fi
}
case "$1" in
start)
start
;;
stop)
stop
;;
uninstall)
uninstall
;;
retart)
stop
start
;;
*)
echo "Usage: $0 {start|stop|restart|uninstall}"
esac
Make sure to change file ownership on all files to the grafana user:
chown -R grafana:grafana /var/lib/grafana* chown -R grafana:grafana /var/log/grafana* chown -R grafana:grafana /data/grafana*
And it works fine the cd to the /data/grafana ensures getting the right configs (As in the manual startup) and logs to /var/log/grafana/grafana.log