A Kubernetes api reader\persistor

Reads the objects off of an kubernetes api endpoint and saves snapshots of all objects over time. This isnt really better than a kibana+elastic search setup but its hassle free and saves the data locally.

clone this repository and run bundle install.

git clone https://github.com/zeari/dotus.git
cd dotus
bundle install

Edit config.yaml in your preferred editor. Youll have to get a token from your kubernertes instance. More info on how to do this in the kubernetes docs.

config:
  type: kubernetes # no need to change this
  url: my.kube.example.com:443 # address:port - the script accesses https://<url>
  token: eytokentokenkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AkentokenMXpwExDfR9jJ6rhxGqJreB3payKjy2d8AMXpwExDfR9jJ6rhxGqJreB3payKjy2d8A
  directory: /home/mykube # directory to save data in
  interval: 1    # collect all infor every <interval> minutes
  kube_config_path: '' # untested - get access info off of your .kube/config

ruby dotus.rb

you@machine /home/dotus$ ruby dotus.rb 
getting pods(16)
getting secrets- cant get secrets: secrets is forbidden: User "system:serviceaccount:management-infra:management-admin" cannot list secrets at the cluster scope: User "system:serviceaccount:management-infra:management-admin" cannot list all secrets in the cluster
getting services(20)
getting nodes(5)
getting replication_controllers(6)
getting resource_quotas(1)
getting limit_ranges(1)
getting persistent_volumes(14)
getting persistent_volume_claims(5)
getting component_statuses(3)
getting service_accounts(103)
  0.090000   0.020000   0.110000 (  0.243072)
sleeping until 2018-04-08 14:33:09 +0300
...

Access the api with appropriate path: GET localhost:4567/history?path=pods/prometheus-0

Theres also a small sinatra based web UI thats shows changes(diffs) over time. run with: ruby rest.rb

Access at http://localhost:4567/view_obj_history.html?path=pods/prometheus-0 and it should look something like this:

you can also use any git UI you like such as gitk. Just point it to the directory you set in config.yaml.

Accessing kubernetes api with https://github.com/abonas/kubeclient each object is saved as json in its path such as: pods/mypod1 or services/myservice in a git repo.

Because:

• it already exists on most machines and its pretty flexible.
• it compresses the text changes nicely (you can test this out with https://github.com/github/git-sizer).

• SSL: is supported by kubeclient so if theres interest, itll be added as an option in config.yaml.
• Openshift: This can also work with openshift but currently doesnt get openshift specific objects (routes, projects...)
• Other cluster types: the concept is generic so getting other clusers to work with this would just require reading from other client types(amazon, vmware...)