Ansible playbook for Inkscope

    

To simplify the installation of Inkscope, an ansible playbook is now available:
see https://github.com/inkscope/inkscope-ansible

Inkscope V1.4.0 is available

A new release of Inkscope is available on Github.

Installation from scratch is described here.

The main feature of this release is Monitoring Ceph with collectd and influxdb.
This feature is optinal but can be activated following this wiki page instructions.





The complete list of changes is:

• monitoring with Influxdb and collectd-ceph
• fix pg chart
• take cluster name for various functions in Inkscope controller
• fix issue #61: display bug on osd pages with Firefox 43
• fix path for ceph-rest-api in standalone mode
• fix full refresh of data
• fix typo, add info for a standalone ceph_rest_api
• fix login issue
• fix osd page: lookup hostids in db before using socket.fqdn
• fix S3 object visualization bug on getChunkBaseName
• fix issue #67 add inkscope_root
• delete redundent import and fix the style of import
• add favicon

Inkscope V1.3.1 is available

A new release of Inkscope is available on Github. This release is tested on Firefly,  Hammer and Infernalis.

Installation from scratch is described here.
Migration from V1.2 is described here. 
 
The complete list of changes is:

Enhancements:

• change log path and make wsgi for ceph-rest-api the default
• remove console
• add date info on hosts and probes page
• enhance flag management and compatibility with Hammer and Infernalis
• enhance rhel71 compatibility (suggested by Paul Hewlett)
• add ceph version detection
• #58 new parameters in pool info (Hammer, Infernalis)
• navigation enhancement

Fixes:

• fix issue #59 (Erasure code profile creation: error messages)
• fix issue #60 (Infernalis: mtime format for bucket info has changed)
• fix issue #55 (compatibility with 0.94)
• fix non functional near and full indicators
• fix text for invalid data
• fix overlaying display of OSD on right panel
• fix OSD space  ratio filtering when no stat
• manage ceph probe connection error

Inkscope V1.3: migration from V1.2

edit: 18/01/2016 Inkscope 1.3.1 version  

One of the new features is the access control of Inkscope.

On the Inkscope server, this needs a new python module that you can install with:

    pip install flask-login

Then you can upgrade Inkscope packages with:

    apt-get update
    apt-get upgrade

You'll also have to upgrade all the servers where cephprobes and sysprobes are installed.

For the access control features, a new database (inkscope) is created in mongo at the first launch with two users:
- one with the admin role (User 'admin' with password 'admin')
- a second with supervizor role (User 'guest', no password)
Fill free to add your own admin user and delete the default one.

If your mongoDB is authenticated, you'll have to connect to mongoDB as admin and grant access for your mongo inkscope user to an 'inkscope' database.

For example:
    mongo -u <admin> -p <adminpwd> admin
    >use inkscope
    >db.system.users.insert(<Your_user_description>)
<Your_user_description> can be found with the following:
    >use <ceph fsid>
    >db.system.users.find()

Then restart probes and then apache

That's it !

Inkscope V1.3 installation on debian servers

edit: 18/01/2016 Inkscope 1.3.1 version 

 Typical installation of Inkscope

Inkscope and its mongoDB database should be installed on an independent server from ceph.
Inkscope provides probes to fetch metrics from the ceph cluster and its machines:

• Sysprobe is used to fetch system informations on each machine of the cluster.
• Cephprobe fetches information on the cluster itself. It is intended to be installed on a machine accessing the ceph-rest-api.

Before installing Inkscope, you'll need to install a mongoDB instance.
The initialisation of the Mongo databases will be done at first launch.

Add the Inkscope debian repository in your source list

Create /etc/apt/sources.list.d/inkscope.list:

echo "deb https://raw.githubusercontent.com/inkscope/inkscope-packaging/master/DEBS ./" | sudo tee /etc/apt/sources.list.d/inkscope.list

Then

sudo apt-get update 

Packages for Inkscope are:

• inkscope-common : install the configuration file for probes and web interface.
  inkscope-sysprobe : installs sysprobe
• inkscope-cephrestapi: installs all script to start a ceph-rest-api 
• inkscope-cephprobe: installs the cephprobe
• inkscope-admviz : installs inskcope web interface 

Install Inkscope server on one server :

sudo apt-get install inkscope-admviz inkscope-cephrestapi

Edit /opt/inkscope/etc/inkscope.conf  for mongoDB, ceph-rest-api and radosgw parameters

In this file, you can also specify a description for your platform in the 'platform' field. This string will be shown on every page of Inkscope in the header.

The configuration file is the same for every module and can be deployed on every machine.

If the Inkscope server is not a ceph node, you'll have to copy the ceph.conf file of the cluster.

Edit /etc/apache2/sites-available/inkScope.conf to fill parameters concerning ceph-rest-api

By default, conf files are provided with ceph-rest-api as a WSGI application
This make ceph-rest-api a part of the inkscope server by launching ceph-rest-api as an apache wsgi application. You can also use the ceph-rest-api as a standalone server. For more details : see  "Inkscope and ceph-rest-api"
In the following, we consider ceph-rest-api as a WSGI application.

You need to create a ceph user named client.restapi with caps : [mds] allow, [mon] allow * , [osd] allow *

sudo ceph auth get-or-create client.restapi mds 'allow' osd 'allow *' mon 'allow *' > /etc/ceph/ceph.client.restapi.keyring

Then you need to add the following section in your \<cluster\>.conf:

[client.restapi]
    log_file = /dev/null
    keyring = /etc/ceph/ceph.client.restapi.keyring

Edit /etc/apache2/ports.conf to add

Listen 8080 

Enable apache proxy or rewrite module according to your choice of access to ceph-rest-api (see "Inkscope and ceph-rest-api")

sudo a2enmod proxy_http  (for standalone server)

sudo a2enmod rewrite (for WSGI application)

Inkscope needs other python modules. To install them, use:

        pip install flask-login simple-json


Enable inkscope

sudo a2ensite inkScope 

Restart apache

sudo service apache2 restart 

 Now you can access inkscope in your browser

http://<inkscope-server>:8080/

On the first launch, two users are created :
- one with the admin role (User 'admin' with password 'admin')
- a second with supervizor role (User 'guest', no password)
Fill free to add your own admin user and delete the default one.

At this stage, Inkscope is not fully operationnal and needs the mongoDB database to be feed. For this, you'll have to install Inkscope probes.

Install sysprobe on each server:

sudo apt-get install inkscope-sysprobe 

Edit /opt/inkscope/etc/inkscope.conf  for mongoDB, ceph-rest-api and radosgw parameters or retrieve the one modified on the previous step.

You'll have to install lshw and sysstat

        apt-get install lshw sysstat

Also install psutil python module (don't use psutil 0.x or 3.x)

        pip install psutil==2.1.3

Start sysprobe:

/etc/init.d/sysprobe start

Install cephprobe on one server:

sudo apt-get install inkscope-cephprobe 

Edit /opt/inkscope/etc/inkscope.conf  for mongoDB, ceph-rest-api and radosgw parameters or retrieve the one modified on the previous step.

Install psutil python module (don't use psutil 0.x or 3.x)

        pip install psutil==2.1.3

Start cephprobe:

/etc/init.d/cephprobe start

If your cluster is healthy, you'll have a first page like this:

Et voila!

Inkscope V1.3 is available

A new release of Inkscope is available on Github. This release is tested on Firefly and Hammer.

Installation from scratch is described here.
Migration from V1.2 is described here. 


The main changes are the Access control to Inkscope with different roles

New management page for Inkscope users

and the management of Rados Block Devices. 

New management page for RBD

The complete list of changes is:

Enhancements:

• add Inkscope access control and roles
• add Inkscope user management page
• add Block Device Images management
• add about inkscope page
• enhance osd info and selection regarding relative used space
• enhance pool management errors
• add view inkscope config page
• add possibility to reweight osd in OSD status view
• add osd info in osd perf page
• enhance S3 bucket info
• enhance S3 user info
• add new pools graph in pool management
• add details on selected pool and relevant rule
• add pool distribution on osd map
• allow search in osd maps
• add the possibility to add a platform name on every screen just have to add "platform":"whatyouwant", in inkscope.conf
• add status history graph for OSD

Fixes:

• fix issue when deleting cache tiering concerned pools
• fix issue when deleting Swift key
• fix issue on pools list
• fix issues when inkscope is behind a firewall or proxy
• fix stat_cat_sum missing in 0.94 and later (#53)
• fix pb on logrotate
• fix sort and search on erasure code table (#51)
• fix osd map issues when some informations are missing

Inkscope and ceph-rest-api (edited)

Edited 2015/04/13: found a better way for apache configuration (proxypass vs rewrite)

Inkscope is essentially based on the use of the ceph-rest-api.

There are two ways to access the ceph-rest-api :

• as a standalone server.
• as an Apache WSGI application. 

ceph-rest-api standalone server

You can start a standalone instance form the command line:

nohup ceph-rest-api -i admin&