ceph/doc/mgr/influx.rst

   1 =============
   2 Influx Module
   3 =============
   4
   5 .. mgr_module:: influx
   6
   7 The influx module continuously collects and sends time series data to an
   8 influxdb database.
   9
  10 The influx module was introduced in the 13.x *Mimic* release.
  11
  12 --------
  13 Enabling
  14 --------
  15
  16 To enable the module, use the following command:
  17
  18 .. prompt:: bash $
  19
  20     ceph mgr module enable influx
  21
  22 If you wish to subsequently disable the module, you can use the equivalent
  23 *disable* command:
  24
  25 .. prompt:: bash $
  26
  27     ceph mgr module disable influx
  28
  29 -------------
  30 Configuration
  31 -------------
  32
  33 For the influx module to send statistics to an InfluxDB server, it
  34 is necessary to configure the servers address and some authentication
  35 credentials.
  36
  37 Set configuration values using the following command:
  38
  39 .. prompt:: bash $
  40
  41     ceph config set mgr mgr/influx/<key> <value>
  42
  43
  44 The most important settings are :confval:`mgr/influx/hostname`,
  45 :confval:`mgr/influx/username` and :confval:`mgr/influx/password`.
  46 For example, a typical configuration might look like this:
  47
  48 .. prompt:: bash $
  49
  50     ceph config set mgr mgr/influx/hostname influx.mydomain.com
  51     ceph config set mgr mgr/influx/username admin123
  52     ceph config set mgr mgr/influx/password p4ssw0rd
  53
  54 Following is the list of all configuration settings:
  55
  56 .. confval:: hostname
  57 .. confval:: username
  58 .. confval:: password
  59 .. confval:: interval
  60 .. confval:: database
  61 .. confval:: port
  62 .. confval:: ssl
  63 .. confval:: verify_ssl
  64 .. confval:: threads
  65 .. confval:: batch_size
  66
  67 ---------
  68 Debugging
  69 ---------
  70
  71 By default, a few debugging statements as well as error statements have been set to print in the log files. Users can add more if necessary.
  72 To make use of the debugging option in the module:
  73
  74 - Add this to the ceph.conf file.
  75
  76   .. code-block:: ini
  77
  78      [mgr]
  79         debug_mgr = 20
  80
  81 - Use this command ``ceph influx self-test``.
  82 - Check the log files. Users may find it easier to filter the log files using *mgr[influx]*.
  83
  84 --------------------
  85 Interesting counters
  86 --------------------
  87
  88 The following tables describe a subset of the values output by
  89 this module.
  90
  91 ^^^^^
  92 Pools
  93 ^^^^^
  94
  95 +---------------+-----------------------------------------------------+
  96 |Counter        | Description                                         |
  97 +===============+=====================================================+
  98 |stored         | Bytes stored in the pool not including copies       |
  99 +---------------+-----------------------------------------------------+
 100 |max_avail      | Max available number of bytes in the pool           |
 101 +---------------+-----------------------------------------------------+
 102 |objects        | Number of objects in the pool                       |
 103 +---------------+-----------------------------------------------------+
 104 |wr_bytes       | Number of bytes written in the pool                 |
 105 +---------------+-----------------------------------------------------+
 106 |dirty          | Number of bytes dirty in the pool                   |
 107 +---------------+-----------------------------------------------------+
 108 |rd_bytes       | Number of bytes read in the pool                    |
 109 +---------------+-----------------------------------------------------+
 110 |stored_raw     | Bytes used in pool including copies made            |
 111 +---------------+-----------------------------------------------------+
 112
 113 ^^^^
 114 OSDs
 115 ^^^^
 116
 117 +------------+------------------------------------+
 118 |Counter     | Description                        |
 119 +============+====================================+
 120 |op_w        | Client write operations            |
 121 +------------+------------------------------------+
 122 |op_in_bytes | Client operations total write size |
 123 +------------+------------------------------------+
 124 |op_r        | Client read operations             |
 125 +------------+------------------------------------+
 126 |op_out_bytes| Client operations total read size  |
 127 +------------+------------------------------------+
 128
 129
 130 +------------------------+--------------------------------------------------------------------------+
 131 |Counter                 | Description                                                              |
 132 +========================+==========================================================================+
 133 |op_wip                  | Replication operations currently being processed (primary)               |
 134 +------------------------+--------------------------------------------------------------------------+
 135 |op_latency              | Latency of client operations (including queue time)                      |
 136 +------------------------+--------------------------------------------------------------------------+
 137 |op_process_latency      | Latency of client operations (excluding queue time)                      |
 138 +------------------------+--------------------------------------------------------------------------+
 139 |op_prepare_latency      | Latency of client operations (excluding queue time and wait for finished)|
 140 +------------------------+--------------------------------------------------------------------------+
 141 |op_r_latency            | Latency of read operation (including queue time)                         |
 142 +------------------------+--------------------------------------------------------------------------+
 143 |op_r_process_latency    | Latency of read operation (excluding queue time)                         |
 144 +------------------------+--------------------------------------------------------------------------+
 145 |op_w_in_bytes           | Client data written                                                      |
 146 +------------------------+--------------------------------------------------------------------------+
 147 |op_w_latency            | Latency of write operation (including queue time)                        |
 148 +------------------------+--------------------------------------------------------------------------+
 149 |op_w_process_latency    | Latency of write operation (excluding queue time)                        |
 150 +------------------------+--------------------------------------------------------------------------+
 151 |op_w_prepare_latency    | Latency of write operations (excluding queue time and wait for finished) |
 152 +------------------------+--------------------------------------------------------------------------+
 153 |op_rw                   | Client read-modify-write operations                                      |
 154 +------------------------+--------------------------------------------------------------------------+
 155 |op_rw_in_bytes          | Client read-modify-write operations write in                             |
 156 +------------------------+--------------------------------------------------------------------------+
 157 |op_rw_out_bytes         | Client read-modify-write operations read out                             |
 158 +------------------------+--------------------------------------------------------------------------+
 159 |op_rw_latency           | Latency of read-modify-write operation (including queue time)            |
 160 +------------------------+--------------------------------------------------------------------------+
 161 |op_rw_process_latency   | Latency of read-modify-write operation (excluding queue time)            |
 162 +------------------------+--------------------------------------------------------------------------+
 163 |op_rw_prepare_latency   | Latency of read-modify-write operations (excluding queue time            |
 164 |                        | and wait for finished)                                                   |
 165 +------------------------+--------------------------------------------------------------------------+
 166 |op_before_queue_op_lat  | Latency of IO before calling queue (before really queue into ShardedOpWq)|
 167 |                        | op_before_dequeue_op_lat                                                 |
 168 +------------------------+--------------------------------------------------------------------------+
 169 |op_before_dequeue_op_lat| Latency of IO before calling dequeue_op(already dequeued and get PG lock)|
 170 +------------------------+--------------------------------------------------------------------------+
 171
 172 Latency counters are measured in microseconds unless otherwise specified in the description.
 173