ceph/doc/rados/operations/operating.rst

   1 =====================
   2  Operating a Cluster
   3 =====================
   4
   5 .. index:: systemd; operating a cluster
   6
   7
   8 Running Ceph with systemd
   9 ==========================
  10
  11 For all distributions that support systemd (CentOS 7, Fedora, Debian Jessie
  12 8.x, SUSE), ceph daemons are now managed using native systemd files instead of
  13 the legacy sysvinit scripts.  For example::
  14
  15         sudo systemctl start ceph.target       # start all daemons
  16         sudo systemctl status ceph-osd@12      # check status of osd.12
  17
  18 To list the Ceph systemd units on a node, execute::
  19
  20         sudo systemctl status ceph\*.service ceph\*.target
  21
  22 Starting all Daemons
  23 --------------------
  24
  25 To start all daemons on a Ceph Node (irrespective of type), execute the
  26 following::
  27
  28         sudo systemctl start ceph.target
  29
  30
  31 Stopping all Daemons
  32 --------------------
  33
  34 To stop all daemons on a Ceph Node (irrespective of type), execute the
  35 following::
  36
  37         sudo systemctl stop ceph\*.service ceph\*.target
  38
  39
  40 Starting all Daemons by Type
  41 ----------------------------
  42
  43 To start all daemons of a particular type on a Ceph Node, execute one of the
  44 following::
  45
  46         sudo systemctl start ceph-osd.target
  47         sudo systemctl start ceph-mon.target
  48         sudo systemctl start ceph-mds.target
  49
  50
  51 Stopping all Daemons by Type
  52 ----------------------------
  53
  54 To stop all daemons of a particular type on a Ceph Node, execute one of the
  55 following::
  56
  57         sudo systemctl stop ceph-mon\*.service ceph-mon.target
  58         sudo systemctl stop ceph-osd\*.service ceph-osd.target
  59         sudo systemctl stop ceph-mds\*.service ceph-mds.target
  60
  61
  62 Starting a Daemon
  63 -----------------
  64
  65 To start a specific daemon instance on a Ceph Node, execute one of the
  66 following::
  67
  68         sudo systemctl start ceph-osd@{id}
  69         sudo systemctl start ceph-mon@{hostname}
  70         sudo systemctl start ceph-mds@{hostname}
  71
  72 For example::
  73
  74         sudo systemctl start ceph-osd@1
  75         sudo systemctl start ceph-mon@ceph-server
  76         sudo systemctl start ceph-mds@ceph-server
  77
  78
  79 Stopping a Daemon
  80 -----------------
  81
  82 To stop a specific daemon instance on a Ceph Node, execute one of the
  83 following::
  84
  85         sudo systemctl stop ceph-osd@{id}
  86         sudo systemctl stop ceph-mon@{hostname}
  87         sudo systemctl stop ceph-mds@{hostname}
  88
  89 For example::
  90
  91         sudo systemctl stop ceph-osd@1
  92         sudo systemctl stop ceph-mon@ceph-server
  93         sudo systemctl stop ceph-mds@ceph-server
  94
  95
  96 .. index:: Ceph service; Upstart; operating a cluster
  97
  98
  99
 100 Running Ceph with Upstart
 101 =========================
 102
 103 When deploying Ceph with ``ceph-deploy`` on Ubuntu Trusty, you may start and
 104 stop Ceph daemons on a :term:`Ceph Node` using the event-based `Upstart`_.
 105 Upstart does not require you to define daemon instances in the Ceph
 106 configuration file.
 107
 108 To list the Ceph Upstart jobs and instances on a node, execute::
 109
 110         sudo initctl list | grep ceph
 111
 112 See `initctl`_ for additional details.
 113
 114
 115 Starting all Daemons
 116 --------------------
 117
 118 To start all daemons on a Ceph Node (irrespective of type), execute the
 119 following::
 120
 121         sudo start ceph-all
 122
 123
 124 Stopping all Daemons
 125 --------------------
 126
 127 To stop all daemons on a Ceph Node (irrespective of type), execute the
 128 following::
 129
 130         sudo stop ceph-all
 131
 132
 133 Starting all Daemons by Type
 134 ----------------------------
 135
 136 To start all daemons of a particular type on a Ceph Node, execute one of the
 137 following::
 138
 139         sudo start ceph-osd-all
 140         sudo start ceph-mon-all
 141         sudo start ceph-mds-all
 142
 143
 144 Stopping all Daemons by Type
 145 ----------------------------
 146
 147 To stop all daemons of a particular type on a Ceph Node, execute one of the
 148 following::
 149
 150         sudo stop ceph-osd-all
 151         sudo stop ceph-mon-all
 152         sudo stop ceph-mds-all
 153
 154
 155 Starting a Daemon
 156 -----------------
 157
 158 To start a specific daemon instance on a Ceph Node, execute one of the
 159 following::
 160
 161         sudo start ceph-osd id={id}
 162         sudo start ceph-mon id={hostname}
 163         sudo start ceph-mds id={hostname}
 164
 165 For example::
 166
 167         sudo start ceph-osd id=1
 168         sudo start ceph-mon id=ceph-server
 169         sudo start ceph-mds id=ceph-server
 170
 171
 172 Stopping a Daemon
 173 -----------------
 174
 175 To stop a specific daemon instance on a Ceph Node, execute one of the
 176 following::
 177
 178         sudo stop ceph-osd id={id}
 179         sudo stop ceph-mon id={hostname}
 180         sudo stop ceph-mds id={hostname}
 181
 182 For example::
 183
 184         sudo stop ceph-osd id=1
 185         sudo start ceph-mon id=ceph-server
 186         sudo start ceph-mds id=ceph-server
 187
 188
 189 .. index:: Ceph service; sysvinit; operating a cluster
 190
 191
 192 Running Ceph
 193 ============
 194
 195 Each time you to **start**, **restart**, and  **stop** Ceph daemons (or your
 196 entire cluster) you must specify at least one option and one command. You may
 197 also specify a daemon type or a daemon instance. ::
 198
 199         {commandline} [options] [commands] [daemons]
 200
 201
 202 The ``ceph`` options include:
 203
 204 +-----------------+----------+-------------------------------------------------+
 205 | Option          | Shortcut | Description                                     |
 206 +=================+==========+=================================================+
 207 | ``--verbose``   |  ``-v``  | Use verbose logging.                            |
 208 +-----------------+----------+-------------------------------------------------+
 209 | ``--valgrind``  | ``N/A``  | (Dev and QA only) Use `Valgrind`_ debugging.    |
 210 +-----------------+----------+-------------------------------------------------+
 211 | ``--allhosts``  |  ``-a``  | Execute on all nodes in ``ceph.conf.``          |
 212 |                 |          | Otherwise, it only executes on ``localhost``.   |
 213 +-----------------+----------+-------------------------------------------------+
 214 | ``--restart``   | ``N/A``  | Automatically restart daemon if it core dumps.  |
 215 +-----------------+----------+-------------------------------------------------+
 216 | ``--norestart`` | ``N/A``  | Don't restart a daemon if it core dumps.        |
 217 +-----------------+----------+-------------------------------------------------+
 218 | ``--conf``      |  ``-c``  | Use an alternate configuration file.            |
 219 +-----------------+----------+-------------------------------------------------+
 220
 221 The ``ceph`` commands include:
 222
 223 +------------------+------------------------------------------------------------+
 224 | Command          | Description                                                |
 225 +==================+============================================================+
 226 |    ``start``     | Start the daemon(s).                                       |
 227 +------------------+------------------------------------------------------------+
 228 |    ``stop``      | Stop the daemon(s).                                        |
 229 +------------------+------------------------------------------------------------+
 230 |  ``forcestop``   | Force the daemon(s) to stop. Same as ``kill -9``           |
 231 +------------------+------------------------------------------------------------+
 232 |   ``killall``    | Kill all daemons of a particular type.                     |
 233 +------------------+------------------------------------------------------------+
 234 |  ``cleanlogs``   | Cleans out the log directory.                              |
 235 +------------------+------------------------------------------------------------+
 236 | ``cleanalllogs`` | Cleans out **everything** in the log directory.            |
 237 +------------------+------------------------------------------------------------+
 238
 239 For subsystem operations, the ``ceph`` service can target specific daemon types
 240 by adding a particular daemon type for the ``[daemons]`` option. Daemon types
 241 include:
 242
 243 - ``mon``
 244 - ``osd``
 245 - ``mds``
 246
 247
 248
 249 .. _Valgrind: http://www.valgrind.org/
 250 .. _Upstart: http://upstart.ubuntu.com/index.html
 251 .. _initctl: http://manpages.ubuntu.com/manpages/raring/en/man8/initctl.8.html