]> git.proxmox.com Git - ceph.git/blob - ceph/doc/changelog/v12.2.2.txt
update sources to ceph Nautilus 14.2.1
[ceph.git] / ceph / doc / changelog / v12.2.2.txt
1 commit cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba
2 Author: Jenkins Build Slave User <ceph-release-team@redhat.com>
3 Date: Thu Nov 30 14:59:27 2017 +0000
4
5 12.2.2
6
7 commit 83684b91a3c6b31419114b83fc22106146885fb6
8 Merge: 6d9f2161b2 b5d02ac0fd
9 Author: Kefu Chai <tchaikov@gmail.com>
10 Date: Thu Nov 30 22:26:46 2017 +0800
11
12 Merge pull request #19240 from tchaikov/wip-22266-luminous
13
14 luminous: tools/ceph_monstore_tool: rebuild initial mgrmap also
15
16 Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
17
18 commit 6d9f2161b269b19b0301348dd9b17660420624d5
19 Merge: 0b4c3b8f1e b02075a963
20 Author: Gregory Farnum <greg@gregs42.com>
21 Date: Wed Nov 29 16:25:14 2017 -0500
22
23 Merge pull request #19230 from tchaikov/wip-22247-luminous
24
25 luminous: mon/PGMap: Fix %USED calculation
26
27 Reviewed-by: Greg Farnum <gfarnum@redhat.com>
28
29 commit 0b4c3b8f1ed72c3a0053ed372e1c5c9b0d48de59
30 Merge: a57edd4f1a eb99a7ee36
31 Author: Andrew Schoen <andrew.schoen@gmail.com>
32 Date: Wed Nov 29 10:33:34 2017 -0600
33
34 Merge pull request #19239 from ceph/luminous-bz1518264
35
36 luminous: ceph-volume correctly fallback to bluestore when no objectstore is specified
37
38 Reviewed-by: Andrew Schoen <aschoen@redhat.com>
39
40 commit b5d02ac0fd60c26417ad33dc6efcf80bff503fdd
41 Author: Kefu Chai <kchai@redhat.com>
42 Date: Wed Nov 29 20:21:33 2017 +0800
43
44 tools/ceph_monstore_tool: rebuild initial mgrmap also
45
46 Fixes: http://tracker.ceph.com/issues/22266
47 Signed-off-by: Kefu Chai <kchai@redhat.com>
48 (cherry picked from commit f63d1da4afa3463730ecbc0be29df6375b79fa8f)
49
50 commit eb99a7ee36d541939f589a674d9890b14e017dbe
51 Author: Alfredo Deza <adeza@redhat.com>
52 Date: Tue Nov 28 09:22:19 2017 -0500
53
54 ceph-volume lvm.activate correct detection and fallback of objectstore flags
55
56 Signed-off-by: Alfredo Deza <adeza@redhat.com>
57 (cherry picked from commit f0ac2dfdbc0a05cff0a5edbedca91274885b7870)
58
59 commit 10dbbb0a6e09c6181e81b04765cd368963753bb8
60 Author: Alfredo Deza <adeza@redhat.com>
61 Date: Tue Nov 28 09:21:34 2017 -0500
62
63 ceph-volume tests.devices.lvm verify objectstore flags in activate
64
65 Signed-off-by: Alfredo Deza <adeza@redhat.com>
66 (cherry picked from commit 8d22856d6c95ac3b45918765b382cae507a8d1a4)
67
68 commit a57edd4f1a47f08c0f93d7a3ff57c376b72c9a8a
69 Merge: 1b0a5660f7 ee02b5c037
70 Author: Sage Weil <sage@newdream.net>
71 Date: Wed Nov 29 08:43:07 2017 -0600
72
73 Merge pull request #19217 from liewegas/wip-p2p-app-warning-luminous
74
75 upgrade/jewel-x/parallel: debug fuse
76
77 commit b02075a963c24c6e1b24d1b076275dcce5350a03
78 Author: Xiaoxi Chen <xiaoxchen@ebay.com>
79 Date: Sun Nov 26 22:51:58 2017 -0700
80
81 mon/PGMap: Fix %USED calculation bug.
82
83 Previous code forgot to multiple raw_used_ratio to calculate
84 used byte.
85
86 Fixes: http://tracker.ceph.com/issues/22247
87 Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
88 (cherry picked from commit d10c6c26f9ef7372e2c95da79d23b07ce5f4e0e5)
89
90 commit ee02b5c037c67c708335745898328e990ecacc90
91 Author: Sage Weil <sage@redhat.com>
92 Date: Tue Nov 28 16:48:36 2017 -0600
93
94 qa/suites/upgrade/jewel-x/point-to-point: whitelist more stuff
95
96 Signed-off-by: Sage Weil <sage@redhat.com>
97
98 commit d2a284c782fed3bec4ed38c898351826bca0a8bc
99 Author: Sage Weil <sage@redhat.com>
100 Date: Tue Nov 28 15:02:18 2017 -0600
101
102 qa/suites/upgrade/jewel-x/parallel: only mount ceph-fuse once
103
104 Otherwise we do 4 mounts for no good reason.
105
106 Signed-off-by: Sage Weil <sage@redhat.com>
107
108 commit b7c6d9799cbfba3cff7bee5fd1de309a8299d911
109 Author: Sage Weil <sage@redhat.com>
110 Date: Tue Nov 28 15:00:05 2017 -0600
111
112 upgrade/jewel-x/parallel: debug fuse
113
114 Signed-off-by: Sage Weil <sage@redhat.com>
115
116 commit 1b0a5660f793714e8cb470c35e084a141135cd8c
117 Merge: 4ed747dccf e50af8bb04
118 Author: Sage Weil <sage@newdream.net>
119 Date: Tue Nov 28 14:48:08 2017 -0600
120
121 Merge pull request #19216 from liewegas/wip-p2p-app-warning-luminous
122
123 qa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning
124
125 commit e50af8bb04bd37bd0e28ddc7935e29bcdc106b05
126 Author: Sage Weil <sage@redhat.com>
127 Date: Tue Nov 28 14:46:02 2017 -0600
128
129 qa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning
130
131 It's generated on the mgr.
132
133 Signed-off-by: Sage Weil <sage@redhat.com>
134
135 commit 4ed747dccfaae15a9a807d3f3db2fc44b8b21fda
136 Merge: acb02717f6 6e1e33a88d
137 Author: Kefu Chai <tchaikov@gmail.com>
138 Date: Tue Nov 28 23:47:17 2017 +0800
139
140 Merge pull request #19205 from tchaikov/wip-22136-luminous
141
142 luminous: qa/ceph-disk: enlarge the simulated SCSI disk
143
144 Reviewed-by: Alfredo Deza <adeza@redhat.com>
145
146 commit acb02717f6e96f96d4128bbebd946238d3c79291
147 Merge: 55f5d7d1f1 bb03f6b20b
148 Author: Nathan Cutler <presnypreklad@gmail.com>
149 Date: Tue Nov 28 14:03:01 2017 +0100
150
151 Merge pull request #19152 from smithfarm/wip-22235-luminous
152
153 luminous: ceph-disk flake8 test fails on very old, and very new, versions of flake8
154
155 Reviewed-by: Kefu Chai <kchai@redhat.com>
156
157 commit 6e1e33a88d038d5b6a469d7fb4e52182b888010f
158 Author: Kefu Chai <kchai@redhat.com>
159 Date: Tue Nov 28 14:42:31 2017 +0800
160
161 qa/ceph-disk: enlarge the simulated SCSI disk
162
163 100MB will be allocated for journal, and the remaining 100MB is for data
164 device. taking the inode into consideration, there will be approximately
165 87988 kB available for the activated OSD. and it will complain with a
166 "nearfull" state.
167
168 Fixes: http://tracker.ceph.com/issues/22136
169 Signed-off-by: Kefu Chai <kchai@redhat.com>
170 (cherry picked from commit b3c159e9fb8c31d0acd75f0702080f18959f672e)
171
172 commit 55f5d7d1f19696af981007c63a7503b2e5d0a5a8
173 Merge: 3bd0007d5f ad2393b8b8
174 Author: Nathan Cutler <presnypreklad@gmail.com>
175 Date: Tue Nov 28 03:23:09 2017 +0100
176
177 Merge pull request #19173 from smithfarm/wip-22251-luminous
178
179 luminous: build/ops: macros expanding in spec file comment
180
181 Reviewed-by: David Disseldorp <ddiss@suse.com>
182 Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
183
184 commit 3bd0007d5f1c991a80ff80fc2b7bb983ceee971e
185 Merge: 7ce2013dfd 5633a58824
186 Author: Yuri Weinstein <yuri.weinstein@gmail.com>
187 Date: Mon Nov 27 10:23:57 2017 -0800
188
189 Merge pull request #19179 from ceph/wip-yuriw-BP-19175-luminous
190
191 qa/suites/rados/rest: move rest_test from qa/suites/rest/
192
193 Reviewed-by: Yuri Weinstein <yweins@redhat.com>
194
195 commit 5633a58824f6248b79af74780411746cb7518813
196 Author: Sage Weil <sage@redhat.com>
197 Date: Mon Nov 27 10:11:51 2017 -0600
198
199 qa/suites/rados/rest: move rest_test from qa/suites/rest/
200
201 ...and add more health whitelists.
202
203 Signed-off-by: Sage Weil <sage@redhat.com>
204 (cherry picked from commit ddb274669ca16b95c452b256e58a2830af10c73d)
205 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
206
207 commit 7ce2013dfda6f06ac47878fd4635ac0862bfbbbd
208 Merge: ecec65906a 61e4de133d
209 Author: Yuri Weinstein <yuri.weinstein@gmail.com>
210 Date: Mon Nov 27 09:20:18 2017 -0800
211
212 Merge pull request #19177 from liewegas/wip-jewel-x-p2p
213
214 qa/suites/upgrade/jewel-x/point-to-point: skip ec tests when mons may be old
215
216 Reviewed-by: Yuri Weinstein <yweins@redhat.com>
217
218 commit 61e4de133d9fa1eddcd858152b7828515e0b280f
219 Author: Sage Weil <sage@redhat.com>
220 Date: Mon Nov 27 10:28:16 2017 -0600
221
222 qa/suites/upgrade/jewel-x/point-to-point: skip ec tests when mons may be old
223
224 Early point release mons don't handle legacy ruleset-* ec profiles, new
225 ones do. Skip the ec tests that may trigger this when we are doing a
226 workload that races with mon upgrades.
227
228 Signed-off-by: Sage Weil <sage@redhat.com>
229
230 commit ad2393b8b8dc71a8099fa87924dcb6936a27fd84
231 Author: Ken Dreyer <kdreyer@redhat.com>
232 Date: Thu Aug 17 09:19:38 2017 -0600
233
234 rpm: rm macros in comments
235
236 rpm expands all macros in a .spec file, even those in comments. Drop the
237 percent signs so rpm will not expand these.
238
239 This change silences rpmlint's warning about macros in comments.
240
241 Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
242 (cherry picked from commit 5c1e9f55d3a144c93c9c18b031db3cdc320561ef)
243
244 commit bb03f6b20b4963ad5d51c1c6f45f19bc7eaf220b
245 Author: Nathan Cutler <ncutler@suse.com>
246 Date: Tue Nov 21 11:36:02 2017 +0100
247
248 tests: ceph-disk: ignore E722 in flake8 test
249
250 Very old, and very new, versions of flake8 treat E722 as an error:
251
252 flake8 runtests: commands[0] | flake8 --ignore=H105,H405,E127 ceph_disk tests
253 ceph_disk/main.py:1575:9: E722 do not use bare except'
254 ceph_disk/main.py:1582:9: E722 do not use bare except'
255 ceph_disk/main.py:3252:5: E722 do not use bare except'
256 ceph_disk/main.py:3288:21: E722 do not use bare except'
257 ceph_disk/main.py:3296:17: E722 do not use bare except'
258 ceph_disk/main.py:4358:5: E722 do not use bare except'
259 tests/test_main.py:26:1: E722 do not use bare except'
260 ERROR: InvocationError: '/opt/j/ws/mkck/src/ceph-disk/.tox/flake8/bin/flake8 --ignore=H105,H405,E127 ceph_disk tests'
261
262 Fixes: http://tracker.ceph.com/issues/22207
263 References: https://gitlab.com/pycqa/flake8/issues/361
264
265 Signed-off-by: Nathan Cutler <ncutler@suse.com>
266 (cherry picked from commit 3600cd7bfdca76485d2998c5da1a0dd25816d1ce)
267
268 commit ecec65906af60c16fc99f669c1591bb821305a64
269 Merge: 613634c1da aac7a85a3a
270 Author: Kefu Chai <tchaikov@gmail.com>
271 Date: Wed Nov 22 13:36:58 2017 +0800
272
273 Merge pull request #19080 from smithfarm/wip-22212-luminous
274
275 luminous: tests: ceph-disk: silence deprecation warnings
276
277 Reviewed-by: Kefu Chai <kchai@redhat.com>
278
279 commit aac7a85a3ae9cce38987ce3f51be4c6cb63c8dd2
280 Author: Kefu Chai <kchai@redhat.com>
281 Date: Tue Nov 21 21:47:30 2017 +0800
282
283 qa/workunits: silence py warnings for ceph-disk tests
284
285 ceph-disk now prints "depreacted" warning message when it starts. but
286 the tests parses its stdout and stderr for a json string. so we need to
287 silence the warnings for the tests.
288
289 Fixes: http://tracker.ceph.com/issues/22154
290 Signed-off-by: Kefu Chai <kchai@redhat.com>
291 (cherry picked from commit d44334f31704487ec3574738e75145872d9932cf)
292
293 commit 613634c1da4cea975d6e1da7d258600c454c9400
294 Merge: 5a469c0376 94839deb2f
295 Author: Andrew Schoen <andrew.schoen@gmail.com>
296 Date: Mon Nov 20 09:24:41 2017 -0600
297
298 Merge pull request #18989 from ceph/wip-luminous-rm22154
299
300 luminous: ceph-disk create deprecation warnings
301
302 Reviewed-by: Andrew Schoen <aschoen@redhat.com>
303
304 commit 5a469c0376e299e5c60d7d9b3c16640515b11f26
305 Merge: 3532f233f6 37d2726751
306 Author: Kefu Chai <tchaikov@gmail.com>
307 Date: Mon Nov 20 22:55:06 2017 +0800
308
309 Merge pull request #19025 from tchaikov/wip-pr-19024-luminous
310
311 luminous: qa/tasks: prolong revive_osd() timeout to 6 min
312
313 Reviewed-by: Sage Weil <sage@redhat.com>
314
315 commit 3532f233f691ac22c32c4533a677b95d0e4c6273
316 Merge: 5e519aebe7 0f7332e925
317 Author: Sage Weil <sage@newdream.net>
318 Date: Mon Nov 20 07:23:30 2017 -0600
319
320 Merge pull request #18945 from liewegas/wip-22128
321
322 mon/OSDMonitor: add option to fix up ruleset-* to crush-* for ec profiles
323
324 Reviewed-by: Joao Eduardo Luis <joao@suse.de>
325
326 commit 37d2726751c05a0b5a3c1b739bce49995cc72445
327 Author: Kefu Chai <kchai@redhat.com>
328 Date: Mon Nov 20 13:40:56 2017 +0800
329
330 qa/tasks: prolong revive_osd() timeout to 6 min
331
332 see also #17902
333
334 Fixes: http://tracker.ceph.com/issues/21474
335 Signed-off-by: Kefu Chai <kchai@redhat.com>
336 (cherry picked from commit 749bbda07522114b99b17a4a01cfcf019520285d)
337
338 commit 5e519aebe718bd16d52e974beba8e3bf97b04ae8
339 Merge: 9abf091336 96c981ce6b
340 Author: Sage Weil <sage@newdream.net>
341 Date: Sat Nov 18 20:34:50 2017 -0600
342
343 Merge pull request #18983 from pdvian/wip-22150-luminous
344
345 luminous: os/bluestore: fix SharedBlob unregistration
346
347 commit 0f7332e9259b320777770f0312233a31103bfeda
348 Author: Sage Weil <sage@redhat.com>
349 Date: Wed Nov 15 08:55:33 2017 -0600
350
351 mon/OSDMonitor: add option to fix up ruleset-* to crush-* for ec profiles
352
353 The jewel->luminous upgrade test will fail if we finish the upgrade while
354 a workload setting old-style ec profiles is running. Add option to
355 automatically fix them up. Warn to the cluster log when this happens.
356
357 For now, enable this option to ease upgrades and whitelist the warning.
358
359 Only include this option in luminous so that we implicitly sunset this
360 compatibility kludge immediately.
361
362 Fixes: http://tracker.ceph.com/issues/22128
363 Signed-off-by: Sage Weil <sage@redhat.com>
364
365 commit 9abf0913367a1ad8cf076c79bf3adace8c526853
366 Merge: c0e032c153 975229c367
367 Author: Sage Weil <sage@newdream.net>
368 Date: Sat Nov 18 09:44:46 2017 -0600
369
370 Merge pull request #18751 from shinobu-x/wip-21701-luminous
371
372 luminous: ceph-kvstore-tool does not call bluestore's umount when exit
373
374 commit c0e032c153a36c00109970395fe42cc2013fdb9a
375 Merge: 81b768ab03 4d4aee14a4
376 Author: Sage Weil <sage@newdream.net>
377 Date: Sat Nov 18 09:44:19 2017 -0600
378
379 Merge pull request #18750 from shinobu-x/wip-21702-luminous
380
381 luminous: BlueStore::umount will crash when the BlueStore is opened by start_kv_only()
382
383 commit 81b768ab036e66d3f4d36ddc31febc4bbcb143fb
384 Merge: f02d7109c5 0fe463b5e1
385 Author: Sage Weil <sage@newdream.net>
386 Date: Sat Nov 18 09:41:37 2017 -0600
387
388 Merge pull request #18860 from liewegas/wip-filestore-rocksdb-compression-luminous
389
390 luminous: os/filestore: disable rocksdb compression
391
392 Reviewed-by: Douglas Fuller <dfuller@redhat.com>
393
394 commit 94839deb2f32e8059206ad48ad711dd2baf2fef5
395 Author: Alfredo Deza <adeza@redhat.com>
396 Date: Fri Nov 17 13:10:29 2017 -0500
397
398 doc/ceph-volume create a migration section to help users coming from ceph-disk
399
400 Signed-off-by: Alfredo Deza <adeza@redhat.com>
401 (cherry picked from commit e433efe51481ec63bc9753a0f446fe2b12b5bb6a)
402
403 commit b8bf0d047868054135592188c7ebe186181310c5
404 Author: Alfredo Deza <adeza@redhat.com>
405 Date: Fri Nov 17 13:01:14 2017 -0500
406
407 ceph-disk add deprecation warnings in favor of ceph-volume
408
409 Signed-off-by: Alfredo Deza <adeza@redhat.com>
410
411 Fixes: http://tracker.ceph.com/issues/22154
412 (cherry picked from commit c9da92e1ec8d60dc40d86630dab95e4fec4d0d30)
413
414 commit f02d7109c5f00cd2165082c4336b3623352be7c5
415 Merge: 9515da2777 ebbe033936
416 Author: Alfredo Deza <alfredo@deza.pe>
417 Date: Fri Nov 17 12:19:36 2017 -0500
418
419 Merge pull request #18973 from ceph/backport-18924
420
421 luminous: ceph-volume: allow using a device or partition for `lvm --data`
422
423 Reviewed-by: Alfredo Deza <adeza@redhat.com>
424
425 commit ebbe033936c424a0f6ba2d102fc271d0b0e9578d
426 Author: Alfredo Deza <adeza@redhat.com>
427 Date: Fri Nov 17 08:41:24 2017 -0500
428
429 ceph-volume tests.devices.lvm prepare isn't bluestore specific anymore
430
431 Signed-off-by: Alfredo Deza <adeza@redhat.com>
432 (cherry picked from commit 2f40dbac386be631ac97e2450117c218d9bf02f9)
433
434 commit 96c981ce6b00520a94385228bcf70a90c5ae8ff9
435 Author: Sage Weil <sage@redhat.com>
436 Date: Tue Nov 7 22:05:10 2017 -0600
437
438 os/bluestore: fix SharedBlob unregistration
439
440 We use the SharedBlobSet remove() in three cases:
441
442 - from SharedBlob::put(), we try to remove ourselves from the set, but
443 have to deal with a racing lookup, so the removal is conditional on
444 nref still being 0.
445 - from split_cache(), we move the SharedBlob to another collection
446 - from make_blob_unshared(), we remove the entry when we clear the sbid.
447
448 The problem is that the condtiional remove() (for the first case) was being
449 used for all three cases, and in the second two cases nref is always != 0,
450 so it doesn't actually happen. This can lead to a crash during cache
451 shutdown.
452
453 Fix by making two variants: remove() that is unconditional, and
454 try_remove() that is conditional.
455
456 Set the sb->coll pointer after because remove() asserts the parent matches
457 where we are unregistering.
458
459 Fixes: http://tracker.ceph.com/issues/22039
460 Signed-off-by: Sage Weil <sage@redhat.com>
461 (cherry picked from commit 78a465b90b1c5187cfec9f25eb58b3bf617ca39b)
462
463 commit 9515da277737ad81d48f5c032f627f3cb919f746
464 Merge: 5c9b93dadd d19b740359
465 Author: Josh Durgin <jdurgin@redhat.com>
466 Date: Thu Nov 16 13:40:32 2017 -0800
467
468 Merge pull request #18957 from tchaikov/wip-pr-18808-luminous
469
470 luminous: qa: do not wait for down/out osd for pg convergence
471
472 Reviewed-by: Josh Durgin <jdurgin@redhat.com>
473
474 commit ad4668b65cb3e32f1b3afc5ec767004f166856e6
475 Author: Alfredo Deza <adeza@redhat.com>
476 Date: Thu Nov 16 08:50:34 2017 -0500
477
478 ceph-volume tests.functional create a common playbook directory for setups
479
480 Signed-off-by: Alfredo Deza <adeza@redhat.com>
481 (cherry picked from commit def89a411f2f4bdb23c4bbd3b71c1310a564f07d)
482
483 commit d25a04114c98aa1449809248e8b87ecd1124af3d
484 Author: Alfredo Deza <adeza@redhat.com>
485 Date: Tue Nov 14 11:01:48 2017 -0500
486
487 doc/ceph-volume lvm prepare can accept devices for --data
488
489 Signed-off-by: Alfredo Deza <adeza@redhat.com>
490 (cherry picked from commit 9bfab348b2ff59c0b939a19c22d4a06bc5236b96)
491
492 Conflicts:
493 doc/ceph-volume/lvm/prepare.rst
494
495 commit 7f7d62a1848e297153f88a8e476585596114e1d5
496 Author: Alfredo Deza <adeza@redhat.com>
497 Date: Tue Nov 14 08:42:27 2017 -0500
498
499 ceph-volume tests.functional add setup playbook for xenial filestore
500
501 Signed-off-by: Alfredo Deza <adeza@redhat.com>
502 (cherry picked from commit 210c1e1d4770dde47f0008cadaaec35deb729272)
503
504 commit 210e1b3bf507654167349411c5cc85641b1d8680
505 Author: Alfredo Deza <adeza@redhat.com>
506 Date: Tue Nov 14 08:42:02 2017 -0500
507
508 ceph-volume tests.functional add data device and journal to xenial filestore
509
510 Signed-off-by: Alfredo Deza <adeza@redhat.com>
511 (cherry picked from commit d0754e25177b9bf3bce695b7991e99f49312d91c)
512
513 commit 211895ac0906747bc448b2326ae5c62f3e6ee4a1
514 Author: Alfredo Deza <adeza@redhat.com>
515 Date: Tue Nov 14 08:40:37 2017 -0500
516
517 ceph-volume tests.functional add setup playbook for xenial bluestore
518
519 Signed-off-by: Alfredo Deza <adeza@redhat.com>
520 (cherry picked from commit d0f5623963f58fc4d5727a79d8377b2191b0f9dc)
521
522 commit 398a1365a12de95bc9810b89a9aeab9040bb07b8
523 Author: Alfredo Deza <adeza@redhat.com>
524 Date: Tue Nov 14 08:40:18 2017 -0500
525
526 ceph-volume tests.functional add raw data device to xenial bluestore
527
528 Signed-off-by: Alfredo Deza <adeza@redhat.com>
529 (cherry picked from commit fbcfb522981cd4039cfe617609c5f160f0b05c52)
530
531 commit 0d082d0dbb43cc418bf0786b1f708968050ae114
532 Author: Alfredo Deza <adeza@redhat.com>
533 Date: Tue Nov 14 08:38:23 2017 -0500
534
535 ceph-volume tests.functional tox.ini addition of setup playbook for partitions
536
537 Signed-off-by: Alfredo Deza <adeza@redhat.com>
538 (cherry picked from commit d074b534643dde37d732b34c36c5089e41848d6d)
539
540 commit a167556eaacb444c41299cd28f1efd4327da4747
541 Author: Alfredo Deza <adeza@redhat.com>
542 Date: Tue Nov 14 08:37:17 2017 -0500
543
544 ceph-volume tests.functional add raw data device to centos7 bluestore
545
546 Signed-off-by: Alfredo Deza <adeza@redhat.com>
547 (cherry picked from commit 2d416a849ad7b33dde1386da09c81249e6c2299d)
548
549 commit 12e180a84f1456dfe7ab940255c6c47ee8ebddf0
550 Author: Alfredo Deza <adeza@redhat.com>
551 Date: Tue Nov 14 08:36:36 2017 -0500
552
553 ceph-volume tests.functional add setup playbook for centos7 bluestore
554
555 Signed-off-by: Alfredo Deza <adeza@redhat.com>
556 (cherry picked from commit 161fd373d2f11f64466927e5d615d039822e2ab5)
557
558 commit f06ea77590336d439235bd9acc6028b854e8c181
559 Author: Alfredo Deza <adeza@redhat.com>
560 Date: Tue Nov 14 08:35:59 2017 -0500
561
562 ceph-volume tests.functional add setup playbook for centos7 filestore
563
564 Signed-off-by: Alfredo Deza <adeza@redhat.com>
565 (cherry picked from commit b3bb147298f8816651f231f77bc91a3a1b50d96f)
566
567 commit f10bfbeefe06e59629a4e9d904e8035bf060920b
568 Author: Alfredo Deza <adeza@redhat.com>
569 Date: Tue Nov 14 08:35:42 2017 -0500
570
571 ceph-volume tests.functional add raw device to centos7 filestore
572
573 Signed-off-by: Alfredo Deza <adeza@redhat.com>
574 (cherry picked from commit c5b8d72570b24dfd0d2f8c1cc8f13812c6c11a69)
575
576 commit 968006a271dc82f3dcada4e5de93ecb0e23238c6
577 Author: Alfredo Deza <adeza@redhat.com>
578 Date: Mon Nov 13 14:29:32 2017 -0500
579
580 ceph-volume lvm.common update --data flag to reflect device acceptance
581
582 Signed-off-by: Alfredo Deza <adeza@redhat.com>
583 (cherry picked from commit 4df7ea8d83cfa02c8864d043b5d5fb2f5409dc96)
584
585 commit c8f64af027689a1fb1bb916e6d479519a12b764e
586 Author: Alfredo Deza <adeza@redhat.com>
587 Date: Mon Nov 13 14:28:32 2017 -0500
588
589 ceph-volume lvm.prepare add example of raw device or partition in help menu
590
591 Signed-off-by: Alfredo Deza <adeza@redhat.com>
592 (cherry picked from commit 6fb8d566aac0e0fa081e6500852855ad177f784f)
593
594 commit f930934159edd947024eef1a33e15a30467cb332
595 Author: Alfredo Deza <adeza@redhat.com>
596 Date: Mon Nov 13 14:26:44 2017 -0500
597
598 ceph-volume lvm.prepare allow partition or raw device as input for --data in filestore
599
600 Signed-off-by: Alfredo Deza <adeza@redhat.com>
601 (cherry picked from commit 89236ee3f81e50b9b059c10f6d6e7ce048c06474)
602
603 commit d19b7403595bef1c3ba73f4a5fb83f5ef2dd3f81
604 Author: Kefu Chai <kchai@redhat.com>
605 Date: Wed Nov 8 14:13:54 2017 +0800
606
607 qa: do not wait for down/out osd for pg convergence
608
609 that osd is not invovlved in the PG state changes.
610
611 Signed-off-by: Kefu Chai <kchai@redhat.com>
612 (cherry picked from commit 7f549af459b40c5bb51a24a3a443ed7a7116915e)
613
614 commit 5c9b93dadd8f05b1a146e3a19f7480ae4019815f
615 Merge: cc41c393b3 2f380b32da
616 Author: Yuri Weinstein <yuri.weinstein@gmail.com>
617 Date: Tue Nov 14 08:38:35 2017 -0800
618
619 Merge pull request #18908 from smithfarm/wip-luminous-fixup
620
621 qa/suites/fs/basic_functional/clusters: more osds
622
623 Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
624 Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
625
626 commit cc41c393b3a76a5f1a18cbda45acc01e2d6fdfc2
627 Merge: d69f42e1af 806e49aadb
628 Author: Alfredo Deza <alfredo@deza.pe>
629 Date: Tue Nov 14 11:06:00 2017 -0500
630
631 Merge pull request #18910 from ceph/backport-18882
632
633 luminous: ceph-volume: add functional tests for simple, rearrange lvm tests
634
635 Reviewed-by: Alfredo Deza <adeza@redhat.com>
636
637 commit 806e49aadb0d832a4bf46fcd681d889d93158232
638 Author: Alfredo Deza <adeza@redhat.com>
639 Date: Fri Nov 10 13:18:07 2017 -0500
640
641 ceph-volume tests.functional update lvm/tox.ini paths after moving it
642
643 Signed-off-by: Alfredo Deza <adeza@redhat.com>
644 (cherry picked from commit 7d787849556788961155534039886aedfcdb2a88)
645
646 commit 724ad01afc0af79fc7f808aae819ff9dc0971b33
647 Author: Alfredo Deza <adeza@redhat.com>
648 Date: Fri Nov 10 13:14:55 2017 -0500
649
650 ceph-volume tests.functional move top level tox.ini to lvm/tox.ini
651
652 Signed-off-by: Alfredo Deza <adeza@redhat.com>
653 (cherry picked from commit 9b14b96d3bf6c8326cfc91e657161ffab3b8c2b4)
654
655 commit 754c237597cc91af4bfe7199f891a9c2a6938ad4
656 Author: Alfredo Deza <adeza@redhat.com>
657 Date: Fri Nov 10 13:12:51 2017 -0500
658
659 ceph-volume tests.functional move xenial to lvm/xenial
660
661 Signed-off-by: Alfredo Deza <adeza@redhat.com>
662 (cherry picked from commit 00d576d266b63080129e58482bd6fba62534ee97)
663
664 commit 762c5f1cc10266d5efa62628c0686b3f8d696bff
665 Author: Alfredo Deza <adeza@redhat.com>
666 Date: Fri Nov 10 13:11:58 2017 -0500
667
668 ceph-volume tests.functional lvm move xenial/bluestore to xenial/bluestore/create
669
670 Signed-off-by: Alfredo Deza <adeza@redhat.com>
671 (cherry picked from commit d5ec7d1c58141f4593ed9d1e4501c9f3be6d9755)
672
673 commit 5b1bde338fbb1e689e3e1305e91f5450ef175edd
674 Author: Alfredo Deza <adeza@redhat.com>
675 Date: Fri Nov 10 13:09:48 2017 -0500
676
677 ceph-volume tests.functional lvm move xenial/create to xenial/filestore/create
678
679 Signed-off-by: Alfredo Deza <adeza@redhat.com>
680 (cherry picked from commit c504b8781b3a31475280a032cd75c9e1eaa6d8c9)
681
682 commit 5a00604f27acad8cb368495f841ce76cce383414
683 Author: Alfredo Deza <adeza@redhat.com>
684 Date: Fri Nov 10 13:02:05 2017 -0500
685
686 ceph-volume tests.functional move centos7 to lvm/centos7
687
688 Signed-off-by: Alfredo Deza <adeza@redhat.com>
689 (cherry picked from commit dc1da3fd0aeafe59a82343fb16fe1fcea66ae3eb)
690
691 commit 57d64a86d0758d174c1ca0b432a43194cbe6162c
692 Author: Alfredo Deza <adeza@redhat.com>
693 Date: Fri Nov 10 12:58:27 2017 -0500
694
695 ceph-volume tests.functional lvm move bluestore to bluestore/create
696
697 Signed-off-by: Alfredo Deza <adeza@redhat.com>
698 (cherry picked from commit aec1a80a3e1e61720f494980711808bfee783a03)
699
700 commit 94a9f3f43d9c3a2ac08be4025e65c47c3767d2c1
701 Author: Alfredo Deza <adeza@redhat.com>
702 Date: Fri Nov 10 12:54:01 2017 -0500
703
704 ceph-volume tests.functional lvm move create to filestore/create
705
706 Signed-off-by: Alfredo Deza <adeza@redhat.com>
707 (cherry picked from commit d6905f3f620d4c733835e21a275d4127cdcb769b)
708
709 commit bc134c20a5409bd6f966d205dd7ba850ff28fc91
710 Author: Alfredo Deza <adeza@redhat.com>
711 Date: Fri Nov 10 12:42:19 2017 -0500
712
713 ceph-volume tests.functional simple xenial bluestore scenario
714
715 Signed-off-by: Alfredo Deza <adeza@redhat.com>
716 (cherry picked from commit 8f0fdc975951a2a8af31bbaa3abd2b5d807a0add)
717
718 commit 004efbfbe4d1eb56190e5e7497a9613776494fae
719 Author: Alfredo Deza <adeza@redhat.com>
720 Date: Fri Nov 10 12:40:18 2017 -0500
721
722 ceph-volume tests.functional simple xenial filestore scenario
723
724 Signed-off-by: Alfredo Deza <adeza@redhat.com>
725 (cherry picked from commit 7452e1b6f9b82c2ef62bae19c632e81039638ba5)
726
727 commit b51744f26f3c6db4d2927a2ac1733f0b80e44010
728 Author: Alfredo Deza <adeza@redhat.com>
729 Date: Fri Nov 10 12:30:05 2017 -0500
730
731 ceph-volume tests.functional simple tox.ini update for xenial scnearios
732
733 Signed-off-by: Alfredo Deza <adeza@redhat.com>
734 (cherry picked from commit 76ed6a8f2ecab7c58def0453ffed9d8a997e0d5b)
735
736 commit 19983b9ba5ed45c8e6fac967fb702fd586132c35
737 Author: Alfredo Deza <adeza@redhat.com>
738 Date: Fri Nov 10 09:12:09 2017 -0500
739
740 ceph-volume tests.functional simple tox.ini addition for bluestore
741
742 Signed-off-by: Alfredo Deza <adeza@redhat.com>
743 (cherry picked from commit 02154e445b87a8fdcabbd699a2532833764140b5)
744
745 commit 040e7913b028c54aeb9acd854610f6a4f112465d
746 Author: Alfredo Deza <adeza@redhat.com>
747 Date: Fri Nov 10 09:11:39 2017 -0500
748
749 ceph-volume tests.functional add initial files for simple bluestore activate
750
751 Signed-off-by: Alfredo Deza <adeza@redhat.com>
752 (cherry picked from commit 3320f28e799e1d77d1ea69be9ced603bb69cc5fa)
753
754 commit 23f6c3e779c743bc1302d1ad542201434ff9431f
755 Author: Alfredo Deza <adeza@redhat.com>
756 Date: Thu Nov 9 16:55:30 2017 -0500
757
758 ceph-volume tests.functional add initial files for simple filestore activate
759
760 Signed-off-by: Alfredo Deza <adeza@redhat.com>
761 (cherry picked from commit 9d18bae52ad77be0e64ef105c33a019446b6f1cf)
762
763 commit 8f425b678f6c947a8c83f121be4fa46151fd6664
764 Author: Alfredo Deza <adeza@redhat.com>
765 Date: Thu Nov 9 16:07:53 2017 -0500
766
767 ceph-volume tests.functional create a specific test.yml for simple activate
768
769 Signed-off-by: Alfredo Deza <adeza@redhat.com>
770 (cherry picked from commit 37bde0d3b37a87c456438b0edc0cb9e2dcd39120)
771
772 commit 6f1fff00f5210840fe143aac7506ce3773600f05
773 Author: Alfredo Deza <adeza@redhat.com>
774 Date: Thu Nov 9 15:40:51 2017 -0500
775
776 ceph-volume tests.functional create a separate tox.ini environ for
777 `simple`
778
779 Signed-off-by: Alfredo Deza <adeza@redhat.com>
780 (cherry picked from commit 89757ad12e6938fe2bf997e0f21a5ffac082e30b)
781
782 commit d69f42e1afaf8759de1544b3d381671a01cfb55a
783 Merge: a7c8c8101d 90976ef6b9
784 Author: Andrew Schoen <andrew.schoen@gmail.com>
785 Date: Mon Nov 13 10:55:24 2017 -0600
786
787 Merge pull request #18907 from ceph/luminous-wip-bz1498200
788
789 luminous: ceph-volume: support GPT and other deployed OSDs
790
791 Reviewed-by: Andrew Schoen <aschoen@redhat.com>
792
793 commit 2f380b32da1b6294b6b0f60622b09b6517f9afdd
794 Author: Sage Weil <sage@redhat.com>
795 Date: Mon Oct 9 13:44:51 2017 -0500
796
797 qa/suites/fs/basic_functional/clusters: more osds
798
799 Signed-off-by: Sage Weil <sage@redhat.com>
800 (cherry picked from commit 998122c324047c96c16d60d7fbb3a21f4dd63c56)
801
802 commit 90976ef6b9815b68df620aac46f2c04117766f99
803 Author: Alfredo Deza <adeza@redhat.com>
804 Date: Thu Nov 9 10:50:43 2017 -0500
805
806 doc/ceph-volume include the top level systemd.rst in the toctree
807
808 Signed-off-by: Alfredo Deza <adeza@redhat.com>
809 (cherry picked from commit e2f281c115c15e820588b478214c3600ff97470f)
810
811 commit 9a8a00d3a17f03d2b1b3a92662f7288f7d18fe7a
812 Author: Alfredo Deza <adeza@redhat.com>
813 Date: Thu Nov 9 06:49:49 2017 -0500
814
815 ceph-volume simple.activate add --file in help docstring as an example
816
817 Signed-off-by: Alfredo Deza <adeza@redhat.com>
818 (cherry picked from commit ff60592897b63581ebce372b3f6ffa0f10d2fe5a)
819
820 commit 34194b8d788d91b4f7c969be5f0099a279bc61bf
821 Author: Alfredo Deza <adeza@redhat.com>
822 Date: Thu Nov 9 06:46:59 2017 -0500
823
824 doc/ceph-volume activate has a --file option for json files
825
826 Signed-off-by: Alfredo Deza <adeza@redhat.com>
827 (cherry picked from commit 29913951b71d68b3f3f9b9fa076f309c0252da36)
828
829 commit 582262b57bcc959d1698636000d7a804cab9c611
830 Author: Alfredo Deza <adeza@redhat.com>
831 Date: Wed Nov 8 17:23:41 2017 -0500
832
833 ceph-volume simple.activate enable the osd when activating
834
835 Signed-off-by: Alfredo Deza <adeza@redhat.com>
836 (cherry picked from commit 366fb8c43af54e9c92f4e95d9a0582c1fc378dbc)
837
838 commit a32e72cdb0efb55d185488fb02f44055f9d3dffe
839 Author: Alfredo Deza <adeza@redhat.com>
840 Date: Wed Nov 8 15:25:05 2017 -0500
841
842 ceph-volume systemd.systemctl always force symlink when masking ceph-disk
843
844 Signed-off-by: Alfredo Deza <adeza@redhat.com>
845 (cherry picked from commit cb470622fd4f13fafe9cb2f38fb25fd1fbd8d89c)
846
847 commit 3af40c35f3cf42be722f9d905cb2d0ba2baf1b1b
848 Author: Alfredo Deza <adeza@redhat.com>
849 Date: Wed Nov 8 15:21:10 2017 -0500
850
851 ceph-volume simple.activate use the contents of the JSON file, fallback to CLI args
852
853 Signed-off-by: Alfredo Deza <adeza@redhat.com>
854 (cherry picked from commit c954c913395557bcd89f25b0496c4428e6109494)
855
856 commit 161e9657d985aa4ceffad2f56e18edd78ca2a81f
857 Author: Alfredo Deza <adeza@redhat.com>
858 Date: Wed Nov 8 14:50:16 2017 -0500
859
860 ceph-volume simple.activate only check for missing id and uuid if file is not passed in
861
862 Signed-off-by: Alfredo Deza <adeza@redhat.com>
863 (cherry picked from commit 826c2709dd5ab0fbf6eb419a735d15e718a7712c)
864
865 commit 585072afc814c6ac87fd64f15c561c51c1e55070
866 Author: Alfredo Deza <adeza@redhat.com>
867 Date: Wed Nov 8 14:28:12 2017 -0500
868
869 ceph-volume simple.activate allow to pass a file to activate
870
871 Signed-off-by: Alfredo Deza <adeza@redhat.com>
872 (cherry picked from commit bd3498f3eabf07637cb936e6c036d1d8d75415b0)
873
874 commit 01266c193588066425b44fea4c1729692f999692
875 Author: Alfredo Deza <adeza@redhat.com>
876 Date: Wed Nov 8 12:49:31 2017 -0500
877
878 ceph-volume tests.util add tests for OSDPath validator
879
880 Signed-off-by: Alfredo Deza <adeza@redhat.com>
881 (cherry picked from commit d7fc26ab4e2cebe485647510119ea300d47db184)
882
883 commit 56fdc1c973b41d855563e459d23682990e8940bf
884 Author: Alfredo Deza <adeza@redhat.com>
885 Date: Wed Nov 8 11:56:36 2017 -0500
886
887 ceph-volume systemd.systemctl masking ceph-disk needs to be done by directly symlinking to dev/null
888
889 Signed-off-by: Alfredo Deza <adeza@redhat.com>
890 (cherry picked from commit cda47c247b929401a7dce3f1ef70371ea80eeceb)
891
892 commit 0a0c289de605b6b74b762b2a0a4ed0f3a04de8ad
893 Author: Alfredo Deza <adeza@redhat.com>
894 Date: Wed Nov 8 09:47:12 2017 -0500
895
896 ceph-volume systemd.systemctl masking needs to use systemctl mask, not disable
897
898 Signed-off-by: Alfredo Deza <adeza@redhat.com>
899 (cherry picked from commit bad2f62b34243addc854abf691854b886aecdc19)
900
901 commit 32913844b36285aae40f9786e5cb035bfca22f2d
902 Author: Alfredo Deza <adeza@redhat.com>
903 Date: Wed Nov 8 09:46:20 2017 -0500
904
905 ceph-volume simple.scan if mounted device cannot be detected, raise an error
906
907 Signed-off-by: Alfredo Deza <adeza@redhat.com>
908 (cherry picked from commit 6b2fc4c0ba63e4bd51774ea09cc6542738128621)
909
910 commit fe73229fb123fdb45f4ef743d8584f6748318868
911 Author: Alfredo Deza <adeza@redhat.com>
912 Date: Wed Nov 8 09:17:52 2017 -0500
913
914 ceph-volume simple.activate remove str formatting from logging
915
916 Signed-off-by: Alfredo Deza <adeza@redhat.com>
917 (cherry picked from commit 230faf04a185c0b95c8ad497ddd5501dc70c1409)
918
919 commit 50c19ef335305215a636595506eda1b5d16f3687
920 Author: Alfredo Deza <adeza@redhat.com>
921 Date: Wed Nov 8 09:11:41 2017 -0500
922
923 ceph-volume util.arg_validators always convert the path to an absolute path
924
925 Signed-off-by: Alfredo Deza <adeza@redhat.com>
926 (cherry picked from commit b5acf4d720b5395ae4ccbf007c94c99610e40089)
927
928 commit d27c35c972abba2b230e1cff1fa35437500dcdf6
929 Author: Alfredo Deza <adeza@redhat.com>
930 Date: Wed Nov 8 09:10:47 2017 -0500
931
932 ceph-volume util.arg_validators require superuser privs to check paths
933
934 Signed-off-by: Alfredo Deza <adeza@redhat.com>
935 (cherry picked from commit 376dad74159532f901d0044f95330fc02f93bd25)
936
937 commit 0832ddc52496cd81aa7c2e1e85252b50d2f33044
938 Author: Alfredo Deza <adeza@redhat.com>
939 Date: Wed Nov 8 09:09:06 2017 -0500
940
941 ceph-volume simple.scan skip directories to scan
942
943 Signed-off-by: Alfredo Deza <adeza@redhat.com>
944 (cherry picked from commit 6bc1e9ee0b8d7bc475f218ae3dd8c6c7fe5a983a)
945
946 commit d6071cb75ba1a702c551d073f032336560654e97
947 Author: Alfredo Deza <adeza@redhat.com>
948 Date: Tue Nov 7 15:08:13 2017 -0500
949
950 ceph-volume tests.devices.simple add activate CLI unit tests
951
952 Signed-off-by: Alfredo Deza <adeza@redhat.com>
953 (cherry picked from commit cde0d517563b537319d06c758b93e421cdabe59d)
954
955 commit 2bff2e7fdbba37280791d3bc9a363e47aa26ab53
956 Author: Alfredo Deza <adeza@redhat.com>
957 Date: Tue Nov 7 15:07:44 2017 -0500
958
959 ceph-volume tests.devices add help menu unit test
960
961 Signed-off-by: Alfredo Deza <adeza@redhat.com>
962 (cherry picked from commit dcc7c72196a327f9501045f025761b228b5379df)
963
964 commit ec8624005082913faf89a9b001d4abeb7c27a589
965 Author: Alfredo Deza <adeza@redhat.com>
966 Date: Tue Nov 7 13:42:45 2017 -0500
967
968 doc/ceph-volume systemd describe the interaction with 'simple' activation
969
970 Signed-off-by: Alfredo Deza <adeza@redhat.com>
971 (cherry picked from commit 7071eeaeb5d77c6ab6e7a24f1b630cb0cf8a8e7c)
972
973 commit aacd22681d1e7f5a604025b2019b195041151b3f
974 Author: Alfredo Deza <adeza@redhat.com>
975 Date: Tue Nov 7 13:42:11 2017 -0500
976
977 doc/ceph-volume index initial description of simple
978
979 Signed-off-by: Alfredo Deza <adeza@redhat.com>
980 (cherry picked from commit f9ee51f9feadb6d0f91b76a2b2ba8a24f1523a77)
981
982 commit e9527e65d5da503107e21dc5b695f287c8529049
983 Author: Alfredo Deza <adeza@redhat.com>
984 Date: Tue Nov 7 13:41:12 2017 -0500
985
986 doc/ceph-volume lvm add back a system.rst with just the lvm portion of it
987
988 Signed-off-by: Alfredo Deza <adeza@redhat.com>
989 (cherry picked from commit f872cd29b93e02b77172f7b382c4746af9ba845d)
990
991 commit ef027a737989dca83c0e5810935bad2280146356
992 Author: Alfredo Deza <adeza@redhat.com>
993 Date: Tue Nov 7 13:40:44 2017 -0500
994
995 doc/ceph-volume make systemd.rst generic enough to be related to other sub-commands
996
997 Signed-off-by: Alfredo Deza <adeza@redhat.com>
998 (cherry picked from commit cf4e32a0dc3ab4f55fe7857b51afbc63a638ec66)
999
1000 commit a83b746eaeece5896770b40949804316c29f6bc1
1001 Author: Alfredo Deza <adeza@redhat.com>
1002 Date: Tue Nov 7 13:39:52 2017 -0500
1003
1004 doc/ceph-volume move lvm/systemd.rst to top level, making it generic
1005
1006 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1007 (cherry picked from commit 0672dd608d4601a936d703ea5ba6edc14a161d8e)
1008
1009 commit bc492490e15d3ea91654cd4dabfb3115f835b9ac
1010 Author: Alfredo Deza <adeza@redhat.com>
1011 Date: Tue Nov 7 11:52:17 2017 -0500
1012
1013 doc/ceph-volume simple.activate initial take on documenting activation
1014
1015 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1016 (cherry picked from commit 80c796bd1c43125f5678710b494b03c486b3fce6)
1017
1018 commit 6301c83097729749fc712846954a3c0f89647f07
1019 Author: Alfredo Deza <adeza@redhat.com>
1020 Date: Tue Nov 7 08:35:57 2017 -0500
1021
1022 doc/ceph-volume lvm update systemd anchor to reflect lvm parent
1023
1024 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1025 (cherry picked from commit 53420a4756a5e4fa6b0f2aa74d6ad1e2919f1954)
1026
1027 commit 5fe4122bcfdc9c8e4f69079e45c907148eccdb7d
1028 Author: Alfredo Deza <adeza@redhat.com>
1029 Date: Tue Nov 7 08:35:43 2017 -0500
1030
1031 doc/ceph-volume lvm.activate update systemd anchor to reflect lvm parent
1032
1033 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1034 (cherry picked from commit 7fc0e7ebcae06f28f6ed08c0db14075ada34e8a7)
1035
1036 commit c98886a99914748d73d0f695808a74850bc9e66e
1037 Author: Alfredo Deza <adeza@redhat.com>
1038 Date: Tue Nov 7 07:56:35 2017 -0500
1039
1040 doc/ceph-volume lvm.systemd update anchor to reflect lvm parent
1041
1042 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1043 (cherry picked from commit 01a8b7e6a45f6fd85bf53d3cab15acc81d0bae1b)
1044
1045 commit 68f89b52d608c3946be9ad92e733fe9472bd35f0
1046 Author: Alfredo Deza <adeza@redhat.com>
1047 Date: Mon Nov 6 15:53:39 2017 -0500
1048
1049 doc/ceph-volume document the scan functionality
1050
1051 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1052 (cherry picked from commit b30a3eaf17a20a1273724b2cfcaf0a7b36eb08f6)
1053
1054 commit 19d0ca22908fcd3fbe83d39c1b708c5818b34f47
1055 Author: Alfredo Deza <adeza@redhat.com>
1056 Date: Mon Nov 6 14:17:20 2017 -0500
1057
1058 doc/ceph-volume update the index to include the simple sub command and files
1059
1060 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1061 (cherry picked from commit d7f85c64e4b409ea95e30ccb5a1388278843c478)
1062
1063 commit 61c90bacc562e1e2d65b767dca97b08973832131
1064 Author: Alfredo Deza <adeza@redhat.com>
1065 Date: Mon Nov 6 11:15:28 2017 -0500
1066
1067 ceph-volume tests.simple add tests for trigger parsing from systemd
1068
1069 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1070 (cherry picked from commit 0e2620234e82abf85274b3c08b39cdf76430ce48)
1071
1072 commit 80ae5b1fb024827cceb0594a60e3361fd4a1e7a3
1073 Author: Alfredo Deza <adeza@redhat.com>
1074 Date: Mon Nov 6 10:36:14 2017 -0500
1075
1076 ceph-volume tests.simple create etc_path scan tests
1077
1078 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1079 (cherry picked from commit 90ebc4e1ffa7b3273787d708bb2c05180530b5d1)
1080
1081 commit b9ad514b45e0233a17834e19a232bca4467a8140
1082 Author: Alfredo Deza <adeza@redhat.com>
1083 Date: Mon Nov 6 10:06:02 2017 -0500
1084
1085 ceph-volume tests.simple add checks for get_contents in scan
1086
1087 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1088 (cherry picked from commit 647bfe0883d2bb05b4ff7f99894075df3e73d2d5)
1089
1090 commit c9308af91a322f92ab7d1f45a423b2a94f64c429
1091 Author: Alfredo Deza <adeza@redhat.com>
1092 Date: Mon Nov 6 09:43:58 2017 -0500
1093
1094 ceph-volume tests.util add binary verification tests
1095
1096 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1097 (cherry picked from commit 827aa57557561355dd4068e26801b5f1ed62f295)
1098
1099 commit c94f52dffe0ea4b48c9fb316e8c53fd06a81b870
1100 Author: Alfredo Deza <adeza@redhat.com>
1101 Date: Mon Nov 6 09:42:53 2017 -0500
1102
1103 ceph-volume tests create a fixture for temporary files
1104
1105 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1106 (cherry picked from commit 23da3445718c01f71e2a5748fb4fc1c5fdc85ca5)
1107
1108 commit bbb25df806609083efd377befb44d6d3bef3338b
1109 Author: Alfredo Deza <adeza@redhat.com>
1110 Date: Fri Nov 3 14:36:38 2017 -0400
1111
1112 ceph-volume systemd.systemctl helpers to mask ceph-disk
1113
1114 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1115 (cherry picked from commit 3da23fa4caea8c9dc91da3eee5b5acc1860bf242)
1116
1117 commit c971321430fd1a4de7c6fa2687ecf35a5b3ec71c
1118 Author: Alfredo Deza <adeza@redhat.com>
1119 Date: Fri Nov 3 14:36:13 2017 -0400
1120
1121 ceph-volume devices include simple at the module import level
1122
1123 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1124 (cherry picked from commit 027a09b3ea6bac416ff632a69a53393badd51708)
1125
1126 commit 1615d947db50ac37e4ef554acc6debe8fd870962
1127 Author: Alfredo Deza <adeza@redhat.com>
1128 Date: Fri Nov 3 14:35:45 2017 -0400
1129
1130 ceph-volume main add simple to the sub-commands
1131
1132 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1133 (cherry picked from commit 94579c77ffe4d5ba2d457ad3981a2b9ed232a90f)
1134
1135 commit abb77a8d9824eef3bd9c75d17f8df101440c25d1
1136 Author: Alfredo Deza <adeza@redhat.com>
1137 Date: Fri Nov 3 14:35:03 2017 -0400
1138
1139 ceph-volume util add an OSDPath argument validator
1140
1141 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1142 (cherry picked from commit a826fdf4a2ed9ff704fb823d05d3cb706ba89e38)
1143
1144 commit ff2a1833da385d6c0c9087e98cb2b93925b06cab
1145 Author: Alfredo Deza <adeza@redhat.com>
1146 Date: Fri Nov 3 14:34:39 2017 -0400
1147
1148 ceph-volume simple.system add a helper to check if a file is a binary or not
1149
1150 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1151 (cherry picked from commit 7bf8676045b4f966b60cdadf4d5af1c89fca69ae)
1152
1153 commit 84d2a15ce9f1a045ed67f79fa7d1dc99dc1e4b8f
1154 Author: Alfredo Deza <adeza@redhat.com>
1155 Date: Fri Nov 3 14:34:06 2017 -0400
1156
1157 ceph-volume util.system add a context manager for temporary mounting/unmounting
1158
1159 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1160 (cherry picked from commit 6394cdd41943e3cda6867ecc59ab835cb2151707)
1161
1162 commit 3d8ff08c2d46017749e7ecaa4e4d49dda4d55d74
1163 Author: Alfredo Deza <adeza@redhat.com>
1164 Date: Fri Nov 3 14:32:42 2017 -0400
1165
1166 ceph-volume simple.scan initial take on directory/device scanning
1167
1168 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1169 (cherry picked from commit 0e54b9be621cc0969a3bbc972d1870080ccdae77)
1170
1171 commit d701569a6486d7ccccf14b5eadf702ad07db4821
1172 Author: Alfredo Deza <adeza@redhat.com>
1173 Date: Fri Nov 3 14:27:23 2017 -0400
1174
1175 ceph-volume simple.trigger enable systemd triggering for simple setups
1176
1177 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1178 (cherry picked from commit cbc0c0f775e96a5b0ab5d5bc141acebe4cc48373)
1179
1180 commit 76fe659a19a8a450b4c61f6d2b56e03dc46746ae
1181 Author: Alfredo Deza <adeza@redhat.com>
1182 Date: Fri Nov 3 14:26:13 2017 -0400
1183
1184 ceph-volume simple.activate initial take on activation
1185
1186 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1187 (cherry picked from commit 5a97374605408d18e9be29bcc051ae7b913d1675)
1188
1189 commit 206c7551435983b4cbdaece61b737e4a1f265dbd
1190 Author: Alfredo Deza <adeza@redhat.com>
1191 Date: Fri Nov 3 14:23:47 2017 -0400
1192
1193 ceph-volume simple add __init__ for the module
1194
1195 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1196 (cherry picked from commit 285e5bdd28a42d98418ca90ad0cdec6bd87849db)
1197
1198 commit 8a5edb9a2acc3f0b5477f09edae4f97f5ec7f5b5
1199 Author: Alfredo Deza <adeza@redhat.com>
1200 Date: Fri Nov 3 14:23:29 2017 -0400
1201
1202 ceph-volume simple create the initial, main module
1203
1204 Signed-off-by: Alfredo Deza <adeza@redhat.com>
1205 (cherry picked from commit f050502425a1993ae8edfdb5785b24129cffeeba)
1206
1207 commit 0fe463b5e1fe62e03b498c32aa708be8c10eb0b8
1208 Author: Sage Weil <sage@redhat.com>
1209 Date: Thu Nov 9 20:10:59 2017 -0600
1210
1211 os/filestore: disable rocksdb compression
1212
1213 Experience working with customer escalations suggests that disabling
1214 compression improves performance, and the storage overhead is generally
1215 not a concern for the metadata and omap data we are storing.
1216
1217 Signed-off-by: Sage Weil <sage@redhat.com>
1218 (cherry picked from commit b878ead071b328e5fe7309a2368383e67679e9f7)
1219
1220
1221 # Conflicts:
1222 # src/common/options.cc
1223
1224 commit a7c8c8101d4b78b4d6e437620b2c1a38cd752c3f
1225 Merge: 1071fdcf73 f56de67980
1226 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1227 Date: Thu Nov 9 18:08:27 2017 +0100
1228
1229 Merge pull request #18801 from linuxbox2/luminous-rgw-readdir2
1230
1231 rgw_file: implement variant offset readdir processing -- pullup 2 of 2
1232
1233 Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
1234
1235 commit 1071fdcf73faa387d0df18489ab7b0359a0c0afb
1236 Merge: 4db48ca836 8cacd2a568
1237 Author: Kefu Chai <tchaikov@gmail.com>
1238 Date: Thu Nov 9 22:36:27 2017 +0800
1239
1240 Merge pull request #18734 from shinobu-x/wip-21648-luminous
1241
1242 luminous: mgr[zabbix] float division by zero
1243
1244 Reviewed-by: Wido den Hollander <wido@widodh.nl>
1245
1246 commit 4db48ca8369d1dae021131c93a1c8484512aa99b
1247 Merge: 9cd31820f2 d858570755
1248 Author: Kefu Chai <tchaikov@gmail.com>
1249 Date: Thu Nov 9 22:35:44 2017 +0800
1250
1251 Merge pull request #18851 from tchaikov/wip-18759-pr-luminous
1252
1253 mon/LogMonitor: "log last" should return up to n entries
1254
1255 Reviewed-by: John Spray <john.spray@redhat.com>
1256
1257 commit 9cd31820f22d746e680f4ce3b0c780157d24194f
1258 Merge: 60ff142c8e 8a7f983f33
1259 Author: Kefu Chai <tchaikov@gmail.com>
1260 Date: Thu Nov 9 22:27:47 2017 +0800
1261
1262 Merge pull request #18741 from shinobu-x/wip-22019-luminous
1263
1264 luminous: tests: "ceph osd create" is not idempotent
1265
1266 Reviewed-by: Kefu Chai <kchai@redhat.com>
1267
1268 commit d858570755d88e9a3708952827a99cc24f09f9ab
1269 Author: Kefu Chai <kchai@redhat.com>
1270 Date: Mon Nov 6 16:01:23 2017 +0800
1271
1272 mon/LogMonitor: "log last" should return up to n entries
1273
1274 limit the # of returned entries to "num", and backoff the start iterator
1275 by one if it reaches the rend().
1276
1277 Signed-off-by: Kefu Chai <kchai@redhat.com>
1278 (cherry picked from commit de14103f5201da69b360d9b01e249896d59376b3)
1279
1280 commit f56de6798077399f472c8d2df25fb1c3ccaf8090
1281 Author: Matt Benjamin <mbenjamin@redhat.com>
1282 Date: Sun Oct 15 21:48:19 2017 -0400
1283
1284 rgw_file: implement variant offset readdir processing
1285
1286 Introduce new rgw_readdir2(...), which in which continues
1287 from an arbitrary dirent name, which presumably has been
1288 seen in a prior partial enumeration.
1289
1290 Add single-file unit test for READDIR cases, librgw_file_marker.cc.
1291
1292 Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
1293 (cherry picked from commit a2c34c597371809bd8fd40ee1fc6b8e6a5145609)
1294 Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
1295
1296 commit 60ff142c8e8ed8fb294f7d13a5461f070aa1ff4f
1297 Merge: f1776bc788 7efa91c7ce
1298 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1299 Date: Thu Nov 9 10:10:53 2017 +0100
1300
1301 Merge pull request #18800 from linuxbox2/luminous-rgw_file-fsid-mount
1302
1303 Luminous rgw file fsid mount -- pullup 1 of 2
1304
1305 Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
1306
1307 commit f1776bc7887d2245e632d5a89189294a823ff3b2
1308 Merge: 2d3c14e5b8 f7dd3be6b7
1309 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1310 Date: Thu Nov 9 10:04:08 2017 +0100
1311
1312 Merge pull request #18767 from smithfarm/wip-22020-luminous
1313
1314 luminous: multisite: race between sync of bucket and bucket instance metadata
1315
1316 Reviewed-By: Casey Bodley <cbodley@redhat.com>
1317
1318 commit 2d3c14e5b88c773548af61312438a69dcb454726
1319 Merge: 2bad0ac00c 36e214c67b
1320 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1321 Date: Thu Nov 9 09:56:16 2017 +0100
1322
1323 Merge pull request #18794 from theanalyst/wip-18709
1324
1325 luminous: rgw: Stale bucket index entry remains after object deletion
1326
1327 Reviewed-By: Casey Bodley <cbodley@redhat.com>
1328
1329 commit 2bad0ac00c898d50c9c036400b4fba09918fb331
1330 Merge: 9787509155 f81e6dc8ab
1331 Author: Kefu Chai <tchaikov@gmail.com>
1332 Date: Wed Nov 8 18:19:27 2017 +0800
1333
1334 Merge pull request #18726 from shinobu-x/wip-luminous-22035
1335
1336 luminous: Spurious ceph-mgr failovers during mon elections
1337
1338 Reviewed-by: John Spray <john.spray@redhat.com>
1339
1340 commit 9787509155df02bd9df21f389968f77d3de2d988
1341 Merge: 0c3e9e6aab 7e08cdf539
1342 Author: Kefu Chai <tchaikov@gmail.com>
1343 Date: Wed Nov 8 18:18:39 2017 +0800
1344
1345 Merge pull request #18738 from shinobu-x/wip-21547-luminous
1346
1347 luminous: ceph-mgr gets process called "exe" after respawn
1348
1349 Reviewed-by: John Spray <john.spray@redhat.com>
1350
1351 commit 0c3e9e6aab5cfbd3d8e998b148e19bab30f3fa0e
1352 Merge: 628e76fe2a ed4a692254
1353 Author: Kefu Chai <tchaikov@gmail.com>
1354 Date: Wed Nov 8 18:17:54 2017 +0800
1355
1356 Merge pull request #18727 from shinobu-x/wip-luminous-22034
1357
1358 luminous: key mismatch for mgr after upgrade from jewel to luminous(dev)
1359
1360 Reviewed-by: John Spray <john.spray@redhat.com>
1361
1362 commit 628e76fe2a939aae4996f43e9e9c9f7d1269e0bb
1363 Merge: ef5264afc9 be5363a771
1364 Author: Kefu Chai <tchaikov@gmail.com>
1365 Date: Wed Nov 8 14:44:41 2017 +0800
1366
1367 Merge pull request #18723 from shinobu-x/wip-luminous-22023
1368
1369 luminous: osd: make stat_bytes and stat_bytes_used counters PRIO_USEFUL
1370
1371 commit ef5264afc992d78c1b34c8a96a43216191fa5406
1372 Merge: a0a2d27c1e 31c56c6e6b
1373 Author: Kefu Chai <tchaikov@gmail.com>
1374 Date: Wed Nov 8 14:38:10 2017 +0800
1375
1376 Merge pull request #18737 from shinobu-x/wip-21549-luminous
1377
1378 luminous: the dashboard uses absolute links for filesystems and clients
1379
1380 Reviewed-by: John Spray <john.spray@redhat.com>
1381
1382 commit a0a2d27c1e40280ae214696dbf5c25567c28ba38
1383 Merge: 947cae47db 76ab4eba99
1384 Author: Kefu Chai <tchaikov@gmail.com>
1385 Date: Wed Nov 8 14:37:19 2017 +0800
1386
1387 Merge pull request #18736 from shinobu-x/wip-21638-luminous
1388
1389 luminous: dashboard OSD list has servers and osds in arbitrary order
1390
1391 Reviewed-by: John Spray <john.spray@redhat.com>
1392
1393 commit 947cae47db9f5dc6d77a85834515670e20b5faf8
1394 Merge: 2e11e6662a e14de28f9e
1395 Author: Kefu Chai <tchaikov@gmail.com>
1396 Date: Wed Nov 8 14:36:40 2017 +0800
1397
1398 Merge pull request #18728 from shinobu-x/wip-luminous-22032
1399
1400 luminous: dashboard barfs on nulls where it expects numbers
1401
1402 Reviewed-by: John Spray <john.spray@redhat.com>
1403
1404 commit 2e11e6662ae167276ece7a96783f02a24fc1f89f
1405 Merge: 31afe858a9 cd18f84304
1406 Author: Kefu Chai <tchaikov@gmail.com>
1407 Date: Wed Nov 8 14:34:35 2017 +0800
1408
1409 Merge pull request #18699 from shinobu-x/wip-luminous-21538
1410
1411 luminous: upmap does not respect osd reweights
1412
1413 Reviewed-by: Sage Weil <sage@redhat.com>
1414
1415 commit 31afe858a96f1d5c67124b92f19cf4542df7e647
1416 Merge: d9df23cf3a 388b5016d9
1417 Author: Kefu Chai <tchaikov@gmail.com>
1418 Date: Wed Nov 8 14:30:42 2017 +0800
1419
1420 Merge pull request #18719 from tchaikov/wip-pr-18373-luminous
1421
1422 luminous: osd,mon: add max-pg-per-osd limit
1423
1424 Reviewed-by: Sage Weil <sage@redhat.com>
1425
1426 commit 388b5016d981c9dd98b6505b2d75b0220cfee772
1427 Author: Kefu Chai <kchai@redhat.com>
1428 Date: Wed Oct 18 16:07:50 2017 +0800
1429
1430 doc: fix the desc of "osd max pg per osd hard ratio"
1431
1432 Signed-off-by: Kefu Chai <kchai@redhat.com>
1433 (cherry picked from commit d940f6220346ad21dfc4f351c57389e8430c0257)
1434
1435 commit 04852a400483b6459985be80a7773ef153c04b1e
1436 Author: Kefu Chai <kchai@redhat.com>
1437 Date: Tue Oct 17 12:17:09 2017 +0800
1438
1439 mon: change "mon_pg_warn_min_per_osd" to uint64_t
1440
1441 * this silences a warning from -Wsign-compare.
1442 * also switch all its user to the new-style option
1443
1444 Signed-off-by: Kefu Chai <kchai@redhat.com>
1445 (cherry picked from commit c3cd0c13a1585388df0f17ab53c170e39c711615)
1446
1447 commit d9df23cf3aa002315e15db46d195be7d5657f9d0
1448 Merge: 567c29f964 53096755c0
1449 Author: Sage Weil <sage@newdream.net>
1450 Date: Tue Nov 7 22:27:15 2017 -0600
1451
1452 Merge pull request #18702 from liewegas/wip-pr-18670-luminous
1453
1454 luminous: qa/tasks/thrashosds: set min_in default to 4
1455
1456 commit 567c29f96461901bd86d4c2d4f84f7b84342837f
1457 Merge: 77c2b0de60 8cbb2eb937
1458 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1459 Date: Tue Nov 7 22:28:58 2017 +0100
1460
1461 Merge pull request #18596 from smithfarm/wip-21955-luminous
1462
1463 luminous: tests: add EC data pool to testing
1464
1465 Reviewed-By: Patrick Donelly <pdonelly@redhat.com>
1466
1467 commit 7efa91c7ced61f0fde81adfc0540a36fafafb10d
1468 Author: Gui Hecheng <guihecheng@cmss.chinamobile.com>
1469 Date: Sat Jul 22 13:12:06 2017 +0800
1470
1471 rgw_file: introduce rgw_mount2 with a bucket name parameter
1472
1473 This explicitly allow mount a specified bucket in librgw.
1474 Originally, mounting a bucket is implemented like a sub-directory
1475 mount in nfs-ganesha FSAL_RGW with lookup_path.
1476 With this change, we allow root_fh to points exactly to the root
1477 of a mounted fs instance, which is a bucket or "/" rather than
1478 always let root_fh points to "/".
1479
1480 Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
1481 (cherry picked from commit 860716e17e840df11a7e1d8b6ca0c1ee694b038b)
1482
1483 commit b53c3948a5e48623bb437b2d36718ce3a799aa54
1484 Author: Gui Hecheng <guihecheng@cmss.chinamobile.com>
1485 Date: Fri May 26 17:45:29 2017 +0800
1486
1487 rgw_file: new fsid for fs instance
1488
1489 We use an in-memory fs_inst_counter for fsid currently, but it
1490 inevitably cause nfs automount problem across a nfs-ganesha crash.
1491 So here we relate the fsid to the s3 uid with a hash.
1492 With this, fsid remains consistent across all fs instances and
1493 across crashes.
1494
1495 We should be able to upgrade from old fsid to new fsid with
1496 update_fh().
1497
1498 Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
1499 (cherry picked from commit 178b547e83a2c0eeb024bbe4ca2ff8d8e7d50572)
1500
1501 commit 77c2b0de6042707b42d6e717e90a525fda8ead76
1502 Merge: 14e0530f50 555746a09e
1503 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1504 Date: Tue Nov 7 22:07:45 2017 +0100
1505
1506 Merge pull request #18628 from batrick/i21953
1507
1508 luminous: mds: sanitize mdsmap of removed pools
1509
1510 Reviewed-By: Sage Weil <sage@redhat.com>
1511
1512 commit 14e0530f50cd5fba46da914cdd09489f13adb2ec
1513 Merge: bc9f508477 c2237c7c6d
1514 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1515 Date: Tue Nov 7 18:33:21 2017 +0100
1516
1517 Merge pull request #18626 from dillaman/wip-21968
1518
1519 luminous: cls/journal: fixed possible infinite loop in expire_tags
1520
1521 Reviewed-By: Mykola Golub <trociny@gmail.com>
1522
1523 commit bc9f5084778607c95dcbc93ea60ce296e8e8ee88
1524 Merge: 6bc121ddee 1aeec0c032
1525 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1526 Date: Tue Nov 7 18:32:20 2017 +0100
1527
1528 Merge pull request #18688 from liewegas/wip-balancer-luminous
1529
1530 luminous: mgr/balancer: backport crush-compat work from master
1531
1532 Reviewed-By: John Spray <jspray@redhat.com>
1533
1534 commit 36e214c67b6982cc7a85e08dedc83ea61e56d6a4
1535 Author: J. Eric Ivancich <ivancich@redhat.com>
1536 Date: Fri Nov 3 09:15:13 2017 -0400
1537
1538 rgw: fix BZ 1500904, Stale bucket index entry remains after object deletion
1539
1540 We have a race condition:
1541
1542 1. RGW client #1: requests an object be deleted.
1543 2. RGW client #1: sends a prepare op to bucket index OSD #1.
1544 3. OSD #1: prepares the op, adding pending ops to the bucket dir entry
1545 4. RGW client #2: sends a list bucket to OSD #1
1546 5. RGW client #2: sees that there are pending operations on bucket
1547 dir entry, and calls check_disk_state
1548 6. RGW client #2: check_disk_state sees that the object still exists, so it
1549 sends CEPH_RGW_UPDATE to bucket index OSD (#1)
1550 7. RGW client #1: sends a delete object to object OSD (#2)
1551 8. OSD #2: deletes the object
1552 9. RGW client #2: sends a complete op to bucket index OSD (#1)
1553 10. OSD #1: completes the op
1554 11. OSD #1: receives the CEPH_RGW_UPDATE and updates the bucket index
1555 entry, thereby **RECREATING** it
1556
1557 Solution implemented:
1558
1559 At step #5 the object's dir entry exists. If we get to beginning of
1560 step #11 and the object's dir entry no longer exists, we know that the
1561 dir entry was just actively being modified, and ignore the
1562 CEPH_RGW_UPDATE operation, thereby NOT recreating it.
1563
1564 Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
1565 (cherry picked from commit b33f529e79b74314a2030231e1308ee225717743)
1566
1567 commit 6bc121ddeec4b12c91ae5ac982ad113bda14d2bf
1568 Merge: ee27efad8b f26f3dc842
1569 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1570 Date: Tue Nov 7 18:21:41 2017 +0100
1571
1572 Merge pull request #18569 from kmroz/wip-21939-luminous
1573
1574 luminous: list bucket which enable versioning get wrong result when user marker
1575
1576 Reviewed-By: Casey Bodley <cbodley@redhat.com>
1577
1578 commit ee27efad8ba4d751828dd73012de12ab16c2f78d
1579 Merge: 601249c6aa a340f1acab
1580 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1581 Date: Tue Nov 7 18:21:03 2017 +0100
1582
1583 Merge pull request #18591 from cbodley/wip-21938
1584
1585 luminous: rgw: fix error handling in ListBucketIndexesCR
1586 (approved in irc & standups)
1587
1588 Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
1589
1590 commit 601249c6aa154d0f9e53332480ac45b5730fb503
1591 Merge: d2226d5adb 15a52ba832
1592 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1593 Date: Tue Nov 7 18:17:57 2017 +0100
1594
1595 Merge pull request #18539 from linuxbox2/luminous-baixuyeyu-refcnt
1596
1597 luminous: baixuyeyu refcnt
1598
1599 Reviewed-By: Casey Bodley <cbodley@redhat.com>
1600
1601 commit d2226d5adbb4752e0180dfa3406e188bd3b37d6e
1602 Merge: 925c68e9e9 902d467a0e
1603 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1604 Date: Tue Nov 7 18:15:38 2017 +0100
1605
1606 Merge pull request #18516 from ceph/wip-bp-pr18193-luminous
1607
1608 qa/rgw: ignore errors from 'pool application enable'
1609
1610 Reviewed-By: Nathan Cutler <ncutler@suse.com>
1611 Reviewed-By: Casey Bodley <cbodley@redhat.com>
1612
1613 commit 925c68e9e9538a97f98bef1e5a884d31811aa229
1614 Merge: 2f35da4e60 add8c3db19
1615 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1616 Date: Tue Nov 7 18:14:21 2017 +0100
1617
1618 Merge pull request #18599 from linuxbox2/lum-rgwfile-21940
1619
1620 rgw_file: set s->obj_size from bytes_written
1621
1622 Reviewed-By: Casey Bodley <cbodley@redhat.com>
1623
1624 commit 2f35da4e60c2b5fd2f45348587a5b175868d04d7
1625 Merge: b2961db15d 26c523c3be
1626 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1627 Date: Tue Nov 7 13:07:09 2017 +0100
1628
1629 Merge pull request #18566 from kmroz/wip-21914-luminous
1630
1631 luminous: [rbd-mirror] peer cluster connections should filter out command line optionals
1632
1633 Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
1634
1635 commit 8e3227ad51fa4909a39eb0d05798b48200a03fc5
1636 Author: Kefu Chai <kchai@redhat.com>
1637 Date: Tue Oct 17 12:10:55 2017 +0800
1638
1639 osd,mon: change "mon_max_pg_per_osd" to uint64_t
1640
1641 as it should never be a negative number. if this option is disabled,
1642 it's 0.
1643
1644 Signed-off-by: Kefu Chai <kchai@redhat.com>
1645 (cherry picked from commit 0d68197376b6cf48c6679d77ec9f28f279f3da68)
1646
1647 commit ae7823187186310bac117fac437d991398cffd5e
1648 Author: Kefu Chai <kchai@redhat.com>
1649 Date: Tue Sep 26 15:54:14 2017 +0800
1650
1651 osd: add max-pg-per-osd limit
1652
1653 osd will refused to create new pgs, until its pg number is lower
1654 than the max-pg-per-osd upper bound setting.
1655
1656 Signed-off-by: Kefu Chai <kchai@redhat.com>
1657 (cherry picked from commit 4c7df944c7f28232873ba681eedce72cdb062ea5)
1658
1659 commit 1db44c5bef752b3a6ce59ea21548b54b77b587d2
1660 Author: Kefu Chai <kchai@redhat.com>
1661 Date: Sun Oct 15 20:46:28 2017 +0800
1662
1663 qa/tasks/ceph: add "create_rbd_pool" option
1664
1665 True by default, but we can opt not to create the "rbd" pool.
1666
1667 Signed-off-by: Kefu Chai <kchai@redhat.com>
1668 (cherry picked from commit ac1e13ce63a6f32ae9ab0db8196c8cc8100d94ed)
1669
1670 commit ed34b00566f9b1b65c09989af44ad24cdb27fbdc
1671 Author: Kefu Chai <kchai@redhat.com>
1672 Date: Thu Oct 12 20:07:46 2017 +0800
1673
1674 osd: print osd as "osd.$osdid" in log message
1675
1676 easier to read this way
1677
1678 Signed-off-by: Kefu Chai <kchai@redhat.com>
1679 (cherry picked from commit c6b71ebf6b7b7c54560f331d5f8e4e24f5a60633)
1680
1681 commit df611786d2882e346075f5a32aef46bea3c36d47
1682 Author: Kefu Chai <kchai@redhat.com>
1683 Date: Tue Sep 26 15:50:08 2017 +0800
1684
1685 mon/OSDMonitor: bypass checks if pg_temp.forced
1686
1687 originally, monitor ignores the pg_temp messages sent from replica osds,
1688 but to re-trigger peering if replica osd's pg number drops down below
1689 the setting, we need to bypass the checks.
1690
1691 Signed-off-by: Kefu Chai <kchai@redhat.com>
1692 (cherry picked from commit da6f7a810055a0dc9e364aca8e6efbfbc32881b3)
1693
1694 commit aefc9315ed6ebbf209d4496b0fb33c72dc107961
1695 Author: Kefu Chai <kchai@redhat.com>
1696 Date: Tue Sep 26 15:49:11 2017 +0800
1697
1698 messages/MOSDPGTemp: add `forced` field
1699
1700 the monitor is supposed to bypass some checks if `forced` is true.
1701
1702 Signed-off-by: Kefu Chai <kchai@redhat.com>
1703 (cherry picked from commit 6335bf791003e9e33b2f738ab3da06f3c626537a)
1704
1705 commit b2961db15dd7528019df7990f8f7690ae3a95aa9
1706 Merge: a5899a57e4 4cac43679a
1707 Author: Kefu Chai <tchaikov@gmail.com>
1708 Date: Tue Nov 7 17:48:34 2017 +0800
1709
1710 Merge pull request #18775 from tchaikov/wip-upgrade-luminous-x
1711
1712 qa: add 1-ceph-install to upgrade:luminous-x
1713
1714 Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
1715 Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
1716
1717 commit 4cac43679a7688cb4765728e1a75e812d0df22de
1718 Author: Yuri Weinstein <yweinste@redhat.com>
1719 Date: Tue Aug 29 09:50:51 2017 -0700
1720
1721 qa: add 1-ceph-install to upgrade:luminous-x
1722
1723 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
1724 (cherry picked from commit aff342627cf77e2faae6904e626d9fb2c897f155)
1725
1726 commit 1aeec0c0326678bcdba7ee0a6a1204f460e3ddf7
1727 Author: Sage Weil <sage@redhat.com>
1728 Date: Mon Nov 6 21:17:22 2017 -0600
1729
1730 qa/suites/rados/thrash/d-*/*balancer*: debug osd in mgr
1731
1732 Signed-off-by: Sage Weil <sage@redhat.com>
1733
1734 commit f7dd3be6b7804035b47d2e6fb94463f0bc772bbe
1735 Author: Casey Bodley <cbodley@redhat.com>
1736 Date: Tue Oct 31 16:56:01 2017 -0400
1737
1738 rgw: remove placement_rule from cls_user_bucket_entry
1739
1740 placement_rule is no longer needed in cls_user_bucket_entry, because the
1741 only time that it's needed, we can read it from the bucket instance in
1742 RGWRados::update_containers_stats()
1743
1744 Signed-off-by: Casey Bodley <cbodley@redhat.com>
1745 (cherry picked from commit 8e62e3526643da67f5af7daa687120feed469785)
1746
1747 commit 17cc13b87b5378bf03e2b0b52c274772ebaf08ef
1748 Author: Casey Bodley <cbodley@redhat.com>
1749 Date: Tue Oct 31 16:29:31 2017 -0400
1750
1751 rgw: remove placement_rule from rgw_link_bucket()
1752
1753 with the fallback in RGWRados::update_containers_stats(), we no longer
1754 need to pass placement_rule into the cls_user_bucket_entry
1755
1756 this removes the dependency between bucket entrypoint metadata and its
1757 bucket instance metadata during multisite sync
1758
1759 Fixes: http://tracker.ceph.com/issues/21990
1760
1761 Signed-off-by: Casey Bodley <cbodley@redhat.com>
1762 (cherry picked from commit dd5d278a4f9b080234cbb77e448208803ec0cf93)
1763
1764 commit 338248a8b376074c0f43b626e9f69fc59ee26487
1765 Author: Casey Bodley <cbodley@redhat.com>
1766 Date: Tue Oct 31 16:26:54 2017 -0400
1767
1768 rgw: take placement_rule from bucket info in update_containers_stats
1769
1770 in case the cls_user_bucket_entry doesn't contain a placement_rule, take
1771 it from the bucket instance info
1772
1773 Signed-off-by: Casey Bodley <cbodley@redhat.com>
1774 (cherry picked from commit 531195d80d5bac774d58b210307eb19b57d26345)
1775
1776 commit 975229c3674ce99704aef399ecfb770cc8bcf1da
1777 Author: Chang Liu <liuchang0812@gmail.com>
1778 Date: Tue Oct 3 00:12:43 2017 +0800
1779
1780 tool: ceph-kvstore-tool doesn't umount BlueStore properly
1781
1782 Fixes: http://tracker.ceph.com/issues/21625
1783
1784 Signed-off-by: Chang Liu <liuchang0812@gmail.com>
1785 (cherry picked from commit 81e4560781c4e5a5a033bfd4a4fe4094fc27d964)
1786
1787 commit 4d4aee14a46ed36cdb40c0ff67193c8650b106da
1788 Author: Chang Liu <liuchang0812@gmail.com>
1789 Date: Tue Oct 3 00:01:43 2017 +0800
1790
1791 os/bluestore: make BlueStore opened by start_kv_only umountable
1792
1793 ceph-kvstore-tool use start_kv_only to debug the kvstore. we
1794 will get a crash when we try to umount bluestore in kvstore-tool.
1795
1796 Fixes: http://tracker.ceph.com/issues/21624
1797
1798 Signed-off-by: Chang Liu <liuchang0812@gmail.com>
1799 (cherry picked from commit 2754c5acad442e50d97c8daf648cfcadd38222a6)
1800
1801 commit 3f7eadb79f4bb0a2fe25b229c24b652e7dcbaf00
1802 Author: Sage Weil <sage@redhat.com>
1803 Date: Sat Nov 4 09:32:51 2017 -0500
1804
1805 qa/suites/rados/thrash: combine balancer with require-luminous
1806
1807 We can only do the balancer stuff if we've done the mkfs-time
1808 require luminous because otherwise the mgr commands aren't proxied via
1809 the mon.
1810
1811 Only do balancer for thrash tests; not for basic, monthrash, verify.
1812
1813 Signed-off-by: Sage Weil <sage@redhat.com>
1814
1815 commit 8a7f983f3322b62cb18421c088e652341125eb1f
1816 Author: Kefu Chai <kchai@redhat.com>
1817 Date: Wed Nov 1 10:45:09 2017 +0800
1818
1819 qa: stop testing deprecated "ceph osd create"
1820
1821 "ceph osd create" is not idempotent, and is considered deprecated.
1822
1823 Fixes: http://tracker.ceph.com/issues/21993
1824 Signed-off-by: Kefu Chai <kchai@redhat.com>
1825 (cherry picked from commit 371d3f40911917704f4992c48236b4c60905bf4e)
1826
1827 commit 7e08cdf53992570d27b47d0028c698b78908ba83
1828 Author: John Spray <john.spray@redhat.com>
1829 Date: Fri Sep 15 12:23:39 2017 -0400
1830
1831 mgr: set explicit thread name
1832
1833 This gets used as our process name in some situations
1834 when respawning. This is the same as what commit 4f177bb6b
1835 did for the MDS.
1836
1837 Fixes: http://tracker.ceph.com/issues/21404
1838 Signed-off-by: John Spray <john.spray@redhat.com>
1839 (cherry picked from commit 44dce0a5664639b2ae0949cc434f1be1176d872d)
1840
1841 commit 31c56c6e6b50b44fef56852e58ab97520ee8614a
1842 Author: Nick Erdmann <n@nirf.de>
1843 Date: Tue Aug 22 16:55:11 2017 +0000
1844
1845 pybind/mgr/dashboard: updated favicon (old one was 404)
1846
1847 Signed-off-by: Nick Erdmann <n@nirf.de>
1848 (cherry picked from commit 7a54520f5c3d4db27fe7e2a12760dcd838ba89aa)
1849
1850 commit d822c15af9b838dc2eea08b5f13f1dba785d776e
1851 Author: Nick Erdmann <n@nirf.de>
1852 Date: Tue Aug 22 08:08:45 2017 +0000
1853
1854 pybind/mgr/dashboard: clean up
1855
1856 Signed-off-by: Nick Erdmann <n@nirf.de>
1857 (cherry picked from commit f512ac3d7712850f274cd01bb589aa9fbc8c8bef)
1858
1859 commit 1f47cc0b53f7e20e156f74b28502c7705ddb4700
1860 Author: Nick Erdmann <n@nirf.de>
1861 Date: Mon Aug 21 17:21:10 2017 +0000
1862
1863 pybind/mgr/dashboard: add url_prefix
1864
1865 This adds a configuration variable url_prefix to the dashboard that
1866 that is prepended to all URLs so you can access the dashboard at
1867 http://$IP:$PORT/$PREFIX/. This is necessary if you wish to use a
1868 reverse http proxy that forwards to the dashboard under a sub-path.
1869
1870 Fixes: http://tracker.ceph.com/issues/20568
1871 Signed-off-by: Nick Erdmann <n@nirf.de>
1872 (cherry picked from commit 6d285fff0df598d66f46d38bf0a6a2cc9c0dc62f)
1873
1874 commit 76ab4eba99785edf01c8ff9464d997b2ec691b31
1875 Author: John Spray <john.spray@redhat.com>
1876 Date: Wed Sep 27 15:13:48 2017 +0100
1877
1878 mgr/dashboard: sort servers and OSDs in OSD list
1879
1880 Fixes: http://tracker.ceph.com/issues/21572
1881 Signed-off-by: John Spray <john.spray@redhat.com>
1882 (cherry picked from commit f409099fa25b73fe580ee4662aff51636f118ed2)
1883
1884 commit 8cacd2a568fca023a51f3be6e20f90b4ec08c82b
1885 Author: John Spray <john.spray@redhat.com>
1886 Date: Sat Sep 23 15:22:34 2017 +0100
1887
1888 mgr/zabbix: log exceptions with backtrace
1889
1890 Logging just the exception object gave a sometimes-enigmatic
1891 single line. Let's use the logger exception method so that
1892 we get a backtrace.
1893
1894 Signed-off-by: John Spray <john.spray@redhat.com>
1895 (cherry picked from commit 316dcc8f0b42b85503632d5472c45c9828882f2c)
1896
1897 commit 06706bea9339e26d1a0ab395e9d42d391ee8c03c
1898 Author: John Spray <john.spray@redhat.com>
1899 Date: Sat Sep 23 15:18:18 2017 +0100
1900
1901 mgr/zabbix: fix div by zero
1902
1903 Fixes: http://tracker.ceph.com/issues/21518
1904 Signed-off-by: John Spray <john.spray@redhat.com>
1905 (cherry picked from commit 9c02738b4ea0303f5b3cbfc4748d6791007be834)
1906
1907 commit a5899a57e4f077f4061fc2aa33a61377de7ac025
1908 Merge: 52f66ef5ba 35de92b259
1909 Author: Sage Weil <sage@newdream.net>
1910 Date: Sat Nov 4 10:52:27 2017 -0500
1911
1912 Merge pull request #18673 from dzafman/wip-21833
1913
1914 osd: build_past_intervals_parallel: Ignore new partially created PGs
1915
1916 commit e14de28f9e524575c633dc98c6ebb9a234c8d1c5
1917 Author: John Spray <john.spray@redhat.com>
1918 Date: Wed Sep 27 14:33:58 2017 +0100
1919
1920 mgr/dashboard: handle null in format_number
1921
1922 Fixes: http://tracker.ceph.com/issues/21570
1923 Signed-off-by: John Spray <john.spray@redhat.com>
1924 (cherry picked from commit f43859d4dca696ba4cac224e0c7e87e4b2aad40f)
1925
1926 commit ed4a692254e71ce7b30566dfd6d16e8a070b3461
1927 Author: John Spray <john.spray@redhat.com>
1928 Date: Thu Oct 19 09:28:18 2017 -0400
1929
1930 mon: don't blow away bootstrap-mgr on upgrades
1931
1932 Fixes: http://tracker.ceph.com/issues/20950
1933 Signed-off-by: John Spray <john.spray@redhat.com>
1934 (cherry picked from commit 57229ea2a4369518c7a16b7a09b045b7896f5a70)
1935
1936 commit f81e6dc8abe3535a54cbf683992c95c4eaf4e186
1937 Author: John Spray <john.spray@redhat.com>
1938 Date: Thu Oct 12 11:57:50 2017 +0100
1939
1940 mon: handle monitor lag when killing mgrs
1941
1942 Fixes: http://tracker.ceph.com/issues/20629
1943 Signed-off-by: John Spray <john.spray@redhat.com>
1944 (cherry picked from commit 3c3776b30a2da3f5d2ece15c57713c0ce191c778)
1945
1946 commit be5363a771172d3260049b0012519b485e4d728e
1947 Author: Yao Zongyou <yaozongyou@vip.qq.com>
1948 Date: Tue Oct 31 13:23:49 2017 +0800
1949
1950 osd: make stat_bytes and stat_bytes_used counters PRIO_USEFUL
1951
1952 These two counters should be reported to mgr because the dashboard
1953 plugin needing them to display osd detailed information.
1954
1955 Fixes: http://tracker.ceph.com/issues/21981
1956
1957 Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
1958 (cherry picked from commit 40bb3c5f05b6f2a917a7e400f88677f41a9629a3)
1959
1960 commit 77766609d808a974aafdff359dadc46af5bd26f4
1961 Author: Sage Weil <sage@redhat.com>
1962 Date: Thu Nov 2 16:18:03 2017 -0500
1963
1964 pybind/mgr/mgr_module: fix calc_pg_upmaps
1965
1966 This was fixed in the object cleanup.
1967
1968 Signed-off-by: Sage Weil <sage@redhat.com>
1969 (cherry picked from commit ed442164d52c803916ca43a5ed76047089d3da66)
1970
1971 commit 56c27e6be813e6a8b972733468eb099596ff7381
1972 Author: Sage Weil <sage@redhat.com>
1973 Date: Thu Nov 2 16:11:26 2017 -0500
1974
1975 mgr/balancer: enable module by default
1976
1977 It will still be "off".
1978
1979 Signed-off-by: Sage Weil <sage@redhat.com>
1980 (cherry picked from commit 26710f0a9b176289237a52e5fa5894342ad163dc)
1981
1982 commit 53096755c02d953867d0fff3e08bc3a62d872ec6
1983 Author: Sage Weil <sage@redhat.com>
1984 Date: Wed Nov 1 08:31:31 2017 -0500
1985
1986 qa/tasks/thrashosds: set min_in default to 4
1987
1988 We have EC tests with k=2,m=2, so we need a min of 4.
1989
1990 Fixes: http://tracker.ceph.com/issues/21997
1991 Signed-off-by: Sage Weil <sage@redhat.com>
1992 (cherry picked from commit d21809b14ea58dc1f44df844e407ebab5a315062)
1993
1994 commit 52f66ef5ba291fccc265fd7a34a4eae201667153
1995 Merge: 1b00bdfeef e58656005d
1996 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
1997 Date: Fri Nov 3 10:26:44 2017 +0100
1998
1999 Merge pull request #18446 from theanalyst/wip-21854-luminous
2000
2001 luminous: rgw_file: explicit NFSv3 open() emulation
2002
2003 Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2004 Reviewed-By: Matt Benjamin <mbenjamin@redhat.com>
2005
2006 commit cd18f84304124e1341516194fb73c8bde48db445
2007 Author: Theofilos Mouratidis <t.mour@cern.ch>
2008 Date: Mon Sep 25 16:17:47 2017 +0200
2009
2010 osd: upmap should respect osd reweights
2011
2012 Modify OSDMap::calc_pg_upmaps to take the osd reweight into account when
2013 computing the size of each OSD.
2014
2015 Signed-off-by: Theofilos Mouratidis <t.mour@cern.ch>
2016 Fixes: http://tracker.ceph.com/issues/21538
2017 (cherry picked from commit b8561cefa705d31954d47723125376a3c087f4f4)
2018
2019 commit 03a11694feee0d78dcc1f296a77200635a651707
2020 Author: Theofilos Mouratidis <t.mour@cern.ch>
2021 Date: Mon Sep 25 16:15:45 2017 +0200
2022
2023 test/cli/osdmaptool: test upmap with an out osd
2024
2025 Test upmap with one osd marked out.
2026
2027 Signed-off-by: Theofilos Mouratidis <t.mour@cern.ch>
2028 (cherry picked from commit ff9e024a59d87eda6cbf3be9464ee7ae6f1140d7)
2029
2030 commit 2c7972d3a4928cec039e8637048c26e94c6278d2
2031 Author: Theofilos Mouratidis <t.mour@cern.ch>
2032 Date: Mon Sep 25 16:14:09 2017 +0200
2033
2034 osdmaptool: add --mark-out option
2035
2036 Add a --mark-down <id> option which sets the reweight for a given
2037 osd id to 0.0.
2038
2039 Signed-off-by: Theofilos Mouratidis <t.mour@cern.ch>
2040 (cherry picked from commit bd75a78187143f750f90fb937984eaa6333159d3)
2041
2042 commit 1b00bdfeefd7b724f14634383ae4baaf7a42c996
2043 Merge: c6052f2706 92d0545781
2044 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
2045 Date: Thu Nov 2 21:23:50 2017 +0100
2046
2047 Merge pull request #18439 from theanalyst/wip-21655-luminous
2048
2049 luminous: expose --sync-stats via admin api
2050
2051 Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2052 Reviewed-By: Casey Bodley <cbodley@redhat.com>
2053
2054 commit 282e21bd07c3dfb5d18f338abd3ced4f4eeaa247
2055 Author: Sage Weil <sage@redhat.com>
2056 Date: Fri Oct 27 12:53:52 2017 -0500
2057
2058 mgr/balancer: simplify pool_info tracking
2059
2060 Signed-off-by: Sage Weil <sage@redhat.com>
2061 (cherry picked from commit a59a1df85382d559362c51bb45284b61caaca1d4)
2062
2063 commit e2346f539f477a4b7a4685828876eb89c84ad00d
2064 Author: Sage Weil <sage@redhat.com>
2065 Date: Wed Oct 25 22:47:02 2017 -0500
2066
2067 mgr/balancer: less verbose on 'eval' by default; add 'eval-verbose'
2068
2069 The verbose output is helpful for debugging and understanding what is
2070 being measured, but most of the time all that you care about is the score.
2071
2072 Signed-off-by: Sage Weil <sage@redhat.com>
2073 (cherry picked from commit 2c300bc8d7189b464f59c93deb5eb56915df62b8)
2074
2075 commit 64d75fa26d3ceb6ccdbee3b31b3705c4db2fc59f
2076 Author: Sage Weil <sage@redhat.com>
2077 Date: Sat Oct 21 10:46:27 2017 -0500
2078
2079 mgr/balancer: fix pg vs object terminology
2080
2081 Signed-off-by: Sage Weil <sage@redhat.com>
2082 (cherry picked from commit 6513e8b0fc2ebcbbbda937ec6d533ea084ef278f)
2083
2084 commit 6082f53391a46076bda1b5d56685d928acd2cd4b
2085 Author: Sage Weil <sage@redhat.com>
2086 Date: Tue Oct 24 17:12:54 2017 -0500
2087
2088 mgr/balancer: restrict to time of day
2089
2090 Signed-off-by: Sage Weil <sage@redhat.com>
2091 (cherry picked from commit 3f0b50b50aeb34ed39767289b8475ec5b877cc27)
2092
2093 commit 91b84cb24466f84ce3e189e08f8cba1e2900a4cc
2094 Author: Sage Weil <sage@redhat.com>
2095 Date: Thu Oct 5 17:31:06 2017 -0500
2096
2097 mgr/module: adjust osd_weight min step to .005
2098
2099 That should be ~1 PG or less on average; no real sense it taking a
2100 step smaller than that!
2101
2102 Signed-off-by: Sage Weil <sage@redhat.com>
2103 (cherry picked from commit 297e2d65abcebe45c6be69a768cf3ea98e1b354d)
2104
2105 commit acbf539d326403b6249ed0e2b0ca5ffc4a52152d
2106 Author: Sage Weil <sage@redhat.com>
2107 Date: Thu Oct 5 17:26:16 2017 -0500
2108
2109 mgr/balancer: if score regresses, take a few more steps
2110
2111 To avoid getting stuck in a local minima, take a few additional
2112 steps if our score drops and see if it gets better.
2113
2114 Signed-off-by: Sage Weil <sage@redhat.com>
2115 (cherry picked from commit 70b503495a0ceb7d1aa4f5fce4403a8eff9a03b5)
2116
2117 commit b9cc962adfd95304cbd56833bb84b827e5eed4d4
2118 Author: Sage Weil <sage@redhat.com>
2119 Date: Thu Oct 5 17:25:19 2017 -0500
2120
2121 mgr/balancer: allow 5% misplaced
2122
2123 Signed-off-by: Sage Weil <sage@redhat.com>
2124 (cherry picked from commit 1ad3101818d1855c8eea8386d7682fab2fe9c8b8)
2125
2126 commit 452962767b4f899c8c2589d01a6b8acc3cac9a69
2127 Author: Sage Weil <sage@redhat.com>
2128 Date: Thu Oct 5 17:25:06 2017 -0500
2129
2130 mgr/balancer: more aggressive steps
2131
2132 We are smart enough to back off if we misplace too much.
2133
2134 Signed-off-by: Sage Weil <sage@redhat.com>
2135 (cherry picked from commit 0dbcf737eaed02b5aa94bc6f27231b4b87f09ce5)
2136
2137 commit 901ae5920c590a2a83f30897b05017e001572e5f
2138 Author: Sage Weil <sage@redhat.com>
2139 Date: Sun Oct 1 16:00:06 2017 -0500
2140
2141 qa/suites/rados/thrash/d-balancer: enable balancer in various modes
2142
2143 Signed-off-by: Sage Weil <sage@redhat.com>
2144 (cherry picked from commit 2c9c18d1ec3d33d385adf2a30dc1d3b8e987f9a5)
2145
2146 commit a1ebe97886f7a578bc56a109f10a3d6149954087
2147 Author: Sage Weil <sage@redhat.com>
2148 Date: Wed Sep 27 17:05:05 2017 -0400
2149
2150 mgr/balancer: crush-compat: phase out osd_weights
2151
2152 Phase out the osd_weight values as we optimize the crush compat
2153 weight set. Allow a small regression in overall score if it means
2154 we are taking a step to remove the osd_weight value.
2155
2156 Fix the 'osd reweightn' invocation.
2157
2158 Signed-off-by: Sage Weil <sage@redhat.com>
2159 (cherry picked from commit 861c37fd99a76d5f1665a610224778fcbb41e9e1)
2160
2161 commit 72716f058cd132d836c3251b4e6d4b056bb4c0a8
2162 Author: Sage Weil <sage@redhat.com>
2163 Date: Wed Sep 27 15:12:54 2017 -0400
2164
2165 mgr/balancer: crush_compat: cope with 'out' osds
2166
2167 Signed-off-by: Sage Weil <sage@redhat.com>
2168 (cherry picked from commit c2bba5820a0bf2225dfc9ba39cc67c78083aba11)
2169
2170 commit c982848f32ed85639346931e86d331fb52458355
2171 Author: Sage Weil <sage@redhat.com>
2172 Date: Wed Sep 27 15:12:36 2017 -0400
2173
2174 mgr/balancer: stop if we get a perfect score
2175
2176 ..and fix the 'worse' threshold (we're just working around floating
2177 point imprecision; 1.01 was too coarse).
2178
2179 Signed-off-by: Sage Weil <sage@redhat.com>
2180 (cherry picked from commit f1f3014ffcc67200c20e6fb2b2e6e8f1141a0a1d)
2181
2182 commit 37ed6f218ba4fafd5360b8f62feb321a1feec56f
2183 Author: Sage Weil <sage@redhat.com>
2184 Date: Wed Sep 27 11:40:36 2017 -0400
2185
2186 mgr/balancer: more dead code
2187
2188 Signed-off-by: Sage Weil <sage@redhat.com>
2189 (cherry picked from commit 37bd64405b8a578329b9a903c9a53322ea29caaf)
2190
2191 commit b3dd7abc79fa3dff7768898caf814bcdfb8f8690
2192 Author: Sage Weil <sage@redhat.com>
2193 Date: Wed Sep 27 11:27:42 2017 -0400
2194
2195 mgr/balancer: crush-compat: throttle changes based on max_misplaced
2196
2197 Take smaller steps if we overshoot max_misplaced.
2198
2199 Signed-off-by: Sage Weil <sage@redhat.com>
2200 (cherry picked from commit df2e008d3388b657d62ea4547e6b1b7a0251aa04)
2201
2202 commit 25bfd12cf252dbba81f482fe9abe53959f992b4b
2203 Author: Sage Weil <sage@redhat.com>
2204 Date: Wed Sep 27 11:19:30 2017 -0400
2205
2206 mgr/balancer: remove dead code
2207
2208 Signed-off-by: Sage Weil <sage@redhat.com>
2209 (cherry picked from commit 020be37fd06a75ec86e05af966be318c2199da9f)
2210
2211 commit 1aff9dfadc148fb1cf9b60400c35bd11011772b2
2212 Author: Sage Weil <sage@redhat.com>
2213 Date: Wed Sep 27 11:19:23 2017 -0400
2214
2215 mgr/balancer: include pg up mapping in MappingState
2216
2217 Signed-off-by: Sage Weil <sage@redhat.com>
2218 (cherry picked from commit f6f2d253c379a6235e810808e7ce3b83cc4e212c)
2219
2220 commit 9121e73f639bd47310ee29dce69a4c105582a3ab
2221 Author: Sage Weil <sage@redhat.com>
2222 Date: Tue Sep 26 18:36:06 2017 -0400
2223
2224 mgr/balancer: normalize weight-set weights to sum to target weight
2225
2226 Signed-off-by: Sage Weil <sage@redhat.com>
2227 (cherry picked from commit 99fcd161bd222a4f0d2ddde0f1a4caecd1a78882)
2228
2229 commit 619ae53354aa5682aeb7d77d3795a323188dad1a
2230 Author: Sage Weil <sage@redhat.com>
2231 Date: Tue Sep 26 18:35:42 2017 -0400
2232
2233 mgr/balancer: note root id in Eval
2234
2235 Signed-off-by: Sage Weil <sage@redhat.com>
2236 (cherry picked from commit 26a7ec0c8a4c215791369d8650cd17d41317aefe)
2237
2238 commit afcce93591c7e5c53596cec03165033f049a0c63
2239 Author: Sage Weil <sage@redhat.com>
2240 Date: Tue Sep 26 18:00:08 2017 -0400
2241
2242 mgr/balancer: make crush-compat mode work!
2243
2244 - it does multiple iterations, like the upmap optimizer.
2245 - it decreases the step size if it isn't improving, in the hope
2246 that it is overshooting the minimum
2247 - debug output is cleaned up a bit (the info level should be
2248 genuinely useful)
2249
2250 Signed-off-by: Sage Weil <sage@redhat.com>
2251 (cherry picked from commit d9a31595ba15de5fda104a0154778e3200fc46a0)
2252
2253 commit c6052f2706ad6b7c92f9d6fa381527e8922b30c6
2254 Merge: 4e1eec777c 56359c367d
2255 Author: Sage Weil <sage@newdream.net>
2256 Date: Thu Nov 2 14:54:50 2017 -0500
2257
2258 Merge pull request #18590 from liewegas/wip-prime-fixes-luminous
2259
2260 luminous: ceph-bluestore-tool: prime-osd-dir: update symlinks instead of bailing
2261
2262 commit 4e1eec777cf194cdf9bd4db1e7c4672d5b2adac7
2263 Merge: 79736e781f 338af16881
2264 Author: Sage Weil <sage@newdream.net>
2265 Date: Thu Nov 2 14:54:18 2017 -0500
2266
2267 Merge pull request #18620 from tchaikov/wip-21527-luminous
2268
2269 luminous: mon/mgr: sync "mgr_command_descs","osd_metadata" and "mgr_metadata" prefixes to new mons
2270
2271 Reviewed-by: Nathan Cutler <ncutler@suse.com>
2272
2273 commit 79736e781fbd36083c639d3f4c22f8f3ae426cce
2274 Merge: 815d8ab573 9d8e5d763b
2275 Author: Sage Weil <sage@newdream.net>
2276 Date: Thu Nov 2 14:53:16 2017 -0500
2277
2278 Merge pull request #18621 from tchaikov/wip-21534-luminous
2279
2280 luminous: mon: update get_store_prefixes implementations
2281
2282 Reviewed-by: Nathan Cutler <ncutler@suse.com>
2283 Reviewed-by: John Spray <john.spray@redhat.com>
2284
2285 commit 815d8ab573215277a5283af1ecabaac84eaf6200
2286 Merge: c23865f07e 6b6eceee02
2287 Author: Sage Weil <sage@newdream.net>
2288 Date: Thu Nov 2 14:52:32 2017 -0500
2289
2290 Merge pull request #18623 from liewegas/wip-pr-18585-luminous
2291
2292 luminous: ceph-bluestore-tool: prime-osd-dir: update symlinks instead of bailing
2293
2294 Reviewed-by: Kefu Chai <kchai@redhat.com>
2295
2296 commit c23865f07e9147f8ac8a8d3837f735558af30dba
2297 Merge: 24bd1de6af 796e336470
2298 Author: Sage Weil <sage@newdream.net>
2299 Date: Thu Nov 2 14:51:58 2017 -0500
2300
2301 Merge pull request #18625 from tchaikov/wip-ceph-disk-unlock-dmcrypted-partitions-luminous
2302
2303 luminous: ceph-disk: unlocks dmcrypted partitions when activating them
2304
2305 Reviewed-by: Nathan Cutler <ncutler@suse.com>
2306
2307 commit 24bd1de6afaa0d3dab763ae946b03ffb7b333430
2308 Merge: 240edcfb18 3c3609b7e3
2309 Author: Sage Weil <sage@newdream.net>
2310 Date: Thu Nov 2 14:51:32 2017 -0500
2311
2312 Merge pull request #18650 from b-ranto/wip-allow-getattr-luminous
2313
2314 luminous: selinux: Allow getattr on lnk sysfs files
2315
2316 Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2317
2318 commit 240edcfb18475bef84bd5d6345dd365411398773
2319 Merge: 98edc3b9f2 deb78542ed
2320 Author: Sage Weil <sage@newdream.net>
2321 Date: Thu Nov 2 14:51:11 2017 -0500
2322
2323 Merge pull request #18675 from jcsp/wip-luminous-mgr
2324
2325 luminous: bulk backport of ceph-mgr improvements
2326
2327 commit 98edc3b9f2012db277c5796055223f6e69b67e66
2328 Merge: 96102df540 0c0d8e6f40
2329 Author: Alfredo Deza <alfredo@deza.pe>
2330 Date: Thu Nov 2 13:39:05 2017 -0400
2331
2332 Merge pull request #18687 from ceph/backport-18656
2333
2334 luminous: "ceph-volume: adds functional testing for bluestore"
2335
2336 Reviewed-by: Alfredo Deza <adeza@redhat.com>
2337
2338 commit 96102df5405fc470696df84996853e254c29fd31
2339 Merge: 172e6c1e0c 2e6b29084a
2340 Author: Kefu Chai <tchaikov@gmail.com>
2341 Date: Fri Nov 3 01:02:26 2017 +0800
2342
2343 Merge pull request #18293 from smithfarm/wip-21795-luminous
2344
2345 luminous: Ubuntu amd64 client can not discover the ubuntu arm64 ceph cluster
2346
2347 Reviewed-by: Kefu Chai <kchai@redhat.com>
2348
2349 commit 0c0d8e6f402ae78ae8110a717188f8b366a67696
2350 Author: Andrew Schoen <aschoen@redhat.com>
2351 Date: Tue Oct 31 15:25:23 2017 -0500
2352
2353 ceph-volume tests: adds objecstore as a testing factor
2354
2355 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2356 (cherry picked from commit f8b114be61d033c853a2e8295b966e30c6a5f721)
2357
2358 commit 9d970edddc1ab453a683bff1dfd19cab46e8cf9a
2359 Author: Andrew Schoen <aschoen@redhat.com>
2360 Date: Tue Oct 31 15:10:28 2017 -0500
2361
2362 ceph-volume: enable the centos7-bluestore and xenial-bluestore tests
2363
2364 This also updates the ansible and testinfra version to match the current
2365 ceph-ansible master branch.
2366
2367 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2368 (cherry picked from commit b49a19a9773599de295197979b498d06ca500cf8)
2369
2370 commit f9554c4e3ef0eea1f4f09828f98c58838390d4fa
2371 Author: Andrew Schoen <aschoen@redhat.com>
2372 Date: Tue Oct 31 15:09:52 2017 -0500
2373
2374 ceph-volume: adds the xenial-bluestore testing scenario
2375
2376 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2377 (cherry picked from commit 38372890c9c40e6f536026f61c5ef6e6d23d7111)
2378
2379 commit b7fef119d0730a3cb8f19a461f773e66ce97af0f
2380 Author: Andrew Schoen <aschoen@redhat.com>
2381 Date: Tue Oct 31 15:05:46 2017 -0500
2382
2383 ceph-volume: adds the centos7-bluestore testing scenario
2384
2385 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2386 (cherry picked from commit 45e4b0c9d7d4fea1d7bd3481d46edf3b42c40d26)
2387
2388 commit deb78542ed45ac402b4492d5b9ae4a9cdf182724
2389 Author: John Spray <john.spray@redhat.com>
2390 Date: Thu Nov 2 07:42:56 2017 -0400
2391
2392 qa: fix mgr _load_module helper
2393
2394 I inadvertently broke this with the latest change
2395 to the module ls output.
2396
2397 Signed-off-by: John Spray <john.spray@redhat.com>
2398 (cherry picked from commit 4fb3025682d812f86c50fa36532290fc0f8857ae)
2399
2400 commit d4fcb97839a501094db2e1704c9799a107ad100e
2401 Author: John Spray <john.spray@redhat.com>
2402 Date: Wed Nov 1 19:10:19 2017 +0000
2403
2404 mgr: fix up make_unique usage for backport
2405
2406 This was getting the definition some other way in master,
2407 but in luminous we need to include the backport14 header.
2408
2409 Signed-off-by: John Spray <john.spray@redhat.com>
2410
2411 commit f41cbb72f39359d7efc9feb0825cbad61e51c07c
2412 Author: John Spray <john.spray@redhat.com>
2413 Date: Fri Oct 20 13:54:29 2017 +0100
2414
2415 mon: fix up mgr_inactive_grace for backport
2416
2417 This was converted to options.cc only, but we cannot
2418 backport another commit that removes this legacy health
2419 reporting code, so this commit updates the legacy health
2420 reporting code for the options.cc style config opt.
2421
2422 Signed-off-by: John Spray <john.spray@redhat.com>
2423
2424 commit a80a7a4d7f9ac73b4d3b86f9787dd9de9865530a
2425 Author: John Spray <john.spray@redhat.com>
2426 Date: Wed Nov 1 06:35:14 2017 -0400
2427
2428 mon: include disabled modules in `mgr module ls`
2429
2430 Otherwise, when someone wants to see what's possible
2431 to do with `mgr module enable` they have to trawl
2432 through the whole mgr map dump.
2433
2434 Signed-off-by: John Spray <john.spray@redhat.com>
2435 (cherry picked from commit 5861c4c022e825fe28347ba7e61ae86a6f260f24)
2436
2437 commit fad998cb11628db970099cc192277c1824be884a
2438 Author: John Spray <john.spray@redhat.com>
2439 Date: Wed Nov 1 06:34:36 2017 -0400
2440
2441 doc: describe using `mgr module ...` commands
2442
2443 ...including the new "mgr services" command.
2444
2445 Signed-off-by: John Spray <john.spray@redhat.com>
2446 (cherry picked from commit d220e1adc337daeac418563dee125f161e85afdf)
2447
2448 commit a46c5733881403f65872ca36d300ab6a4ca9d2cc
2449 Author: John Spray <john.spray@redhat.com>
2450 Date: Wed Nov 1 06:28:30 2017 -0400
2451
2452 doc: describe how to implement standby modules
2453
2454 Signed-off-by: John Spray <john.spray@redhat.com>
2455 (cherry picked from commit ceb2a91190441b19171e5b5726748e43ee4d1e92)
2456
2457 commit c704b344a4a739e5ba18535a0fd4f05308c89019
2458 Author: John Spray <john.spray@redhat.com>
2459 Date: Mon Oct 23 05:37:49 2017 -0400
2460
2461 qa: fix mgr caps
2462
2463 This was still using Kraken era settings
2464
2465 Signed-off-by: John Spray <john.spray@redhat.com>
2466 (cherry picked from commit 9988ebed9530718b523a23d729d499dedab5eb6d)
2467
2468 commit f58cb7035cf8992b8772f3358f2d67787ab585c3
2469 Author: John Spray <john.spray@redhat.com>
2470 Date: Thu Oct 19 07:50:19 2017 -0400
2471
2472 qa: expand mgr testing
2473
2474 Some extra coverage of the dashboard, including its standby
2475 redirect mode and the publishing of URIs.
2476
2477 Also invoking the command_spam mode of the selftest module.
2478
2479 Signed-off-by: John Spray <john.spray@redhat.com>
2480 (cherry picked from commit 05e648be6a51d3efa110ad9826bbdd0adcc4dd4d)
2481
2482 commit a067468b3717dbab20f84996e76e2336d5fb5f30
2483 Author: John Spray <john.spray@redhat.com>
2484 Date: Tue Oct 17 18:39:17 2017 -0400
2485
2486 mgr/selftest: extend test and add background spam mode
2487
2488 Signed-off-by: John Spray <john.spray@redhat.com>
2489 (cherry picked from commit a382c3f1ca98b9fb7300e2d410bb2a1bb10b35ae)
2490
2491 commit 1430e448ff93f73b8e8fba61f591ce4ec8c02380
2492 Author: John Spray <john.spray@redhat.com>
2493 Date: Tue Oct 17 18:16:22 2017 -0400
2494
2495 mgr: drop GIL around set_uri, set_health_checks
2496
2497 These didn't need to keep the GIL to go and do their
2498 pure C++ parts, and by keeping it they could deadlock
2499 while trying to take ActiveMgrModules::lock.
2500
2501 Signed-off-by: John Spray <john.spray@redhat.com>
2502 (cherry picked from commit 27ee148e040ebaf512f8e11f814b3a7c8cf21f8b)
2503
2504 commit 2a94381b53241f9ecb98c4cc605ef6547b910ca2
2505 Author: John Spray <john.spray@redhat.com>
2506 Date: Tue Oct 17 18:14:43 2017 -0400
2507
2508 mgr: fix ~MonCommandCompletion
2509
2510 This was doing a Py_DECREF outside of the Gil.
2511
2512 Fixes: http://tracker.ceph.com/issues/21593
2513 Signed-off-by: John Spray <john.spray@redhat.com>
2514 (cherry picked from commit 58dfa97ba88882fb3540d15e31bcac48a1aef5ef)
2515
2516 commit 045ed0e023ae2d1a567b3426ef2b48980a851b7e
2517 Author: John Spray <john.spray@redhat.com>
2518 Date: Mon Oct 16 10:51:34 2017 -0400
2519
2520 mgr: update for SafeThreadState
2521
2522 A bunch of the previous commits were done
2523 before this class existed, so updating in
2524 one go instead of trying to edit history
2525 in fine detail.
2526
2527 Signed-off-by: John Spray <john.spray@redhat.com>
2528 (cherry picked from commit 29193a47e6cf8297d9b1ceecc7695f2c85434999)
2529
2530 commit ef67307966575b618614225d6206019781d71647
2531 Author: John Spray <john.spray@redhat.com>
2532 Date: Fri Oct 13 11:31:22 2017 -0400
2533
2534 mgr: refactor PyOSDMap etc implementation
2535
2536 Implement real python classes from the C side,
2537 rather than exposing only module methods.
2538
2539 Signed-off-by: John Spray <john.spray@redhat.com>
2540 (cherry picked from commit 7e61f79f5d56b568103a067d9a1eb87af997ad61)
2541
2542 commit d85f91cf3e2f747cc23218a52d9271dd6e27febb
2543 Author: Sage Weil <sage@redhat.com>
2544 Date: Tue Sep 26 18:35:29 2017 -0400
2545
2546 mgr/PyOSDMap: add CRUSH get_item_weight
2547
2548 Signed-off-by: Sage Weil <sage@redhat.com>
2549 (cherry picked from commit eacc9021459b31e42232bb958536d594d03b07b3)
2550
2551 commit b1307e074b5fb708420686bf814bd4a7aa76f6d8
2552 Author: John Spray <john.spray@redhat.com>
2553 Date: Mon Oct 16 06:33:48 2017 -0400
2554
2555 mgr: fix py_module_registry shutdown
2556
2557 Was calling way too early, which did a
2558 Py_Finalize before the modules had been
2559 joined.
2560
2561 Signed-off-by: John Spray <john.spray@redhat.com>
2562 (cherry picked from commit 0d5b1d70e616d7d1c2d6360375770f5c4754649d)
2563
2564 commit 642a26dfcd9bef06fceb119008f5c3078bbf10e7
2565 Author: John Spray <john.spray@redhat.com>
2566 Date: Thu Oct 12 13:14:02 2017 -0400
2567
2568 mgr: fix thread naming
2569
2570 Was passing a reference to a local stringstream into
2571 Thread::create, not realising that it was taking a char*
2572 reference instead of a copy. Result was garbage (or usually,
2573 all threads having the name of the last one created)
2574
2575 Signed-off-by: John Spray <john.spray@redhat.com>
2576 (cherry picked from commit bb4e71ed2ebdee1ac5e4b3eee390060e19fea0d8)
2577
2578 commit f9223ad56d8e01c1f6e8690a6a186d02eed8d96d
2579 Author: John Spray <john.spray@redhat.com>
2580 Date: Fri Oct 6 11:02:44 2017 -0400
2581
2582 mgr: cut down duplication between active+standby
2583
2584 ...by using PyModuleRunner class from ActivePyModule too.
2585
2586 Signed-off-by: John Spray <john.spray@redhat.com>
2587 (cherry picked from commit df8797320bed7ad9f121477e35d7e3862efd89bd)
2588
2589 commit 728e1e4e136aab5b4d185c738de8df7bcdce18ee
2590 Author: John Spray <john.spray@redhat.com>
2591 Date: Wed Oct 4 13:13:25 2017 -0400
2592
2593 mgr: fix os._exit overrides
2594
2595 These would throw an exception when passed
2596 a status code.
2597
2598 Signed-off-by: John Spray <john.spray@redhat.com>
2599 (cherry picked from commit e2442c1e20bf4ff12d58af500b34a18cc60d2de1)
2600
2601 commit ca51a1b9d2cf0a3bf0fd7b69b833fa6696e61888
2602 Author: John Spray <john.spray@redhat.com>
2603 Date: Thu Aug 24 14:07:37 2017 -0400
2604
2605 mon/MgrMonitor: reset services map on drop_active
2606
2607 Signed-off-by: John Spray <john.spray@redhat.com>
2608 (cherry picked from commit 7b629ae46599d79ca1929cfc6637b367c6bb9029)
2609
2610 commit 8d4512b5636eb41b2cbb50a42d071580cff728c6
2611 Author: John Spray <john.spray@redhat.com>
2612 Date: Tue Aug 22 14:47:10 2017 -0400
2613
2614 mgr/dashboard: implement standby mode
2615
2616 Signed-off-by: John Spray <john.spray@redhat.com>
2617 (cherry picked from commit 4f7007d1b0226af3f0cc33627ebf5051975657ac)
2618
2619 commit 3953c0b3b7d0012507ac047085a3f863dc4929d3
2620 Author: John Spray <john.spray@redhat.com>
2621 Date: Tue Aug 22 11:41:26 2017 -0400
2622
2623 pybind/mgr: add MgrStandbyModule
2624
2625 Signed-off-by: John Spray <john.spray@redhat.com>
2626 (cherry picked from commit 3048e85cd712b7da77cf6ac55dd6a689d00e47e5)
2627
2628 commit e37df9459d6d9abdbe310153bd53d1c1c4384a6b
2629 Author: John Spray <john.spray@redhat.com>
2630 Date: Tue Aug 22 14:42:11 2017 -0400
2631
2632 mgr: standby modules come up and run now
2633
2634 ...they still don't have access to any config though.
2635
2636 Signed-off-by: John Spray <john.spray@redhat.com>
2637 (cherry picked from commit c1471c7501948004096581ee415ab4a1fa2d9379)
2638
2639 commit 977583eba266df834a7e27516cacb750bf7121ec
2640 Author: John Spray <john.spray@redhat.com>
2641 Date: Wed Aug 16 10:23:59 2017 -0400
2642
2643 mgr: enable running modules in standby mode
2644
2645 Modules can implement a second, separate class
2646 that has access to very little state about the
2647 system and can't implement commands.
2648
2649 They have just enough information to redirect
2650 or forward incoming requests/traffic to the
2651 active instance of the module on the active mgr.
2652
2653 This enables module authors to create modules
2654 that end users can access via any (running) mgr node
2655 at any time, rather than having to first work out
2656 which mgr node is active.
2657
2658 Signed-off-by: John Spray <john.spray@redhat.com>
2659 (cherry picked from commit 25566d1edca638bd15b3ba3326ee7e4d3e573cbb)
2660
2661 commit 6a35a96ea838760945073b756ea7ae13e9a68ccf
2662 Author: John Spray <john.spray@redhat.com>
2663 Date: Tue Aug 15 06:53:18 2017 -0400
2664
2665 mgr: clean up python source file naming
2666
2667 Signed-off-by: John Spray <john.spray@redhat.com>
2668 (cherry picked from commit 70d45a6b93c92baf8d6a3b15765110a5384c5e60)
2669
2670 commit d37bf83f419fd5b34f0cbc8ee5313425e5177bc8
2671 Author: John Spray <john.spray@redhat.com>
2672 Date: Mon Aug 14 06:31:18 2017 -0400
2673
2674 mgr: refactor python module management
2675
2676 Separate out the *loading* of modules from
2677 the *running* of modules.
2678
2679 This is a precursor to enabling modules to run
2680 in standby mode.
2681
2682 Signed-off-by: John Spray <john.spray@redhat.com>
2683 (cherry picked from commit 9718896c8b844db2f3c07df1d344636da4605e61)
2684
2685 commit b563555edb51b576fcbf94a3b92598a7300aaf09
2686 Author: John Spray <john.spray@redhat.com>
2687 Date: Thu Jul 27 13:49:27 2017 -0400
2688
2689 pybind/mgr: use set_uri hook from dashboard+restful modules
2690
2691 No more guessing the URL!
2692
2693 Signed-off-by: John Spray <john.spray@redhat.com>
2694 (cherry picked from commit 089e105dd7ec762572ac06794caa7f5543075001)
2695
2696 commit 6dd4d0504de9806fcf7c398a8d66b956b45986d9
2697 Author: John Spray <john.spray@redhat.com>
2698 Date: Thu Jul 27 11:50:23 2017 -0400
2699
2700 mgr: enable python modules to advertise their service URI
2701
2702 Fixes: http://tracker.ceph.com/issues/17460
2703 Signed-off-by: John Spray <john.spray@redhat.com>
2704 (cherry picked from commit a0183a63fa791954d14c57632e184858cefe893d)
2705
2706 commit 778322d0913d4d9c70609a3c40d809f62a366020
2707 Author: John Spray <john.spray@redhat.com>
2708 Date: Thu Jul 27 11:49:45 2017 -0400
2709
2710 mon/MgrMonitor: store services in map and expose with command
2711
2712 Signed-off-by: John Spray <john.spray@redhat.com>
2713 (cherry picked from commit c3c3e4e90ba6b09e29879b500f211d607ebabb53)
2714
2715 commit a6b87a8e7c859607d4554833c5f9ad4cb2fea187
2716 Author: John Spray <john.spray@redhat.com>
2717 Date: Thu Jul 27 11:46:40 2017 -0400
2718
2719 messages: `services` in MMgrBeacon
2720
2721 Signed-off-by: John Spray <john.spray@redhat.com>
2722 (cherry picked from commit 236841b3b62af92ce0c4852045327fcfbc5c1651)
2723
2724 commit b44cf5f70d0286c9dcdcda8dbb9f014a3386813a
2725 Author: John Spray <john.spray@redhat.com>
2726 Date: Thu Jul 27 11:45:53 2017 -0400
2727
2728 mon/MgrMap: store list of services
2729
2730 Signed-off-by: John Spray <john.spray@redhat.com>
2731 (cherry picked from commit 3f703bd91f07b2fe43a16df0083d7b7c23803fd5)
2732
2733 commit 5b677f3f02500b87757b9965d20151e345b8ba3f
2734 Author: John Spray <john.spray@redhat.com>
2735 Date: Thu Jul 27 06:31:01 2017 -0400
2736
2737 mgr: carry PyModules ref in MonCommandCompletion
2738
2739 Signed-off-by: John Spray <john.spray@redhat.com>
2740 (cherry picked from commit e938bf9b9d27e192765c805e5f532c9dd4808b21)
2741
2742 commit b69a656ac76fe38431bcd66c626883e324be1ba4
2743 Author: John Spray <john.spray@redhat.com>
2744 Date: Wed Jul 26 12:31:13 2017 -0400
2745
2746 pybind: update MgrModule for ceph_state->ceph_module
2747
2748 & tidy up the places where ceph_state was getting
2749 used outside of MgrModule.
2750
2751 Signed-off-by: John Spray <john.spray@redhat.com>
2752 (cherry picked from commit 62cb512e4740f1f78f516b4f2179c1123fae1b36)
2753
2754 commit 8b5f302706e91c5c6a88e918a9d4baafd726c211
2755 Author: John Spray <john.spray@redhat.com>
2756 Date: Wed Jul 26 07:44:00 2017 -0400
2757
2758 mgr: refactor python interface
2759
2760 Expose a python class instead of a module,
2761 so that we have a place to carry our reference
2762 to our MgrPyModule* and to PyModules*, rather than
2763 passing a handle for the former and using
2764 a global pointer for the latter.
2765
2766 Signed-off-by: John Spray <john.spray@redhat.com>
2767 (cherry picked from commit 563878ba217491dd0a6fbd588cd56d09e3456c14)
2768
2769 commit 35b4518c4a0c477f0190bfc006434093fe720c05
2770 Author: John Spray <john.spray@redhat.com>
2771 Date: Thu Aug 3 06:22:35 2017 -0400
2772
2773 mgr/dashboard: remove blue highlight on scrubbing pg states
2774
2775 This was kind of unnecessary, highlighting a completely normal
2776 and healthy situation in a different colour. The blue was
2777 also really hard to read against a grey background.
2778
2779 Signed-off-by: John Spray <john.spray@redhat.com>
2780 (cherry picked from commit 99fa1fdf4e1be57792f50907147781d12009b32b)
2781
2782 commit 764e7011d0e69e08aa5f56a5c8c56b8875820b7e
2783 Author: John Spray <john.spray@redhat.com>
2784 Date: Thu Jul 27 11:42:16 2017 -0400
2785
2786 mgr/dashboard: clean up fs standby list when empty
2787
2788 Signed-off-by: John Spray <john.spray@redhat.com>
2789 (cherry picked from commit 5e64787c0ae0ac2a365c89bf89dfea425adc17d4)
2790
2791 commit 1d1dce056664a40ea4dc9ebd1dc3826f0e449555
2792 Author: John Spray <john.spray@redhat.com>
2793 Date: Wed Aug 30 13:56:39 2017 +0100
2794
2795 mgr: remove old-style config opt usage
2796
2797 Signed-off-by: John Spray <john.spray@redhat.com>
2798 (cherry picked from commit ec09a7abc515f802451bf7ef3d22ce8ee6c6c7b3)
2799
2800 commit a0131144036a9ea64c6f8e3289562bf7db18c746
2801 Author: John Spray <john.spray@redhat.com>
2802 Date: Wed Aug 30 12:12:40 2017 +0100
2803
2804 mon: remove old-style mgr config opt usage
2805
2806 Signed-off-by: John Spray <john.spray@redhat.com>
2807 (cherry picked from commit 6af4120d63324150ba19022c41fe4fa8a38cacbb)
2808
2809 commit 526425c63b6a8f2d3f79fdd75c360d7c2ecfeec6
2810 Author: John Spray <john.spray@redhat.com>
2811 Date: Wed Aug 30 11:48:25 2017 +0100
2812
2813 common: populate manager config option metadata
2814
2815 Signed-off-by: John Spray <john.spray@redhat.com>
2816 (cherry picked from commit eba4c3f2762ae40ba746091e32364c2d68e780d9)
2817
2818 commit 1eee973b90418979c33ca42b0720045f2de670c3
2819 Author: Kefu Chai <kchai@redhat.com>
2820 Date: Thu Jul 13 14:49:48 2017 +0800
2821
2822 common,mds,mgr,mon,osd: store event only if it's added
2823
2824 otherwise
2825 * we will try to cancel it even it's never been added
2826 * we will keep a dangling pointer around. which is, well,
2827 scaring.
2828 * static analyzer will yell at us:
2829 Memory - illegal accesses (USE_AFTER_FREE)
2830
2831 Signed-off-by: Kefu Chai <kchai@redhat.com>
2832 (cherry picked from commit 2449b3a5c365987746ada095fde30e3dc63ee0c7)
2833
2834 commit 66aa481be983fdd60beddc7ce621dad3edbf5490
2835 Author: John Spray <john.spray@redhat.com>
2836 Date: Tue Oct 3 08:16:10 2017 -0400
2837
2838 mgr: safety checks on pyThreadState usage
2839
2840 Previously relied on the caller of Gil() to
2841 pass new_thread=true if they would be
2842 calling from a different thread.
2843
2844 Enforce this with an assertion, by wrapping
2845 PyThreadState in a SafeThreadState class
2846 that remembers which POSIX thread
2847 it's meant to be used in.
2848
2849 Signed-off-by: John Spray <john.spray@redhat.com>
2850 (cherry picked from commit 625e1b5cfb9b8a5843dfe75e97826f70a57d6ebe)
2851
2852 commit 385a6a0e8e6a6dd315ab358dcea7f3c069d9ad4d
2853 Author: John Spray <john.spray@redhat.com>
2854 Date: Tue Aug 22 11:38:25 2017 -0400
2855
2856 mgr: move Gil implementation into .cc
2857
2858 The inclusion of Python.h in the .h was awkward
2859 for other files including Gil.h.
2860
2861 Signed-off-by: John Spray <john.spray@redhat.com>
2862 (cherry picked from commit 23c3a075ee1a27e1b57fcb452a4d6ce53080264e)
2863
2864 commit 241d655e127c71e9d9012d9205005c97d61def8a
2865 Author: John Spray <john.spray@redhat.com>
2866 Date: Wed Jul 26 07:21:40 2017 -0400
2867
2868 mgr: reduce Gil verbosity at level 20
2869
2870 Even at 20, it's pretty heavy to be logging
2871 every lock acquire/release.
2872
2873 Signed-off-by: John Spray <john.spray@redhat.com>
2874 (cherry picked from commit 987612a97529be7e67b89977c4a0cf47906a5ecb)
2875
2876 commit 30db4f5a54eac28e546c43a2ce099aa89d179495
2877 Author: Jan Fajerski <jfajerski@suse.com>
2878 Date: Wed Oct 11 12:28:19 2017 +0200
2879
2880 pybind/mgr/prometheus: no ports in osd_metadata
2881
2882 Ports might change on a OSD restart and this would create a new metadata
2883 metric for this osd.
2884
2885 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2886 (cherry picked from commit 48fec7db4b214fe8ef6a04f8cb53fb8a2fb9c2ca)
2887
2888 commit 80fc65cafaad3bb5499a15edbd97ecf483b4ad82
2889 Author: Jan Fajerski <jfajerski@suse.com>
2890 Date: Wed Oct 11 10:59:33 2017 +0200
2891
2892 pybind/mgr/prometheus: add osd_in/out metric; make osd_weight a metric
2893
2894 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2895 (cherry picked from commit e4c44c1d702ce242f2cb9a58ca7ce1c31fe0a498)
2896
2897 commit db09ea1c75c80dc189042c59e09ebc1c1f8d1249
2898 Author: Jan Fajerski <jfajerski@suse.com>
2899 Date: Wed Oct 11 20:07:19 2017 +0200
2900
2901 pybind/mgr_module: move PRIO_* and PERFCOUNTER_* to MgrModule class
2902
2903 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2904 (cherry picked from commit f69484debade5f4fa2bd3a0d1badc9291cc9d7b7)
2905
2906 commit bbe8fbe9ca98c1b0c8b5b43c0296fd9cc4d09c77
2907 Author: John Spray <john.spray@redhat.com>
2908 Date: Mon Oct 9 12:10:22 2017 +0100
2909
2910 qa/mgr: fix influx/prometheus test names
2911
2912 This was a typo: they were swapped around.
2913
2914 Signed-off-by: John Spray <john.spray@redhat.com>
2915 (cherry picked from commit d96a59e74b6984b77c9f3b15f702e3bf45053590)
2916
2917 commit be207ede6028e515a0a632e12330848c93d04a34
2918 Author: John Spray <john.spray@redhat.com>
2919 Date: Thu Sep 28 10:50:53 2017 -0400
2920
2921 doc: flesh out prometheus docs
2922
2923 Explain ceph_disk_occupation, importance
2924 of instance labels and honor_labels, provide
2925 example prometheus configuration yaml.
2926
2927 Signed-off-by: John Spray <john.spray@redhat.com>
2928 (cherry picked from commit 5227afed5f33fa9487e1bfa3fd8ce0d82eb4a20f)
2929
2930 commit 8a9e1cb00110ed73f492f1f6cf23b3595756efc4
2931 Author: John Spray <john.spray@redhat.com>
2932 Date: Thu Sep 28 10:10:14 2017 -0400
2933
2934 mgr/prometheus: add ceph_disk_occupation series
2935
2936 This is the magic series that enables consumers to
2937 easily get the drive stats that go with their
2938 OSD stats.
2939
2940 Fixes: http://tracker.ceph.com/issues/21594
2941 Signed-off-by: John Spray <john.spray@redhat.com>
2942 (cherry picked from commit 284be75524f7125dc1409b9c05fe47b37484964e)
2943
2944 commit 51d74e41223397abcde006a4ce53e693a2125852
2945 Author: Benjeman Meekhof <bmeekhof@users.noreply.github.com>
2946 Date: Wed Oct 4 10:05:17 2017 -0400
2947
2948 mgr/influx: Correct name of daemon stat measurement to 'ceph_daemon_stats'
2949
2950 Signed-off-by: Benjeman Meekhof <bmeekhof@umich.edu>
2951 (cherry picked from commit f9014a1c75c6a3adf414b48a707fd444e65b3024)
2952
2953 commit 2934dda9133a3a8876ab2701b11d4379440a5e41
2954 Author: Benjeman Meekhof <bmeekhof@users.noreply.github.com>
2955 Date: Tue Oct 3 16:30:43 2017 -0400
2956
2957 mgr/influx: modify module database check to not require admin privileges
2958
2959 - existing check tried to list all DB and fails even if DB exists if user is not admin level
2960 - still tries to create database if not found and user has privs
2961
2962 Signed-off-by: Benjeman Meekhof <bmeekhof@umich.edu>
2963 (cherry picked from commit 06d7d37c7b9a8c3f4435eff04b6f4934be5e676f)
2964
2965 commit 8c816b8e0fc1fd3fe227690287bcc6e6fce7c54d
2966 Author: Jan Fajerski <jfajerski@suse.com>
2967 Date: Tue Oct 10 08:40:31 2017 +0200
2968
2969 pybind/mgr/prometheus: fix metric type undef -> untyped
2970
2971 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2972 (cherry picked from commit 6306392492d103200b21ea91bce10a315d7c4e16)
2973
2974 commit 2ebab2f19cdd44f4c568eb96388fc4296f0f1814
2975 Author: John Spray <john.spray@redhat.com>
2976 Date: Mon Sep 25 11:14:57 2017 -0400
2977
2978 mgr: respect perf counter prio_adjust in MgrClient
2979
2980 This awkwardly involves re-ordering some definitions
2981 in perf_counters.h in order to refer to the prio
2982 names defined in PerfCountersBuilder.
2983
2984 Signed-off-by: John Spray <john.spray@redhat.com>
2985 (cherry picked from commit 88163749b572ffd2bfe0850136fad5dbed2a9180)
2986
2987 commit f8e9c37286d37d43bb768531f9cfbf70f2cb06b6
2988 Author: John Spray <john.spray@redhat.com>
2989 Date: Mon Sep 18 09:06:13 2017 -0400
2990
2991 test: update perfcounters test for priority in output
2992
2993 Signed-off-by: John Spray <john.spray@redhat.com>
2994 (cherry picked from commit 0f531f7871a68db96b2fb66ffdf6fae6935e6107)
2995
2996 commit f073fc4663db17ea44e9c36831d21df1597d193a
2997 Author: John Spray <john.spray@redhat.com>
2998 Date: Wed Sep 13 17:16:54 2017 -0400
2999
3000 qa: add mgr module selftest task
3001
3002 The module self test commands give us a chance to
3003 catch any other ceph changes that change something
3004 that a module was relying on reading.
3005
3006 Signed-off-by: John Spray <john.spray@redhat.com>
3007 (cherry picked from commit 99352ceced9d0fe92ddad6b97b1393b41de75d50)
3008
3009 commit 4c22f0f2669d343a8e7e83f0bc2a2dacbe194f34
3010 Author: John Spray <john.spray@redhat.com>
3011 Date: Wed Sep 13 10:46:56 2017 -0400
3012
3013 mgr/prometheus: remove explicit counter list
3014
3015 These have had their priorities bumped up to
3016 USEFUL, so they'll appear in the default
3017 get_all_counters output.
3018
3019 Signed-off-by: John Spray <john.spray@redhat.com>
3020 (cherry picked from commit ad5a31efbea8081f03dd73669e891d03857ef9cc)
3021
3022 commit fec2b3abf9d9abdc12bfeedaf2b22e8b0cc8c9f4
3023 Author: John Spray <john.spray@redhat.com>
3024 Date: Wed Sep 13 10:45:21 2017 -0400
3025
3026 mon: elevate priority of many perf counters
3027
3028 We can be quite liberal here, because mons are
3029 small in number. However, we don't want to expose
3030 KV database counters at this database from OSDs, so
3031 use the prio_adjust mechanism for that.
3032
3033 Signed-off-by: John Spray <john.spray@redhat.com>
3034 (cherry picked from commit ac8320f23dd4c00eb80da0d9837c29744e38bd57)
3035
3036 commit 8b9a18d3a0c40cb0ef10e32018ea1b23ff53f51e
3037 Author: John Spray <john.spray@redhat.com>
3038 Date: Wed Sep 13 07:07:50 2017 -0400
3039
3040 osd: upgrade a bunch of perf counters to PRIO_USEFUL
3041
3042 These are broadly the OSD-wide IO stats, which happen
3043 to also be the ones that were named in the
3044 prometheus plugin until I changed it to be
3045 priority-based.
3046
3047 Signed-off-by: John Spray <john.spray@redhat.com>
3048 (cherry picked from commit a1cc4ba2993de62b60fd1e58a9704877a6da5fe4)
3049
3050 commit 278188c76ebdbaaa36b3d185b1378abf7665f3fc
3051 Author: John Spray <john.spray@redhat.com>
3052 Date: Wed Sep 13 07:06:24 2017 -0400
3053
3054 common: PerfCountersBuilder helper for priorities
3055
3056 Let the caller set a priority as the defaul, to enable them
3057 to create a bunch at a given priority. This is just a
3058 convenience.
3059
3060 Signed-off-by: John Spray <john.spray@redhat.com>
3061 (cherry picked from commit 66f61eeda6a2465b5fc0e40a4f1300913db065dc)
3062
3063 commit 3dff5c0f39289e02e882bf86bf3e23e94ee33aa8
3064 Author: John Spray <john.spray@redhat.com>
3065 Date: Tue Sep 12 10:27:12 2017 -0400
3066
3067 mgr/prometheus: add a self-test command
3068
3069 Signed-off-by: John Spray <john.spray@redhat.com>
3070 (cherry picked from commit 76e1ba52b1b95d417cdd04b8fe985acee648f0e9)
3071
3072 commit a6bc96dfe93f7cbcefa8030a3b6830117516931e
3073 Author: John Spray <john.spray@redhat.com>
3074 Date: Tue Sep 12 08:05:28 2017 -0400
3075
3076 mgr/influx: remove file-based config
3077
3078 ...and also trim down the configuration to what's really
3079 needed. In general users don't need to pick and choose
3080 metrics. We could add it back if there was a strong
3081 motivation.
3082
3083 Signed-off-by: John Spray <john.spray@redhat.com>
3084 (cherry picked from commit 6776d4645afc49a4bfb4b62673c91384239037f4)
3085
3086 commit bda26fe0e707ec9e609be613805340dadd17e8f3
3087 Author: John Spray <john.spray@redhat.com>
3088 Date: Tue Sep 12 06:51:21 2017 -0400
3089
3090 mgr/influx: enable self-test without dependencies
3091
3092 The idea of self-test commands is that they're self
3093 contained and just exercise the module's calls
3094 to the Ceph-side.
3095
3096 Signed-off-by: John Spray <john.spray@redhat.com>
3097 (cherry picked from commit 125294ab9d6e99aa4c960fea147a4e86624b869e)
3098
3099 commit 9abd779d3321d1cda9c8677600e1e35af46109e7
3100 Author: John Spray <john.spray@redhat.com>
3101 Date: Tue Sep 12 06:18:15 2017 -0400
3102
3103 mgr/influx: revise perf counter handling
3104
3105 - Use new get_all_perf_counters path
3106 - Consequently get counters for all daemons, not just OSD
3107 - Tag stats with ceph_daemon rather than osd_id, as some
3108 stats appear from more than one daemon type
3109 - Remove summing of perf counters, external TSDB and/or queries
3110 can do this.
3111 - Remove mgr_id tag: this would change depending on which
3112 mgr was active, which is certainly not desirable.
3113
3114 Signed-off-by: John Spray <john.spray@redhat.com>
3115 (cherry picked from commit 59b48e7660f4b757804974835027cd08a59843c2)
3116
3117 commit 32f5f0fe515e6890e8aefad6ad8cdc2574ae8a34
3118 Author: John Spray <john.spray@redhat.com>
3119 Date: Thu Aug 3 13:00:56 2017 -0400
3120
3121 mgr: omit module list in beacon logging
3122
3123 This is useful in itself, but awkward when dealing
3124 with logs generally, because it means that when you
3125 grep on the name of a module, you get mostly beacon
3126 messages rather than the log messages from the
3127 module.
3128
3129 Signed-off-by: John Spray <john.spray@redhat.com>
3130 (cherry picked from commit 8d1277fa5c578ce0ea23a70cc58c6cf99921ee25)
3131
3132 commit 10ab4f8b6821e2d6593bc09161c23a9163b93611
3133 Author: John Spray <john.spray@redhat.com>
3134 Date: Tue Sep 12 05:42:23 2017 -0400
3135
3136 mgr: define perf counter constants in mgr_module
3137
3138 So that modules can consume perf counter data
3139 intelligently without having to hunt around
3140 in C land for these constants and redefine them.
3141
3142 Signed-off-by: John Spray <john.spray@redhat.com>
3143 (cherry picked from commit 39ab28ed47e869e1466cb3a316a2cb11bdedd23a)
3144
3145 commit 290d15ed912285803a40d02308b921b415c580a2
3146 Author: John Spray <john.spray@redhat.com>
3147 Date: Mon Sep 11 09:12:25 2017 -0400
3148
3149 ceph.in: use PRIO_INTERESTING as daemonperf threshold
3150
3151 Using PRIO_USEFUL as the threshold for what goes into
3152 time series databases. I'm claiming that we have
3153 more "useful" counters than fit on the screen,
3154 so daemonperf's "a screen's worth" threshold
3155 should be at the "interesting" level.
3156
3157 Signed-off-by: John Spray <john.spray@redhat.com>
3158 (cherry picked from commit 30a74ce343caec2a433cb532ba697fe7013ed05c)
3159
3160 commit 5ee9e15858d5aa2a71a89c13dea9a5db72579726
3161 Author: John Spray <john.spray@redhat.com>
3162 Date: Mon Sep 11 09:12:01 2017 -0400
3163
3164 mon: set some priorities on perf counters
3165
3166 Signed-off-by: John Spray <john.spray@redhat.com>
3167 (cherry picked from commit 29a71c35c39fbe1d4887e3f5ebb93232daab3487)
3168
3169 commit 3bd478794e2626251eda91850974188da208b591
3170 Author: John Spray <john.spray@redhat.com>
3171 Date: Mon Sep 4 05:39:11 2017 -0400
3172
3173 mgr/prometheus: tag stats by daemon name
3174
3175 Using osd=0 or similar tags was problematic because
3176 daemons of different types have some same-named
3177 counters (e.g. MDS and OSD both have objecter
3178 perf counters).
3179
3180 Signed-off-by: John Spray <john.spray@redhat.com>
3181 (cherry picked from commit eb524c272c89f8f99f22969b78caa016db7c671e)
3182
3183 commit af92c011b20eaef073730be2f8d7112a0f7e99f8
3184 Author: John Spray <john.spray@redhat.com>
3185 Date: Fri Sep 1 12:02:37 2017 -0400
3186
3187 mgr/prometheus: use new get_all_perf_counters interface
3188
3189 Signed-off-by: John Spray <john.spray@redhat.com>
3190 (cherry picked from commit 11137aa269271ad15dcf19a8d51ce6f4acb7a98e)
3191
3192 commit 3ce4a950975188051b6a3e6cb366c2fb23f0e88f
3193 Author: John Spray <john.spray@redhat.com>
3194 Date: Fri Sep 1 12:01:35 2017 -0400
3195
3196 common: used fixed size int for perf counter prio
3197
3198 ...to avoid any ambiguity in allowed range and
3199 make clear how to encode it down the wire.
3200
3201 Signed-off-by: John Spray <john.spray@redhat.com>
3202 (cherry picked from commit ba08fc1008d17aa7a5f285ea2705705ce1a0bda0)
3203
3204 commit d4a0c778747970c231a55baea32f59a1009af4dd
3205 Author: John Spray <john.spray@redhat.com>
3206 Date: Fri Sep 1 12:00:59 2017 -0400
3207
3208 mgr: transmit perf counter prio to the mgr
3209
3210 Signed-off-by: John Spray <john.spray@redhat.com>
3211 (cherry picked from commit f304f84cfbc22c1a54d152cc38227077bc564a7e)
3212
3213 commit cdcac6e92ff57f1a4e5f5cac676049c6584452c4
3214 Author: John Spray <john.spray@redhat.com>
3215 Date: Fri Sep 1 10:46:56 2017 -0400
3216
3217 common: always include priority in perf counter dump
3218
3219 JSON output with inconsistent sets of members is
3220 annoying to use on the receiving side.
3221
3222 Signed-off-by: John Spray <john.spray@redhat.com>
3223 (cherry picked from commit e631f1a72735ec618e2f3012ad7b9c5830d6c0eb)
3224
3225 commit 802cd49bae2cce6c55eddd68feb617df893e1046
3226 Author: John Spray <john.spray@redhat.com>
3227 Date: Tue Aug 29 11:55:28 2017 -0400
3228
3229 mgr: add get_all_perf_counters to MgrModule interface
3230
3231 This is for use by modules that dump counters
3232 in bulk, e.g. to a TSDB.
3233
3234 Signed-off-by: John Spray <john.spray@redhat.com>
3235 (cherry picked from commit 9a42d4255d9d968d6162b53b71db292d9d3de2e4)
3236
3237 commit 85a93dcdddc4cd82c8935bfe123cb20f13f8928a
3238 Author: Jan Fajerski <jfajerski@suse.com>
3239 Date: Fri Aug 11 13:09:24 2017 +0200
3240
3241 pybind/mgr/prometheus: export cluster-wide pg stats, not per osd
3242
3243 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3244 (cherry picked from commit 13b1236b96d4563e0985cad40d3009b60cc475e7)
3245
3246 commit 1d89c0809f64009d646b929fec675e1aaa6c2b1a
3247 Author: Jan Fajerski <jfajerski@suse.com>
3248 Date: Fri Aug 11 12:51:47 2017 +0200
3249
3250 pybind/mgr/prometheus: add more osd metadata
3251
3252 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3253 (cherry picked from commit e7704fa9cc35549dba526212c2830df589670416)
3254
3255 commit 6a65408c1364669916643329494825aae394b200
3256 Author: Jan Fajerski <jfajerski@suse.com>
3257 Date: Fri Aug 11 12:05:09 2017 +0200
3258
3259 pybind/mgr/prometheus: don't get perf counters that are not in schema
3260
3261 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3262 (cherry picked from commit d4ba07d04477ccae3a89dcdcafbb7e76149dfd1c)
3263
3264 commit 62092680ad966eabcdc6b557e9858fe0562147ee
3265 Author: Jan Fajerski <jfajerski@suse.com>
3266 Date: Fri Aug 11 12:04:28 2017 +0200
3267
3268 pybind/mgr/prometheus: add mon and osd perf counters to export
3269
3270 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3271 (cherry picked from commit fa25d31263a26074225e2a00cb82448066b54069)
3272
3273 commit 752c888533aaa9c7ae5781fafe4a6aa3302059fc
3274 Author: Jan Fajerski <jfajerski@suse.com>
3275 Date: Thu Aug 10 19:46:07 2017 +0200
3276
3277 pybind/mgr/prometheus: add index page, export metrics under metrics/
3278
3279 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3280 (cherry picked from commit d99a506ed37c2d0991d68ecd34ac5fb213a3eea4)
3281
3282 commit b279ae25d95f6c4b8290042fc9f33c4a6f7afac2
3283 Author: Jan Fajerski <jfajerski@suse.com>
3284 Date: Thu Aug 10 18:19:42 2017 +0200
3285
3286 pybind/mgr/prometheus: export selected perf_counters
3287
3288 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3289 (cherry picked from commit f6e2e36ba72caf6347f3bb6a985925d0e35077a2)
3290
3291 commit 4c092524929db048f6863acf1a9f12281bdc1646
3292 Author: Jan Fajerski <jfajerski@suse.com>
3293 Date: Thu Aug 10 18:18:36 2017 +0200
3294
3295 pybind/mgr/prometheus: export osd and pool metadata
3296
3297 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3298 (cherry picked from commit 2bea3814699c27baa8f633b56a8800d697685898)
3299
3300 commit e3dafc3dd682a10e2310efdac4615d834933e7d6
3301 Author: Jan Fajerski <jfajerski@suse.com>
3302 Date: Thu Aug 10 18:15:56 2017 +0200
3303
3304 pybind/mgr/prometheus: actually emit reported pg counts
3305
3306 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3307 (cherry picked from commit c288624eed862559b2c86c5dfc85c837716739ab)
3308
3309 commit 1ef5c88ef08ab9950ee8d7d4acda032b5a54f2f5
3310 Author: Jan Fajerski <jfajerski@suse.com>
3311 Date: Thu Aug 10 18:09:17 2017 +0200
3312
3313 pybind/mgr/prometheus: no need to wait for notify event
3314
3315 If stats or perf counters are not available they won't be emitted.
3316
3317 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3318 (cherry picked from commit ead0973d7dd12fe985390891c80f1bc15f7b9aec)
3319
3320 commit d0ef1cd2570644451205e5306feca0da94462d1f
3321 Author: Jan Fajerski <jfajerski@suse.com>
3322 Date: Thu Aug 10 18:07:14 2017 +0200
3323
3324 pybind/mgr/prometheus: no need to convert perf_schema to ordered_dict
3325
3326 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3327 (cherry picked from commit 5e4b4b5ea2a217731691c1c391c252b08452798a)
3328
3329 commit 7f191ff9dff33cac551ae5f64027d566b17b6d98
3330 Author: Jan Fajerski <jfajerski@suse.com>
3331 Date: Wed Aug 9 17:22:49 2017 +0200
3332
3333 pybind/mgr/prometheus: add device_class label to osd metrics
3334
3335 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3336 (cherry picked from commit 76d1918724320b7d6b1120b57b3002bb24099001)
3337
3338 commit b24263387e46ac537a8ac189f9e0e80699518e0b
3339 Author: Jan Fajerski <jfajerski@suse.com>
3340 Date: Wed Aug 9 16:19:38 2017 +0200
3341
3342 pybind/mgr/prometheus: add cluster wide metrics; no perf counters for now
3343
3344 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3345 (cherry picked from commit 49b3ff83cd231066d2a8f1809fadbdeb2c0c1f88)
3346
3347 commit 5f0ef3a73a55a3f24997e415a848308afa0263ba
3348 Author: Jan Fajerski <jfajerski@suse.com>
3349 Date: Fri Aug 4 10:23:11 2017 +0200
3350
3351 pybind/mgr/prometheus: prefix metrics with 'ceph'; replace :: with _
3352
3353 Both follow prometheus best practices. While : is a legal metric
3354 character, "Exposed metrics should not contain colons, these are for
3355 users to use when aggregating."
3356
3357 Signed-off-by: Jan Fajerski <jfajerski@suse.com>
3358 (cherry picked from commit 177afcc7886aa3898d092ebd1e101697bc6539fd)
3359
3360 commit a303218c85498ccf472d2f1b35fd391376fb0faf
3361 Author: mhdo2 <mhdo2@users.noreply.github.com>
3362 Date: Mon Aug 21 12:13:01 2017 -0400
3363
3364 doc/mgr: add influx plugin docs
3365
3366 Signed-off-by: My Do <mhdo@umich.edu>
3367 (cherry picked from commit e345fe3c5780976a4e33488b3a75cd24bb2c96c5)
3368
3369 commit de89603e54f550ffc4ff994026f32c5b7d5f6529
3370 Author: mhdo2 <mhdo2@users.noreply.github.com>
3371 Date: Tue Jul 18 18:33:55 2017 -0400
3372
3373 mgr/influx: added influx plugin
3374
3375 Signed-off-by: My Do <mhdo@umich.edu>
3376 (cherry picked from commit 68ae26c014d0471cc3f2f979dc8d822b2e50740f)
3377
3378 commit 2fea47d9710ec1e388db044065bc42b8046dae22
3379 Author: John Spray <john.spray@redhat.com>
3380 Date: Sat Sep 23 11:55:55 2017 -0400
3381
3382 mgr: store declared_types in MgrSession
3383
3384 Because we don't (yet) properly prevent multiple sessions
3385 from daemons reporting the same name (e.g. rgws), storing
3386 it in the DaemonPerfCounters meant that one daemon's report
3387 was referring to another daemon's set of reported types.
3388
3389 This should always have been a property of the session.
3390
3391 The behaviour will still be ugly when multiple daemons
3392 are using the same name (stomping on each other's stats/statsu)
3393 but it shouldn't crash.
3394
3395 Fixes: http://tracker.ceph.com/issues/21197
3396 Signed-off-by: John Spray <john.spray@redhat.com>
3397 (cherry picked from commit dc415f1ae09a308bd448614934a4c168eb9cf07b)
3398
3399 commit 951d67fc9fee23f3f8f7d7df8fbfb8c29e60f82f
3400 Author: John Spray <john.spray@redhat.com>
3401 Date: Mon Sep 18 10:12:00 2017 +0100
3402
3403 mgr: make pgmap_ready atomic to avoid taking lock
3404
3405 Signed-off-by: John Spray <john.spray@redhat.com>
3406 (cherry picked from commit d20915741d985e080a723cd6563bc6f4a657276f)
3407
3408 commit 946d1541bd2b14d6f8abbaa201c3521dd117f01b
3409 Author: John Spray <john.spray@redhat.com>
3410 Date: Mon Aug 28 07:29:36 2017 -0400
3411
3412 mgr/DaemonServer: handle MMgrReports in parallel
3413
3414 The DaemonStateIndex locking is sufficient to make all
3415 the report processing safe: holding DaemonServer::lock
3416 through all ms_dispatch was unnecessarily serializing
3417 dispatch.
3418
3419 Signed-off-by: John Spray <john.spray@redhat.com>
3420 (cherry picked from commit 64af9d3da0fceff9ad0ff668f60d272c46912f34)
3421
3422 commit d70fae092db920e2db77c7c8b044cfb4d9687992
3423 Author: John Spray <john.spray@redhat.com>
3424 Date: Thu Aug 24 12:53:24 2017 -0400
3425
3426 mgr: clean up DaemonStateIndex locking
3427
3428 Various things here were dangerously operating
3429 outside locks.
3430
3431 Additionally switch to a RWLock because this lock
3432 will be relatively read-hot when it's taken every time
3433 a MMgrReport is handled, to look up the DaemonState
3434 for the sender.
3435
3436 Fixes: http://tracker.ceph.com/issues/21158
3437 Signed-off-by: John Spray <john.spray@redhat.com>
3438 (cherry picked from commit 806f10847cefe5c7a78fc319b1b130d372197dd3)
3439
3440 commit b86cc9a2e49a4d1b53e83f47876a42b42819efcb
3441 Author: John Spray <john.spray@redhat.com>
3442 Date: Thu Aug 31 12:13:23 2017 -0400
3443
3444 mgr: runtime adjustment of perf counter threshold
3445
3446 ceph-mgr has missed out on the `config set` command
3447 that the other daemons got recently: add it here
3448 and hook it all up to the stats period and threshold
3449 settings.
3450
3451 Signed-off-by: John Spray <john.spray@redhat.com>
3452 (cherry picked from commit 057b73d641decb9403aba50caae9d139f3a34dd4)
3453
3454 commit c278580d207f0b99daed48afdc689ae77fe73e9b
3455 Author: John Spray <john.spray@redhat.com>
3456 Date: Mon Jul 31 09:24:09 2017 -0400
3457
3458 mgr: apply a threshold to perf counter prios
3459
3460 ...so that we can control the level of load
3461 we're putting on ceph-mgr with perf counters. Don't collect
3462 anything below PRIO_USEFUL by default.
3463
3464 Signed-off-by: John Spray <john.spray@redhat.com>
3465 (cherry picked from commit bdc775fdd8acdad5c58ff3065a21396f80ce5db4)
3466
3467 commit 11720b96ec8f9ef683710dffa3da4cda2ecf096d
3468 Author: Sage Weil <sage@redhat.com>
3469 Date: Tue Aug 8 16:36:23 2017 -0400
3470
3471 pybind/mgr/balancer: make auto mode work
3472
3473 (with upmap at least)
3474
3475 Signed-off-by: Sage Weil <sage@redhat.com>
3476 (cherry picked from commit ef1a3be05671ad31907cf8c4beb64a766359bc66)
3477
3478 commit b6a000f0efef3cd6a143b82ae33cacf660cd8e4c
3479 Author: Spandan Kumar Sahu <spandankumarsahu@gmail.com>
3480 Date: Mon Aug 7 04:01:57 2017 +0530
3481
3482 src/pybind/mgr/balancer/module.py: improve scoring method
3483
3484 * score lies in [0, 1), 0 being perfect distribution
3485 * use shifted and scaled cdf of normal distribution
3486 to prioritize highly over-weighted device.
3487 * consider only over-weighted devices to calculate score
3488
3489 Signed-off-by: Spandan Kumar Sahu <spandankumarsahu@gmail.com>
3490 (cherry picked from commit c09308c49ca087fb8c5e7d4261b0234190f863d9)
3491
3492 commit 6090ae6c224904516736c5f1a4ae5bcb6d7e6caa
3493 Author: Sage Weil <sage@redhat.com>
3494 Date: Fri Aug 4 17:59:20 2017 -0400
3495
3496 pybind/mgr/balancer: make 'crush-compat' sort of work
3497
3498 Signed-off-by: Sage Weil <sage@redhat.com>
3499 (cherry picked from commit 7a00e02acd1b2ff21dac829de30f80fd69eae602)
3500
3501 commit add3cd36db7c02d52c2fa429c034c114cac526d8
3502 Author: Sage Weil <sage@redhat.com>
3503 Date: Thu Aug 3 16:23:08 2017 -0400
3504
3505 pybind/mgr/balancer: rough framework
3506
3507 Signed-off-by: Sage Weil <sage@redhat.com>
3508 (cherry picked from commit d5e5c68c374e7d5514f89aac2d3df6008d103a76)
3509
3510 commit 0c73e433ab6583fca6eea7678c23b469d643ae04
3511 Author: Sage Weil <sage@redhat.com>
3512 Date: Thu Jul 27 23:33:06 2017 -0400
3513
3514 mgr/PyOSDMap: OSDMap.map_pool_pgs_up, CRUSHMap.get_item_name
3515
3516 Signed-off-by: Sage Weil <sage@redhat.com>
3517 (cherry picked from commit a928bf62316c32f37dd1791192fd9a2ddaef0d33)
3518
3519 commit 423947563c8e88f89bef9d71b3116c3302bd40c9
3520 Author: Sage Weil <sage@redhat.com>
3521 Date: Sun Jul 23 00:10:56 2017 -0400
3522
3523 mgr/PyOSDMap: get_crush, find_takes, get_take_weight_osd_map
3524
3525 These let us identify distinct CRUSH hierarchies that rules distribute
3526 data over, and create relative weight maps for the OSDs they map to.
3527
3528 Signed-off-by: Sage Weil <sage@redhat.com>
3529 (cherry picked from commit 3b8a276c437cfd599c55a935d141375afda676ff)
3530
3531 commit 073f23734c8058e3efcb440df89adab818510695
3532 Author: Sage Weil <sage@redhat.com>
3533 Date: Thu Jul 27 10:07:31 2017 -0400
3534
3535 crush/CrushWrapper: rule_has_take
3536
3537 Signed-off-by: Sage Weil <sage@redhat.com>
3538 (cherry picked from commit ef140de639078b40c05971fb219f7b8c12d83228)
3539
3540 commit df426b5c24e12b1156bccdd8948cbed5977c348a
3541 Author: Sage Weil <sage@redhat.com>
3542 Date: Sat Jul 22 23:50:27 2017 -0400
3543
3544 crush/CrushWrapper: refactor get_rule_weight_osd_map to work with roots too
3545
3546 Allow us to specify a root node in the hierarchy instead of a rule.
3547 This way we can use it in conjunction with find_takes().
3548
3549 Signed-off-by: Sage Weil <sage@redhat.com>
3550 (cherry picked from commit 69454e0570274ff7f252e7f081965dcc9bb04459)
3551
3552 commit 89cac2d5176300838c23a28814257d0f395e39c9
3553 Author: Sage Weil <sage@redhat.com>
3554 Date: Sat Jul 22 23:17:18 2017 -0400
3555
3556 pybind/mgr/balancer: do upmap by pool, in random order
3557
3558 Signed-off-by: Sage Weil <sage@redhat.com>
3559 (cherry picked from commit 028a66d43244c15a77e71f3d3e4f41773837ab02)
3560
3561 commit bfdc955ab6ab424b6a46dc1b0022fb3dc13ce157
3562 Author: Sage Weil <sage@redhat.com>
3563 Date: Tue Jul 11 16:27:08 2017 -0400
3564
3565 pybind/mgr/balancer: add balancer module
3566
3567 - wake up every minute
3568 - back off when unknown, inactive, degraded
3569 - throttle against misplaced ratio
3570 - apply some optimization step
3571 - initially implement 'upmap' only
3572
3573 Signed-off-by: Sage Weil <sage@redhat.com>
3574 (cherry picked from commit 0d9685c50f79fbb53dbc8bd98c95900ef6e902b8)
3575
3576 commit c57a55e8d426e6f87d4649a799d9ddee665618e0
3577 Author: Sage Weil <sage@redhat.com>
3578 Date: Tue Jul 11 16:26:16 2017 -0400
3579
3580 pybind/mgr/mgr_module: add default arg to get_config
3581
3582 Signed-off-by: Sage Weil <sage@redhat.com>
3583 (cherry picked from commit 39c42ddb9339c1950a3a474e8083db8b24e775a6)
3584
3585 commit 4d686ee875d5bc0125426d348e044988aaca9f91
3586 Author: Sage Weil <sage@redhat.com>
3587 Date: Mon Jul 10 23:23:19 2017 -0400
3588
3589 mgr: add trivial OSDMap wrapper class
3590
3591 Signed-off-by: Sage Weil <sage@redhat.com>
3592 (cherry picked from commit 2ef005196ba2eb49c34c32def624938c7a8beb03)
3593
3594 commit 1b721632aa8271d74b319714db0a9fedacb2629b
3595 Author: Sage Weil <sage@redhat.com>
3596 Date: Thu Jul 27 10:06:45 2017 -0400
3597
3598 mgr/PyModules: add 'pg_dump' get
3599
3600 Signed-off-by: Sage Weil <sage@redhat.com>
3601 (cherry picked from commit bfb9286f4212947183c46543d609b664ea13b489)
3602
3603 commit 68d411cf7b934c724f1f8ebeaa7148daebd79599
3604 Author: Sage Weil <sage@redhat.com>
3605 Date: Tue Jul 11 16:25:42 2017 -0400
3606
3607 mgr/PyModules: add 'pg_status' dump
3608
3609 This is summary info, same as what's in 'ceph status'.
3610
3611 Signed-off-by: Sage Weil <sage@redhat.com>
3612 (cherry picked from commit 85b5b80906d00e098d4b1af1354c60a357022dd2)
3613
3614 commit 35de92b259f50b52e51ab1daf57041553170406d
3615 Author: David Zafman <dzafman@redhat.com>
3616 Date: Wed Nov 1 09:53:34 2017 -0700
3617
3618 osd: build_past_intervals_parallel: Ignore new partially created PGs
3619
3620 Fixes: http://tracker.ceph.com/issues/21833
3621
3622 Signed-off-by: David Zafman <dzafman@redhat.com>
3623
3624 commit 172e6c1e0c5bb86db7cc0017acaa674aa893e3a0
3625 Merge: 2988a39abe 966683fde6
3626 Author: Casey Bodley <cbodley@users.noreply.github.com>
3627 Date: Wed Nov 1 16:28:25 2017 -0400
3628
3629 Merge pull request #18674 from ceph/wip-rgw-s3-branch
3630
3631 qa/tests: use ceph-luminous branch for s3tests
3632
3633 Reviewed-by: Casey Bodley <cbodley@redhat.com>
3634
3635 commit 966683fde600837eb9a0f82ca6fd00f52e721809
3636 Author: Vasu Kulkarni <vasu@redhat.com>
3637 Date: Wed Nov 1 10:32:07 2017 -0700
3638
3639 qa: use ceph-luminous branch for s3tests
3640
3641 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
3642
3643 commit 2988a39abedc6a092b8b3c2f0b33a3559a55461b
3644 Merge: 4dc0a0e38a 8f87fa2d3a
3645 Author: John Spray <jspray@redhat.com>
3646 Date: Wed Nov 1 15:24:55 2017 +0100
3647
3648 Merge pull request #18412 from kmroz/wip-21659-luminous
3649
3650 luminous: mgr: fix crashable DaemonStateIndex::get calls
3651
3652 Reviewed-by: John Spray <john.spray@redhat.com>
3653
3654 commit 4dc0a0e38a3f1a988c180d47970102df4b326b9e
3655 Merge: 273e035dbe 72c8583107
3656 Author: John Spray <jspray@redhat.com>
3657 Date: Wed Nov 1 12:33:45 2017 +0100
3658
3659 Merge pull request #18113 from jcsp/wip-prometheus-port-backport
3660
3661 luminous: ceph-mgr: can not change prometheus port for mgr
3662
3663 Reviewed-by: Kefu Chai <kchai@redhat.com>
3664 Reviewed-by: John Spray <john.spray@redhat.com>
3665
3666 commit 273e035dbe158f162c2ee559744c456c942f1737
3667 Merge: a7f519913d f463cd84ae
3668 Author: Yuri Weinstein <yuri.weinstein@gmail.com>
3669 Date: Tue Oct 31 14:45:27 2017 -0700
3670
3671 Merge pull request #18655 from ceph/wip-yuriw-bp-PR18634-luminous
3672
3673 qa: add "restful" to ceph_mgr_modules in ceph-ansible suite
3674
3675 commit f463cd84ae1fb38817078967a4a40ba4b600f0e5
3676 Author: Kefu Chai <kchai@redhat.com>
3677 Date: Tue Oct 31 11:21:58 2017 +0800
3678
3679 qa: add "restful" to ceph_mgr_modules in ceph-ansible suite
3680
3681 backport of https://github.com/ceph/ceph/pull/18634
3682
3683 Signed-off-by: Kefu Chai <kchai@redhat.com>
3684 (cherry picked from commit caf9ee5c60d999951979d0b67afda8d56e1cd91d)
3685 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
3686
3687 commit a7f519913df3aba83aa3ead9eee6b94aa8f90ffd
3688 Merge: f2749114c5 b84803d609
3689 Author: Karol Mroz <kmroz@suse.de>
3690 Date: Tue Oct 31 10:26:42 2017 -0700
3691
3692 Merge pull request #17889 from smithfarm/wip-21372-luminous
3693
3694 luminous: core: Improve OSD startup time by only scanning for omap corruption once
3695
3696 Reviewed-by: David Zafman <dzafman@redhat.com>
3697
3698 commit f2749114c596d4016eb14e4777cb93a11b14b705
3699 Merge: 528c3b6d32 1236e0f2e9
3700 Author: Karol Mroz <kmroz@suse.de>
3701 Date: Tue Oct 31 10:18:07 2017 -0700
3702
3703 Merge pull request #18004 from linuxbox2/luminous-rgwf-wr
3704
3705 luminous: rgw_file: fix write error when the write offset overlaps.
3706
3707 Reviewed-by: Casey Bodley <cbodley@redhat.com>
3708
3709 commit 528c3b6d32f9c3319fd429de37bbca578538ed7c
3710 Merge: ec2d294684 d800747fa1
3711 Author: Karol Mroz <kmroz@suse.de>
3712 Date: Tue Oct 31 09:03:48 2017 -0700
3713
3714 Merge pull request #18438 from theanalyst/wip-21696-luminous
3715
3716 luminous: fix a bug about inconsistent unit of comparison
3717
3718 Reviewed-by: Casey Bodley <cbodley@redhat.com>
3719
3720 commit 3c3609b7e3ce7339a845f9191a709d12025fbbb2
3721 Author: Boris Ranto <branto@redhat.com>
3722 Date: Thu Sep 21 17:24:07 2017 +0200
3723
3724 selinux: Allow getattr on lnk sysfs files
3725
3726 This showed up during downstream testing for luminous. We are doing
3727 getattr on the sysfs lnk files and the current policy does not allow
3728 this.
3729
3730 Fixes: http://tracker.ceph.com/issues/21523
3731 Signed-off-by: Boris Ranto <branto@redhat.com>
3732 (cherry picked from commit 394c26adb97cd150233fe8760355f486d03624a4)
3733
3734 commit ec2d2946840fac65d9588f225adaa6f51c32f6b0
3735 Merge: 90017e7d93 def3d55eb7
3736 Author: Kefu Chai <tchaikov@gmail.com>
3737 Date: Tue Oct 31 13:04:00 2017 +0800
3738
3739 Merge pull request #18410 from kmroz/wip-21732-luminous
3740
3741 luminous: qa/suites/rest/basic/tasks/rest_test: whitelisting
3742
3743 Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
3744 Reviewed-by: Kefu Chai <kchai@redhat.com>
3745
3746 commit 90017e7d933b52794d32fef69d97d5ba529d3936
3747 Merge: 4f024c6831 c603faaf17
3748 Author: Yuri Weinstein <yuri.weinstein@gmail.com>
3749 Date: Mon Oct 30 20:23:39 2017 -0700
3750
3751 Merge pull request #18629 from ceph/wip-yuriw-21978-luminous
3752
3753 qa/suites/upgrade/jewel-x: Changed typo ('hammer' to 'jewel')
3754
3755 commit c603faaf171fd3074ffe5e1342e8b96cd261e097
3756 Author: Yuri Weinstein <yweinste@redhat.com>
3757 Date: Mon Oct 30 14:52:52 2017 -0700
3758
3759 Changed typo ('hammer' to 'jewel')
3760
3761 Fixes http://tracker.ceph.com/issues/21978
3762 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
3763
3764 commit 555746a09e8bb7bcf99da91f9d00dfab9791d80c
3765 Author: Patrick Donnelly <pdonnell@redhat.com>
3766 Date: Fri Oct 27 13:20:07 2017 -0700
3767
3768 MDSMonitor: wait for readable OSDMap before sanitizing
3769
3770 Fixes: http://tracker.ceph.com/issues/21945
3771
3772 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3773 (cherry picked from commit ca52f3bd93e6c743aa05171108527d877807b426)
3774
3775 commit be13cdc0d4e54ce23c6ecf658100ddd860b1b96f
3776 Author: Patrick Donnelly <pdonnell@redhat.com>
3777 Date: Tue Oct 3 12:25:12 2017 -0700
3778
3779 mds: clean up non-existent data pools in MDSMap
3780
3781 Older versions of Ceph weren't strict about preventing pool deletion when the
3782 MDSMap referred to to-be-deleted pool. If we are dealing with a cluster
3783 upgrade, we should try to gracefully handle that by cleaning out data pools
3784 that have been removed.
3785
3786 Reproduced this by allowing CephFS pools to be deleted:
3787
3788 diff --git a/src/mon/OSDMonitor.cc b/src/mon/OSDMonitor.cc
3789 index 85c47c13da6..694b240cb9f 100644
3790 --- a/src/mon/OSDMonitor.cc
3791 +++ b/src/mon/OSDMonitor.cc
3792 @@ -10962,7 +10962,7 @@ int OSDMonitor::_check_remove_pool(int64_t pool_id, const pg_pool_t& pool,
3793 FSMap const &pending_fsmap = mon->mdsmon()->get_pending();
3794 if (pending_fsmap.pool_in_use(pool_id)) {
3795 *ss << "pool '" << poolstr << "' is in use by CephFS";
3796 - return -EBUSY;
3797 + //return -EBUSY;
3798 }
3799
3800 if (pool.tier_of >= 0) {
3801
3802 pdonnell@icewind ~/ceph/build$ bin/ceph osd pool create derp 4 4
3803 pool 'derp' created
3804 pdonnell@icewind ~/ceph/build$ bin/ceph fs add_data_pool cephfs_a derp
3805 added data pool 3 to fsmap
3806 pdonnell@icewind ~/ceph/build$ bin/ceph osd pool rm derp derp --yes-i-really-really-mean-it
3807 pool 'derp' is in use by CephFSpool 'derp' removed
3808 pdonnell@icewind ~/ceph/build$ bin/ceph fs ls
3809 ...
3810 2017-10-03 12:50:48.409561 7f9e2e05b700 -1 /home/pdonnell/ceph/src/osd/OSDMap.h: In function 'const string& OSDMap::get_pool_name(int64_t) const' thread 7f9e2e05b700 time 2017-10-03 12:50:48.407897
3811 /home/pdonnell/ceph/src/osd/OSDMap.h: 1184: FAILED assert(i != pool_name.end())
3812
3813 ceph version 12.1.2-2624-g37884a41964 (37884a419640b446fffc1fa4d6074c97339fdd96) mimic (dev)
3814 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xf5) [0x564ebb5420f5]
3815 2: (()+0x41dade) [0x564ebb3cbade]
3816 3: (MDSMonitor::preprocess_command(boost::intrusive_ptr<MonOpRequest>)+0x1fb9) [0x564ebb4cd119]
3817
3818 Note when testing this fix, use something like this after removing the data pool:
3819
3820 pdonnell@icewind ~/ceph/build$ bin/ceph fs set cephfs_a max_mds 2
3821
3822 Setting max_mds will cause a new FSMap to be created where MDSMap::sanitize is
3823 called; this is simulating the initial load+sanitize of a Hammer legacy MDSMap
3824 by the mons.
3825
3826 Fixes: http://tracker.ceph.com/issues/21568
3827
3828 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3829
3830 (cherry picked from commit 7adf0fb819cc98702cd97214192770472eab5d27)
3831
3832 commit 23fa3b726368f036b31e53a0bec8ad4bc654d993
3833 Author: Patrick Donnelly <pdonnell@redhat.com>
3834 Date: Tue Oct 3 12:23:03 2017 -0700
3835
3836 mds: reduce variable scope
3837
3838 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3839 (cherry picked from commit 37884a419640b446fffc1fa4d6074c97339fdd96)
3840
3841 commit 4f024c68319a79bef9d937d7f2363a5b69575773
3842 Merge: 6166148078 5a0016131b
3843 Author: Alfredo Deza <alfredo@deza.pe>
3844 Date: Mon Oct 30 14:05:00 2017 -0400
3845
3846 Merge pull request #18627 from ceph/backport-18513
3847
3848 ceph-volume lvm zap backport
3849
3850 Reviewed-by: Alfredo Deza <adeza@redhat.com>
3851
3852 commit 5a0016131b1ec900255057876c98fc70e00542f0
3853 Author: Andrew Schoen <aschoen@redhat.com>
3854 Date: Fri Oct 27 11:29:50 2017 -0500
3855
3856 ceph-volume: set journal_uuid and journal_device when using a partition
3857
3858 This correctly sets the tags when a partition is used for a filestore
3859 journal.
3860
3861 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3862 (cherry picked from commit 1a8561d38dd7363dc920ae82ec1343b2b75a1ca2)
3863
3864 commit 05522e75f8d98658b5440d3c2f70e93ce65c65ce
3865 Author: Andrew Schoen <aschoen@redhat.com>
3866 Date: Tue Oct 24 10:13:40 2017 -0500
3867
3868 docs for ceph-volume lvm zap
3869
3870 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3871 (cherry picked from commit 3e93a31deda96ed6fb23fa19ce3e273de05f7d88)
3872
3873 commit cb1e81447f5c0c4eb8c0fd9fb11d0ceae3e26199
3874 Author: Andrew Schoen <aschoen@redhat.com>
3875 Date: Mon Oct 23 09:51:43 2017 -0500
3876
3877 ceph-volume: add tests for ceph-volume lvm zap
3878
3879 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3880 (cherry picked from commit 3d5e391693fc64747a4774287c968f842294eaa6)
3881
3882 commit 33927c10e78842bb4c4ce4c0e4051ccceb8bb9e8
3883 Author: Andrew Schoen <aschoen@redhat.com>
3884 Date: Mon Oct 23 09:44:07 2017 -0500
3885
3886 ceph-volume: print success message if zap succeeds
3887
3888 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3889 (cherry picked from commit 6d70762dee0cd9047c291cf9869f666a375e956b)
3890
3891 commit d8381ab509d9f60f6fe62c5692a9374b3187d5c9
3892 Author: Andrew Schoen <aschoen@redhat.com>
3893 Date: Fri Oct 20 09:58:48 2017 -0500
3894
3895 ceph-volume: terminal.write only takes one argument
3896
3897 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3898 (cherry picked from commit a5454eba241abd8cc1b1a660b12a1aec7c3c16e0)
3899
3900 commit 6f2bd88278f2c7dc4cfd156969f98d7cc8c3e763
3901 Author: Andrew Schoen <aschoen@redhat.com>
3902 Date: Thu Oct 19 16:29:39 2017 -0500
3903
3904 ceph-volume: the metadata field for the lv path is lv_path not path
3905
3906 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3907 (cherry picked from commit e3a9113e7025f1e3a3130ec1e2d565f37bf3d2dc)
3908
3909 commit 1dfe7e9854b00850b86168049821447d33298fff
3910 Author: Andrew Schoen <aschoen@redhat.com>
3911 Date: Thu Oct 19 14:59:26 2017 -0500
3912
3913 ceph-volume: update help text for ceph-volume lvm zap
3914
3915 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3916 (cherry picked from commit cbc38c4e4a7dcc24b31bcfa6af73eb8cf04f56ad)
3917
3918 commit c5206435a9bae9d93e6cd9a3c2b98127871ad94e
3919 Author: Andrew Schoen <aschoen@redhat.com>
3920 Date: Thu Oct 19 14:55:44 2017 -0500
3921
3922 ceph-volume: remove lvm metadata when zapping an lv
3923
3924 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3925 (cherry picked from commit 5f57fc87205c2d35da9a1f28c72e233ffb3fe4d9)
3926
3927 commit eb53ef67b4e3bf5afb6e414fd42caab67c4cfdf2
3928 Author: Andrew Schoen <aschoen@redhat.com>
3929 Date: Thu Oct 19 14:55:02 2017 -0500
3930
3931 ceph-volume: adds Volume.clear_tags
3932
3933 Will remove all tags for the current lv
3934
3935 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3936 (cherry picked from commit 3c9401f1618f7fcbea827fe7279e8dfde617d957)
3937
3938 commit 4ee13e0587c5e152fdac18004bc4336f8b90e4af
3939 Author: Andrew Schoen <aschoen@redhat.com>
3940 Date: Thu Oct 19 12:01:57 2017 -0500
3941
3942 ceph-volume: zap should leave lvs and partitions intact
3943
3944 This will remove filesystems and wipe data from any lv or partition
3945 given to 'ceph-volume lvm zap' but still leave it intact for further
3946 use.
3947
3948 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3949 (cherry picked from commit caba9fb80b358222192f736bd1b0ab31dca25cec)
3950
3951 commit 8c3ab3459abfebac20bb4ce3ddecf1a7a58cf401
3952 Author: Andrew Schoen <aschoen@redhat.com>
3953 Date: Thu Oct 19 11:44:11 2017 -0500
3954
3955 ceph-volume: adds utilites to wipe the fs and clear data when zapping
3956
3957 These should eventually move to a disk api.
3958
3959 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3960 (cherry picked from commit 2f64d4a0abd41afbcb9eba6a237642502d9a9135)
3961
3962 commit 8a0e7fad57e41e10d51e0e167b671668ee1aa286
3963 Author: Andrew Schoen <aschoen@redhat.com>
3964 Date: Thu Oct 19 10:35:51 2017 -0500
3965
3966 ceph-volume: adds tests for api.lvm.remove_lv
3967
3968 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3969 (cherry picked from commit 937b57438147681c2c6e32c6db38d8bea68d4731)
3970
3971 commit c6dd47ab6d1ec6784ec3cef8f65139baeaf4fa3a
3972 Author: Andrew Schoen <aschoen@redhat.com>
3973 Date: Thu Oct 19 10:35:10 2017 -0500
3974
3975 ceph-volume: api.lvm.remove_lv should return True when successful
3976
3977 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3978 (cherry picked from commit 7f055aa6deb3904cf0334e214c13a26098b08aa8)
3979
3980 commit 71ae0b8cabc0a696e6762d7f377f9f4b28d2a963
3981 Author: Andrew Schoen <aschoen@redhat.com>
3982 Date: Wed Oct 18 10:19:25 2017 -0500
3983
3984 ceph-volume: zap logical volumes
3985
3986 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3987 (cherry picked from commit 1d083a2191315ee94301c2f5f102a0906dd05fa8)
3988
3989 commit 7110922c42ee30fa25dc9dacbfc8d0f9ae2f2a79
3990 Author: Andrew Schoen <aschoen@redhat.com>
3991 Date: Wed Oct 18 10:19:00 2017 -0500
3992
3993 ceph-volume: adds a remove_lv command to the lvm api
3994
3995 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
3996 (cherry picked from commit cf98b6971ced0caa29ff4f7ac346df652177fa29)
3997
3998 commit 731610f18b9e4109ce72a4467af209144e4a127d
3999 Author: Andrew Schoen <aschoen@redhat.com>
4000 Date: Tue Oct 17 14:15:18 2017 -0500
4001
4002 ceph-volume: stubs out the ceph-volume lvm zap command
4003
4004 Signed-off-by: Andrew Schoen <aschoen@redhat.com>
4005 (cherry picked from commit 2e64b797ef6ae91623ffba8ae28d3f8ccc7d7b93)
4006
4007 commit c2237c7c6dbcd5420d8ed87c6f2648c3f4e6edae
4008 Author: Jason Dillaman <dillaman@redhat.com>
4009 Date: Fri Oct 27 09:58:20 2017 -0400
4010
4011 qa/suites/rbd: run cls tests for all dependencies
4012
4013 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4014 (cherry picked from commit 27613a63d1f1ee6fa7327cd1c63b875c0e5247f8)
4015
4016 commit 6b75efab390b3019e404f007090e9031328e1301
4017 Author: Jason Dillaman <dillaman@redhat.com>
4018 Date: Fri Oct 27 09:57:43 2017 -0400
4019
4020 cls/journal: fixed possible infinite loop in expire_tags
4021
4022 Fixes: http://tracker.ceph.com/issues/21956
4023 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4024 (cherry picked from commit 9e66dca49591e50b9cab5df311f1dc217eb58fcc)
4025
4026 commit 796e33647022de1fd831b31045242fb8e9d0e4d2
4027 Author: Kefu Chai <kchai@redhat.com>
4028 Date: Wed Aug 30 18:46:49 2017 +0800
4029
4030 ceph-disk: unlock all partitions when activate
4031
4032 should unlock all dmcrypted partitions when activating a device.
4033
4034 Signed-off-by: Kefu Chai <kchai@redhat.com>
4035 (cherry picked from commit ba2aa0cee9e077d8439ba31228b41beb2d827a04)
4036
4037 commit 3e9aad1a116e02bb126010f310ca2267177b5162
4038 Author: Felix Winterhalter <felix@audiofair.de>
4039 Date: Mon Jul 17 02:04:39 2017 +0200
4040
4041 ceph-disk activate unlocks bluestore data partition
4042
4043 Signed-off-by: Felix Winterhalter <felix@audiofair.de>
4044 (cherry picked from commit 1287caf2dbb5ef6e5f243fe1d23633946aef26f9)
4045
4046 commit 6b6eceee027e571d8d3da4af144391f8da85b53e
4047 Author: Yao Zongyou <yaozongyou@vip.qq.com>
4048 Date: Sat Oct 28 18:23:30 2017 +0800
4049
4050 ceph-bluestore-tool: the link target should not ending with new line
4051
4052 Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
4053 (cherry picked from commit 39c68d128cf29f8e0a617009d16c5edf471ead47)
4054
4055 commit cc84812507607d0a91233a513088094533a2d6a7
4056 Author: Yao Zongyou <yaozongyou@vip.qq.com>
4057 Date: Sat Oct 28 18:22:27 2017 +0800
4058
4059 ceph-bluestore-tool: the right action is prime-osd-dir not prime-osd-dev
4060
4061 Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
4062 (cherry picked from commit d418a04e9fed6bf91cc9acc5ac777eadf664c974)
4063
4064 commit 9d8e5d763b173247f95f0769fd52372a8a7a5371
4065 Author: John Spray <john.spray@redhat.com>
4066 Date: Mon Sep 25 10:44:28 2017 +0100
4067
4068 mon: implement MDSMonitor::get_store_prefixes
4069
4070 Fixes: http://tracker.ceph.com/issues/21534
4071 Signed-off-by: John Spray <john.spray@redhat.com>
4072 (cherry picked from commit a3c317b406c69b9d6a2d7df94806f4c308e6ee6a)
4073
4074 commit 338af1688147babb4e92523972175fe09ebb34b6
4075 Author: huanwen ren <ren.huanwen@zte.com.cn>
4076 Date: Mon Sep 25 15:01:02 2017 +0800
4077
4078 mon/mgr: sync mgr_command_descs table and mgr_metadata table
4079
4080 sync mgr_command_descs table and mgr_metadata table to new mons
4081
4082 Fixes: http://tracker.ceph.com/issues/21527
4083
4084 Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
4085 (cherry picked from commit 13f6aa3aaa6de0aeccec67d7c6f3effe43dcae49)
4086
4087 Conflict: in master PaxosService::get_store_prefixes(..) is marked const
4088 while in luminous, the cleanup commit which added the `const` is not
4089 backported yet, so drop the `const` in the backported commit.
4090
4091 commit de07d2954afb012e51d2eaca12c1763e29a19eca
4092 Author: John Spray <john.spray@redhat.com>
4093 Date: Mon Sep 25 10:37:18 2017 +0100
4094
4095 mon/OSDMonitor: tidy prefix definitions
4096
4097 We should define them in one place to make it easy
4098 when updating get_store_prefixes.
4099
4100 Fixes: http://tracker.ceph.com/issues/21534
4101 Signed-off-by: John Spray <john.spray@redhat.com>
4102 (cherry picked from commit 889ac5166ad8fd30678325ddc2da59f45db53f06)
4103
4104 commit 981e552d72c151b6bf2c9bb64b969f9446ef4789
4105 Author: huanwen ren <ren.huanwen@zte.com.cn>
4106 Date: Mon Sep 25 14:55:55 2017 +0800
4107
4108 mon/osd_metadata: sync osd_metadata table
4109
4110 sync osd_metadata table to new mons when add new mons
4111
4112 Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
4113 (cherry picked from commit 755ec735107c75156ae4935f7255bbfe5dc384d9)
4114
4115 commit 3f0ad5f453a259cc53f50b1a9515e8a720da4a1d
4116 Author: huanwen ren <ren.huanwen@zte.com.cn>
4117 Date: Mon Sep 25 14:55:55 2017 +0800
4118
4119 mon/osd_metadata: sync osd_metadata table
4120
4121 sync osd_metadata table to new mons when add new mons
4122
4123 Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
4124 (cherry picked from commit 6c20433bfb049ac6c69f6f7a979006e8b9ea0e29)
4125
4126 commit 61661480780e555fc501aec7c32163596e1e18d3
4127 Merge: c0ec364ad6 410434b3d2
4128 Author: Patrick Donnelly <pdonnell@redhat.com>
4129 Date: Sun Oct 29 11:06:28 2017 -0700
4130
4131 Merge PR #18385 into luminous
4132
4133 * refs/pull/18385/head:
4134 mds: fix race in PurgeQueue::wait_for_recovery()
4135 mds: open purge queue when transitioning out of standby replay
4136 mds: always re-probe mds log when standby replay done
4137
4138 Reviewed-by: John Spray <john.spray@redhat.com>
4139
4140 commit c0ec364ad6f54da7efbbb6b84ad34ea9782e3df2
4141 Merge: 5ee57e1b42 695d7ad511
4142 Author: Patrick Donnelly <pdonnell@redhat.com>
4143 Date: Sun Oct 29 11:06:24 2017 -0700
4144
4145 Merge PR #18316 into luminous
4146
4147 * refs/pull/18316/head:
4148 mds: prevent trim count from underflowing
4149
4150 Reviewed-by: Zheng Yan <zyan@redhat.com>
4151
4152 commit 5ee57e1b42d93fc0dc77b1221c362753684b280e
4153 Merge: 84f4bf40da b99acfd601
4154 Author: Patrick Donnelly <pdonnell@redhat.com>
4155 Date: Sun Oct 29 11:06:20 2017 -0700
4156
4157 Merge PR #18300 into luminous
4158
4159 * refs/pull/18300/head:
4160 mds: keep CInode::STATE_QUEUEDEXPORTPIN state when exporting inode
4161
4162 Reviewed-by: Zheng Yan <zyan@redhat.com>
4163 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
4164
4165 commit 84f4bf40dade5ef55eba139d63187959b98e84e5
4166 Merge: 2638d5039e 460268b5e9
4167 Author: Patrick Donnelly <pdonnell@redhat.com>
4168 Date: Sun Oct 29 11:06:16 2017 -0700
4169
4170 Merge PR #17729 into luminous
4171
4172 * refs/pull/17729/head:
4173 ceph.in: validate service glob
4174
4175 Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
4176 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
4177
4178 commit 2638d5039e615035563338cd428b44fb23d879ff
4179 Merge: f6f88c2a9b 2973b6d418
4180 Author: Patrick Donnelly <pdonnell@redhat.com>
4181 Date: Sun Oct 29 11:00:18 2017 -0700
4182
4183 Merge PR #18299 into luminous
4184
4185 * refs/pull/18299/head:
4186 mds: update client metadata for already open session
4187
4188 Reviewed-by: Zheng Yan <zyan@redhat.com>
4189 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
4190
4191 commit f6f88c2a9b40cf84658319a07a2bc26858763093
4192 Merge: 388901f091 f353a1e805
4193 Author: Patrick Donnelly <pdonnell@redhat.com>
4194 Date: Sun Oct 29 11:00:14 2017 -0700
4195
4196 Merge PR #18298 into luminous
4197
4198 * refs/pull/18298/head:
4199 osdc/ObjectCacher: limit memory usage of BufferHead
4200
4201 Reviewed-by: Zheng Yan <zyan@redhat.com>
4202
4203 commit 388901f0911b2d45f5b5ca2d653da5c605d99e2d
4204 Merge: 45cfeae6eb c5ccbf1108
4205 Author: Patrick Donnelly <pdonnell@redhat.com>
4206 Date: Sun Oct 29 11:00:10 2017 -0700
4207
4208 Merge PR #18085 into luminous
4209
4210 * refs/pull/18085/head:
4211 ceph_volume_client: fix setting caps for IDs
4212
4213 Reviewed-by: Ramana Raja <rraja@redhat.com>
4214
4215 commit 45cfeae6ebd5a0910c03ff323ecdd5740e569b41
4216 Merge: ecd5b0066f 1021fe235c
4217 Author: Patrick Donnelly <pdonnell@redhat.com>
4218 Date: Sun Oct 29 11:00:06 2017 -0700
4219
4220 Merge PR #18030 into luminous
4221
4222 * refs/pull/18030/head:
4223 qa: relax cap expected value check
4224 mds: improve cap min/max ratio descriptions
4225 mds: fix whitespace
4226 mds: cap client recall to min caps per client
4227 mds: fix conf types
4228 mds: fix whitespace
4229 doc/cephfs: add client min cache and max cache ratio describe
4230 mds: adding tunable features for caps_per_client
4231
4232 Reviewed-by: Zheng Yan <zyan@redhat.com>
4233
4234 commit ecd5b0066fc091f34a166989b2e68e165c390dd0
4235 Merge: 04acd559db d5e583490d
4236 Author: Patrick Donnelly <pdonnell@redhat.com>
4237 Date: Sun Oct 29 10:55:32 2017 -0700
4238
4239 Merge PR #17921 into luminous
4240
4241 * refs/pull/17921/head:
4242 ceph_volume_client: perform snapshot operations in
4243
4244 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
4245 Reviewed-by: Ramana Raja <rraja@redhat.com>
4246
4247 commit add8c3db195acfda75a1628196e839b0147e7c3f
4248 Author: Matt Benjamin <mbenjamin@redhat.com>
4249 Date: Thu Oct 26 18:28:10 2017 -0400
4250
4251 rgw_file: set s->obj_size from bytes_written
4252
4253 Required to store correct final accounted_size of objects in
4254 RGWWriteWriteRequest::write_finish.
4255
4256 Fixes: http://tracker.ceph.com/issues/21940
4257
4258 Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
4259 (cherry picked from commit b1f528d35aeccabb4e5818aec6feb8e53e562500)
4260
4261 commit 8cbb2eb937cae4e136ef77bc93e6d5346e21c8da
4262 Author: Sage Weil <sage@redhat.com>
4263 Date: Mon Oct 9 08:15:21 2017 -0500
4264
4265 qa/cephfs: test ec data pool
4266
4267 Signed-off-by: Sage Weil <sage@redhat.com>
4268 (cherry picked from commit d0732fc96fbc6849dd51b391d85f765c74cfb593)
4269
4270 commit 04acd559db55c6e8040a2ba65a850e72a04ad2ab
4271 Merge: d294493c42 8a87d43db2
4272 Author: Andrew Schoen <andrew.schoen@gmail.com>
4273 Date: Fri Oct 27 11:34:15 2017 -0500
4274
4275 Merge pull request #18593 from ceph/luminous-wip-bz1499840
4276
4277 luminous ceph-volume lvm bluestore support
4278
4279 Reviewed-by: Andrew Schoen <aschoen@redhat.com>
4280
4281 commit d294493c42ea21e85a1fd36eb8623229a2ff6ea6
4282 Merge: 58c1b8c4f2 34cd96d342
4283 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4284 Date: Fri Oct 27 17:30:35 2017 +0200
4285
4286 Merge pull request #18334 from kmroz/wip-21816-luminous
4287
4288 luminous: rgw: fix bilog entries on multipart complete
4289
4290 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4291
4292 commit 58c1b8c4f28b73d9b7db1cf3fe79ae5062832c88
4293 Merge: 8742c619b0 d7f6b93af4
4294 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4295 Date: Fri Oct 27 17:30:07 2017 +0200
4296
4297 Merge pull request #17861 from smithfarm/wip-21441-luminous
4298
4299 luminous: rbd: [cli] mirror getter commands will fail if mirroring has never been enabled
4300
4301 commit 8742c619b03cc5f048dc08f76d67ea64c109b4b3
4302 Merge: 7c03693d0b f8bfd9458d
4303 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4304 Date: Fri Oct 27 17:29:55 2017 +0200
4305
4306 Merge pull request #18416 from kmroz/wip-21855-luminous
4307
4308 luminous: librbd: object map batch update might cause OSD suicide timeout
4309
4310 Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
4311
4312 commit 7c03693d0bd1a7108bd2d55eda7b7bd1e4e7f904
4313 Merge: fc486a26cb 8b3e9917a7
4314 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4315 Date: Fri Oct 27 17:29:43 2017 +0200
4316
4317 Merge pull request #18337 from kmroz/wip-21640-luminous
4318
4319 luminous: rbd-mirror: forced promotion can result in incorrect status
4320
4321 Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
4322
4323 commit fc486a26cb12466df6269ec4c7717332be2ed92c
4324 Merge: c944c688e5 4ebd4b3928
4325 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4326 Date: Fri Oct 27 17:29:22 2017 +0200
4327
4328 Merge pull request #18336 from kmroz/wip-21639-luminous
4329
4330 luminous: librbd: snapshots should be created/removed against data pool
4331
4332 Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
4333
4334 commit c944c688e5a4a7935233e7fb3824b97d9afe44d9
4335 Merge: bc7e648b18 34af07f97a
4336 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4337 Date: Fri Oct 27 17:29:03 2017 +0200
4338
4339 Merge pull request #17860 from smithfarm/wip-21299-luminous
4340
4341 luminous: rbd: [rbd-mirror] asok hook names not updated when image is renamed
4342
4343 Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
4344
4345 commit 8a87d43db25a364841d969636bd74b7590c3d563
4346 Author: Alfredo Deza <adeza@redhat.com>
4347 Date: Thu Oct 26 15:09:18 2017 -0400
4348
4349 ceph-volume lvm.activate remove links on activate before priming
4350
4351 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4352 (cherry picked from commit 634b5caaed7c9188e426727e83a0768bdbc51f0d)
4353
4354 commit 869d13037dbb2b8882c4a4a91ec20c9814bcc438
4355 Author: Alfredo Deza <adeza@redhat.com>
4356 Date: Thu Oct 26 07:48:24 2017 -0400
4357
4358 ceph-volume lvm.activate ceph-bluestore-tool needs --cluster too
4359
4360 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4361 (cherry picked from commit fb36087bc3c7e7bb8358cbf8ad84409fa23fac68)
4362
4363 commit 3baab9f4e286c3b54c179b0f471435c2dbc859b2
4364 Author: Alfredo Deza <adeza@redhat.com>
4365 Date: Wed Oct 25 18:57:28 2017 -0400
4366
4367 ceph-volume lvm.activate consume cluster_name from lvm metadata
4368
4369 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4370 (cherry picked from commit 2b7ff497fe9e0e167ab01bf0d8ce5e26f0da836f)
4371
4372 commit 8f41a983356ee9d182f8247f2da8db15848afae0
4373 Author: Alfredo Deza <adeza@redhat.com>
4374 Date: Wed Oct 25 18:57:03 2017 -0400
4375
4376 ceph-volume lvm.prepare persist cluster_name on lvm metadata
4377
4378 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4379 (cherry picked from commit 6d38ad987e08791be379f6c006c1eb5bf9464415)
4380
4381 commit 1ae30d3130af845ebf563a74a1e2642f5236f1ed
4382 Author: Alfredo Deza <adeza@redhat.com>
4383 Date: Wed Oct 25 15:30:43 2017 -0400
4384
4385 ceph-volume util.prepare bluestore db and wal paths are to devices, not osd dir paths
4386
4387 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4388 (cherry picked from commit fd616acd6ae0f184c1757e7de38fc746d526908c)
4389
4390 commit fdfbfb8140fc1be3123d1254f4463613dc7c7cb0
4391 Author: Alfredo Deza <adeza@redhat.com>
4392 Date: Wed Oct 25 15:30:06 2017 -0400
4393
4394 ceph-volume lvm.prepare bluestore wal and db links get created with mkfs
4395
4396 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4397 (cherry picked from commit 80698d2309a221d2318b11be9b8f8a95b51416ea)
4398
4399 commit 6ac58f3cd5e292153c82d881a30db1f6c4bfd936
4400 Author: Alfredo Deza <adeza@redhat.com>
4401 Date: Wed Oct 25 10:28:43 2017 -0400
4402
4403 ceph-volume lvm.prepare use wal and db for mkfs
4404
4405 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4406 (cherry picked from commit 4970ab5c804111ce4b2b57817f1e29d58b18a893)
4407
4408 commit c9ecd14ca220e45960650715703cae3e4376e3c0
4409 Author: Alfredo Deza <adeza@redhat.com>
4410 Date: Tue Oct 24 16:28:33 2017 -0400
4411
4412 ceph-volume lvm.prepare ensure tags are set for ceph.type correctly for block and data
4413
4414 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4415 (cherry picked from commit 58dbefd3be7bad51e6c56c50fbfb450e205b3036)
4416
4417 commit 76fb5fec94a9bbfed1163a23faf87e19d5617bd4
4418 Author: Alfredo Deza <adeza@redhat.com>
4419 Date: Tue Oct 24 16:26:03 2017 -0400
4420
4421 ceph-volume lvm.activate check if lv device is mounted at path
4422
4423 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4424 (cherry picked from commit 1ead135bef801280e7cec21283c95c7ba440d84b)
4425
4426 commit 343362027368c4170bd785f1633afeb5ed90f3a2
4427 Author: Alfredo Deza <adeza@redhat.com>
4428 Date: Tue Oct 24 15:55:21 2017 -0400
4429
4430 ceph-volume lvm.prepare default to using bluestore
4431
4432 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4433 (cherry picked from commit 39dd0d1d10aba08c3e8299eb1702260274a756a7)
4434
4435 commit 0a27fe88266458eead5a011c27cc323f5b7173a5
4436 Author: Alfredo Deza <adeza@redhat.com>
4437 Date: Tue Oct 24 15:54:57 2017 -0400
4438
4439 ceph-volume lvm.create default to using bluestore
4440
4441 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4442 (cherry picked from commit d3145da6e643dedb2fbed72e7d4d0cddf397c5e3)
4443
4444 commit bd2e0aa78ad1a500935c3134f4d1e6c3413a26ae
4445 Author: Alfredo Deza <adeza@redhat.com>
4446 Date: Tue Oct 24 15:54:11 2017 -0400
4447
4448 ceph-volume lvm.common remove boolean defaults for CLI flags
4449
4450 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4451 (cherry picked from commit a7d5965ab532a621f402bad55d45dfed61d90cc5)
4452
4453 commit c3d474af562ec5b8658bed6362046b0208a2c0eb
4454 Author: Alfredo Deza <adeza@redhat.com>
4455 Date: Tue Oct 24 13:29:18 2017 -0400
4456
4457 ceph-volume lvm.prepare update to use create_osd_path
4458
4459 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4460 (cherry picked from commit bafb72144666f891773bed95e9a0f757673af2e0)
4461
4462 commit bc7e648b182569865d1c2a2aea6da1e52a3d3cb1
4463 Merge: 690be9c711 b015ce1161
4464 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4465 Date: Fri Oct 27 16:57:48 2017 +0200
4466
4467 Merge pull request #18138 from kmroz/wip-21684-luminous
4468
4469 luminous: rgw: stop/join TokenCache revoke thread only if started.
4470
4471 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4472
4473 commit 690be9c711b34be1ec4254ba0cedf7d6755f59f6
4474 Merge: 5727e4a33e 06c31a6cee
4475 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4476 Date: Fri Oct 27 16:55:22 2017 +0200
4477
4478 Merge pull request #17994 from ukernel/luminous-21337
4479
4480 luminous: mds: make sure snap inode's last matches its parent dentry's last
4481
4482 Reviewed-By: Patrick Donelly <pdonelly@redhat.com>
4483
4484 commit 5727e4a33e0b82e0f9591251572b61458ec2cfae
4485 Merge: d973d6d7ae 624b3ac505
4486 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4487 Date: Fri Oct 27 16:52:43 2017 +0200
4488
4489 Merge pull request #18431 from theanalyst/wip-21857-luminous
4490
4491 luminous: rgw: We cant't get torrents if objects are encrypted using SSE-C
4492
4493 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4494
4495 commit 02013a714ec5fa6c2ff1073e432b8f6b9ff41305
4496 Author: Alfredo Deza <adeza@redhat.com>
4497 Date: Mon Oct 23 09:44:27 2017 -0400
4498
4499 ceph-volume lvm.activate only prime-osd-dir when directory is empty
4500
4501 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4502 (cherry picked from commit 9bb6cfd867c2d8e972093d023622f8c2e5b440d4)
4503
4504 commit 28593dbf1caeeec8f7c69dbd06e2ff9759afd072
4505 Author: Alfredo Deza <adeza@redhat.com>
4506 Date: Mon Oct 23 09:20:26 2017 -0400
4507
4508 ceph-volume lvm.activate safeguard against auto detect objectstore flag not being set
4509
4510 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4511 (cherry picked from commit c9b5f352a8f9e2743e5dca3a0479c8099a59fd12)
4512
4513 commit 8df51c8af5d95d67effece720ec2ff82517155b9
4514 Author: Alfredo Deza <adeza@redhat.com>
4515 Date: Fri Oct 20 15:18:20 2017 -0400
4516
4517 ceph-volume util.system use strings for comparison in py3
4518
4519 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4520 (cherry picked from commit 1b671a8602b036cb8d53bc40eb70198c13143051)
4521
4522 commit 1f09ee754fec40c4b17ea33829e6449d8749690a
4523 Author: Alfredo Deza <adeza@redhat.com>
4524 Date: Fri Oct 20 15:10:08 2017 -0400
4525
4526 f ceph-volume tests update changes from the help menu in lvm
4527
4528 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4529 (cherry picked from commit 3ddcd3c2f19cc848a11a2882f150462ad2f26c65)
4530
4531 commit ec7c42bd59dc05cb8bad082d64ffdc28f13d3dc8
4532 Author: Alfredo Deza <adeza@redhat.com>
4533 Date: Fri Oct 20 14:12:02 2017 -0400
4534
4535 ceph-volume lvm.common --journal-size doesn't accept a volume group
4536
4537 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4538 (cherry picked from commit a8282e9a580bcfa74abdd33032e2ce2851b5cf29)
4539
4540 commit 243098815d1d49570c193767d008cbc4fa0f174b
4541 Author: Alfredo Deza <adeza@redhat.com>
4542 Date: Fri Oct 20 14:04:31 2017 -0400
4543
4544 ceph-volume lvm.prepare filestore does not require a volume group
4545
4546 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4547 (cherry picked from commit 3653f105927d455b8df143797af0cfe72f8d6834)
4548
4549 commit da5f764a083613e5d74d1401da65c2ba3aff5fb4
4550 Author: Alfredo Deza <adeza@redhat.com>
4551 Date: Fri Oct 20 14:04:05 2017 -0400
4552
4553 ceph-volume lvm.common volume groups are no longer required
4554
4555 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4556 (cherry picked from commit 526c0aa81ac8eed95c2b4664a00ded2118372fff)
4557
4558 commit eaa9150d4a6bacf62fcf485e8d36430743ac06cf
4559 Author: Alfredo Deza <adeza@redhat.com>
4560 Date: Fri Oct 20 12:07:06 2017 -0400
4561
4562 doc/ceph-volume activate workflow mention tmpfs in osd dirs
4563
4564 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4565 (cherry picked from commit 8788fe3721034f390240c01493bc1d27d65a73a5)
4566
4567 commit d65af56eaaab728d8c81ddb69b967cb13f177766
4568 Author: Alfredo Deza <adeza@redhat.com>
4569 Date: Fri Oct 20 12:02:10 2017 -0400
4570
4571 doc/ceph-volume update activation to include bluestore support
4572
4573 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4574 (cherry picked from commit 288a3124793d11d71b540555fd03c2f61a79dd16)
4575
4576 commit 6545b1c14e84af5f25fd4bbd405b56f7b5797113
4577 Author: Alfredo Deza <adeza@redhat.com>
4578 Date: Fri Oct 20 11:58:47 2017 -0400
4579
4580 doc/ceph-volume update create to indicate bluestore support
4581
4582 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4583 (cherry picked from commit 61ce8b4b844fcb64fc95373c5515de902a52fc8c)
4584
4585 commit d973d6d7aefae1c34b664f98955baed4c841579b
4586 Merge: cf621f8b4e 5b5f0b5a33
4587 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4588 Date: Fri Oct 27 16:49:03 2017 +0200
4589
4590 Merge pull request #17858 from smithfarm/wip-21448-luminous
4591
4592 luminous: rgw: string_view instance points to expired memory in PrefixableSignatureHelper
4593
4594 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4595
4596 commit cf621f8b4e8138284843f6d979aca61651a854bd
4597 Merge: e0c3a05959 0b3a974be7
4598 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4599 Date: Fri Oct 27 16:48:54 2017 +0200
4600
4601 Merge pull request #18442 from theanalyst/wip-21637-luminous
4602
4603 luminous: encryption: PutObj response does not include sse-kms headers
4604
4605 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4606 Reviewed-By: Matt Benjamin <mbenjamin@redhat.com>
4607
4608 commit e0c3a05959a70b4cf4213320ba7c990578bf8c19
4609 Merge: dd7aa70301 14a1dcb1ff
4610 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4611 Date: Fri Oct 27 16:48:26 2017 +0200
4612
4613 Merge pull request #18437 from theanalyst/wip-21698-luminous
4614
4615 luminous: radosgw-admin usage show loops indefinitly
4616
4617 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4618
4619 commit dd7aa7030144d42958f92af5c7f6804a402f3b6d
4620 Merge: 3a8f046716 c3a719da27
4621 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4622 Date: Fri Oct 27 16:48:12 2017 +0200
4623
4624 Merge pull request #18434 from theanalyst/wip-21817-luminous
4625
4626 luminous: rgw: zone compression type is not validated
4627
4628 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4629 Reviewed-By: Matt Benjamin <mbenjamin@redhat.com>
4630
4631 commit 3a8f046716456eb0f51db79f152f3dc67d84c319
4632 Merge: 0d9b3a01d0 4c18ac1240
4633 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4634 Date: Fri Oct 27 16:47:48 2017 +0200
4635
4636 Merge pull request #18440 from theanalyst/wip-21652-luminous
4637
4638 luminous: policy checks missing from Get/SetRequestPayment operations
4639
4640 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4641
4642 commit 0d9b3a01d0972a2fc5ae9550ba80c38acd9edbeb
4643 Merge: aa71baeabe a3e2ae4925
4644 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4645 Date: Fri Oct 27 16:47:33 2017 +0200
4646
4647 Merge pull request #18441 from theanalyst/wip-21651-luminous
4648
4649 luminous: rgw: avoid logging keystone revocation failures when no keystone is configured
4650
4651 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4652
4653 commit aa71baeabef5aa7eb6903593b3dfcc8878227c99
4654 Merge: 1067293a7e 0b84dd07c4
4655 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4656 Date: Fri Oct 27 16:47:13 2017 +0200
4657
4658 Merge pull request #18443 from theanalyst/wip-21634-luminous
4659
4660 luminous: s3:GetBucketLocation bucket policy fails with 403
4661
4662 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4663
4664 commit 1067293a7e21fc835447c9e5e1d8416902593ba1
4665 Merge: f2f8aef89c abefb578c3
4666 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4667 Date: Fri Oct 27 16:46:59 2017 +0200
4668
4669 Merge pull request #18444 from theanalyst/wip-21635-luminous
4670
4671 luminous: s3:GetBucketCORS/s3:PutBucketCORS policy fails with 403
4672
4673 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4674
4675 commit f2f8aef89c3144ac5d859ea0fe8a7db57cfa8ad6
4676 Merge: 385d84b8eb 0e65ea466f
4677 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4678 Date: Fri Oct 27 16:46:44 2017 +0200
4679
4680 Merge pull request #18430 from theanalyst/wip-21695-luminous
4681
4682 luminous: failed CompleteMultipartUpload request does not release lock
4683
4684 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4685 Reviewed-By: Matt Benjamin <mbenjamin@redhat.com>
4686
4687 commit 385d84b8ebb3a4192ce4817aaf6c99b27af0190d
4688 Merge: 4a74a41c47 f9850d2148
4689 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4690 Date: Fri Oct 27 16:46:13 2017 +0200
4691
4692 Merge pull request #18445 from theanalyst/wip-21633-luminous
4693
4694 luminous: s3:GetBucketWebsite/PutBucketWebsite fails with 403
4695
4696 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4697
4698 commit 4a74a41c473fcda61f156d8bf720bf0e4cf0aec0
4699 Merge: 14cb83cd07 8b420c4627
4700 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4701 Date: Fri Oct 27 16:45:54 2017 +0200
4702
4703 Merge pull request #18436 from theanalyst/wip-21789-luminous
4704
4705 luminous: user creation can overwrite existing user even if different uid is given
4706
4707 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4708
4709 commit 14cb83cd077258e061cfa09733cf0b9a82f7507a
4710 Merge: 0339b8b599 fe45086a54
4711 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4712 Date: Fri Oct 27 16:45:36 2017 +0200
4713
4714 Merge pull request #18435 from theanalyst/wip-21790-luminous
4715
4716 luminous: RGW: Multipart upload may double the quota
4717
4718 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4719
4720 commit 0339b8b599f313e6a7b176f0f8b94b8101ab50c3
4721 Merge: 68cc868d1f 248bd94dab
4722 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4723 Date: Fri Oct 27 16:45:19 2017 +0200
4724
4725 Merge pull request #18432 from theanalyst/wip-21856-luminous
4726
4727 disable dynamic resharding in multisite enviorment
4728
4729 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4730
4731 commit 68cc868d1fdca55308fa1aba0bb708d07170e668
4732 Merge: f337bef88a 17df0ba8f0
4733 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
4734 Date: Fri Oct 27 16:44:40 2017 +0200
4735
4736 Merge pull request #18429 from theanalyst/wip-21792-luminous
4737
4738 luminous: encryption: reject requests that don't provide all expected headers
4739
4740 Reviewed-By: Casey Bodley <cbodley@redhat.com>
4741
4742 commit 29470eac4ca939c824b56f4fbc03c8b7814f9d02
4743 Author: Alfredo Deza <adeza@redhat.com>
4744 Date: Fri Oct 20 11:51:55 2017 -0400
4745
4746 doc/ceph-volume update prepare with bluestore workflow
4747
4748 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4749 (cherry picked from commit 9f1a5627399e2589fe706b158a32a9fb8642ac23)
4750
4751 commit c90e473ff35d15d309eb92dbdc6b9df2e8bd5ecc
4752 Author: Alfredo Deza <adeza@redhat.com>
4753 Date: Fri Oct 20 10:15:09 2017 -0400
4754
4755 doc/ceph-volume update filestore to indicate it is not the only/default objectstore
4756
4757 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4758 (cherry picked from commit c93603e5764e021305cfeb1c297ee16318126fe1)
4759
4760 commit 3890c47dddd0d028b0c003cb46a9bec670c445f1
4761 Author: Alfredo Deza <adeza@redhat.com>
4762 Date: Fri Oct 20 10:00:17 2017 -0400
4763
4764 doc/ceph-volume elaborate on env vars for interval and tries in activation
4765
4766 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4767 (cherry picked from commit 1dc24d1a7065b4e23b1bfa0e7c6d263b5ebc6906)
4768
4769 commit 88240acf19176ae5c139836b7d46848e15ef5454
4770 Author: Alfredo Deza <adeza@redhat.com>
4771 Date: Fri Oct 20 09:33:55 2017 -0400
4772
4773 ceph-volume lvm.common update cli flags help for bluestore support
4774
4775 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4776 (cherry picked from commit c9693fb3f8386016aba5d7c8f53f5f71f948c88d)
4777
4778 commit a945e7776309d39955918cec7e0c5f1895abc39b
4779 Author: Alfredo Deza <adeza@redhat.com>
4780 Date: Fri Oct 20 09:23:35 2017 -0400
4781
4782 ceph-volume util.disk st_mode is needed for stat()
4783
4784 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4785 (cherry picked from commit e3b5663f7968e44ec0cd6db2bfc43acdb233e314)
4786
4787 commit e833916afe22e9c4765344229b5b89cfc9af1b14
4788 Author: Alfredo Deza <adeza@redhat.com>
4789 Date: Fri Oct 20 09:23:02 2017 -0400
4790
4791 ceph-volume decorators always log to the file with exceptions
4792
4793 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4794 (cherry picked from commit cb3533a72571251d9f1b6171f783246462726857)
4795
4796 commit 53e9cf6fcd7549b4bfa78d7568d56b30b38e81fd
4797 Author: Alfredo Deza <adeza@redhat.com>
4798 Date: Fri Oct 20 08:49:32 2017 -0400
4799
4800 ceph-volume tests verify behavior of get_lv_from_argument
4801
4802 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4803 (cherry picked from commit adabbd462bcb19a6da65211e24dfb2b9b5043ef4)
4804
4805 commit 40cfec281cc2584b2e2987f356109c6c160d4597
4806 Author: Alfredo Deza <adeza@redhat.com>
4807 Date: Fri Oct 20 08:48:01 2017 -0400
4808
4809 ceph-volume api.lvm return result of get_lv when using arguments
4810
4811 If the argument is an absolute path it is fine to just return whatever
4812 get_lv finds since it is a "safe" call, it will return a None if nothing
4813 is found
4814
4815 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4816 (cherry picked from commit f209c9d4d50bd7abe0f7f6b9fb29359cb7196718)
4817
4818 commit 7139077aab892c3213815d1dcf71d93df80a32c8
4819 Author: Alfredo Deza <adeza@redhat.com>
4820 Date: Fri Oct 20 08:12:01 2017 -0400
4821
4822 ceph-volume lvm.listing support bluestore, not only filestore
4823
4824 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4825 (cherry picked from commit 6a5b89a475c2a36022ca09dbb7f6b94cc3b44881)
4826
4827 commit 654e06f1202596d5cecef9d03134861eed053882
4828 Author: Alfredo Deza <adeza@redhat.com>
4829 Date: Fri Oct 20 08:10:51 2017 -0400
4830
4831 ceph-volume api.lvm allow full paths to detect lv from arguments
4832
4833 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4834 (cherry picked from commit 8d257101b1556ec5ce805622e9b7b6b74f6b000d)
4835
4836 commit 454d48eb29f4429370b831645a29e0450b5b46b1
4837 Author: Alfredo Deza <adeza@redhat.com>
4838 Date: Fri Oct 20 08:10:26 2017 -0400
4839
4840 ceph-volume tests add support for bluestore list verification
4841
4842 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4843 (cherry picked from commit 4674da9c07f871bf1f25bb782c136fe082095a14)
4844
4845 commit 8d72737f90b0cd1db860678ebb66596e233fd646
4846 Author: Alfredo Deza <adeza@redhat.com>
4847 Date: Thu Oct 19 13:20:55 2017 -0400
4848
4849 ceph-volume tests activate with fsid works for bluestore and filestore
4850
4851 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4852 (cherry picked from commit 5b9f0853f780db3b0af6b4b7c1ad1d59184069c9)
4853
4854 commit 846aa2492f6db342d9fb4c477c2e13e61e414aaf
4855 Author: Alfredo Deza <adeza@redhat.com>
4856 Date: Thu Oct 19 13:14:05 2017 -0400
4857
4858 ceph-volume tests arg validator can accept absolute paths
4859
4860 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4861 (cherry picked from commit 15586715f506505a57ec5122416541479df74bc8)
4862
4863 commit 2c9ee51a0a7ed5edc900316c19ba27facb9163eb
4864 Author: Alfredo Deza <adeza@redhat.com>
4865 Date: Thu Oct 19 12:03:17 2017 -0400
4866
4867 ceph-volume tests update changes from the help menu in lvm
4868
4869 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4870 (cherry picked from commit 39bdc2e3f621a32bcbb3dfe64f156bbfd7e4f5ee)
4871
4872 commit 5724bb04bb74e17b9f7e96b3a3e434cac720c4ed
4873 Author: Alfredo Deza <adeza@redhat.com>
4874 Date: Thu Oct 19 11:46:57 2017 -0400
4875
4876 ceph-volume tests update to get_lv from get_journal_lv
4877
4878 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4879 (cherry picked from commit 9be1012072f36e21a3f3cef42a42f7f1eb83c64e)
4880
4881 commit 43e25933701605ac8cd7cb3d6fbd4cbf6705565e
4882 Author: Alfredo Deza <adeza@redhat.com>
4883 Date: Thu Oct 19 11:30:29 2017 -0400
4884
4885 ceph-volume tests.util new path/device mount interface
4886
4887 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4888 (cherry picked from commit d5984bad97347e58318793fc05da84832d323113)
4889
4890 commit 9b36a8bf8d471047dc94cdfcac1f84a9802b9fc5
4891 Author: Alfredo Deza <adeza@redhat.com>
4892 Date: Thu Oct 19 09:49:25 2017 -0400
4893
4894 ceph-volume tests update api.lvm tests
4895
4896 The create_lv signature changed to require full size description and
4897 tags need to be an actual dictionary (vs. keyword args)
4898
4899 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4900 (cherry picked from commit e8a18637531cde59d73a97d106958489c1d12117)
4901
4902 commit ea57e70e6f826ac17eae0226b9d916e8bff4d021
4903 Author: Alfredo Deza <adeza@redhat.com>
4904 Date: Wed Oct 18 16:06:55 2017 -0400
4905
4906 ceph-volume lvm.activate ceph-bluestore-tool should populate the osd dir
4907
4908 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4909 (cherry picked from commit f3bb616bcf8a4737a3701ebf812de831785d6341)
4910
4911 commit fe3b61ac0da67d9c80ead24c6ccf79e1507fa132
4912 Author: Alfredo Deza <adeza@redhat.com>
4913 Date: Wed Oct 18 15:06:01 2017 -0400
4914
4915 ceph-volume lvm.activate auto detect objectstore type
4916
4917 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4918 (cherry picked from commit 472aa0b1997a0b1301b699b7ce30dce728aaea0c)
4919
4920 commit 5da9775184e4bc9bf1b83d18eae602c9a510a89f
4921 Author: Alfredo Deza <adeza@redhat.com>
4922 Date: Wed Oct 18 15:00:19 2017 -0400
4923
4924 ceph-volume lvm.trigger enable objectstore auto detection for activate
4925
4926 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4927 (cherry picked from commit f579ef07026564f1a94b2923a2e4640ade2da503)
4928
4929 commit 307c99e4382895e6b42c193e9b98b9206fd57f9a
4930 Author: Alfredo Deza <adeza@redhat.com>
4931 Date: Wed Oct 18 12:00:34 2017 -0400
4932
4933 ceph-volume lvm.activate add bluestore support for activation
4934
4935 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4936 (cherry picked from commit 5696fed09b65044142b34f89492a6d91d3243e14)
4937
4938 commit 70632b0fac2fa7e411418c90a50b99391379f436
4939 Author: Alfredo Deza <adeza@redhat.com>
4940 Date: Wed Oct 18 11:40:38 2017 -0400
4941
4942 ceph-volume util.system create mappings of mounts
4943
4944 This makes it easier for consumers to detect a path, or a device that
4945 might be mounted or might have more than one mount, including tmpfs and
4946 devtmpfs support, which was just not possible before.
4947
4948 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4949 (cherry picked from commit f61007cc650f6964ef2ff3ea98a1debf02713198)
4950
4951 commit 839dc1f554a12fb109ca1f992784dd4f4933898a
4952 Author: Alfredo Deza <adeza@redhat.com>
4953 Date: Mon Oct 16 06:51:05 2017 -0400
4954
4955 ceph-volume util.prepare separate filestore vs. bluestore prepare utils
4956
4957 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4958 (cherry picked from commit 85cdc783008ff0e0566c34aaab7cd5f12db1cbc7)
4959
4960 commit deae88983d80cedcdc842d192f8d659b7533d3dc
4961 Author: Alfredo Deza <adeza@redhat.com>
4962 Date: Mon Oct 16 06:50:27 2017 -0400
4963
4964 ceph-volume process allow obfuscating a key or index when logging commands
4965
4966 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4967 (cherry picked from commit bbcca70d962855d991f0aa8e86a19f1855345668)
4968
4969 commit 18336242b85065d8a2b0a92f22b2e91a81b997ba
4970 Author: Alfredo Deza <adeza@redhat.com>
4971 Date: Fri Oct 13 09:22:53 2017 -0400
4972
4973 ceph-volume util.prepare add other ln helpers for bluestore
4974
4975 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4976 (cherry picked from commit 555b664882db2cd247087f907bdf4d426fb652f8)
4977
4978 commit 37a1564a41ba8ae6a89eb0903f0fdf6b463d90f0
4979 Author: Alfredo Deza <adeza@redhat.com>
4980 Date: Thu Oct 12 16:08:52 2017 -0400
4981
4982 ceph-volume util.arg_validators allow to pass a group as --data for lvm
4983
4984 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4985 (cherry picked from commit 211c38f591945dee53196068533784c385bae102)
4986
4987 commit afd1588fe06a80f2277082fd7bd15f43d8e601b7
4988 Author: Alfredo Deza <adeza@redhat.com>
4989 Date: Thu Oct 12 16:08:16 2017 -0400
4990
4991 ceph-volume util.disk add utilities for is_device and is_partition
4992
4993 Signed-off-by: Alfredo Deza <adeza@redhat.com>
4994 (cherry picked from commit 6b23fc72240ced158cf5335f6e815dbfd804dfab)
4995
4996 commit 5e8f798d2b8f80b21f3ce4701d22e47992dd0938
4997 Author: Alfredo Deza <adeza@redhat.com>
4998 Date: Thu Oct 12 16:05:22 2017 -0400
4999
5000 ceph-volume api.lvm udpate create_lv for bluestore
5001
5002 Require full size notation for LVM (e.g. 50G or 100M) and do not
5003 "translate" tags by pre-fixing them with 'ceph'. That is already how the
5004 rest of the API works, no need to make that translation in one place
5005
5006 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5007 (cherry picked from commit ac0d1555d3d9caeef9d4fc3e46bc11b7e437413b)
5008
5009 commit f337bef88a31a5d23420665406a06f761e8d4e6e
5010 Merge: 3db3ca9938 d2be1e0ccb
5011 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
5012 Date: Fri Oct 27 16:43:43 2017 +0200
5013
5014 Merge pull request #17857 from smithfarm/wip-21446-luminous
5015
5016 luminous: rgw:multisite: Get bucket location which is located in another zonegroup, will return 301 Moved Permanently
5017
5018 Reviewed-By: Casey Bodley <cbodley@redhat.com>
5019
5020 commit 3db3ca99380521c79596b06b695eefbb81d57908
5021 Merge: ced01a5b85 c4d6539374
5022 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
5023 Date: Fri Oct 27 16:43:00 2017 +0200
5024
5025 Merge pull request #17856 from smithfarm/wip-21444-luminous
5026
5027 luminous: rgw: setxattrs call leads to different mtimes for bucket index and object
5028
5029 Reviewed-By: Casey Bodley <cbodley@redhat.com>
5030
5031 commit 3bbd840fe0d34d42c04fac523aee5fc023d8bd3b
5032 Author: Alfredo Deza <adeza@redhat.com>
5033 Date: Thu Oct 12 15:42:22 2017 -0400
5034
5035 ceph-volume lvm.prepare update filestore workflow to use new helpers
5036
5037 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5038 (cherry picked from commit 1e8a79b8f4b9e6360e8e3ace580e46caeedca8c7)
5039
5040 commit ced01a5b85c9ec5657d8f09a447b6308ea597754
5041 Merge: 2c9a9af424 fe0a41b4a9
5042 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
5043 Date: Fri Oct 27 16:41:15 2017 +0200
5044
5045 Merge pull request #18417 from kmroz/wip-21782-luminous
5046
5047 luminous: cls/journal: possible infinite loop within tag_list class method
5048
5049 Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
5050
5051 commit 2c9a9af424c618c50334c0efa7f5a5f807aeb4fd
5052 Merge: a1d286252a 7d2b7e8e31
5053 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
5054 Date: Fri Oct 27 16:38:04 2017 +0200
5055
5056 Merge pull request #18287 from smithfarm/wip-retract-assertions-luminous
5057
5058 luminous: rgw: Remove assertions in IAM Policy
5059
5060 Reviewed-By: Adam Emerson <aemerson@redhat.com>
5061 Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
5062
5063 commit fb95f3f9fd6122f9b8c3c2215463fc8a1ef62ba2
5064 Author: Alfredo Deza <adeza@redhat.com>
5065 Date: Thu Oct 12 14:19:07 2017 -0400
5066
5067 ceph-volume lvm.prepare initial take on bluestore support
5068
5069 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5070 (cherry picked from commit e4fc3464af472a8dbdf049917eed73519ff82c3b)
5071
5072 commit a1d286252a75c3632a7ecc63a366e5262f9e16cd
5073 Merge: b151619a45 fd207447d1
5074 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
5075 Date: Fri Oct 27 16:29:02 2017 +0200
5076
5077 Merge pull request #17859 from smithfarm/wip-21451-luminous
5078
5079 luminous: rgw: lc process only schdule the first item of lc objects
5080
5081 Reviewed-By: Daniel Gryniewicz <dgryniewicz@redhat.com>
5082
5083 commit 26ef33efc37cdd626c6a7577812bb87947417e01
5084 Author: Alfredo Deza <adeza@redhat.com>
5085 Date: Thu Oct 12 14:16:25 2017 -0400
5086
5087 ceph-volume lvm.common update help flags for bluestore usage
5088
5089 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5090 (cherry picked from commit 17028f3a3c1f9394fa82dc6f2bbd596d96acb037)
5091
5092 commit 005359b92a910b72712edbcaa7b2e27a54d3a093
5093 Author: Alfredo Deza <adeza@redhat.com>
5094 Date: Wed Oct 11 14:30:41 2017 -0400
5095
5096 ceph-volume api.lvm allow to create a vg
5097
5098 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5099 (cherry picked from commit 16d7feb2b5d5eb5fa0bf23a95b60623ae2e1676f)
5100
5101 commit 795e69673f452227afc12d76ed5aa0d6a8af8665
5102 Author: Alfredo Deza <adeza@redhat.com>
5103 Date: Tue Oct 10 12:30:06 2017 -0400
5104
5105 ceph-volume lvm add block CLI flags for bluestore
5106
5107 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5108 (cherry picked from commit 63d2afbc605ac1531bc9f00a1891017bfd42fbce)
5109
5110 commit cbfb082c180e93cd147e164afd1d32ef9234924e
5111 Author: Alfredo Deza <adeza@redhat.com>
5112 Date: Tue Oct 10 12:15:14 2017 -0400
5113
5114 ceph-volume lvm make bluestore the default option
5115
5116 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5117 (cherry picked from commit dc3ced30747312dedd0e895a75ec15b1925ef1ea)
5118
5119 commit a340f1acab04587f5b2c323abc1a14b8dd7de915
5120 Author: Casey Bodley <cbodley@redhat.com>
5121 Date: Mon Oct 9 14:46:47 2017 -0400
5122
5123 rgw: RGWDataSyncControlCR retries on all errors
5124
5125 similar to RGWMetaSyncShardControlCR, we don't want to exit and
5126 stop the data sync processor thread on failures. we want to keep
5127 retrying with backoff
5128
5129 Signed-off-by: Casey Bodley <cbodley@redhat.com>
5130 (cherry picked from commit 065e67bbd312240f5128c31f5525098c62f3afce)
5131
5132 Conflicts:
5133 src/rgw/rgw_data_sync.cc (sync tracing)
5134
5135 commit fdec63a28e24e056938139591e5799a0e3693c20
5136 Author: Casey Bodley <cbodley@redhat.com>
5137 Date: Mon Oct 9 14:09:40 2017 -0400
5138
5139 rgw: fix error handling in ListBucketIndexesCR
5140
5141 the call to set_state() returns 0, when we want operate() to return the
5142 error code instead. use set_cr_error() to do this
5143
5144 Fixes: http://tracker.ceph.com/issues/21735
5145
5146 Signed-off-by: Casey Bodley <cbodley@redhat.com>
5147 (cherry picked from commit ed6340a47f32472bb1f650407dbe739c44bf4bd6)
5148
5149 commit e711cf319fa12ec7b03edda769685353e24cbfcb
5150 Author: Casey Bodley <cbodley@redhat.com>
5151 Date: Mon Oct 9 14:08:21 2017 -0400
5152
5153 rgw: ListBucketIndexesCR spawns entries_index after listing metadata
5154
5155 if the metadata listing fails, we won't have to clean up entries_index
5156
5157 Signed-off-by: Casey Bodley <cbodley@redhat.com>
5158 (cherry picked from commit 7f127f54406ef0e08a1265b9bc20433fe3f21523)
5159
5160 commit 56359c367d8267281f714dcecefdb50c598718a6
5161 Author: Sage Weil <sage@redhat.com>
5162 Date: Thu Oct 26 13:51:40 2017 -0500
5163
5164 ceph-bluestore-tool: prime-osd-dir: update symlinks instead of bailing
5165
5166 If the symlink points to the right location, do nothing. If it doesn't,
5167 replace it. If it's not a symlink, bail with EEXIST.
5168
5169 Signed-off-by: Sage Weil <sage@redhat.com>
5170 (cherry picked from commit de8dc42d42218bc1a1779e1bcc5831c567853c8d)
5171
5172 commit b151619a4523b148026e613860a05add6aff3831
5173 Merge: 84fc30873a 352373ff4a
5174 Author: Abhishek L <abhishek.lekshmanan@gmail.com>
5175 Date: Fri Oct 27 15:11:00 2017 +0200
5176
5177 Merge pull request #18433 from theanalyst/wip-21545-luminous
5178
5179 luminous: rgw file write error
5180
5181 Reviewed-By: Matt Benjamin <mbenjamin@redhat.com>
5182
5183 commit 84fc30873aa6ed3c1bf0c91307c362d27e9bc72a
5184 Merge: 2bc24caa00 bb8586b259
5185 Author: Andrew Schoen <andrew.schoen@gmail.com>
5186 Date: Fri Oct 27 08:03:16 2017 -0500
5187
5188 Merge pull request #18587 from ceph/luminous-wip-volume-api-change
5189
5190 luminous ceph-volume lvm api refactor/move
5191
5192 Reviewed-by: Andrew Schoen <aschoen@redhat.com>
5193
5194 commit 2bc24caa003ea3c4898202a887a5864078c0f3fd
5195 Merge: a5548a8247 5f96edfb41
5196 Author: Sage Weil <sage@newdream.net>
5197 Date: Fri Oct 27 06:39:58 2017 -0500
5198
5199 Merge pull request #18568 from liewegas/wip-fix-rop-leak-luminous-2
5200
5201 luminous: osd/PG: fix recovery op leak due to recovery preemption
5202
5203 Reviewed-by: David Zafman <dzafman@redhat.com>
5204
5205 commit bb8586b259726eb0ae72db7c6a238b2d2432fc9b
5206 Author: Alfredo Deza <adeza@redhat.com>
5207 Date: Tue Oct 3 16:13:33 2017 -0400
5208
5209 ceph-volume create an api module to hold common api modules
5210
5211 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5212 (cherry picked from commit f72368641d7f38b6395afb7ed70a0a9d0794a03a)
5213
5214 commit 3d32fb30193437b57535c79657ee726704f4b037
5215 Author: Alfredo Deza <adeza@redhat.com>
5216 Date: Wed Oct 4 06:44:54 2017 -0400
5217
5218 ceph-volume tests move lvm api tests into its new test module
5219
5220 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5221 (cherry picked from commit eec0c8a5c27adc9b3fc5e999cbee8165bdb45736)
5222
5223 commit e6145af90c3f1c8c520bb7671194e6d8a13bb5d2
5224 Author: Alfredo Deza <adeza@redhat.com>
5225 Date: Wed Oct 4 06:43:36 2017 -0400
5226
5227 ceph-volume tests refactor lvm api import for test_listing
5228
5229 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5230 (cherry picked from commit 66fd41fd4b35e275196bfb94794f3fda9fd77f76)
5231
5232 commit c63d3ba89489cc42aaa364c99b3d3b4c1bba226c
5233 Author: Alfredo Deza <adeza@redhat.com>
5234 Date: Wed Oct 4 06:43:18 2017 -0400
5235
5236 ceph-volume tests refactor lvm api import for api tests
5237
5238 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5239 (cherry picked from commit 2a9a36bd24bddb35a7618127a0ec57f661a71566)
5240
5241 commit 6efd25344230c0abb51cd82f99310a4b94f2fcd3
5242 Author: Alfredo Deza <adeza@redhat.com>
5243 Date: Wed Oct 4 06:42:47 2017 -0400
5244
5245 ceph-volume tests refactor lvm api import for activate tests
5246
5247 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5248 (cherry picked from commit d81aa8c112312f2fb49d94ce3512b3356b0b8814)
5249
5250 commit 47cd005b672828aedf11aeb67a6099477783f7f0
5251 Author: Alfredo Deza <adeza@redhat.com>
5252 Date: Wed Oct 4 06:42:01 2017 -0400
5253
5254 ceph-volume tests refactor lvm api import in conftest
5255
5256 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5257 (cherry picked from commit a00aff7066fe6a679498ac8a02ec22ef29feced3)
5258
5259 commit 4a6dfa9b6949bdcdba22a7003c451390105d287e
5260 Author: Alfredo Deza <adeza@redhat.com>
5261 Date: Tue Oct 3 16:17:08 2017 -0400
5262
5263 ceph-volume devices.lvm refactor importing api to come from api/lvm.py
5264
5265 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5266 (cherry picked from commit f4bee6cb42a017abce269ed3926deff04038a47e)
5267
5268 commit 9a20f184676973222c931cecff26ca313e636e1d
5269 Author: Alfredo Deza <adeza@redhat.com>
5270 Date: Tue Oct 3 16:14:16 2017 -0400
5271
5272 ceph-volume move lvm/api.py to api/lvm.py so disk can consume it
5273
5274 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5275 (cherry picked from commit bb72480d2bf44ff04ea93c98f4a4e59032a28896)
5276
5277 commit f26f3dc842c04ac70e309266aaedbae9d45eeae8
5278 Author: yuliyang <yuliyang@cmss.chinamobile.com>
5279 Date: Sun Sep 24 08:41:04 2017 +0800
5280
5281 rgw:fix list objects with marker when bucket is enable versioning
5282
5283 fix: http://tracker.ceph.com/issues/21500
5284
5285 Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
5286 (cherry picked from commit bc16b162cf757b9c6ceae30912eb647ef9304f75)
5287
5288 commit a5548a8247cd9b072a2e0357cf6d0358550e7565
5289 Merge: 724609a8a5 1751a094d7
5290 Author: Sage Weil <sage@newdream.net>
5291 Date: Thu Oct 26 16:52:28 2017 -0500
5292
5293 Merge pull request #18498 from liewegas/wip-recovery-fixes-luminous
5294
5295 luminous: osd: fix recovery priority and pg state on recovery->backfill transition
5296
5297 Reviewed-by: David Zafman <dzafman@redhat.com.
5298
5299 commit 724609a8a54a7619b48f4608790d81a2a43d4683
5300 Merge: 50c4cc0610 565b5cd1d6
5301 Author: Andrew Schoen <andrew.schoen@gmail.com>
5302 Date: Thu Oct 26 16:50:20 2017 -0500
5303
5304 Merge pull request #18567 from ceph/backport-wip-bz1491250
5305
5306 luminous: ceph-volume lvm list
5307
5308 Reviewed-by: Andrew Schoen <aschoen@redhat.com>
5309
5310 commit 5f96edfb41c4b028732cf12da5ab44322e251b2a
5311 Author: Sage Weil <sage@redhat.com>
5312 Date: Thu Oct 26 16:23:41 2017 -0500
5313
5314 osd/PG: fix recovery op leak due to recovery preemption
5315
5316 This was fixed in master in a different patch, but are not yet ready to
5317 backport the bits there that came before this. For now, fix it
5318 specifically for luminous. We can either sort out the conflicts later
5319 or revert this and backport the master parts conflict-free.
5320
5321 Signed-off-by: Sage Weil <sage@redhat.com>
5322
5323 commit 50c4cc06101fd1c8a9323cd3a04c92c8a9ab2580
5324 Merge: a175c0321e 33aa167331
5325 Author: Sage Weil <sage@newdream.net>
5326 Date: Thu Oct 26 16:14:43 2017 -0500
5327
5328 Merge pull request #17805 from tchaikov/wip-luminous-pr-17508
5329
5330 luminous: mon: more aggressively convert crush rulesets -> distinct rules
5331
5332 Reviewed-by: Sage Weil <sage@redhat.com>
5333
5334 commit a175c0321e745ac095707d5a2d3cd25232272bfc
5335 Merge: 72b057187a b382db7cfc
5336 Author: Sage Weil <sage@newdream.net>
5337 Date: Thu Oct 26 16:14:07 2017 -0500
5338
5339 Merge pull request #18364 from kmroz/wip-21544-luminous
5340
5341 luminous: mon: osd feature checks with 0 up osds
5342
5343 Reviewed-by: Sage Weil <sage@redhat.com>
5344
5345 commit 72b057187aed9b4e5f3a4ecf82fafa6e9cd2d3fd
5346 Merge: f6362e3110 b60d8cf0cb
5347 Author: Sage Weil <sage@newdream.net>
5348 Date: Thu Oct 26 16:13:31 2017 -0500
5349
5350 Merge pull request #18413 from kmroz/wip-21693-luminous
5351
5352 luminous: osd: additional protection for out-of-bounds EC reads
5353
5354 Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5355
5356 commit f6362e3110e4e482ff5a676035b862b1b0b666df
5357 Merge: f36670e190 4c6b1b65f7
5358 Author: Sage Weil <sage@newdream.net>
5359 Date: Thu Oct 26 16:11:42 2017 -0500
5360
5361 Merge pull request #18529 from smithfarm/wip-21918-luminous
5362
5363 luminous: Disable messenger logging (debug ms = 0/0) for clients unless overridden.
5364
5365 Reviewed-by: Sage Weil <sage@redhat.com>
5366
5367 commit f36670e190ea96589c373d87d30ee8f4b3c6b20b
5368 Merge: 9a28a5c9d7 cec24f99ab
5369 Author: Sage Weil <sage@newdream.net>
5370 Date: Thu Oct 26 16:11:21 2017 -0500
5371
5372 Merge pull request #18540 from liewegas/wip-pr-17894-luminous
5373
5374 luminous: ceph.spec.in,debian/rules: change aio-max-nr to 1048576
5375
5376 Reviewed-by: Kefu Chai <kchai@redhat.com>
5377 Reviewed-by: Boris Ranto <branto@redhat.com>
5378
5379 commit 565b5cd1d68437096e283ccb942d8f108c26d3d4
5380 Author: Alfredo Deza <adeza@redhat.com>
5381 Date: Wed Sep 13 08:23:40 2017 -0400
5382
5383 ceph-volume lvm add listing module to main
5384
5385 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5386 (cherry picked from commit ff72fd0ed52ef2d166007c7769c0140424982dc7)
5387
5388 commit 58095350953140a1fa4b968c2e0a5774a960e739
5389 Author: Alfredo Deza <adeza@redhat.com>
5390 Date: Tue Oct 3 11:41:10 2017 -0400
5391
5392 doc/ceph-volume add lvm/list to the toctree
5393
5394 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5395 (cherry picked from commit d11c80c917f44b33077715b19564aeea30c78e42)
5396
5397 commit 3893947d3e04f049a85245750b841adbbcefeac8
5398 Author: Alfredo Deza <adeza@redhat.com>
5399 Date: Tue Oct 3 11:36:06 2017 -0400
5400
5401 doc/ceph-volume create the reference for the list sub-command
5402
5403 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5404 (cherry picked from commit 9a52939ef8fc4abe720d2525c59997f4f9760902)
5405
5406 commit 0992c3d7c136a58ff38f521fc0978ff036843d27
5407 Author: Alfredo Deza <adeza@redhat.com>
5408 Date: Tue Oct 3 11:35:39 2017 -0400
5409
5410 doc/ceph-volume add create and list to the index
5411
5412 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5413 (cherry picked from commit ed5fa519aca1335039bfc32bc060af5181265517)
5414
5415 commit 148537cc333d88b75640506c15a1bc221c9e09d6
5416 Author: Alfredo Deza <adeza@redhat.com>
5417 Date: Tue Oct 3 08:59:37 2017 -0400
5418
5419 ceph-volume tests create a unit test module for listing features
5420
5421 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5422 (cherry picked from commit 2c2cf547b07f9510146b86d0746190b6d3fead3d)
5423
5424 commit 285bc06569c8ed06890d23e9537a9d1106825b7f
5425 Author: Alfredo Deza <adeza@redhat.com>
5426 Date: Tue Oct 3 08:59:01 2017 -0400
5427
5428 ceph-volume tests create a small factory fixture
5429
5430 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5431 (cherry picked from commit 5a0b17de81770ef3b851a1ff98232d93c78f49f9)
5432
5433 commit 1e4e241d9c77796874a003799a0546fc185c5241
5434 Author: Alfredo Deza <adeza@redhat.com>
5435 Date: Mon Oct 2 14:40:41 2017 -0400
5436
5437 ceph-volume tests ensure Volume.as_dict gets populated correctly
5438
5439 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5440 (cherry picked from commit c5b933a96d067fb8c7f753a67123e5662398f964)
5441
5442 commit a0ab94e8d70ae9fc5d741c47a8f0dcfe033f9a5e
5443 Author: Alfredo Deza <adeza@redhat.com>
5444 Date: Mon Oct 2 14:31:57 2017 -0400
5445
5446 ceph-volume lvm.listing initial take on listing command
5447
5448 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5449 (cherry picked from commit 2d80190a039798a637383513f292e6aab62cd3f8)
5450
5451 commit 454c655f2eb0b1e79ca8e1e1d87ff9c0fe4886da
5452 Author: Alfredo Deza <adeza@redhat.com>
5453 Date: Mon Oct 2 12:35:13 2017 -0400
5454
5455 ceph-volume lvm.api be able to return a dictionary repr of a Volume object
5456
5457 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5458 (cherry picked from commit 0cae22750f396d1c1664875edb2742c50a41bffd)
5459
5460 commit 1390fb76d76b76428e6a9210005dbf01fd3b3a1a
5461 Author: Alfredo Deza <adeza@redhat.com>
5462 Date: Mon Oct 2 12:12:57 2017 -0400
5463
5464 ceph-volume process allows to fully mute terminal output on commands
5465
5466 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5467 (cherry picked from commit 233f64a4fd90a19c50d57b849ffaa6a25c835f34)
5468
5469 commit 00e9ec1fa25ac3950f43ec3cf84f8321b04507eb
5470 Author: Alfredo Deza <adeza@redhat.com>
5471 Date: Thu Sep 14 07:35:47 2017 -0400
5472
5473 ceph-volume lvm.api use a helper to get an lv from an arg
5474
5475 Signed-off-by: Alfredo Deza <adeza@redhat.com>
5476 (cherry picked from commit 3c5bbbc5822f02a038f093647c5de58bef2fe8f5)
5477
5478 commit 26c523c3beeb5da7e855be64a053ac9dca7d10e2
5479 Author: Jason Dillaman <dillaman@redhat.com>
5480 Date: Mon Oct 23 14:53:30 2017 -0400
5481
5482 rbd-mirror: strip environment/CLI overrides for remote cluster
5483
5484 Fixes: http://tracker.ceph.com/issues/21894
5485 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5486 (cherry picked from commit 70dc22e03a115b130b9c214030d5996276a1634b)
5487
5488 commit 9a28a5c9d7ae618f5b79d3727ba155b5066a2653
5489 Merge: 42172a4431 18a99f5f6b
5490 Author: Josh Durgin <jdurgin@redhat.com>
5491 Date: Wed Oct 25 11:45:38 2017 -0700
5492
5493 Merge pull request #18456 from liewegas/wip-21882-luminous
5494
5495 luminous: messages/MOSDMap: do compat reencode of crush map, too
5496
5497 Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5498
5499 commit 18a99f5f6b4976f87dcd0d4fe7e34fddd90de22b
5500 Author: Sage Weil <sage@redhat.com>
5501 Date: Wed Oct 25 07:00:14 2017 -0500
5502
5503 qa/suites/upgrade/jewel-x: make sure min compat client is hammer for straw2
5504
5505 Signed-off-by: Sage Weil <sage@redhat.com>
5506
5507 commit cec24f99ab5e368d2dae7d53628fee09515bd873
5508 Author: chenliuzhong <liuzhong.chen@easystack.cn>
5509 Date: Tue Oct 24 10:54:33 2017 +0800
5510
5511 ceph.spec.in,debian/rules: change aio-max-nr to 1048576
5512
5513 when osd is more than 14 in one host,it report error that aio is not enough.
5514 As the default aio-max-nr is 65536, one OSD needs 4096 aios and other programs may use aios.
5515 This patch change aio-max-nr to 1048576 when install ceph-osd rpm package and debian package
5516
5517 Signed-off-by: chenliuzhong <liuzhong.chen@easystack.cn>
5518 (cherry picked from commit 36326dc7104fc2f20f19d51b6f618a029ba072d7)
5519
5520 commit 15a52ba8329831ddf350664e6e6612523f98dcf4
5521 Author: baixueyu <baixueyu@inspur.com>
5522 Date: Wed Oct 18 11:16:20 2017 +0800
5523
5524 You can find the problem do like this:
5525
5526 upload obj to bucket1
5527 s3cmd put obj s3://bucket1
5528 cp obj from bucket1 to bucket2
5529 s3cmd cp s3://bucket1/obj s3://bucket2
5530 del obj from bucket1 and bucket2
5531 s3cmd del s3://bucket1/obj
5532 s3cmd del s3://bucket2/obj
5533 you can see the pool 'default.rgw.buckets.data', the data of obj can not deleted.
5534 ceph df | grep default.rgw.buckets.data
5535
5536 Fixes: http://tracker.ceph.com/issues/21819
5537
5538 Signed-off-by: Xueyu Bai baixueyu@inspur.com
5539 (cherry picked from commit 2e11545077c485d5c155ab932b6274a8ac863e61)
5540
5541 commit 4c6b1b65f7337809682bf907be94fe946909959a
5542 Author: Jason Dillaman <dillaman@redhat.com>
5543 Date: Thu Oct 19 22:13:36 2017 -0400
5544
5545 common/common_init: disable ms subsystem log gathering for clients
5546
5547 The log gathering causes large performance degradation to clients
5548 with high message throughputs. This is hopefully a short-term
5549 workaround until per-message logging can be replaced with an
5550 efficient data recording system for post-incident analysis
5551 use-cases.
5552
5553 Fixes: http://tracker.ceph.com/issues/21860
5554 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
5555 (cherry picked from commit a3a40413f7908b08c40dec4020034cca4a0c4798)
5556
5557 commit 42172a443183ffe6b36e85770e53fe678db293bf
5558 Merge: f2afb7a0d5 9f49698fab
5559 Author: Sage Weil <sage@newdream.net>
5560 Date: Tue Oct 24 21:36:18 2017 -0500
5561
5562 Merge pull request #18503 from liewegas/wip-21878-luminous
5563
5564 luminous: os/bluestore/BlueFS: fix race with log flush during async log compaction
5565
5566 Reviewed-by: Varada Kari <varada.kari@gmail.com>
5567
5568 commit f2afb7a0d590ff55ae11f5bf3b13264a56380ce6
5569 Merge: d0be2106f9 3ad21109ed
5570 Author: Sage Weil <sage@newdream.net>
5571 Date: Tue Oct 24 21:35:29 2017 -0500
5572
5573 Merge pull request #18501 from liewegas/wip-21766-luminous
5574
5575 luminous: os/bluestore: handle compressed extents in blob unsharing checks
5576
5577 commit d0be2106f96377f059ec08800e32e492ec6f82a3
5578 Merge: d52e59bad7 e6eeb796b4
5579 Author: Sage Weil <sage@newdream.net>
5580 Date: Tue Oct 24 21:34:52 2017 -0500
5581
5582 Merge pull request #18459 from liewegas/wip-pr-18457-luminous
5583
5584 luminous: qa/suites/rados/rest/mgr-restful: whitelist more health
5585
5586 commit 902d467a0ec23baebf28a2419a4c0c78e0b1b662
5587 Author: Casey Bodley <cbodley@redhat.com>
5588 Date: Mon Oct 9 10:11:14 2017 -0400
5589
5590 qa/rgw: ignore errors from 'pool application enable'
5591
5592 Fixes: http://tracker.ceph.com/issues/21715
5593
5594 Signed-off-by: Casey Bodley <cbodley@redhat.com>
5595 (cherry picked from commit 160240e0c1c216c950b7210a561b27436198de1f)
5596 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5597
5598 commit 1751a094d76ac84fbcecfc9816904cbb496bd765
5599 Author: Sage Weil <sage@redhat.com>
5600 Date: Mon Oct 23 17:11:59 2017 -0500
5601
5602 osd/PrimaryLogPG: clear DEGRADED at recovery completion even if more backfill
5603
5604 We may have log recovery *and* backfill to do, but cease to be degraded
5605 as soon as the log recovery portion is done. If that's the case, clear
5606 the DEGRADED bit so that the PG state is not misleading.
5607
5608 Signed-off-by: Sage Weil <sage@redhat.com>
5609 (cherry picked from commit 3e91fda79d3be771f46394312a6b72ab75660012)
5610
5611 commit d52e59bad700e8add6cd4cf895817aa8fd7a601a
5612 Merge: 724a51cd44 0048e6a58c
5613 Author: Kefu Chai <tchaikov@gmail.com>
5614 Date: Tue Oct 24 11:51:19 2017 +0800
5615
5616 Merge pull request #18491 from liewegas/wip-21573-luminous
5617
5618 luminous: buffer: fix ABI breakage by removing list _mempool member
5619
5620 Reviewed-by: Kefu Chai <kchai@redhat.com>
5621
5622 commit 9f49698fab5de9ade79d3aba957afe82daa4fecc
5623 Author: Sage Weil <sage@redhat.com>
5624 Date: Fri Oct 20 08:51:17 2017 -0500
5625
5626 os/bluestore/BlueFS: fix race with log flush during async log compaction
5627
5628 During async log compaction we rely on _flush-and_sync_log to update the
5629 log_writer to jump_to. However, if racing threads are also trying to flush
5630 the log and manage to flush our new log events for us, then our flush will
5631 turn into a no-op, and we won't update jump_to correctly at all. This
5632 results in a corrupted log size a bit later one.
5633
5634 Fix by ensuring that there are no in-progress flushes before we add our
5635 log entries. Also, add asserts to _flush_and_sync_log to make sure we
5636 never bail out early if jump_to is set (which would indicate this or
5637 another similar bug is still present).
5638
5639 Fixes: http://tracker.ceph.com/issues/21878
5640 Signed-off-by: Sage Weil <sage@redhat.com>
5641 (cherry picked from commit 4324c8bc7e66633035c15995e3f82ef91d3a5e8c)
5642
5643 commit 3ad21109ed2df068bb113e8551505b850fbfcb30
5644 Author: Sage Weil <sage@redhat.com>
5645 Date: Wed Oct 11 16:48:41 2017 -0500
5646
5647 os/bluestore: handle compressed extents in blob unsharing checks
5648
5649 If the blob is compressed, we aren't mapping to a range within
5650 the allocated extents, but rather referencing the entire blob.
5651
5652 Fixes: http://tracker.ceph.com/issues/21766
5653 Signed-off-by: Sage Weil <sage@redhat.com>
5654 (cherry picked from commit eb26cfbfbb2b9b9fe84dfe9c999e2d67fd2661c0)
5655
5656 commit 8f176f31d091cb53e1baa8c317df9e64bef4d95e
5657 Author: Sage Weil <sage@redhat.com>
5658 Date: Sun Oct 22 22:46:00 2017 -0500
5659
5660 osd/PG: on recovery done, requeue for backfill
5661
5662 We were keeping our existing recovery reservation slot (with a high
5663 priority) and going straight to waiting for backfill reservations on
5664 the peers. This is a problem because the reserver thinks we're doing
5665 high priority work when we're actually doing lower-priority backfill.
5666
5667 Fix by closing out our recovery reservation and going to the
5668 WaitLocalBackfillReserved state, where we'll re-request backfill at the
5669 appropriate priority.
5670
5671 Signed-off-by: Sage Weil <sage@redhat.com>
5672 (cherry picked from commit 09c50e2fe4fc3e8951a483e4b2693f0ffc008dcf)
5673
5674 commit cc707155ea475836f97791c08c31994fb40e4374
5675 Author: Sage Weil <sage@redhat.com>
5676 Date: Sun Oct 22 22:43:18 2017 -0500
5677
5678 osd/PG: move local_reserver recovery cancel to Recovering state transition
5679
5680 This is easier to follow than canceling the reservation in the next state.
5681
5682 Signed-off-by: Sage Weil <sage@redhat.com>
5683 (cherry picked from commit dde007749bb960122f399b4cb8608a8c1ea4eb9c)
5684
5685 commit def29079dc623926fed26a4946d6b9a074dfa2ac
5686 Author: Sage Weil <sage@redhat.com>
5687 Date: Fri Oct 20 22:55:29 2017 -0500
5688
5689 qa/suites/upgrade/jewel-x/parallel: run some jewel after completed upgrade
5690
5691 Signed-off-by: Sage Weil <sage@redhat.com>
5692
5693 commit 8697eca5ea24c4724f637e4d4f75d3e0d2b95278
5694 Author: Sage Weil <sage@redhat.com>
5695 Date: Fri Oct 20 22:52:45 2017 -0500
5696
5697 qa/suites/upgrade/jewel-x/: set up compat weight-set after cluster upgrade
5698
5699 ...but before we run some client workloads. This will hopefully ensure
5700 that older clients will behave.
5701
5702 Signed-off-by: Sage Weil <sage@redhat.com>
5703
5704 commit 89ee508ac51839c3d1f71c5e21443e8f2679c59e
5705 Author: Sage Weil <sage@redhat.com>
5706 Date: Sat Oct 21 13:03:17 2017 -0500
5707
5708 mon/OSDMonitor: add 'osd crush set-all-straw-buckets-to-straw2'
5709
5710 This is a common and recommended step that users should take once they
5711 have clients that support straw2 (hammer!). Let's make it easy.
5712
5713 This may result in a small amount of data movement, but usually it is
5714 very little.
5715
5716 Signed-off-by: Sage Weil <sage@redhat.com>
5717 (cherry picked from commit 928770513cbe3a244095e36dcb41c83c0724cfe9)
5718
5719 commit 94a4ca6c8e4d26465cbefd1492ee05f21b08ff1e
5720 Author: Sage Weil <sage@redhat.com>
5721 Date: Sat Oct 21 12:59:16 2017 -0500
5722
5723 crush/CrushWrapper: add bucket_set_alg()
5724
5725 Signed-off-by: Sage Weil <sage@redhat.com>
5726 (cherry picked from commit edc411ee4cb7b88a970ccfc9d29b3a3ba15d066c)
5727
5728 commit 0048e6a58c7cdf3b3d98df575bc47db8397cd5a9
5729 Author: Sage Weil <sage@redhat.com>
5730 Date: Thu Oct 19 16:19:35 2017 -0500
5731
5732 buffer: remove list _mempool member
5733
5734 This broke the C++ ABI by changing the list structure size. Also, it's
5735 not necessary as we can infer the mempool by looking at the other list
5736 contents. We don't (currently) have a need to map an empty list to a
5737 particular mempool and have that state stick.
5738
5739 Fixes: http://tracker.ceph.com/issues/21573
5740 Signed-off-by: Sage Weil <sage@redhat.com>
5741 (cherry picked from commit 9b92d87d37e3892b0096cd728b46154aed1e2d86)
5742
5743 commit 3cd334b6264998490e6fb8321fb7242ff82b36e6
5744 Author: Sage Weil <sage@redhat.com>
5745 Date: Thu Oct 19 16:09:10 2017 -0500
5746
5747 buffer: allow mempool to be passed into raw* ctors and create methods
5748
5749 This is more convenient, and also faster than initializing it in
5750 buffer_anon and the immediately moving it elsewhere.
5751
5752 Drop the optionality of the alignment argument.
5753
5754 No users yet.
5755
5756 Signed-off-by: Sage Weil <sage@redhat.com>
5757 (cherry picked from commit 481277b8c92368b8cac8fdafe1848720ec1035c2)
5758
5759 commit 724a51cd442d35c950414b86608c48936b01b78b
5760 Author: Sage Weil <sage@redhat.com>
5761 Date: Mon Oct 23 12:05:39 2017 -0500
5762
5763 /etc/sysconfig/ceph: remove jemalloc option
5764
5765 This breaks when used with rocksdb, which is now the default.
5766
5767 See http://tracker.ceph.com/issues/20557
5768
5769 Signed-off-by: Sage Weil <sage@redhat.com>
5770 (cherry picked from commit 19efccef248c2d66fe3d7fdac8f56d455f2c7b27)
5771
5772 commit 95b6bc9ac41c4985ad97a515c4105351a0e6b94d
5773 Author: Sage Weil <sage@redhat.com>
5774 Date: Mon Oct 23 11:16:26 2017 -0500
5775
5776 etc/default/ceph: remove jemalloc option
5777
5778 This breaks when used with rocksdb, which is now the default.
5779
5780 See http://tracker.ceph.com/issues/20557
5781
5782 Signed-off-by: Sage Weil <sage@redhat.com>
5783 (cherry picked from commit fba2055b4e54128db1e9a83f27bb3526d65d4db7)
5784
5785 commit e6eeb796b4d24fcf6797519be06aca9771e73028
5786 Author: Sage Weil <sage@redhat.com>
5787 Date: Fri Oct 20 23:14:36 2017 -0500
5788
5789 qa/suites/rados/rest/mgr-restful: whitelist more health
5790
5791 The test is fiddling with OSDs.
5792
5793 Signed-off-by: Sage Weil <sage@redhat.com>
5794 (cherry picked from commit ddf3e9162da542af0c5f025957b8304e7359c924)
5795
5796 commit 33aa1673316b77b71e473d1ab71cf61587e425a6
5797 Author: Sage Weil <sage@redhat.com>
5798 Date: Tue Sep 5 22:46:48 2017 -0400
5799
5800 mon/OSDMonitor: improve crush map validation
5801
5802 - move into OSDMap method
5803 - ensure that rules exist for each pool
5804 - ensure pool type matches rule type
5805 - ensure rule mask min/max size cover the pool size
5806
5807 Signed-off-by: Sage Weil <sage@redhat.com>
5808 (cherry picked from commit 8f8f0b25058ff7319ec9d023f0eceb5832d0ecff)
5809
5810 commit d825de7681ba1cff257ba4108d6c22c81e3a6aab
5811 Author: John Spray <john.spray@redhat.com>
5812 Date: Fri Aug 25 11:06:21 2017 +0100
5813
5814 mon: more forceful renumbering of legacy ruleset IDs
5815
5816 Previously, the rules were only modified in the trivial case,
5817 so we continued to potentially have CRUSH maps with the
5818 legacy ruleset functionality in use.
5819
5820 In order to ultimately remove rulesets entirely, we need
5821 to do this more aggressively, renumbering all the rules
5822 and then updating any pools as needed.
5823
5824 Signed-off-by: John Spray <john.spray@redhat.com>
5825 (cherry picked from commit 71d4b2bed54371657693cfb999ade44449be0efd)
5826
5827 Conflicts:
5828 src/mon/OSDMonitor.cc: the check for multiple rules was removed
5829 in master, but not in luminous. once we renumber the legacy ruleset IDs,
5830 it's not need to check for and to warn the user at seeing the case where
5831 1-to-n mapping from ruleset to rule IDs.
5832
5833 commit f52d1ad23d97e1ab8c70f9b17b75daa0773698b7
5834 Author: John Spray <john.spray@redhat.com>
5835 Date: Fri Aug 25 10:42:58 2017 +0100
5836
5837 osd: s/crush_ruleset_in_use/crush_rule_in_use/
5838
5839 Signed-off-by: John Spray <john.spray@redhat.com>
5840 (cherry picked from commit 675483ecca06686fd4c626bfea33748092aef0c6)
5841
5842 commit 17d73e5a2e592719df8099450c9cd5f46d6fd582
5843 Merge: d4158133f7 e25a583323
5844 Author: Sage Weil <sage@newdream.net>
5845 Date: Fri Oct 20 23:10:49 2017 -0500
5846
5847 Merge pull request #17773 from xiexingguo/wip-luminous-object-legacy-flag
5848
5849 luminous: osd/PrimaryLogPG: _delete_oid - fix incorrect 'legacy' flag
5850
5851 Reviewed-by: Kefu Chai <kchai@redhat.com>
5852
5853 commit d4158133f7586472d01d9c6e669db92ddcd2e73d
5854 Merge: 84fbb0ff70 8b4fe14ba0
5855 Author: Sage Weil <sage@newdream.net>
5856 Date: Fri Oct 20 23:10:06 2017 -0500
5857
5858 Merge pull request #18362 from kmroz/wip-21543-luminous
5859
5860 luminous: qa/tasks: prolong revive_osd() timeout to 6 min
5861
5862 commit 84fbb0ff705df5bc9f164dd5a02bd5a82e6478d7
5863 Merge: 87ab8d5c80 993d098505
5864 Author: Sage Weil <sage@newdream.net>
5865 Date: Fri Oct 20 23:09:52 2017 -0500
5866
5867 Merge pull request #18388 from tchaikov/wip-pr-18346-luminous
5868
5869 os/filestore: print out the error if do_read_entry() fails
5870
5871 Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5872
5873 commit 87ab8d5c80374a73ad95f9ed9dd8826c54e64e9f
5874 Merge: 00daa8462a fd42f2a9cc
5875 Author: Sage Weil <sage@newdream.net>
5876 Date: Fri Oct 20 23:09:17 2017 -0500
5877
5878 Merge pull request #18398 from smithfarm/wip-21783-luminous
5879
5880 luminous: cli/crushtools/build.t sometimes fails in jenkins' make check run
5881
5882 Reviewed-by: Kefu Chai <kchai@redhat.com>
5883
5884 commit 00daa8462a5a337ecc57bd8664bfcc748befeead
5885 Merge: 5a4850c8c6 112069c70d
5886 Author: Sage Weil <sage@newdream.net>
5887 Date: Fri Oct 20 23:08:58 2017 -0500
5888
5889 Merge pull request #18401 from liewegas/wip-bluestore-label-luminous
5890
5891 luminous: os/bluestore: ceph-bluestore-tool repair updates and prime-osd-dir support
5892
5893 commit dbddf21bd3aac284122fd5fc84abdd4c89b12b3e
5894 Author: Sage Weil <sage@redhat.com>
5895 Date: Fri Oct 20 22:32:33 2017 -0500
5896
5897 messages/MOSDMap: do compat reencode of crush map, too
5898
5899 If we are reencoding an incremental, and it embeds a crush map, we need
5900 to reencode that in a compatible way too. This is especially true now
5901 because we have the compat crush weight-sets. Otherwise, a client may
5902 learn the crush map through an incremental but not understand choose_args,
5903 and not see/understand the alternate weight set. It will send requests
5904 to the wrong OSDs where they will just get dropped.
5905
5906 Fixes: http://tracker.ceph.com/issues/21882
5907 Signed-off-by: Sage Weil <sage@redhat.com>
5908 (cherry picked from commit 9eaafc66278d59447b29ce6cc378d0cd3ad14ad4)
5909
5910 commit c5ccbf1108532547f54f084b8f06c7f5ddf8a4e8
5911 Author: Ramana Raja <rraja@redhat.com>
5912 Date: Sun Sep 24 20:23:12 2017 +0530
5913
5914 ceph_volume_client: fix setting caps for IDs
5915
5916 ... that have empty OSD and MDS caps. Don't add a ',' at the
5917 start of OSD and MDS caps.
5918
5919 Fixes: http://tracker.ceph.com/issues/21501
5920 Signed-off-by: Ramana Raja <rraja@redhat.com>
5921 (cherry picked from commit baf3b88800c63ef7467abbc7b54e40c0da669f38)
5922
5923 commit b382db7cfce84adc897cd68e4cd7a4eb1b40a9f1
5924 Author: Brad Hubbard <bhubbard@redhat.com>
5925 Date: Wed Sep 20 13:15:30 2017 +1000
5926
5927 mon/OSDMonitor: mon osd feature checks with 0 up osds
5928
5929 get_up_osd_features() returns 0 if no osds are up which causes feature
5930 checks to fail.
5931
5932 Fixes: http://tracker.ceph.com/issues/21471
5933
5934 Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
5935 (cherry picked from commit 26ba0ba044846d18f9bdfdbee6e2a9c46882c742)
5936
5937 Conflicts:
5938 src/mon/MonCommands.h
5939 - removed mimic reference
5940 src/mon/OSDMonitor.cc
5941 - removed mimic-only command path
5942
5943 commit c845db3f8c2a0c2494fbdc9d6cc63c8e0c3b0563
5944 Author: Sage Weil <sage@redhat.com>
5945 Date: Tue Sep 19 18:25:56 2017 -0400
5946
5947 osd/OSDMap: ignore xinfo if features == 0
5948
5949 Some old bug (e.g., http://tracker.ceph.com/issues/20751) could
5950 result in an UP+EXISTS osd having features==0. If that happens,
5951 we shouldn't crash the mon, which (reasonably) does
5952
5953 if (osdmap.get_epoch()) {
5954 if (osdmap.get_num_up_osds() > 0) {
5955 assert(osdmap.get_up_osd_features() & CEPH_FEATURE_MON_STATEFUL_SUB);
5956 check_subs();
5957 }
5958 }
5959
5960 Signed-off-by: Sage Weil <sage@redhat.com>
5961 (cherry picked from commit 8399833f3d221364a8ededb97cd4e1c5a258d924)
5962
5963 commit e58656005d681ee0e35a25b324321cfeea8c7b3a
5964 Author: Matt Benjamin <mbenjamin@redhat.com>
5965 Date: Tue Oct 17 17:45:37 2017 -0400
5966
5967 rgw_file: explicit NFSv3 open() emulation
5968
5969 Expect RGW_OPEN_FLAG_V3 in rgw_write(), and if present, attempt
5970 a stateless open inline.
5971
5972 Required by Ganesha v2.5 and later
5973
5974 Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
5975 (cherry picked from commit 6ed23b4a0cea7e41b4743e27319737af693947ec)
5976
5977 commit f9850d2148b396032634f7ffa18ae458bd208195
5978 Author: Adam C. Emerson <aemerson@redhat.com>
5979 Date: Thu Sep 28 13:54:32 2017 -0400
5980
5981 rgw: Check bucket Website operations in policy
5982
5983 Add code to check s3:GetBucketWebsite and s3:PutBucketWebsite
5984 operations against bucket policy.
5985
5986 Fixes: http://tracker.ceph.com/issues/21597
5987 Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1493896
5988
5989 Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
5990 (cherry picked from commit ceed535957ac186e241fcff26b103cf7efa959b1)
5991
5992 commit abefb578c345a0ddd7100cae987e582b530d3729
5993 Author: Adam C. Emerson <aemerson@redhat.com>
5994 Date: Wed Sep 27 15:42:27 2017 -0400
5995
5996 rgw: Check bucket CORS operations in policy
5997
5998 Add code to check s3:GetCORS and s3:PutCORS operations against bucket
5999 policy.
6000
6001 Fixes: http://tracker.ceph.com/issues/21578
6002 Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1494140
6003
6004 Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
6005 (cherry picked from commit 27eb13fe568cc802feaf69131a21db076bcb6746)
6006
6007 commit 0b84dd07c41a6d69d99672218c72a4f69c21b040
6008 Author: Adam C. Emerson <aemerson@redhat.com>
6009 Date: Wed Sep 27 16:08:56 2017 -0400
6010
6011 rgw: Check bucket GetBucketLocation in policy
6012
6013 Add code to check s3:GetBucketLocation against bucket policy.
6014
6015 Fixes: http://tracker.ceph.com/issues/21582
6016 Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1493934
6017
6018 Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
6019 (cherry picked from commit 79188d679edeb6e2f7ca852fdc4224368412cb72)
6020
6021 commit 0b3a974be7bb9cd1d25ee9c2b861f38ea721c66b
6022 Author: Casey Bodley <cbodley@redhat.com>
6023 Date: Wed Sep 27 14:26:25 2017 -0400
6024
6025 rgw: include SSE-KMS headers in encrypted upload response
6026
6027 Fixes: http://tracker.ceph.com/issues/21576
6028
6029 Signed-off-by: Casey Bodley <cbodley@redhat.com>
6030 (cherry picked from commit a5b3db7acb4150d9d27ba42f72658e418dd444c0)
6031
6032 commit a3e2ae4925e7e25c213ef37072d576d1f1ffdc13
6033 Author: Abhishek Lekshmanan <abhishek@suse.com>
6034 Date: Fri Sep 22 16:11:55 2017 +0200
6035
6036 rgw: defer constructing keystone engine unless url is configured
6037
6038 currently we create a keystone revocation thread even when keystone url
6039 is empty, lets defer the construction of keystone unless the urls are
6040 configured
6041
6042 Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6043 (cherry picked from commit 104c2f59011e6b515e3845cce529ee44334e76c0)
6044
6045 commit 4c18ac124048f72a10d92aecfe1eadabab0a80b4
6046 Author: Adam C. Emerson <aemerson@redhat.com>
6047 Date: Wed Sep 27 14:35:59 2017 -0400
6048
6049 rgw: Check bucket versioning operations in policy
6050
6051 Add code to check s3:GetBucketVersioning and s3:PutBucketVersioning
6052 operations against bucket policy.
6053
6054 Fixes: http://tracker.ceph.com/issues/21389
6055 Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1490278
6056
6057 Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
6058 (cherry picked from commit 16de0fc1c5ede961ebd481f13753214a971c206c)
6059
6060 commit be1ded107ac4e1a1b1515d40553aed3581e0afac
6061 Author: Adam C. Emerson <aemerson@redhat.com>
6062 Date: Thu Sep 14 18:07:15 2017 -0400
6063
6064 rgw: Check payment operations in policy
6065
6066 Add code to check s3:GetBucketRequestPayment and
6067 s3:PutBucketRequestPayment operations against bucket policy.
6068
6069 Fixes: http://tracker.ceph.com/issues/21389
6070 Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1490278
6071
6072 Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
6073 (cherry picked from commit f9d1ae1d153319e870c3ccaf7afdc92786cdaa3b)
6074
6075 commit 92d0545781ca2bff39f7bd8e9d63bb8c2d8cb997
6076 Author: Nathan Johnson <njohnson@ena.com>
6077 Date: Thu Sep 7 23:27:40 2017 -0500
6078
6079 rgw: admin api - add ability to sync user stats from admin api
6080
6081 Fixes: http://tracker.ceph.com/issues/21301
6082 Signed-off-by: Nathan Johnson <nathan@nathanjohnson.org>
6083 (cherry picked from commit 828412d573a0b31387fc9f6a879f9a6083535730)
6084
6085 commit d800747fa18a1872f1d748119bfcc7eff34ae6cf
6086 Author: gaosibei <gaosb@inspur.com>
6087 Date: Tue Sep 26 10:19:22 2017 +0800
6088
6089 RGW: fix a bug about inconsistent unit of comparison
6090
6091 Fixes:http://tracker.ceph.com/issues/21590
6092
6093 Signed-off-by: gaosibei <gaosb@inspur.com>
6094 (cherry picked from commit cb39f065d6eba87cf1fc2e99334322bf63092df3)
6095
6096 commit 14a1dcb1ff70b2a468cb47e7f239b98e45c63a88
6097 Author: Mark Kogan <mkogan@redhat.com>
6098 Date: Mon Sep 25 09:53:00 2017 +0300
6099
6100 rgw: update the usage read iterator in truncated scenario
6101 Fixes: http://tracker.ceph.com/issues/21196
6102
6103 Signed-off-by: Mark Kogan <mkogan@redhat.com>
6104 (cherry picked from commit 7306514a813661b77bfcbfc6f534dbabbdd3aa78)
6105
6106 commit 8b420c4627faca27f61f472597c6f67cca2efa2f
6107 Author: Casey Bodley <cbodley@redhat.com>
6108 Date: Thu Oct 5 16:39:30 2017 -0400
6109
6110 rgw: RGWUser::init no longer overwrites user_id
6111
6112 if an admin op specifies a user_id and does not find a user with that
6113 id, but does find a user based on a later field (email, access key,
6114 etc), RGWUser::user_id will be overwritten with the existing user's id
6115
6116 when this happens on 'radosgw-admin user create', RGWUser::execute_add()
6117 will modify that existing user, instead of trying to create a new user
6118 with the given user_id (and failing due to the conflicting email,
6119 access key, etc)
6120
6121 by preserving the original user_id (when specified), this uid conflict
6122 is detected in RGWUser::check_op() and a "user id mismatch" error is
6123 returned
6124
6125 Fixes: http://tracker.ceph.com/issues/21685
6126
6127 Signed-off-by: Casey Bodley <cbodley@redhat.com>
6128 (cherry picked from commit 4e65c9e9af86e832cb96d57d487771aa28251e7c)
6129
6130 commit fe45086a54d76cd9b913663d4537b36a8a276ed4
6131 Author: gaosibei <gaosb@inspur.com>
6132 Date: Tue Sep 26 10:44:09 2017 +0800
6133
6134 RGW: Multipart upload may double the quota
6135
6136 Fixes: http://tracker.ceph.com/issues/21586
6137
6138 Signed-off-by: Sibei Gao <gaosb@inspur.com>
6139 (cherry picked from commit 97f95e457fb7f9e36031f41e0f2dd3955daedd87)
6140
6141 commit c3a719da278a830cc1b8101e3d8ef25316da33d7
6142 Author: Casey Bodley <cbodley@redhat.com>
6143 Date: Thu Oct 12 13:26:29 2017 -0400
6144
6145 rgw: 'zone placement' commands validate compression type
6146
6147 Fixes: http://tracker.ceph.com/issues/21775
6148
6149 Signed-off-by: Casey Bodley <cbodley@redhat.com>
6150 (cherry picked from commit 33f8ee8b6fa5605edbbfe12d8e097123e509ad9f)
6151
6152 commit 352373ff4a333c9b3869c9f168ee14530067907a
6153 Author: Yao Zongyou <yaozongyou@vip.qq.com>
6154 Date: Sun Sep 24 22:11:22 2017 +0800
6155
6156 rgw_file: fix write error when the write offset overlaps.
6157
6158 Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
6159 (cherry picked from commit 872d73f945364002f0fa31762e6976db5b4b3c19)
6160
6161 commit 248bd94dab4359dfea34bfa0cbdd16d9a9b76a02
6162 Author: Orit Wasserman <owasserm@redhat.com>
6163 Date: Mon Oct 9 13:25:36 2017 +0300
6164
6165 rgw: disable dynamic resharding in multisite environment
6166
6167 Fixes:http://tracker.ceph.com/issues/21725
6168 Signed-off-by: Orit Wasserman <owasserm@redhat.com>
6169 (cherry picked from commit f1ec7a49bde054a19a0a8fd80f37866e1e40379f)
6170
6171 commit 624b3ac5053dbef008d2e9238c6958d07206f6c3
6172 Author: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
6173 Date: Tue Sep 26 10:00:59 2017 +0800
6174
6175 rgw: Torrents are not supported for objects encrypted using SSE-C
6176
6177 Fixes: http://tracker.ceph.com/issues/21720
6178
6179 Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
6180 (cherry picked from commit 9a8ae664da54eb74e74a12cc16a52b0df7df70a0)
6181
6182 commit 0e65ea466f05a2bc8825e51b32901d74082c1b65
6183 Author: Matt Benjamin <mbenjamin@redhat.com>
6184 Date: Tue Oct 3 17:48:29 2017 -0400
6185
6186 rgw: release cls lock if taken in RGWCompleteMultipart
6187
6188 Follows Casey's proposal to conditionally release the lock in
6189 ::complete(), in order to avoid duplicated code in various early
6190 return cases.
6191
6192 Fixes: http://tracker.ceph.com/issues/21596
6193
6194 Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
6195 (cherry picked from commit 704f793f08a02760d23eb5778b738bb07be0e7cf)
6196
6197 commit 17df0ba8f00abbf4b30e0370090251b0c7f6b643
6198 Author: Enming Zhang <enming.zhang@umcloud.com>
6199 Date: Sat Aug 26 04:46:35 2017 +0800
6200
6201 rgw: encryption add exception handling for from_base64 on bad input
6202
6203 If calling from_base64 with charactors that is not base64 encoded,
6204 rgw will crash.
6205
6206 Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
6207 (cherry picked from commit f0b88e51be86d84793b794f6fe87fdda62004a4d)
6208
6209 commit 46f09e3803ba3c4b463bfa6a2eeb40a0bd7cc0ef
6210 Author: Enming Zhang <enming.zhang@umcloud.com>
6211 Date: Fri Aug 25 19:48:53 2017 +0800
6212
6213 rgw: encryption fix the issue when not provide encryption mode
6214
6215 Now, in RGW, if someone want to upload an object using server-side
6216 encryption with providing customer key or kms key id, but not
6217 specify the encryption mode in the
6218 "x-amz-server-side-encryption-customer-algorithm" or
6219 "x-amz-server-side-encryption", the object will be uploaded
6220 successfully without encryption.
6221
6222 This is not a correct way to deal with it. It is better to
6223 return error.
6224
6225 Fixes: http://tracker.ceph.com/issues/21581
6226
6227 Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
6228 (cherry picked from commit f8c4be8a8943096217d89f7c5abd129fa2414b36)
6229
6230 commit fefbc9fec47cc6858f74b7ea372d39efeb95c61f
6231 Author: Enming Zhang <enming.zhang@umcloud.com>
6232 Date: Fri Aug 25 19:47:21 2017 +0800
6233
6234 rgw: encryption SSE-KMS add the details of error msg in response
6235
6236 Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
6237 (cherry picked from commit 3f16785daf4b3609f2bff7c107a35f908103e32a)
6238
6239 commit 2e493e1f7a1f20d2f33e66816cc72d6b5f193b61
6240 Author: Enming Zhang <enming.zhang@umcloud.com>
6241 Date: Fri Aug 25 19:37:52 2017 +0800
6242
6243 rgw: encryption SSE-C add the details of error msg in response
6244
6245 Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
6246 (cherry picked from commit 9502549ac2133e969a5f268601b92fd4063c1bd9)
6247
6248 commit fe0a41b4a921ac3510b344a6edf6e930a2fa2465
6249 Author: Jason Dillaman <dillaman@redhat.com>
6250 Date: Thu Oct 12 08:58:03 2017 -0400
6251
6252 cls/journal: fixed possible infinite loop which could kill the OSD
6253
6254 Fixes: http://tracker.ceph.com/issues/21771
6255 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6256 (cherry picked from commit 9e7475f8fb08b0ef30cad2c0d680cecf331b44ef)
6257
6258 commit e0d57c544d55f3693f858464f7995b4b30cfa88d
6259 Author: Jason Dillaman <dillaman@redhat.com>
6260 Date: Thu Oct 12 08:56:57 2017 -0400
6261
6262 test: ceph_test_cls_journal was dropped when converting to cmake
6263
6264 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6265 (cherry picked from commit 5d9cfebabac33b645c6199bda63ff4619e6f538f)
6266
6267 commit f8bfd9458d44d96d4ef56a28195a9e36fc0190c6
6268 Author: Jason Dillaman <dillaman@redhat.com>
6269 Date: Sun Oct 15 17:26:25 2017 -0400
6270
6271 librbd: batch large object map updates into multiple chunks
6272
6273 Fixes: http://tracker.ceph.com/issues/21797
6274 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6275 (cherry picked from commit 04c5d12acc045731fbf1d0ddce276b5743d9fd89)
6276
6277 commit 6866abc01be5fd92acc918472a604a3af9894b44
6278 Author: Jason Dillaman <dillaman@redhat.com>
6279 Date: Fri Oct 13 18:55:47 2017 -0400
6280
6281 test/librbd: initial test cases for trim state machine
6282
6283 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6284 (cherry picked from commit 4674b578d8233da3b3c145606ed9c0e4e88a540a)
6285
6286 commit 3b87dea6584010ae05e540825867c9961708ff36
6287 Author: Jason Dillaman <dillaman@redhat.com>
6288 Date: Fri Oct 13 15:49:00 2017 -0400
6289
6290 librbd: tweaks to support testing of trim state machine
6291
6292 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6293 (cherry picked from commit 3220480d4a22c81cb74f25e528f2bcf3986342c1)
6294
6295 commit ce628329641ac6322d5c59055e8db9eecafbfef4
6296 Author: Jason Dillaman <dillaman@redhat.com>
6297 Date: Fri Oct 13 14:44:40 2017 -0400
6298
6299 librbd: combine trim state machine object map batch update states
6300
6301 The PRE/POST states were previously divided into two halves for handling
6302 the copy-up batch and the direct removal batch. This can be simplified by
6303 just using a single PRE/POST for the entire deletion region.
6304
6305 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6306 (cherry picked from commit 72ce4576fa2b562799a5bc78bd423cfabe097d67)
6307
6308 Conflicts:
6309 src/librbd/operation/TrimRequest.h
6310
6311 commit 80ff76db5495ae41baf6d4292b6b10c2f789c155
6312 Author: Jason Dillaman <dillaman@redhat.com>
6313 Date: Fri Oct 13 11:06:38 2017 -0400
6314
6315 cls/rbd: object map update now utilizes constant-time bit vector operations
6316
6317 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6318 (cherry picked from commit fc99603ea2b5b268181d38507b8b6fb55ae0a6d0)
6319
6320 commit 5dc46378370da8eede9958a88d6764737d55b09b
6321 Author: Jason Dillaman <dillaman@redhat.com>
6322 Date: Fri Oct 13 11:05:48 2017 -0400
6323
6324 common/bit_vector: provide constant time iteration of underlying bufferlist
6325
6326 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6327 (cherry picked from commit daa29f7d2b50bc4b44a108a0f91d45ce90fc16e5)
6328
6329 commit ae4ebaca231e4ae94efc8d445fee792f76e656e1
6330 Author: Jason Dillaman <dillaman@redhat.com>
6331 Date: Fri Oct 13 11:03:25 2017 -0400
6332
6333 common/buffer: expose hidden const deference operator
6334
6335 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6336 (cherry picked from commit f35947e3c6661dfe9f951896bc54bc8da158b490)
6337
6338 commit b60d8cf0cbe56500af98b3d3857245e94d904b19
6339 Author: Jason Dillaman <dillaman@redhat.com>
6340 Date: Mon Oct 2 17:28:04 2017 -0400
6341
6342 osd: additional protection for out-of-bounds EC reads
6343
6344 Fixes: http://tracker.ceph.com/issues/21629
6345 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6346 (cherry picked from commit 881f2a02aecef0cd6bf8ec3e5045b76c8441e832)
6347
6348 commit 8f87fa2d3af44840a3044cd736a2f8da0b602b07
6349 Author: John Spray <john.spray@redhat.com>
6350 Date: Sat Sep 23 13:21:47 2017 -0400
6351
6352 mgr: fix crashable DaemonStateIndex::get calls
6353
6354 This function was recently fixed to return null
6355 on missing entries: handle that properly.
6356
6357 Fixes: http://tracker.ceph.com/issues/17737
6358 Signed-off-by: John Spray <john.spray@redhat.com>
6359 (cherry picked from commit ade4827d86bb2bc79466a2da040475651c2aae0d)
6360
6361 commit def3d55eb71e0c62b7fd523865c2ba196342aa1a
6362 Author: huangjun <huangjun@xsky.com>
6363 Date: Fri Oct 6 11:58:50 2017 +0800
6364
6365 qa/suites/rest/basic/tasks/rest_test: whiltelist OSD_DOWN
6366
6367 Fixes: http://tracker.ceph.com/issues/21425
6368 Signed-off-by: huangjun <huangjun@xsky.com>
6369 (cherry picked from commit 838e12cfc84b386fd4eae09e526b078286f0771e)
6370
6371 commit 20c9e641f7096bf3e208b4d6d28494603eeba891
6372 Author: huangjun <huangjun@xsky.com>
6373 Date: Tue Sep 19 16:13:34 2017 +0800
6374
6375 qa/suites/rest/basic/tasks/rest_test: more whitelisting
6376
6377 Fixes: http://tracker.ceph.com/issues/21425
6378
6379 Signed-off-by: huangjun <huangjun@xsky.com>
6380 (cherry picked from commit 4d30d02e522039461762d51a3a826a337214ca7e)
6381
6382 commit 5a4850c8c66b75d02fc2597e1ca744c6b0303836
6383 Merge: 17c6f35703 03e2a68e43
6384 Author: Sage Weil <sage@newdream.net>
6385 Date: Thu Oct 19 16:43:39 2017 -0500
6386
6387 Merge pull request #17692 from smithfarm/wip-21176-luminous
6388
6389 build/ops: python-numpy-devel build dependency for SUSE
6390
6391 Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6392 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
6393
6394 commit 17c6f357030315040f8af95e751921c475b32289
6395 Merge: 97b30154f8 5aa445897c
6396 Author: Sage Weil <sage@newdream.net>
6397 Date: Thu Oct 19 16:42:45 2017 -0500
6398
6399 Merge pull request #17730 from xiexingguo/wip-pr-17371
6400
6401 luminous: mon, osd: per pool space-full flag support
6402
6403 Reviewed-by: Sage Weil <sage@redhat.com>
6404
6405 commit 97b30154f884f4ea987e3330799bf412b08ba3e4
6406 Merge: 0a8f1540ba fb7e6a581d
6407 Author: Sage Weil <sage@newdream.net>
6408 Date: Thu Oct 19 16:42:07 2017 -0500
6409
6410 Merge pull request #17779 from smithfarm/wip-rh-74-luminous
6411
6412 tests: CentOS 7.4 is now the latest
6413
6414 Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
6415
6416 commit 0a8f1540ba08bb79e9ec8f3358490a31be734b2b
6417 Merge: 5ca7af785a d7cde5f316
6418 Author: Sage Weil <sage@newdream.net>
6419 Date: Thu Oct 19 16:41:34 2017 -0500
6420
6421 Merge pull request #17863 from smithfarm/wip-21343-luminous
6422
6423 luminous: mon: DNS SRV default service name not used anymore
6424
6425 commit 5ca7af785a6695121f841909a6118a5103795d99
6426 Merge: 37d7cfc9f1 49e030da55
6427 Author: Sage Weil <sage@newdream.net>
6428 Date: Thu Oct 19 16:40:45 2017 -0500
6429
6430 Merge pull request #17864 from smithfarm/wip-21438-luminous
6431
6432 luminous: core: Daemons(OSD, Mon...) exit abnormally at injectargs command
6433
6434 Reviewed-by: Kefu Chai <kchai@redhat.com>
6435
6436 commit 37d7cfc9f136c9604a1e53604a8e0d939eee60db
6437 Merge: 223b0956b9 077b3601d6
6438 Author: Sage Weil <sage@newdream.net>
6439 Date: Thu Oct 19 16:40:18 2017 -0500
6440
6441 Merge pull request #17866 from smithfarm/wip-21320-luminous
6442
6443 luminous: mgr: Quieten scary RuntimeError from restful module on startup
6444
6445 commit 223b0956b93504881a5f06d2589a0b138abf37a9
6446 Merge: 4f1a7a82a1 82651da2d5
6447 Author: Sage Weil <sage@newdream.net>
6448 Date: Thu Oct 19 16:39:53 2017 -0500
6449
6450 Merge pull request #17951 from smithfarm/wip-21548-luminous
6451
6452 luminous: tests: ceph_manager: bad AssertionError: failed to recover before timeout expired
6453
6454 commit 4f1a7a82a1134d6688537653ac07d924275e1f3a
6455 Merge: 37b13acabe a670921f4f
6456 Author: Sage Weil <sage@newdream.net>
6457 Date: Thu Oct 19 16:39:32 2017 -0500
6458
6459 Merge pull request #18342 from xiexingguo/wip-pr-18318
6460
6461 luminous: bluestore: using bluestore_compression_min_blob_size instead of bluestore_compression_max_blob_size to config comp_min_blob_size
6462
6463 Reviewed-by: Sage Weil <sage@redhat.com>
6464
6465 commit 112069c70df5c7719af9291a8de2b4fcf48d049a
6466 Author: Sage Weil <sage@redhat.com>
6467 Date: Mon Oct 16 17:46:03 2017 -0500
6468
6469 os/bluestore: fsync on _write_bdev_label
6470
6471 Signed-off-by: Sage Weil <sage@redhat.com>
6472 (cherry picked from commit 7aca8af6625156eeaa936629f83ede33d3bbe866)
6473
6474 commit 1e9aa60e3f6acca6649f5d5d51421cc2bd51e55a
6475 Author: Sage Weil <sage@redhat.com>
6476 Date: Mon Oct 16 17:45:54 2017 -0500
6477
6478 ceph-bluestore-tool: implement 'set-label-key' and 'rm-label-key'
6479
6480 Signed-off-by: Sage Weil <sage@redhat.com>
6481 (cherry picked from commit 4b468c989f9e8609e7f640cfa4385c454ae6dc17)
6482
6483 commit 170499a1e570bc110be08ca2a38063229fee75dc
6484 Author: Sage Weil <sage@redhat.com>
6485 Date: Mon Oct 16 17:42:29 2017 -0500
6486
6487 os/bluestore: make _write_bdev_label static and public
6488
6489 Signed-off-by: Sage Weil <sage@redhat.com>
6490 (cherry picked from commit 0b0550c967ae0d6ae49641c6859f0b63267e2cd9)
6491
6492 commit 895a277568f902f1c00b9df475ea56b00b115841
6493 Author: Sage Weil <sage@redhat.com>
6494 Date: Thu Oct 12 11:40:11 2017 -0500
6495
6496 doc/man/8/ceph-bluestore-tool: add man page
6497
6498 Signed-off-by: Sage Weil <sage@redhat.com>
6499 (cherry picked from commit 7b91e50dbd289e65f10cb98c5eea9f3171c2d1f1)
6500
6501 commit 24b3b7960e5c5d118aacb63753c794466e801f84
6502 Author: Sage Weil <sage@redhat.com>
6503 Date: Fri Oct 13 09:20:53 2017 -0500
6504
6505 common/options: document 'key', 'keyfile', 'keyring'
6506
6507 Signed-off-by: Sage Weil <sage@redhat.com>
6508 (cherry picked from commit cdee8b26b9d93189dcd2875038361fb59ed21ba2)
6509
6510 commit 508889d4a7aa93f3bbe13ad8bfc181f3fc9ed2a9
6511 Author: Sage Weil <sage@redhat.com>
6512 Date: Thu Oct 12 13:54:06 2017 -0500
6513
6514 ceph-bluestore-tool: fix show-label to use dev name as key
6515
6516 Signed-off-by: Sage Weil <sage@redhat.com>
6517 (cherry picked from commit 4785345ace7b675a0e1c34c457aad1103aab5a1d)
6518
6519 commit 6e17557f288aa7686b8b68c1df31a9a8c26912ac
6520 Author: Sage Weil <sage@redhat.com>
6521 Date: Thu Oct 12 08:48:59 2017 -0500
6522
6523 ceph-bluestore-tool: drop "action ..." print
6524
6525 Signed-off-by: Sage Weil <sage@redhat.com>
6526 (cherry picked from commit 5e486c2bd3414f4ee6519574d4d4584618144867)
6527
6528 commit a128aad320e99c396ff17bcaadb48866667b87df
6529 Author: Sage Weil <sage@redhat.com>
6530 Date: Thu Oct 12 08:48:46 2017 -0500
6531
6532 ceph-bluestore-tool: only infer devs if devs.empty()
6533
6534 Signed-off-by: Sage Weil <sage@redhat.com>
6535 (cherry picked from commit 2d217367af0df5e18394b1c6179d92db3c0b4448)
6536
6537 commit 24d86603faf4a826684a5e124ed9b447de0b50e8
6538 Author: Sage Weil <sage@redhat.com>
6539 Date: Wed Oct 11 17:36:40 2017 -0500
6540
6541 ceph-bluestore-tool: implement prime-osd-dir
6542
6543 This populates an osd dir based on the metadata in a bluestore
6544 device label.
6545
6546 Signed-off-by: Sage Weil <sage@redhat.com>
6547 (cherry picked from commit 72ee7e29fb77f581a537b1ff2b274c9f3a7de53f)
6548
6549 commit 0f43e6907cfd27f2d6791b896480f2c537115212
6550 Author: Sage Weil <sage@redhat.com>
6551 Date: Wed Oct 11 16:33:54 2017 -0500
6552
6553 os/bluestore: keep meta items for extra bdev paths
6554
6555 Signed-off-by: Sage Weil <sage@redhat.com>
6556 (cherry picked from commit 8d07fa5ad0772b4d979dc10695d230074d1f1e69)
6557
6558 commit bb9b70c33a3e013ef78d931fd865ab44c255d772
6559 Author: Sage Weil <sage@redhat.com>
6560 Date: Wed Oct 11 17:33:00 2017 -0500
6561
6562 vstart.sh: specify block files
6563
6564 This is mostly just to test ceph-bluestore-tool prime-osd-dir.
6565
6566 Signed-off-by: Sage Weil <sage@redhat.com>
6567 (cherry picked from commit d4e0c46d89c2ebe6ae5f9af1c909a09daaea9687)
6568
6569 commit ce83461a60cea6026a7abdd51b2a7a35302392c6
6570 Author: Sage Weil <sage@redhat.com>
6571 Date: Wed Oct 11 16:32:16 2017 -0500
6572
6573 osd: store osd cephx key in "osd_key" meta slot
6574
6575 Note that this *only* works with --mkkey (deprecated except for
6576 vstart.sh) and --key <key>. If you write out a full keyring before
6577 running --mkfs it doesn't get populated. Users should pass --key
6578 instead of --keyring in that case.
6579
6580 Signed-off-by: Sage Weil <sage@redhat.com>
6581 (cherry picked from commit 65b707358e5442eab0fd6ba4d05d9f0a7adc969f)
6582
6583 commit 60d43cb51d7b05cc778cda6b5fcd368db618e3db
6584 Author: Sage Weil <sage@redhat.com>
6585 Date: Wed Oct 11 16:17:09 2017 -0500
6586
6587 ceph-osd: mkkey before mkfs
6588
6589 Signed-off-by: Sage Weil <sage@redhat.com>
6590 (cherry picked from commit 75400ead3061ba1e2820878783fe7b1ddcd9a5fb)
6591
6592 commit faad6afa3441b5ce9455a4de0535baef78b8e7de
6593 Author: Sage Weil <sage@redhat.com>
6594 Date: Wed Oct 11 15:53:56 2017 -0500
6595
6596 os/bluestore: store meta values in main device label
6597
6598 Signed-off-by: Sage Weil <sage@redhat.com>
6599 (cherry picked from commit 33b8e8e86f6bdbee120729561c6cf433d286e2f8)
6600
6601 commit 1027e57d9af374f1fa1dee2a585dfe539dc4f5eb
6602 Author: Sage Weil <sage@redhat.com>
6603 Date: Sun Sep 10 15:37:10 2017 -0400
6604
6605 os/bluestore: fsck: fix error prefixes
6606
6607 __func__ is now _fsck instead of fsck
6608
6609 Signed-off-by: Sage Weil <sage@redhat.com>
6610 (cherry picked from commit 7d381af7aed14e08823eca4d0b12de14456ef6a1)
6611
6612 commit 68642c43384d5a30155cd67129267d38d6cc3a06
6613 Author: Sage Weil <sage@redhat.com>
6614 Date: Thu Sep 7 12:29:32 2017 -0400
6615
6616 os/bluestore: allow repair invocation
6617
6618 Signed-off-by: Sage Weil <sage@redhat.com>
6619 (cherry picked from commit 659fcd279ae82c90172fd6ca07a032d75fe50c96)
6620
6621 commit fd42f2a9ccc5016660b9c205f6aa0104ffdd0b10
6622 Author: Kefu Chai <kchai@redhat.com>
6623 Date: Wed Oct 11 17:45:19 2017 +0800
6624
6625 crushtool: print error message to stderr not dout(1)
6626
6627 in hope to fix the mysterious test failure where cli/crushtool/build.t
6628 prints nothing when error message is expected.
6629
6630 Fixes: http://tracker.ceph.com/issues/21758
6631 Signed-off-by: Kefu Chai <kchai@redhat.com>
6632 (cherry picked from commit dc78d40af77ff8d5e4f3d39497e6e3c98c309306)
6633
6634 commit 6902627cb3cb41547be5134aba5c10a39b78163a
6635 Author: Sage Weil <sage@redhat.com>
6636 Date: Sat Jul 22 23:51:47 2017 -0400
6637
6638 crush/CrushWrapper: fix output arg for find_{takes,roots}()
6639
6640 Signed-off-by: Sage Weil <sage@redhat.com>
6641 (cherry picked from commit 60b9cfafc3128cc0cb1f89137221fcc46fcd3802)
6642
6643 commit 993d09850580ca7a697c1a221a8e258f4cd64237
6644 Author: Kefu Chai <kchai@redhat.com>
6645 Date: Tue Oct 17 17:08:59 2017 +0800
6646
6647 os/filestore: print out the error if do_read_entry() fails
6648
6649 Signed-off-by: Kefu Chai <kchai@redhat.com>
6650 (cherry picked from commit 42e85fe35d2fe8f3e99bd110021fd5157cf589d7)
6651
6652 commit 410434b3d23c54971f3e2c4df179b139979a33c0
6653 Author: Yan, Zheng <zyan@redhat.com>
6654 Date: Thu Oct 19 11:32:38 2017 +0800
6655
6656 mds: fix race in PurgeQueue::wait_for_recovery()
6657
6658 After PurgeQueue::wait_for_recovery() locks the mutex, purge queue
6659 may have already been recovered.
6660
6661 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6662
6663 commit ee96c34a4d1fc48dec6a1afb4fe98634805c02ce
6664 Author: Yan, Zheng <zyan@redhat.com>
6665 Date: Wed Sep 27 19:59:47 2017 +0800
6666
6667 mds: open purge queue when transitioning out of standby replay
6668
6669 MDS opens the purge queue when it starts standby replay. This is
6670 wrong because purge queue may change during standby replay.
6671
6672 Fixes: http://tracker.ceph.com/issues/19593
6673 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6674 (cherry picked from commit e515e84f69eeab90ea5c5831f7d3e684e48fb62e)
6675
6676 commit 681cddfa420a0f5f4335564843cdfdb1a4f2371d
6677 Author: Yan, Zheng <zyan@redhat.com>
6678 Date: Wed Sep 27 18:49:55 2017 +0800
6679
6680 mds: always re-probe mds log when standby replay done
6681
6682 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6683 (cherry picked from commit 82c1f5fcfd151aa1e8c39c7f198abec9bf807b65)
6684
6685 commit 37b13acabe3a0cbdcd88c06f49548146d2c69c14
6686 Merge: 90b6067f6f f30e9a5e6b
6687 Author: vasukulkarni <vasu.kulkarni@gmail.com>
6688 Date: Tue Oct 17 15:47:31 2017 -0700
6689
6690 Merge pull request #18363 from ceph/wip-yuriw-21822-luminous
6691
6692 tests - ceph-ansible vars additions
6693
6694 commit f30e9a5e6bd47129f8a35c1f9067216cfe8a6a70
6695 Author: Yuri Weinstein <yweinste@redhat.com>
6696 Date: Tue Oct 17 13:14:36 2017 -0700
6697
6698 tests - ceph-ansible vars additions
6699 added symlinks for distros
6700
6701 Fixes http://tracker.ceph.com/issues/21822
6702 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6703
6704 commit 90b6067f6f5cbfaf48afb08bd17cb9e5f46a5af9
6705 Merge: 1718fd969c ab53002186
6706 Author: Sage Weil <sage@newdream.net>
6707 Date: Tue Oct 17 16:31:25 2017 -0500
6708
6709 Merge pull request #17975 from dillaman/wip-systemd-rbd-mirror-luminous
6710
6711 luminous: systemd: rbd-mirror does not start on reboot
6712
6713 Reviewed-by: Sébastien Han <seb@redhat.com>
6714 Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6715
6716 commit 1718fd969c32cc09cfc208a18455291ab2886e93
6717 Merge: 345286b775 9d12fa5e6d
6718 Author: Sage Weil <sage@newdream.net>
6719 Date: Tue Oct 17 16:30:46 2017 -0500
6720
6721 Merge pull request #18234 from jdurgin/wip-filestore-rocksdb-luminous
6722
6723 filestore: set default readahead and compaction threads for rocksdb
6724
6725 Reviewed-by: Sage Weil <sage@redhat.com>
6726 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
6727
6728 commit 345286b775fd269eb9f13cfcb8d0aab533dbfbc6
6729 Merge: 9223ace029 ab644b89e0
6730 Author: Sage Weil <sage@newdream.net>
6731 Date: Tue Oct 17 16:29:38 2017 -0500
6732
6733 Merge pull request #18236 from tchaikov/wip-21609-luminous
6734
6735 luminous: mon,osd: fix "pg ls {forced_backfill, backfilling}"
6736
6737 Reviewed-by: Sage Weil <sage@redhat.com>
6738
6739 commit 9223ace02909d6551f6126181d11bf00bab1cfe3
6740 Merge: fdefc8094e 099801e616
6741 Author: Sage Weil <sage@newdream.net>
6742 Date: Tue Oct 17 16:29:08 2017 -0500
6743
6744 Merge pull request #18257 from smithfarm/wip-21699-luminous
6745
6746 luminous: mgr status module uses base 10 units
6747
6748 Reviewed-by: John Spray <john.spray@redhat.com>
6749
6750 commit 8b4fe14ba0e9f8e1b09ae4112dbebd370136bd3f
6751 Author: Kefu Chai <kchai@redhat.com>
6752 Date: Fri Sep 22 10:58:40 2017 +0800
6753
6754 qa/tasks: prolong revive_osd() timeout to 6 min
6755
6756 bluestore_fsck_on_mount and bluestore_fsck_on_mount_deep are enabled by
6757 default. and bluestore is used as the default store backend. it takes
6758 longer to perform the deep fsck with verbose log. so prolong the
6759 revive_osd()'s timeout from 150 sec to 360 sec.
6760
6761 Fixes: http://tracker.ceph.com/issues/21474
6762 Signed-off-by: Kefu Chai <kchai@redhat.com>
6763 (cherry picked from commit 42be200c564184feff1056b7771ce3c1b2cc5527)
6764
6765 commit a670921f4fb2e15f5ea44e9dda238c2eef96897c
6766 Author: linbing <hawkerous@gmail.com>
6767 Date: Mon Oct 16 09:57:23 2017 +0800
6768
6769 bluestore: using bluestore_compression_min_blob_size instead of bluestore_compression_max_blob_size to config comp_min_blob_size
6770
6771 Signed-off-by: linbing <linbing@t2cloud.net>
6772 (cherry picked from commit da8dc4d4c60f5fd66f6eb2ba7257c52948f24681)
6773
6774 commit fdefc8094ed639c859db5b4eba858cfe05329e5c
6775 Merge: bac56cccf9 3a94d69264
6776 Author: Kefu Chai <tchaikov@gmail.com>
6777 Date: Tue Oct 17 15:19:01 2017 +0800
6778
6779 Merge pull request #18339 from tchaikov/wip-gen-state-diagram-luminous
6780
6781 doc: build with multiple-line state transition function signature
6782
6783 Reviewed-By: Nathan Cutler <ncutler@suse.com>
6784
6785 commit bac56cccf9e3fb44a0ed85c151a8b1a0fb5fa4b0
6786 Merge: 61aca44033 37ddfc61c3
6787 Author: Kefu Chai <tchaikov@gmail.com>
6788 Date: Tue Oct 17 12:44:04 2017 +0800
6789
6790 Merge pull request #17835 from rzarzynski/wip-rgw-per-storage-policy-stats-luminous
6791
6792 luminous: rgw: add support for Swift's per storage policy statistics
6793
6794 Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
6795 Reviewed-by: Casey Bodley <cbodley@redhat.com>
6796
6797 commit 3a94d6926403ac1f55a9d5723f6b07486f35060b
6798 Author: Alfredo Deza <adeza@redhat.com>
6799 Date: Fri Oct 6 08:57:01 2017 -0400
6800
6801 doc parse two lines for getting the context
6802
6803 So that signatures can get parsed when they are split like:
6804
6805 PG::RecoveryState::RepWaitBackfillReserved::react(
6806 const RemoteReservationCanceled &evt)
6807
6808 Signed-off-by: Alfredo Deza <adeza@redhat.com>
6809 (cherry picked from commit 9e2a52ccec4a5c833dd861ae528d52efbc0f9e5f)
6810
6811 commit ddd88ff365c5399d88890abe1608f12c4a960488
6812 Author: Alfredo Deza <adeza@redhat.com>
6813 Date: Fri Oct 6 08:03:36 2017 -0400
6814
6815 doc raise exceptions with a base class
6816
6817 Although valid in very old Python, it is no longer possible to raise
6818 "bare" exceptions without a class.
6819
6820 Signed-off-by: Alfredo Deza <adeza@redhat.com>
6821 (cherry picked from commit 347b7b1f193f97a3577a971e074a23366b0c8617)
6822
6823 commit 8b3e9917a70452cc4182aae469aac331314df4e6
6824 Author: Jason Dillaman <dillaman@redhat.com>
6825 Date: Tue Sep 26 15:46:28 2017 -0400
6826
6827 rbd-mirror: ensure forced-failover cannot result in sync state
6828
6829 If the local image already exists and the local image isn't
6830 registered in the remote journal, it should be assumed that
6831 it's already in the replaying state so it can verify the
6832 ancestry to detect split-brains.
6833
6834 Fixes: http://tracker.ceph.com/issues/21559
6835 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6836 (cherry picked from commit bc96c53d947625d12f7b30a45da68a96c09faf70)
6837
6838 commit d7da395e5196eae13b31c018bf503b9e0c169bda
6839 Author: Jason Dillaman <dillaman@redhat.com>
6840 Date: Tue Sep 26 14:21:42 2017 -0400
6841
6842 rbd-mirror: forced-promotion should interrupt replay delay to shut down
6843
6844 Fixes: http://tracker.ceph.com/issues/21559
6845 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6846 (cherry picked from commit e3b58312572ceb7abc675128dfb231c9b888655e)
6847
6848 commit 4ebd4b39282f715a30a849c01510a281faec2ca6
6849 Author: Jason Dillaman <dillaman@redhat.com>
6850 Date: Fri Sep 29 15:11:38 2017 -0400
6851
6852 librbd: snapshots should be created/removed against data pool
6853
6854 Fixes: http://tracker.ceph.com/issues/21567
6855 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6856 (cherry picked from commit 5a3baf1bd852d6c5d0de10a33839658789edc4eb)
6857
6858 commit 34cd96d3425dcea4053ce0514632194dd7b2eaab
6859 Author: Casey Bodley <cbodley@redhat.com>
6860 Date: Thu Oct 12 11:25:13 2017 -0400
6861
6862 cls/rgw: increment header version to avoid overwriting bilog entries
6863
6864 Fixes: http://tracker.ceph.com/issues/21772
6865
6866 Signed-off-by: Casey Bodley <cbodley@redhat.com>
6867 (cherry picked from commit 081ba106a910583851b9acdcaf5971e37a439329)
6868
6869 commit 972916bf69192a2c504bf855e2af0480815ecc91
6870 Author: Casey Bodley <cbodley@redhat.com>
6871 Date: Wed Oct 11 19:27:55 2017 -0400
6872
6873 test/rgw: add test_multipart_object_sync
6874
6875 Signed-off-by: Casey Bodley <cbodley@redhat.com>
6876 (cherry picked from commit 1c14d4daf9201d58b1d0038bdd733a16275e037a)
6877
6878 commit 695d7ad51179d4f1f5e4168dec3758e3ffa4fe4d
6879 Author: Patrick Donnelly <pdonnell@redhat.com>
6880 Date: Sat Oct 14 13:47:53 2017 -0700
6881
6882 mds: prevent trim count from underflowing
6883
6884 Fixes: http://tracker.ceph.com/issues/21807
6885
6886 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6887 (cherry picked from commit 452bdd8b35643ed82d8614efcd4ca22688392eb6)
6888
6889 commit 61aca440334219d5d04df632812dbdf164de3fbc
6890 Merge: 462b93ecc5 bb92cc93ac
6891 Author: Matt Benjamin <mbenjamin@redhat.com>
6892 Date: Sun Oct 15 14:30:57 2017 -0400
6893
6894 Merge pull request #17834 from rzarzynski/wip-rgw-21148-luminous
6895
6896 luminous: rgw: add support for Swift's reversed account listings
6897
6898 commit 462b93ecc5e8caf7b0c35dd83dbbe7e33cc015d9
6899 Merge: c4ac0d64a9 119995a8f0
6900 Author: Matt Benjamin <mbenjamin@redhat.com>
6901 Date: Sun Oct 15 12:48:02 2017 -0400
6902
6903 Merge pull request #17811 from smithfarm/wip-21456-luminous
6904
6905 luminous: rgw: wrong error message is returned when putting container with a name that is too long
6906
6907 commit c4ac0d64a95a6f9ec974446a6971f9d60ab67b9f
6908 Merge: 5695829ffd 957e221f1f
6909 Author: Marcus Watts <mwatts@redhat.com>
6910 Date: Fri Oct 13 20:42:16 2017 -0400
6911
6912 Merge pull request #17832 from rzarzynski/wip-rgw-18977-luminous
6913
6914 luminous: rgw: list_objects() honors end_marker regardless of namespace.
6915
6916 commit b99acfd6018178ad8cd7db187d6892780f82a276
6917 Author: Yan, Zheng <zyan@redhat.com>
6918 Date: Thu Oct 12 12:01:35 2017 +0800
6919
6920 mds: keep CInode::STATE_QUEUEDEXPORTPIN state when exporting inode
6921
6922 Fixes: http://tracker.ceph.com/issues/21768
6923 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6924 (cherry picked from commit 1d160098a93092904026b62326fd9890de48044a)
6925
6926 commit 2973b6d4184cb5c36f8823010ab83a2b8ebb12d0
6927 Author: Yan, Zheng <zyan@redhat.com>
6928 Date: Tue Oct 10 17:47:33 2017 +0800
6929
6930 mds: update client metadata for already open session
6931
6932 session opened by Server::prepare_force_open_sessions() has no
6933 client metadata.
6934
6935 Fixes: http://tracker.ceph.com/issues/21746
6936 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6937 (cherry picked from commit 9d5c92a3367369789836d8669aa421074c69e4f3)
6938
6939 commit f353a1e805f4be3e31d8c3346f0f41fa2619c770
6940 Author: Yan, Zheng <zyan@redhat.com>
6941 Date: Mon Oct 9 18:00:38 2017 +0800
6942
6943 osdc/ObjectCacher: limit memory usage of BufferHead
6944
6945 when doing small size random writes, size of data structures that used
6946 for tracking dirty data can be larger than the dirty data size.
6947
6948 Fixes: http://tracker.ceph.com/issues/21726
6949 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6950 (cherry picked from commit 27db0255992354e15b4285891a33fede6849cf62)
6951
6952 commit 5695829ffd72a03f5611393c6037caf73ff1e813
6953 Merge: d3804d216d 6d032e6ce3
6954 Author: Josh Durgin <jdurgin@redhat.com>
6955 Date: Fri Oct 13 15:29:45 2017 -0700
6956
6957 Merge pull request #18275 from ceph/wip-yuriw-21776-luminous
6958
6959 tests - Removed `distors` and added `supported` to run on all support…
6960
6961 Reviewed-by: Vasu Kulkarni <vakulkar@redhat.com>
6962 Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6963
6964 commit 6d032e6ce33fe153958a445066a2a7ba00ffd260
6965 Author: Yuri Weinstein <yweinste@redhat.com>
6966 Date: Thu Oct 12 13:36:20 2017 -0700
6967
6968 tests - Removed `distors` and added `supported` to run on all supported OSs
6969 Added `openstack` fragment to run on vps
6970 Forced/hard-coded `machine_type=vps`
6971 Added `print`s
6972 Added only centos and ubuntu latest to support systemd (in distros dir)
6973 Added `ceph osd set-require-min-compat-client luminous`
6974
6975 Fixes http://tracker.ceph.com/issues/21776
6976
6977 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6978
6979 commit d3804d216d21d7e2b12e69eae1c1ef293229a6ca
6980 Merge: c9b493d2db 28e7d5645e
6981 Author: Sage Weil <sage@newdream.net>
6982 Date: Fri Oct 13 14:34:56 2017 -0500
6983
6984 Merge pull request #18050 from xiexingguo/wip-pr-17610
6985
6986 luminous: os/bluestore: set bitmap freelist resolution to min_alloc_size
6987
6988 Reviewed-by: Sage Weil <sage@redhat.com>
6989
6990 commit c9b493d2db39765c6ecfb31a3c9e8a38465e6ba0
6991 Merge: 09d597d34a b435af1137
6992 Author: Sage Weil <sage@newdream.net>
6993 Date: Fri Oct 13 14:34:30 2017 -0500
6994
6995 Merge pull request #18247 from liewegas/wip-seesaw-warning-luminous
6996
6997 qa/suites/rados/singleton/all/mon-seesaw: whitelist MON_DOWN
6998
6999 commit 2e6b29084ae505098fe6889d69133a8527c773be
7000 Author: Kefu Chai <kchai@redhat.com>
7001 Date: Fri Sep 1 17:32:22 2017 +0800
7002
7003 arch/arm: set ceph_arch_aarch64_crc32 only if the build host supports crc32cx
7004
7005 HWCAP_CRC32 is defined by the linux kernel source. so it's defined as
7006 long as the linux kernel source is new enough. but the compiler on the
7007 building host is not necessarily able to build the `crc32cx`
7008 instruction. if we happen to have an incapable compiler on a machine with
7009 recent linux kernel source, the dummy "ceph_crc32c_aarch64()" will be
7010 selected by `ceph_choose_crc32()`. and it always return 0.
7011
7012 See-also: http://tracker.ceph.com/issues/19705
7013 Signed-off-by: Kefu Chai <kchai@redhat.com>
7014 (cherry picked from commit 8a077bd2a93d3e12e20013e76e57a35240f5f481)
7015
7016 commit 7d2b7e8e3113daf40fd56d8258294d45b854ca55
7017 Author: Adam C. Emerson <aemerson@redhat.com>
7018 Date: Tue Oct 10 16:21:48 2017 -0400
7019
7020 rgw: Remove assertions in IAM Policy
7021
7022 A couple of them could be triggered by user input.
7023
7024 Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
7025 (cherry picked from commit b3118cabb8060a8cc6a01c4e8264cb18e7b1745a)
7026
7027 commit 09d597d34a1d567dc5350570f044eaa3d74a024f
7028 Merge: 7fdd9a6dac 37ea1976b3
7029 Author: Sage Weil <sage@newdream.net>
7030 Date: Thu Oct 12 14:57:38 2017 -0500
7031
7032 Merge pull request #18253 from ceph/wip-yuriw-21660_2-luminous_1
7033
7034 tests - Added yaml fragmet to cover testing...
7035
7036 commit 7fdd9a6dac4e047ae710dfaad38d5dbe3caa2634
7037 Merge: 8ad4617f3d 2b7bd94f13
7038 Author: Sage Weil <sage@newdream.net>
7039 Date: Thu Oct 12 14:57:23 2017 -0500
7040
7041 Merge pull request #18254 from ceph/wip-yuriw-21660_3-luminous_1
7042
7043 tests - Added yaml fragmet to cover testing...
7044
7045 commit ab644b89e0aad7b0c1a26ed3b9a2f3ea685c7a15
7046 Author: Kefu Chai <kchai@redhat.com>
7047 Date: Wed Oct 11 11:45:33 2017 +0800
7048
7049 qa: s/backfill/backfilling/
7050
7051 it's renamed "backfilling" in 4015343f .
7052
7053 Signed-off-by: Kefu Chai <kchai@redhat.com>
7054 (cherry picked from commit e21114274f6a2742748a5a9b965d415241c80f3c)
7055
7056 commit 099801e616c3c9e8501f153501b74d5220383f33
7057 Author: Yanhu Cao <gmayyyha@gmail.com>
7058 Date: Wed Oct 11 09:31:14 2017 +0800
7059
7060 mgr/status: fix ceph fs status returns error
7061
7062 Fixes: http://tracker.ceph.com/issues/21752
7063
7064 Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
7065 (cherry picked from commit 4a90daa700142ed1f58f5f2a2cc85f3049bccd64)
7066
7067 commit 0618f19128d0eb04004e65e6eab477b7b1b7fb6a
7068 Author: John Spray <jspray@redhat.com>
7069 Date: Wed Aug 30 20:32:11 2017 +0100
7070
7071 mgr/status: format byte quantities in base 2 multiples
7072
7073 Fixes: http://tracker.ceph.com/issues/21189
7074 Signed-off-by: John Spray <john.spray@redhat.com>
7075 (cherry picked from commit 2a5ae210928f8c9f1e3b72863c277ae5655bb771)
7076
7077 commit 2b7bd94f139251b4373a9662e5add86456566486
7078 Author: Yuri Weinstein <yweinste@redhat.com>
7079 Date: Wed Oct 11 13:12:45 2017 -0700
7080
7081 tests - Added yaml fragmet to cover testing...
7082 ... for http://tracker.ceph.com/issues/21660#note-17
7083
7084 for luminous-x (see similar #18200, #18226)
7085
7086 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7087 (cherry picked from commit e7fdda31803cd37604a9296a876320bfcb849d34)
7088 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7089
7090 commit 37ea1976b30e4e03ac535ee353c3a5277c53dbd3
7091 Author: Yuri Weinstein <yweinste@redhat.com>
7092 Date: Tue Oct 10 13:48:33 2017 -0700
7093
7094 tests - Added yaml fragmet to cover testing...
7095 ... for http://tracker.ceph.com/issues/21660#note-17
7096 for jewel-x (see similar https://github.com/ceph/ceph/pull/18200)
7097
7098 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7099 (cherry picked from commit b552e636ddd8ce2cfb605b4c124440d8dd1e8e47)
7100 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7101
7102 commit 8ad4617f3dea71984d0d2a6119e9e51ef76779fd
7103 Merge: edf28e6912 59a5a10904
7104 Author: Sage Weil <sage@newdream.net>
7105 Date: Wed Oct 11 12:20:04 2017 -0500
7106
7107 Merge pull request #18025 from liewegas/wip-recovery-preemption-luminous
7108
7109 luminous: osd: allow recovery preemption
7110
7111 Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7112
7113 commit edf28e6912c183de4d955f125ef18d8a52594f59
7114 Merge: 91cb216c01 3354937698
7115 Author: Sage Weil <sage@newdream.net>
7116 Date: Wed Oct 11 12:19:45 2017 -0500
7117
7118 Merge pull request #18154 from ktdreyer/luminous-gitignore-debian-patches
7119
7120 luminous: .gitignore: allow debian .patch files
7121
7122 commit 91cb216c01eca89ff7e338328d64216998effd16
7123 Merge: 27d3f8c748 b3f9439cfd
7124 Author: Sage Weil <sage@newdream.net>
7125 Date: Wed Oct 11 12:19:08 2017 -0500
7126
7127 Merge pull request #18189 from tchaikov/wip-retry-oserror-luminous
7128
7129 luminous: ceph-disk: retry on OSError
7130
7131 commit 27d3f8c748de33a35c5006513d198bbcbee19b45
7132 Merge: a33dd01164 f60a942023
7133 Author: Sage Weil <sage@newdream.net>
7134 Date: Wed Oct 11 12:18:27 2017 -0500
7135
7136 Merge pull request #18227 from liewegas/wip-bluestore-mempool-luminous
7137
7138 luminous: os/bluestore: several mempool accounting fixes
7139
7140 Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7141
7142 commit b435af1137ede418740d2dcf39114d8476775fd8
7143 Author: Sage Weil <sage@redhat.com>
7144 Date: Wed Oct 11 08:24:50 2017 -0500
7145
7146 qa/suites/rados/singleton/all/mon-seesaw: whitelist MON_DOWN
7147
7148 Mgr can get marked down when mon weirdness is happening.
7149
7150 Signed-off-by: Sage Weil <sage@redhat.com>
7151 (cherry picked from commit 0a886bc9f3e9805de04c8c60bd3d78b937737b96)
7152
7153 commit 51c6f0def379ba013a82204398a021663f1b5d56
7154 Author: Kefu Chai <kchai@redhat.com>
7155 Date: Tue Oct 10 20:32:08 2017 +0800
7156
7157 mon/PGMap: let pg_string_state() return boost::optional<>
7158
7159 better to be specific, so we don't run into the same problem even we
7160 are using the MSB of uint64_t for a pg state bit in future. we could,
7161 however use uint64_t(-1) to indicate the pg_string_state()'s failure to
7162 parse the state string, because pg_string_state() only translate a
7163 single state a time. but it's always better to be explicit than
7164 implicit.
7165
7166 Fixes: http://tracker.ceph.com/issues/21609
7167 Signed-off-by: Kefu Chai <kchai@redhat.com>
7168 (cherry picked from commit 260f87a9f1c4e32ff3a596ea341ad07a901f44a9)
7169
7170 Conflicts:
7171 src/mon/PGMap.cc
7172 src/osd/osd_types.cc
7173 src/osd/osd_types.h: trivial resolution
7174
7175 commit 9d12fa5e6dad5492491f4718ba7c593077d984a6
7176 Author: Josh Durgin <jdurgin@redhat.com>
7177 Date: Tue Oct 10 19:54:31 2017 -0400
7178
7179 common/options: enable multiple rocksdb compaction threads for filestore
7180
7181 One of the major benefits of rocksdb over leveldb is multithreaded
7182 compaction. The default of 1 thread does not provide much benefit, and
7183 is insufficient for heavy rgw workloads.
7184
7185 For high-write and delete omap workloads I've seen up to 8 compaction
7186 threads be used. There's little overhead to having a higher max than
7187 are needed, so set the default to 8.
7188
7189 Signed-off-by: Josh Durgin <jdurgin@redhat.com>
7190 (cherry picked from commit 023fa810aa6b3af305e9027e3f717e54d1bb2712)
7191
7192 Conflicts:
7193 src/common/options.cc (trivial)
7194
7195 commit 6f2f8cdc6a6fa64928fd2d5459b4974e281d857e
7196 Author: Mark Nelson <mnelson@redhat.com>
7197 Date: Thu Sep 21 17:21:16 2017 -0500
7198
7199 common/options.cc: Set Filestore rocksdb compaction readahead option.
7200
7201 fixes: http://tracker.ceph.com/issues/21505
7202
7203 Signed-off-by: Mark Nelson <mnelson@redhat.com>
7204 (cherry picked from commit 66567e573836c570040c8d8148c34b0cf9dc9ce2)
7205
7206 commit f60a942023088cbba53a816e6ef846994921cab3
7207 Author: Sage Weil <sage@redhat.com>
7208 Date: Thu Sep 28 08:02:50 2017 -0400
7209
7210 os/bluestore: move several buffer{ptr,list}s into cache_other mempool
7211
7212 Signed-off-by: Sage Weil <sage@redhat.com>
7213 (cherry picked from commit 80c60fcde22cf1269ada45d0914543b8f7d49b3e)
7214
7215 commit 37dd32f449bf2b0aaa3dbcba5cc06da076adbb1e
7216 Author: Sage Weil <sage@redhat.com>
7217 Date: Thu Sep 28 08:14:37 2017 -0400
7218
7219 os/bluestore: put new attrs in correct mempool too
7220
7221 Signed-off-by: Sage Weil <sage@redhat.com>
7222 (cherry picked from commit e7762ea1477e861ebc738aa0588a01c0da883d62)
7223
7224 commit dea2c1e6704c40de11c041e9982e9a9f7d9d4cb3
7225 Author: Sage Weil <sage@redhat.com>
7226 Date: Fri Sep 22 08:09:37 2017 -0400
7227
7228 os/bluestore: put attrs in mempool
7229
7230 Signed-off-by: Sage Weil <sage@redhat.com>
7231 (cherry picked from commit ef6524436fe095f94fce421ce26ed4c64e1424fe)
7232
7233 commit c2ed1f9b1801e43cf1d345da4d4876de5334cc40
7234 Author: Sage Weil <sage@redhat.com>
7235 Date: Fri Sep 22 08:08:52 2017 -0400
7236
7237 buffer: add ptr::[try_]reassign_to_mempool
7238
7239 Signed-off-by: Sage Weil <sage@redhat.com>
7240 (cherry picked from commit 937379d57a0f8097ae713adf714ba0414d36dffe)
7241
7242 commit a33dd01164bb18b24a0909c9419e15fcd2e79446
7243 Merge: 9e48df69de c0a1168ec2
7244 Author: Josh Durgin <jdurgin@redhat.com>
7245 Date: Tue Oct 10 13:17:46 2017 -0700
7246
7247 Merge pull request #18200 from ceph/wip-yuriw-21660-luminous
7248
7249 tests - Added yaml fragmet to cover testing
7250
7251 Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7252 Reviewed-by: Jason Dillaman <dillaman@redhat.com>
7253
7254 commit c0a1168ec2bacf6d78041f3ae49bfe6fff669913
7255 Author: Yuri Weinstein <yweinste@redhat.com>
7256 Date: Mon Oct 9 12:51:59 2017 -0700
7257
7258 tests - Added yaml fragmet to cover testing on standanone client.4
7259 for http://tracker.ceph.com/issues/21660#note-17
7260
7261 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7262
7263 commit b3f9439cfd9141ddde9874c06fd43d346c10c5da
7264 Author: Kefu Chai <kchai@redhat.com>
7265 Date: Sat Oct 7 22:15:11 2017 +0800
7266
7267 ceph-disk: retry on OSError
7268
7269 we are likely to
7270 1) create partition, for instance, sdc1
7271 2) partprobe sdc
7272 3) udevadm settle
7273 4) check the device by its path: /dev/sdc1
7274
7275 but there is chance that the uevent sent from kernel fails to reach udev
7276 before we call "udevadm", hence "/dev/sdc1" does not exist even after
7277 "udevadm settle" returns. so we retry in case of OSError here.
7278
7279 Signed-off-by: Kefu Chai <kchai@redhat.com>
7280 (cherry picked from commit 4f82dfb9e761a09484e6ba3bd027da535162783e)
7281
7282 commit 83b3377c6b04d78b20b7c23d145e015d63e471a4
7283 Author: Kefu Chai <kchai@redhat.com>
7284 Date: Sat Oct 7 21:13:47 2017 +0800
7285
7286 ceph-disk: factor out the retry logic into a decorator
7287
7288 Signed-off-by: Kefu Chai <kchai@redhat.com>
7289 (cherry picked from commit 02a8620de7f200736900aafc944b2c1ac47d9910)
7290
7291 commit 9e48df69de14d8415eed008b824204313774e2ba
7292 Merge: a81b0da8e4 41af4ca8f3
7293 Author: Alfredo Deza <alfredo@deza.pe>
7294 Date: Sun Oct 8 12:05:25 2017 -0400
7295
7296 Merge pull request #18167 from tchaikov/wip-luminous-sphinx
7297
7298 luminous: admin: bump sphinx to 1.6
7299
7300 Reviewed-by: Alfredo Deza <adeza@redhat.com>
7301
7302 commit 41af4ca8f3cd3db8dc076c07e1a082a053b91b26
7303 Author: Kefu Chai <kchai@redhat.com>
7304 Date: Mon Sep 11 21:54:33 2017 +0800
7305
7306 doc: switch to upstream sphinx-ditaa
7307
7308 it works with setuptools and is now compatible with py3
7309
7310 the py3 branch is created to track the upstream's master branch
7311
7312 Signed-off-by: Kefu Chai <kchai@redhat.com>
7313 (cherry picked from commit fda079d5ed4c8a80c677f714a680233a568d512e)
7314
7315 commit e49cae8b03340834e0b44491a4a903c0d61e1f74
7316 Author: Alfredo Deza <adeza@redhat.com>
7317 Date: Tue Aug 15 09:12:27 2017 -0400
7318
7319 admin: bump sphinx to 1.6
7320
7321 Signed-off-by: Alfredo Deza <adeza@redhat.com>
7322 (cherry picked from commit 88a1114cb3f90e52ba718dc832617fa004d63b3c)
7323
7324 commit a81b0da8e4aca275cc3195c04f3e0d485e4a2f31
7325 Merge: 1e521b5fb4 e4164c43f5
7326 Author: Alfredo Deza <alfredo@deza.pe>
7327 Date: Fri Oct 6 17:42:30 2017 -0400
7328
7329 Merge pull request #17914 from liewegas/wip-21498-luminous
7330
7331 ceph-disk: fix '--runtime' omission for ceph-osd service
7332
7333 Reviewed-by: Alfredo Deza <adeza@redhat.com>
7334
7335 commit 1e521b5fb47de74720d6aab39750c53aa2b2d8e7
7336 Merge: d550610512 ee5b9ea46c
7337 Author: Sage Weil <sage@newdream.net>
7338 Date: Fri Oct 6 15:35:06 2017 -0500
7339
7340 Merge pull request #18135 from liewegas/wip-vta-luminous
7341
7342 luminous: cmake: disable VTA on options.cc
7343
7344 commit 33549376987b18a9bdcf5f56e62268c5791124bc
7345 Author: Ken Dreyer <kdreyer@redhat.com>
7346 Date: Thu Sep 7 11:07:59 2017 -0600
7347
7348 .gitignore: allow debian .patch files
7349
7350 The Ubuntu packaging layout with git-buildpackage assumes a
7351 "debian/patches/" directory with several .patch files in it.
7352
7353 When upstream's .gitignore tells Git to ignore .patch files, we have to
7354 edit that line out downstream. When we forget to do that downstream, it
7355 can lead to missing patches and broken downstream builds.
7356
7357 Allow patches in the /debian/patches directory so it's easier to
7358 maintain an Ubuntu package based on upstream's Git repo.
7359
7360 Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
7361 (cherry picked from commit c734b0c0296152721b658af7b699a64b3a49d251)
7362
7363 commit d5506105120479c1831ab559b555e2d4ea4c357c
7364 Merge: d46675a1ec 0dc73f1210
7365 Author: Sage Weil <sage@newdream.net>
7366 Date: Fri Oct 6 07:38:53 2017 -0500
7367
7368 Merge pull request #18140 from liewegas/wip-21660-luminous
7369
7370 luminous: src/messages/MOSDMap: reencode OSDMap for older clients
7371
7372 commit d46675a1ecb10f7176265cb1fc5ca971209aecb1
7373 Merge: 39ad203313 8b2bd38785
7374 Author: Sage Weil <sage@newdream.net>
7375 Date: Thu Oct 5 22:12:22 2017 -0500
7376
7377 Merge pull request #18037 from ajarr/wip-21602-luminous
7378
7379 luminous: ceph_volume_client: add get, put, and delete object interfaces
7380
7381 Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7382
7383 commit 39ad2033136e32d76e89e86d3f00bd1b928242ce
7384 Merge: 473f9d1317 80f6508fc2
7385 Author: Sage Weil <sage@newdream.net>
7386 Date: Thu Oct 5 21:03:42 2017 -0500
7387
7388 Merge pull request #18103 from liewegas/wip-21259-luminous
7389
7390 luminous: osd: dump bluestore debug on shutdown if debug option is set
7391
7392 commit 473f9d13173aa751d54b9a322060111d627f71f1
7393 Merge: c50df6511f 49294965f9
7394 Author: Sage Weil <sage@newdream.net>
7395 Date: Thu Oct 5 21:03:28 2017 -0500
7396
7397 Merge pull request #18112 from liewegas/wip-localpool-min-size-luminous
7398
7399 luminous: mgr/localpool: fix min_size, 3x default, crush rule
7400
7401 Reviewed-by: Alexander Marangone <amarango@redhat.com>
7402
7403 commit c50df6511fda7d03c3cfa828acd5e56f2ef45d0f
7404 Merge: 4ff03e5192 16c6dd5129
7405 Author: Sage Weil <sage@newdream.net>
7406 Date: Thu Oct 5 21:02:53 2017 -0500
7407
7408 Merge pull request #18126 from smithfarm/wip-sigpipe-porting-luminous
7409
7410 luminous: msg: reimplement sigpipe blocking
7411
7412 Reviewed-by: Greg Farnum <gfarnum@redhat.com>
7413
7414 commit 4ff03e51928c0d7da9a90d50ec504b30eb9e4b32
7415 Merge: 766c6f3647 7986d4566a
7416 Author: Sage Weil <sage@newdream.net>
7417 Date: Thu Oct 5 21:02:09 2017 -0500
7418
7419 Merge pull request #18127 from liewegas/wip-21470-luminous
7420
7421 luminous: os/bluestore: fix another aio stall/deadlock
7422
7423 commit 766c6f3647b57b482f76ef254c95a651741d9ad5
7424 Merge: f972702229 3850f8e0b7
7425 Author: Sage Weil <sage@newdream.net>
7426 Date: Thu Oct 5 21:01:53 2017 -0500
7427
7428 Merge pull request #18128 from liewegas/wip-bluefs-allocation-luminous
7429
7430 luminous: os/bluestore: make bluefs behave better near enospc
7431
7432 commit f97270222935d1c43a41102c3ada586a7deca190
7433 Merge: e4c51f62ff f99fe83a37
7434 Author: Sage Weil <sage@newdream.net>
7435 Date: Thu Oct 5 21:01:27 2017 -0500
7436
7437 Merge pull request #18131 from liewegas/wip-ifname-luminous
7438
7439 luminous: common/pick_address: add {public,cluster}_network_interface option
7440
7441 commit e4c51f62ffc0f2fcc9214f6b7895210aa79c288b
7442 Merge: 66af04cd9b f0a6f616c6
7443 Author: Sage Weil <sage@newdream.net>
7444 Date: Thu Oct 5 21:01:06 2017 -0500
7445
7446 Merge pull request #18132 from gregsfortytwo/wip-20416-bitwise-assert-luminous
7447
7448 osd: make the PG's SORTBITWISE assert a more generous shutdown
7449
7450 Reviewed-by: Sage Weil <sage@redhat.com>
7451
7452 commit 0dc73f12105ec271a43fe176c2f2a22849e8475c
7453 Author: Sage Weil <sage@redhat.com>
7454 Date: Thu Oct 5 15:26:16 2017 -0500
7455
7456 src/messages/MOSDMap: reencode OSDMap for older clients
7457
7458 We explicitly select which missing bits trigger a reencode. We
7459 already had jewel and earlier covered, but kraken includes all of
7460 the previously mentioned bits but not SERVER_LUMINOUS. This
7461 prevents kraken clients from decoding luminous maps.
7462
7463 Fixes: http://tracker.ceph.com/issues/21660
7464 Signed-off-by: Sage Weil <sage@redhat.com>
7465 (cherry picked from commit d2664aa34dc4c13da64d1ad187019737080069d7)
7466
7467 commit 3850f8e0b791f2d05906647866b14a390ab2f5da
7468 Author: Sage Weil <sage@redhat.com>
7469 Date: Tue Oct 3 11:18:17 2017 -0500
7470
7471 os/bluestore: add bluestore_bluefs_min_free
7472
7473 We need at least ~1GB free so we can write out new SSTs (which are 256MB
7474 each).
7475
7476 Signed-off-by: Sage Weil <sage@redhat.com>
7477 (cherry picked from commit 65be614f2bfd65a1f13205a3075c87acc72c4836)
7478
7479 (avoided 1_G syntax that luminous doesn't support)
7480
7481 commit b015ce116159ec57d20bcd29306e450a816610f9
7482 Author: Karol Mroz <kmroz@suse.de>
7483 Date: Mon Oct 2 14:01:47 2017 -0700
7484
7485 rgw: stop/join TokenCache revoke thread only if started.
7486
7487 Thread::join triggers an assert otherwise.
7488
7489 Fixes http://tracker.ceph.com/issues/21666
7490
7491 Signed-off-by: Karol Mroz <kmroz@suse.de>
7492 (cherry picked from commit 26f2da083c7dd21b89c1c1e6c498b14e034364a6)
7493
7494 commit ee5b9ea46c8b1e831c60f9cc0b10819b14d5efb8
7495 Author: Kefu Chai <kchai@redhat.com>
7496 Date: Thu Aug 31 18:15:28 2017 +0800
7497
7498 cmake: disable VTA on options.cc
7499
7500 to silence following warning and to avoid compiling this file twice:
7501
7502 ceph/src/common/options.cc: In function ‘std::vector<Option> get_global_options()’:
7503 ceph/src/common/options.cc:151:21: note: variable tracking
7504 size limit exceeded with -fvar-tracking-assignments, retrying without
7505 std::vector<Option> get_global_options() {
7506 ^~~~~~~~~~~~~~~~~~
7507
7508 Signed-off-by: Kefu Chai <kchai@redhat.com>
7509 (cherry picked from commit 4bb56402a6d6f642d54f329aa1e809cbe044e0c6)
7510
7511 commit 59a5a109040884dd2c7c77f3bc84378b54048f1d
7512 Author: Sage Weil <sage@redhat.com>
7513 Date: Wed Oct 4 15:28:26 2017 -0500
7514
7515 osd/PG: separate event for RemoteReservationCanceled
7516
7517 Right now we transparently map a RemoteReservationRejected into a
7518 *Canceled event because this what peers send over the wire. Even
7519 once new peers start sending and explicit CANCEL, old peers will
7520 still do so, so we'll maintain this mapping for a while.
7521
7522 Signed-off-by: Sage Weil <sage@redhat.com>
7523 (cherry picked from commit 84d71e6a10b02591b5d5e126b346771871eb1575)
7524
7525 commit 206400997daaec97fe9af7e2e735e1b609006107
7526 Author: Sage Weil <sage@redhat.com>
7527 Date: Wed Oct 4 14:55:15 2017 -0500
7528
7529 osd/PG: separate verb 'Reject' from passive 'rejected'
7530
7531 This reduces pg->reject_reservation() callsites from 2 to 1 and
7532 makes the state transitions a bit more explicit.
7533
7534 Signed-off-by: Sage Weil <sage@redhat.com>
7535 (cherry picked from commit bf7f101a787652644c27aae4e752fd21f265e866)
7536
7537 commit 8c1716a42def8547f3af446a143715fad24addb5
7538 Author: Sage Weil <sage@redhat.com>
7539 Date: Sun Oct 1 15:05:40 2017 -0500
7540
7541 osd: make note about when we get MBackfillReserve REJECT messages
7542
7543 Signed-off-by: Sage Weil <sage@redhat.com>
7544 (cherry picked from commit 6e829a3a7c7aaff78142514fde7703cad48953fd)
7545
7546 commit 260ab6009cdce0d846685e4c7789336db22885f1
7547 Author: Sage Weil <sage@redhat.com>
7548 Date: Sun Oct 1 15:04:34 2017 -0500
7549
7550 osd/PG: handle RecoveryReservationRejected in RepWaitRecoveryReserved
7551
7552 This state is analogous to RepWaitBackfillReserved; just like we do there
7553 we want to handle the REJECT from the primary by canceling our local
7554 remote_reservation.
7555
7556 Signed-off-by: Sage Weil <sage@redhat.com>
7557 (cherry picked from commit ab8f1d291216c07fed7b661896b0a0c1279f50eb)
7558
7559 commit 479b05a8c1659e80028190c7fe90e762084c4c24
7560 Author: Sage Weil <sage@redhat.com>
7561 Date: Sun Oct 1 15:03:22 2017 -0500
7562
7563 osd/PG: ignore RemoteReservationRejected if we are RepNotRecoverying
7564
7565 The primary may send us a REJECT (meaning cancel) if recovery/backfill is
7566 preempted there. That can happen even if the recovery isn't reserved or
7567 requested here (e.g., because the primary is still waiting for the local
7568 reservation). Just ignore it and remain in RepNotRecovering.
7569
7570 Fixes: http://tracker.ceph.com/issues/21613
7571 Signed-off-by: Sage Weil <sage@redhat.com>
7572 (cherry picked from commit 1ce235c5dd0b777223f6465e71fb7ee4befd13d8)
7573
7574 commit 2a95156d7be9e6c796d5f0ce7bc0eab89c42230d
7575 Author: Sage Weil <sage@redhat.com>
7576 Date: Sun Oct 1 15:01:05 2017 -0500
7577
7578 osd/PG: cancel local reservation in RemoteReservationRejected handler
7579
7580 We can get a RemoteReservationRejected event either because *we* decide
7581 to reject, or because we get a REJECT from the primary that means "cancel"
7582 (e.g., because recovery/backfill was preempted there). In both cases we
7583 want to cancel our remote_reservation.
7584
7585 Signed-off-by: Sage Weil <sage@redhat.com>
7586 (cherry picked from commit f5809afb0f2ca2f1187609e645d6c4c5bd73e39d)
7587
7588 commit 92ff2cbd69c444c6648889a2da7e01be6b00311e
7589 Author: Sage Weil <sage@redhat.com>
7590 Date: Sun Oct 1 14:59:31 2017 -0500
7591
7592 osd/PG: move reject_reservation out of RemoteReservationRejected reaction
7593
7594 The RemoteReservationRejected event is also submitted when we are a
7595 replica or backfill target and get a MBackfillReserve REJECT message
7596 because the primary canceled or was preempted. In that case, we don't
7597 want to send a REJECT back to the primary; we only need to send it in the
7598 cases where *we*, locally, decide to reject. Move the call to those call
7599 sites.
7600
7601 Signed-off-by: Sage Weil <sage@redhat.com>
7602 (cherry picked from commit 57d18f0e8d9b0428a193c63112a28ddd046337b4)
7603
7604 commit f0a6f616c6c0358c2a7b9eb24fd6ca9c4290be0a
7605 Author: Greg Farnum <gfarnum@redhat.com>
7606 Date: Fri Sep 29 15:18:26 2017 -0700
7607
7608 osd: make the PG's SORTBITWISE assert a more generous shutdown
7609
7610 We want to stop working if we get activated while sortbitwise is not set
7611 on the cluster, but we might have old maps where it wasn't if the flag
7612 was changed recently. And doing it in the PG code was a bit silly anyway.
7613
7614 Instead check SORTBITWISE in the main OSDMap handling code prior to
7615 prepublishing it. Let it go through if we aren't active at the time.
7616
7617 Fixes: http://tracker.ceph.com/issues/20416
7618
7619 Signed-off-by: Greg Farnum <gfarnum@redhat.com>
7620 (cherry picked from commit 0a691b2b1c19fbc30af5c4046736dacb2fb8bfa4)
7621
7622 commit f99fe83a37241fe1c616ecb854b5196112985861
7623 Author: Sage Weil <sage@redhat.com>
7624 Date: Thu Sep 28 17:47:17 2017 -0400
7625
7626 common/pick_address: add {public,cluster}_network_interface option
7627
7628 Add _interfaces option to constrain the choice of IPs in the network
7629 list to those on interfaces matching the provided list of interface names.
7630 The _interfaces options only work in concert with the _network options,
7631 so you must also specify a list of networks if you want to use a specific
7632 interface, e.g., by specifying a broad network like "::" or "0.0.0.0/0".
7633
7634 Signed-off-by: Sage Weil <sage@redhat.com>
7635 (cherry picked from commit 95cc790acddb597d6fef2d9e444f0b6e0436f16f)
7636
7637 commit b84803d6092667631527b8b37000cac6447e0b84
7638 Author: David Zafman <dzafman@redhat.com>
7639 Date: Tue Sep 12 17:17:13 2017 -0700
7640
7641 osd: Only scan for omap corruption once
7642
7643 Before
7644 state 2: Can have complete tables (some may be bad)
7645 state 3: Never had complete tables
7646 After
7647 state 2: Can have complete tables (some may be bad)
7648 state 3 with legacy: Can have complete tables (bad ones are cleared)
7649 state 3: Never had complete tables
7650
7651 Once OSDs boot with this change you can't downgrade to a previous release.
7652 If someone does downgrade they could have unstable OSDs that hit assert(state.v < 3).
7653 The following command run after shutting down the cluster but before downgrading
7654 ceph packages would be a way to fix this.
7655
7656 ceph-osdomap-tool --omap-path ... --command resetv2
7657
7658 Fixes: http://tracker.ceph.com/issues/21328
7659
7660 Signed-off-by: David Zafman <dzafman@redhat.com>
7661 (cherry picked from commit 8805ef53424e30fd3f24ee38f5a6bdd9e6dd8641)
7662
7663 commit d0ea152865eeff63cf49e137f5ac342ec6725a6a
7664 Author: David Zafman <dzafman@redhat.com>
7665 Date: Tue Sep 12 18:06:10 2017 -0700
7666
7667 tools: Add --backend option to ceph-osdomap-tool default to rocksdb
7668
7669 Fix hard-coded "leveldb" backend. The command is broken in Luminous
7670 now that "rocksdb" is the default.
7671
7672 Signed-off-by: David Zafman <dzafman@redhat.com>
7673 (cherry picked from commit de43493990923bcdd20f88e9d04647e5ba709feb)
7674
7675 commit 94090379a13639ce0a8619dfe178cc62acdd8fc4
7676 Author: Luo Kexue <luo.kexue@zte.com.cn>
7677 Date: Mon Aug 28 09:24:10 2017 +0800
7678
7679 osd, mds, tools: drop the invalid comment and some unused variables
7680
7681 Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>
7682 (cherry picked from commit 2e93424167de15e91394169f4395f5f446e710e2)
7683
7684 commit 382ff40fb17db2c657318038495ae7140f95b7e6
7685 Author: David Zafman <dzafman@redhat.com>
7686 Date: Tue Sep 12 23:14:15 2017 -0700
7687
7688 tools: Add the ability to reset state to v2
7689
7690 Available for testing and user downgrade.
7691
7692 Signed-off-by: David Zafman <dzafman@redhat.com>
7693 (cherry picked from commit 3e4d68640cc43efc0cf10ea8119b3aa583b7f36b)
7694
7695 commit dc2c1d9d2fdd5449dd7c3213e1d2b5cbd928d4d2
7696 Author: David Zafman <dzafman@redhat.com>
7697 Date: Tue Sep 12 22:12:52 2017 -0700
7698
7699 tools: Show DB state information
7700
7701 Signed-off-by: David Zafman <dzafman@redhat.com>
7702 (cherry picked from commit 3214882a95f9f70d9f6d28f4e403ee16324530f9)
7703
7704 commit 36675e34b610ed6afa90bdb93da6e49025e4d9e1
7705 Author: Sage Weil <sage@redhat.com>
7706 Date: Tue Oct 3 10:41:33 2017 -0500
7707
7708 os/bluestore/BlueFS: crash on enospc
7709
7710 We were passing this error back to rocksdb, which would then crash (much)
7711 later with a corrupted SST file! No good.
7712
7713 Signed-off-by: Sage Weil <sage@redhat.com>
7714 (cherry picked from commit 569e924812bd7cc61e6e755f265890dbd5c95c31)
7715
7716 commit 16c6dd5129f54a6f5eec7fe16719a179c176548e
7717 Author: Greg Farnum <gfarnum@redhat.com>
7718 Date: Tue Oct 3 15:54:06 2017 -0700
7719
7720 msgr: add a mechanism for Solaris to avoid dying on SIGPIPE
7721
7722 This is fairly clean: we define an RAII object in the Messenger.h on
7723 Solaris, and "declare" it with a macro in the implementations. There's
7724 no code duplication and on Linux it's just entirely compiled out.
7725
7726 Signed-off-by: Greg Farnum <gfarnum@redhat.com>
7727 (cherry picked from commit cba20a95e816aaf9f0971b29b14b0be8c524b59d)
7728
7729 Conflicts:
7730 src/msg/async/PosixStack.cc - luminous #include "common/simple_spin.h" is
7731 missing in master (trivial resolution)
7732
7733 commit 7986d4566a1f6d8e22a9acd19608530ce64cbfa1
7734 Author: Sage Weil <sage@redhat.com>
7735 Date: Tue Oct 3 16:48:37 2017 -0500
7736
7737 os/bluestore: use normal Context for async deferred_try_submit
7738
7739 I'm not quite sure why the FunctionContext did not ever execute on the
7740 finisher thread (perhaps the [&] captured some state on the stack that it
7741 shouldn't have?). In any case, using a traditional Context here appears
7742 to resolve the problem (of the async deferred_try_submit() never executing,
7743 leading to a bluestore stall/deadlock).
7744
7745 Fixes: http://tracker.ceph.com/issues/21470
7746 Signed-off-by: Sage Weil <sage@redhat.com>
7747 (cherry picked from commit 67ec75805787ed63b35f8d70478a7a2cd785df06)
7748
7749 commit 9ab0f64bcf74f74838f6066d554f728902c31715
7750 Author: Sage Weil <sage@redhat.com>
7751 Date: Fri Sep 29 13:47:19 2017 -0500
7752
7753 os/bluestore: wake kv thread when blocking on deferred_bytes
7754
7755 We need to wake the kv thread whenever setting deferred_aggressive to
7756 ensure that txns with deferred io that have committed but haven't submitted
7757 their deferred writes get submitted. This aligns us with the other
7758 users of deferred_aggressive (e.g., _osr_drain_all).
7759
7760 Signed-off-by: Sage Weil <sage@redhat.com>
7761 (cherry picked from commit 633b17007701d87903fe1d10b19c44210a3326eb)
7762
7763 commit 0251cfcd17111334d3f13dc1e9d52a9aa9302354
7764 Author: Greg Farnum <gfarnum@redhat.com>
7765 Date: Tue Oct 3 15:06:25 2017 -0700
7766
7767 Revert "SIGPIPE suppression for platforms without SO_NOSIGPIPE or MSG_NOSIGNAL"
7768
7769 This reverts commit 131deb39769c1187c334ee84f552d3be01f1751b. It added
7770 code that shouldn't have entered the project repo.
7771
7772 Conflicts:
7773 src/msg/async/AsyncConnection.cc
7774 src/msg/async/AsyncConnection.h
7775 src/msg/simple/Pipe.cc
7776 src/msg/simple/Pipe.h
7777
7778 Signed-off-by: Greg Farnum <gfarnum@redhat.com>
7779 (cherry picked from commit 21bdb730932196a48407be0effab8813a78c4b1b)
7780
7781 commit 72c858310796848128bbccfa328794d504471e5a
7782 Author: wujian <wujian3659@163.com>
7783 Date: Fri Sep 15 11:23:44 2017 +0800
7784
7785 ceph-mgr: can not change prometheus port for mgr
7786
7787 Signed-off-by: wujian <wujian3659@163.com>
7788 (cherry picked from commit 6cc0338ed15a0402471cfd05acfcf00d07517d1a)
7789
7790 commit 49294965f9f92946382949264344c2aa0b6d70bd
7791 Author: Sage Weil <sage@redhat.com>
7792 Date: Wed Oct 4 08:25:38 2017 -0500
7793
7794 mgr/localpool: fix rule selection
7795
7796 The 'osd pool create' arg parsing is broken; the rule name for
7797 'ceph osd pool create $name $numpgs replicated $rulename' is passed
7798 via the erasure_code_profile param. Too many req=false options
7799 without a way to disambiguate them.
7800
7801 Work around it by passing both 'rule' and 'erasure_code_profile'
7802 keys, so that if/when the hack in OSDMonitor.cc is removed it will
7803 still work. Blech.
7804
7805 Signed-off-by: Sage Weil <sage@redhat.com>
7806 (cherry picked from commit 7623513935525498640defa2064c291fd69a2b76)
7807
7808 commit cf6f90c5e1e17a1f44f6ed80422b5f1c543362ca
7809 Author: Sage Weil <sage@redhat.com>
7810 Date: Mon Oct 2 17:11:46 2017 -0500
7811
7812 mgr/localpool: optionally adjust min_size too
7813
7814 Signed-off-by: Sage Weil <sage@redhat.com>
7815 (cherry picked from commit af72a8932c60a52aad76f1cc94bfbb31048215cc)
7816
7817 commit d18b7b8652e38c679993241ac232bb7310db7e22
7818 Author: Sage Weil <sage@redhat.com>
7819 Date: Mon Oct 2 17:11:38 2017 -0500
7820
7821 mgr/localpool: default to 3x
7822
7823 Signed-off-by: Sage Weil <sage@redhat.com>
7824 (cherry picked from commit 9624923f19dc649a8f182f28e9580a3045964d9e)
7825
7826 commit 80f6508fc25018dd9c70d05f99c40325062d129e
7827 Author: Sage Weil <sage@redhat.com>
7828 Date: Thu Sep 21 15:19:47 2017 -0400
7829
7830 osd: make shutdown debug conditional (and off by default)
7831
7832 Signed-off-by: Sage Weil <sage@redhat.com>
7833 (cherry picked from commit 6169cf64423c7554dc0630d90d8dee27437bf05f)
7834
7835 commit ca177e93d4e52d50a49b76af516a8009153197e7
7836 Author: Sage Weil <sage@redhat.com>
7837 Date: Thu Sep 7 17:12:42 2017 -0400
7838
7839 osd: debug_bluestore on shutdown
7840
7841 ...just like we do with filestore etc.
7842
7843 Signed-off-by: Sage Weil <sage@redhat.com>
7844 (cherry picked from commit 354dccda322b7ac8844b321f603e049128bf4779)
7845
7846 commit 4d931ad0d349a6974f9f7053792e6f826b67169a
7847 Author: Sage Weil <sage@redhat.com>
7848 Date: Thu Sep 7 17:11:30 2017 -0400
7849
7850 os/bluestore: dump stray cache content on shutdown
7851
7852 Tracking down http://tracker.ceph.com/issues/21259.
7853
7854 Signed-off-by: Sage Weil <sage@redhat.com>
7855 (cherry picked from commit 28d9b6b0e92cf51996a12a43c81f7ac2abcaecaa)
7856
7857 commit 66af04cd9b61d482362361cb3b12af2d8ffa462c
7858 Merge: 57b5f58f5e b064ed172a
7859 Author: Sage Weil <sage@newdream.net>
7860 Date: Tue Oct 3 13:41:21 2017 -0500
7861
7862 Merge pull request #17734 from liewegas/wip-21089-onmount
7863
7864 luminous: os/bluestore: replace 21089 repair with something online (instead of fsck)
7865
7866 Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7867
7868 commit 57b5f58f5e8be116deed59c5c97636eb730c3dc8
7869 Merge: ae9de1673a a069e8ae61
7870 Author: Sage Weil <sage@newdream.net>
7871 Date: Tue Oct 3 13:40:56 2017 -0500
7872
7873 Merge pull request #17814 from liewegas/wip-pg-limits-luminous
7874
7875 luminous: mon: cluster limit on pgs
7876
7877 Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7878
7879 commit a069e8ae61a452cefe5673f0035251c00857fee5
7880 Author: Sage Weil <sage@redhat.com>
7881 Date: Thu Sep 14 16:01:14 2017 -0400
7882
7883 doc/rados/operations/health-checks: fix TOO_MANY_PGS discussion
7884
7885 Fiddling with pgp_num doesn't help with TOO_MANY_PGS.
7886
7887 Signed-off-by: Sage Weil <sage@redhat.com>
7888 (cherry picked from commit 027672b777402381f6736e517ed287b38bb17abb)
7889
7890 commit 7320ee7293a34e4ea0ab5254373f51b93249b91d
7891 Author: Sage Weil <sage@redhat.com>
7892 Date: Thu Sep 14 16:00:31 2017 -0400
7893
7894 mon: rename mon_pg_warn_max_per_osd -> mon_max_pg_per_osd
7895
7896 Signed-off-by: Sage Weil <sage@redhat.com>
7897 (cherry picked from commit 986b86fbebf9e06f9f841da8ded0bedb310fc69b)
7898
7899 commit 37ddfc61c3376afeccfe7a8029412b9a38401bfc
7900 Author: Casey Bodley <cbodley@redhat.com>
7901 Date: Fri Sep 22 12:03:57 2017 -0400
7902
7903 rgw: dont reuse stale RGWObjectCtx for get_bucket_info()
7904
7905 if the earlier call to store->get_bucket_entrypoint_info() failed with
7906 ENOENT, the obj_ctx will cache exists=false.
7907 put_bucket_entrypoint_info() doesn't invalidate that, so this call to
7908 get_bucket_info() was reading from a stale cache and failing with ENOENT
7909
7910 Fixes: http://tracker.ceph.com/issues/21506
7911
7912 Signed-off-by: Casey Bodley <cbodley@redhat.com>
7913 (cherry picked from commit 3f4f760a85f162262c5b419e9cf78966c7299f0a)
7914
7915 commit 28e7d5645e5fdf5471a2a809bd232521f2d33814
7916 Author: Sage Weil <sage@redhat.com>
7917 Date: Wed Sep 20 12:38:46 2017 -0400
7918
7919 os/bluestore: ignore 0x2000~2000 extent oddity from luminous upgrade
7920
7921 Luminous does a block_size granularity freelist, and assumes that
7922 0~ROUND_UP_TO(SUPER_RESERVED,block_size) is used. Current master uses
7923 min_alloc_size granularity and changes that assumption to
7924 0~ROUND_UP_TO(SUPER_RESERVED,min_alloc_size). That means if master
7925 fsck's a luminous-created bluestore, it will think 0x2000~2000 is used
7926 (current baked-in min_alloc_size-based assumption) but the old freelist
7927 says it is free (old mkfs assumption). The disparity is harmless since
7928 the extent is below min_alloc_size, so ignore it.
7929
7930 Fixes: http://tracker.ceph.com/issues/21408
7931 Signed-off-by: Sage Weil <sage@redhat.com>
7932 (cherry picked from commit 4959ad310a96208565b47c035ab5d5dded1b8ff5)
7933
7934 commit ae9de1673a7b4aa032cbde7c5646c4d945ff618a
7935 Merge: eec0edaaa0 3a037dda42
7936 Author: Sage Weil <sage@newdream.net>
7937 Date: Sun Oct 1 15:56:10 2017 -0500
7938
7939 Merge pull request #17867 from smithfarm/wip-21443-luminous
7940
7941 luminous: mgr: Prometheus crash when update
7942
7943 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
7944
7945 commit eec0edaaa031400e7728081c306a1901cb981486
7946 Merge: 98e729a977 ddca5dbe04
7947 Author: Sage Weil <sage@newdream.net>
7948 Date: Sun Oct 1 15:55:59 2017 -0500
7949
7950 Merge pull request #17868 from smithfarm/wip-21452-luminous
7951
7952 luminous: mgr: prometheus module generates invalid output when counter names contain non-alphanum characters
7953
7954 Reviewed-by: Amit Kumar <amitkuma@redhat.com>
7955
7956 commit 98e729a9773acb5200357b3178cf04883383cf4a
7957 Merge: 87e8829605 faf3fec1a6
7958 Author: Sage Weil <sage@newdream.net>
7959 Date: Sun Oct 1 15:55:30 2017 -0500
7960
7961 Merge pull request #17896 from liewegas/wip-bluestore-tool-luminous
7962
7963 ceph-objectstore-tool and ceph-bluestore-tool: backports from master
7964
7965 Reviewed-by: David Zafman <dzafman@redhat.com>
7966
7967 commit 87e8829605adb2609cd4867f3d23489d84e657fb
7968 Merge: a48b2e41e7 1fc6a51a41
7969 Author: Sage Weil <sage@newdream.net>
7970 Date: Sun Oct 1 15:55:11 2017 -0500
7971
7972 Merge pull request #17930 from jcsp/wip-luminous-health-warn
7973
7974 mon: show legacy health warning in `status` output
7975
7976 Reviewed-by: Sage Weil <sage@redhat.com>
7977
7978 commit a48b2e41e78f9190b7f94d11af2a04c919380aae
7979 Merge: ced74c00d6 4f28ef0016
7980 Author: Sage Weil <sage@newdream.net>
7981 Date: Sun Oct 1 15:54:47 2017 -0500
7982
7983 Merge pull request #18031 from xiexingguo/wip-pr-17987
7984
7985 luminous: osd/PrimaryLogPG: kick off recovery on backoffing a degraded object
7986
7987 Reviewed-by: Sage Weil <sage@redhat.com>
7988
7989 commit ced74c00d6de9fbf84ecb4d3064fbaec01ec827f
7990 Merge: 242635d938 f9d0442ca5
7991 Author: Sage Weil <sage@newdream.net>
7992 Date: Sun Oct 1 15:54:17 2017 -0500
7993
7994 Merge pull request #18033 from xiexingguo/wip-pr-17698
7995
7996 luminous: os/bluestore: allocate entire write in one go
7997
7998 Reviewed-by: Sage Weil <sage@redhat.com>
7999
8000 commit 242635d938fcd46d337b7727f0f3f578122b41ad
8001 Merge: 9d8acf6f3f 86d143722e
8002 Author: Sage Weil <sage@newdream.net>
8003 Date: Sun Oct 1 15:53:56 2017 -0500
8004
8005 Merge pull request #18038 from jecluis/wip-21300-luminous
8006
8007 luminous: mon/MgrMonitor: handle cmd descs to/from disk in the absence of active mgr
8008
8009 commit 1021fe235ca756337e3a3ff4804680c1e93b0270
8010 Author: Patrick Donnelly <pdonnell@redhat.com>
8011 Date: Fri Sep 29 08:48:14 2017 -0700
8012
8013 qa: relax cap expected value check
8014
8015 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
8016 (cherry picked from commit b37c7f7db7f0d76e524aabdad6dd0f16548268a6)
8017
8018 commit 633b114aca65548b91a898db7bbbef784b76180b
8019 Author: Sage Weil <sage@redhat.com>
8020 Date: Fri Sep 8 18:08:51 2017 -0400
8021
8022 os/bluestore: use min_alloc_size for freelist resolution
8023
8024 For HDD with min_alloc_size=64k, this is a 16x reduction in allocation
8025 metadata!
8026
8027 Signed-off-by: Sage Weil <sage@redhat.com>
8028 (cherry picked from commit 6b8e4d512604095fb8a209229d4633ac19b499de)
8029
8030 Conflicts:
8031 Slightly conflict with 834542c4027a8cc4d23eff089827d328919372d2, which
8032 drops the literal description of apply().
8033
8034 commit 3decf1c0de9f54b09afc954b13c2c8fac1011de9
8035 Author: Sage Weil <sage@redhat.com>
8036 Date: Fri Sep 8 18:08:07 2017 -0400
8037
8038 os/bluestore: align bluefs_extents to min_alloc_size
8039
8040 Signed-off-by: Sage Weil <sage@redhat.com>
8041 (cherry picked from commit 0c777efdcb2ee5a6322f0eb277e681d0f086e0b6)
8042
8043 commit 529c02db4da9b45cc13bedaa20509a896217fd83
8044 Author: Sage Weil <sage@redhat.com>
8045 Date: Fri Sep 8 18:07:38 2017 -0400
8046
8047 os/bluestore/FreelistManager: create: accept min alloc size
8048
8049 Accept a block size other than bdev_block_size. Let's call it, oh, I don't
8050 know, min_alloc_size.
8051
8052 Signed-off-by: Sage Weil <sage@redhat.com>
8053 (cherry picked from commit 52453d4ca223c8819f8e35f2c0b691803e74537f)
8054
8055 commit 37929849863c60531bcdbf80124e751504ac710f
8056 Author: Sage Weil <sage@redhat.com>
8057 Date: Fri Sep 8 18:06:05 2017 -0400
8058
8059 os/bluestore: mkfs: choose min_alloc_size earlier
8060
8061 Signed-off-by: Sage Weil <sage@redhat.com>
8062 (cherry picked from commit 3efde01586776b23bbac1e663ae5baf6500acee4)
8063
8064 commit efcf874295db0a68c43a9fd0a3a20cc3dcdf050a
8065 Author: Sage Weil <sage@redhat.com>
8066 Date: Fri Sep 8 18:05:29 2017 -0400
8067
8068 os/bluestore: require that bluefs_alloc_size be multiple of min_alloc_size
8069
8070 Signed-off-by: Sage Weil <sage@redhat.com>
8071 (cherry picked from commit 5b47ac59816894e983a98d3da8b5415d569c6663)
8072
8073 commit 58c52baeaed4a0a6dd5aed076db60988845431d0
8074 Author: Sage Weil <sage@redhat.com>
8075 Date: Wed Sep 27 17:42:07 2017 -0400
8076
8077 qa/suites/rados/singleton/all/recovery-preemption: add test
8078
8079 This mirrors what I was testing locally.
8080
8081 Signed-off-by: Sage Weil <sage@redhat.com>
8082 (cherry picked from commit d7b29acb1952d0b3dfd19326fd3418cfbd66ef3c)
8083
8084 commit 2e28f3e5ae3a4140e802f915b8db5dc434b6a3c2
8085 Author: Sage Weil <sage@redhat.com>
8086 Date: Thu Sep 21 12:37:13 2017 -0400
8087
8088 osd/PG: handle racy preemption
8089
8090 If we finish recovery/backfill and go active, but also get
8091 preempted at the same time, we can ignore the event.
8092
8093 Signed-off-by: Sage Weil <sage@redhat.com>
8094 (cherry picked from commit d8c3756d26abbaf326f634a494dcb12fe373f68d)
8095
8096 commit ba106b6d32fb3138b7a61fe613b211e02f1e44aa
8097 Author: Sage Weil <sage@redhat.com>
8098 Date: Tue Sep 19 15:26:40 2017 -0500
8099
8100 osd/PG: allow local recovery reservations to be preempted
8101
8102 If a PG has a higher recovery priority and a lower-priority item is in
8103 progress, allow it to be preempted. This triggers the RecoveryCancel
8104 or BackfillCancel event with a 0 delay, which means it will immediately
8105 re-request a reservation (and presumably wait).
8106
8107 Signed-off-by: Sage Weil <sage@redhat.com>
8108 (cherry picked from commit a8534cce1a1661375a93aff2314633bce63695ed)
8109
8110 commit 33ea286d0cedf44b7b3c70bc9f35c7f88fcc0361
8111 Author: Sage Weil <sage@redhat.com>
8112 Date: Tue Sep 19 15:25:05 2017 -0500
8113
8114 common/AsyncReserver: support preemption
8115
8116 If an (optional) preemption context is provided, use that to preempt
8117 and existing reservation and grant a higher-priority one.
8118
8119 Signed-off-by: Sage Weil <sage@redhat.com>
8120 (cherry picked from commit dbc002eaa90e952df1acf295a630443ac3ada418)
8121
8122 commit dad61658d1f48f1089e265d7441bf1349fd42f1f
8123 Author: Sage Weil <sage@redhat.com>
8124 Date: Thu Sep 21 12:37:49 2017 -0400
8125
8126 common/AsyncReserver: get a cct
8127
8128 Signed-off-by: Sage Weil <sage@redhat.com>
8129 (cherry picked from commit 08d2c8875bba7c41d1f9eeec586f6880f8be99b2)
8130
8131 commit 1b0875ca6d9ab91f59ffe2356113ed2cc643a276
8132 Author: Sage Weil <sage@redhat.com>
8133 Date: Thu Sep 21 10:30:57 2017 -0400
8134
8135 osd: PG_STATE_BACKFILL -> PG_STATE_BACKFILLING
8136
8137 Match user-facing string
8138
8139 Signed-off-by: Sage Weil <sage@redhat.com>
8140 (cherry picked from commit 31a34946f7aa0ad2b9848cbc808d209394a9ad44)
8141
8142 - add update to mon/PGMap.cc
8143
8144 commit 9d8acf6f3f85dd1410629cc680474e38f3be9838
8145 Merge: 62ff5e4c98 b54c7ba225
8146 Author: Sage Weil <sage@newdream.net>
8147 Date: Fri Sep 29 07:11:31 2017 -0500
8148
8149 Merge pull request #17862 from smithfarm/wip-21307-luminous
8150
8151 luminous: mon: Client client.admin marked osd.2 out, after it was down for 1504627577 seconds
8152
8153 Reviewed-by: Sage Weil <sage@redhat.com>
8154
8155 commit 62ff5e4c981a9e0d9a92bf3ac85210d98b0db038
8156 Merge: 453858d4b7 4c9d86bd86
8157 Author: Sage Weil <sage@newdream.net>
8158 Date: Fri Sep 29 07:10:55 2017 -0500
8159
8160 Merge pull request #17865 from smithfarm/wip-21465-luminous
8161
8162 luminous: OSD metadata 'backend_filestore_dev_node' is unknown even for simple deployment
8163
8164 Reviewed-by: Sage Weil <sage@redhat.com>
8165
8166 commit 453858d4b777ee81e5af4f443afc07e6af8b1a60
8167 Merge: 2e85e4f0c4 430a140d38
8168 Author: Sage Weil <sage@newdream.net>
8169 Date: Fri Sep 29 07:10:26 2017 -0500
8170
8171 Merge pull request #17936 from liewegas/wip-ruleset-errors-luminous
8172
8173 mon/OSDMonitor: error out if setting ruleset-* ec profile property
8174
8175 Reviewed-by: Sage Weil <sage@redhat.com>
8176
8177 commit 2e85e4f0c4f196dce8115e0a3aecc506caf1c7d1
8178 Merge: 1c228c95dc 481da57cca
8179 Author: Sage Weil <sage@newdream.net>
8180 Date: Fri Sep 29 07:10:06 2017 -0500
8181
8182 Merge pull request #17946 from liewegas/wip-mgr-localpool-luminous
8183
8184 luminous: mgr/localpool: module to automagically create localized pools
8185
8186 Reviewed-by: John Spray <john.spray@redhat.com>
8187
8188 commit 1c228c95dc142c3ca142f039e606e25cb500e53a
8189 Merge: 9915a2f600 9aafc53ed4
8190 Author: Sage Weil <sage@newdream.net>
8191 Date: Fri Sep 29 07:09:27 2017 -0500
8192
8193 Merge pull request #17998 from liewegas/wip-pr-17978-luminous
8194
8195 rbdmap: fix umount when multiple mounts use the same RBD
8196
8197 Reviewed-by: Sage Weil <sage@redhat.com>
8198
8199 commit 86d143722e1f16a19a56ed7a163d1dc9327c0c90
8200 Author: Joao Eduardo Luis <joao@suse.de>
8201 Date: Wed Sep 20 17:53:40 2017 +0100
8202
8203 mon/MgrMonitor: read cmd descs if empty on update_from_paxos()
8204
8205 If the MgrMonitor's `command_descs` is empty, the monitor will not send
8206 the mgr commands to clients on `get_descriptions`. This, in turn, has
8207 the clients sending the commands to the monitors, which will have no
8208 idea how to handle them.
8209
8210 Therefore, make sure to read the `command_descs` from disk if the vector
8211 is empty.
8212
8213 Fixes: http://tracker.ceph.com/issues/21300
8214
8215 Signed-off-by: Joao Eduardo Luis <joao@suse.de>
8216 (cherry picked from commit 3d06079bae0fbc096d6c3639807d9be3597e841a)
8217
8218 commit 8b2bd387859bdc2287ba6dcaba27d8b234984a5a
8219 Author: Ramana Raja <rraja@redhat.com>
8220 Date: Wed Sep 13 19:53:43 2017 +0530
8221
8222 pybind/ceph_volume_client: add get, put, and delete object interfaces
8223
8224 Wrap low-level rados APIs to allow ceph_volume_client to get, put, and
8225 delete objects. The interfaces would allow OpenStack Manila's
8226 cephfs driver to store config data in a shared storage to implement
8227 highly available Manila deployments. Restrict write(put) and
8228 read(get) object sizes to 'osd_max_size' config setting.
8229
8230 Signed-off-by: Ramana Raja <rraja@redhat.com>
8231 (cherry picked from commit d1bd171d6b6eb00c47168f38cec1a30f9c9f02bd)
8232
8233 commit 9421b40f1748c50b7f92abe8615c0cd9208fdbdc
8234 Author: Ramana Raja <rraja@redhat.com>
8235 Date: Mon Sep 18 20:16:30 2017 +0530
8236
8237 pybind/ceph_volume_client: remove 'compat_version'
8238
8239 ... class attribute of the 'CephFSVolumeClient' class. It was supposed
8240 to record the earliest version of CephFSVolumeClient that the current
8241 version is compatible with. It's not useful data to be stored as a
8242 class attribute.
8243
8244 Signed-off-by: Ramana Raja <rraja@redhat.com>
8245 (cherry picked from commit 894a734aa5a56b20d3f68bb3ad644b370f193934)
8246
8247 commit dd23023329b2382afef23ee02d7ef9b14baaf07b
8248 Author: Ramana Raja <rraja@redhat.com>
8249 Date: Mon Sep 18 20:09:55 2017 +0530
8250
8251 pybind/ceph_volume_client: set the version
8252
8253 ... of on-disk structures to be same as the class attribute 'version'
8254 of the CephFSVolumeClient class.
8255
8256 Signed-off-by: Ramana Raja <rraja@redhat.com>
8257 (cherry picked from commit 8267c2ba09841095f20a8833c155185529e64f46)
8258
8259 commit 9ee3f7ad21049d0692804d4405b4bf0f8c795ae3
8260 Author: Joao Eduardo Luis <joao@suse.de>
8261 Date: Wed Sep 27 17:55:17 2017 +0100
8262
8263 mon/MgrMonitor: populate on-disk cmd descs if empty on upgrade
8264
8265 During kraken, when we first introduced the mgrs, we wouldn't populate
8266 the on-disk command descriptions on create_initial(). Therefore, if we
8267 are upgrading from a cluster that never had a mgr, we may end up
8268 crashing because we have no cmd descs to load from disk.
8269
8270 Fixes: http://tracker.ceph.com/issues/21300
8271
8272 Signed-off-by: Joao Eduardo Luis <joao@suse.de>
8273
8274 commit f9d0442ca50078224b72f9876d2fed41fd409be6
8275 Author: Sage Weil <sage@redhat.com>
8276 Date: Thu Aug 10 16:44:59 2017 -0400
8277
8278 os/bluestore: allocate entire write in one go
8279
8280 On the first pass through the writes, compress data and calculate a final
8281 amount of space we need to allocate. On the second pass, assign the
8282 extents to blobs and queue the writes.
8283
8284 This allows us to do a single allocation for all blobs, which will lead
8285 to less fragmentation and a much better write pattern.
8286
8287 Signed-off-by: Sage Weil <sage@redhat.com>
8288 (cherry picked from commit e200f358499af8e3acb6ac4f675cc167433b53ec)
8289
8290 commit 4f28ef00162692557654d84bc1c0988998a6f2c4
8291 Author: xie xingguo <xie.xingguo@zte.com.cn>
8292 Date: Wed Sep 27 16:05:56 2017 +0800
8293
8294 osd/PrimaryLogPG: kick off recovery on backoffing a degraded object
8295
8296 As we are now blocking frontend ops from accessing that very object!
8297
8298 Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
8299 (cherry picked from commit db20328b456d70d6728fd27f17da6f2f3546e84b)
8300
8301 commit 711892dceaa7e4598bffff0edcff45554bc06ffc
8302 Author: Patrick Donnelly <pdonnell@redhat.com>
8303 Date: Thu Sep 28 16:01:00 2017 -0700
8304
8305 mds: improve cap min/max ratio descriptions
8306
8307 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
8308 (cherry picked from commit dcf97d17356f59c8870a36a99a77f879a20df348)
8309
8310 commit bef8ded7b82fc6896398bd334bdbd4fc63ebfe51
8311 Author: Patrick Donnelly <pdonnell@redhat.com>
8312 Date: Thu Sep 28 15:56:26 2017 -0700
8313
8314 mds: fix whitespace
8315
8316 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
8317 (cherry picked from commit ab69d682937a0a13246d28cfa2bbbf8c1b7ced38)
8318
8319 commit a5c96d4f7a5081242c6abf6c722adfa131030a55
8320 Author: Patrick Donnelly <pdonnell@redhat.com>
8321 Date: Wed Sep 27 10:39:01 2017 -0700
8322
8323 mds: cap client recall to min caps per client
8324
8325 Fixes: http://tracker.ceph.com/issues/21575
8326
8327 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
8328 (cherry picked from commit 538834171fe4524b4bb7cffdcb08c5b13fe7689f)
8329
8330 commit 913c72d96a6c405b4e4fe57abcfbf58d53a66e63
8331 Author: Patrick Donnelly <pdonnell@redhat.com>
8332 Date: Wed Sep 27 09:29:39 2017 -0700
8333
8334 mds: fix conf types
8335
8336 This correct an assertion failure.
8337
8338 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
8339 (cherry picked from commit bfc490249566356cff785f2f89dc03d69af322da)
8340
8341 commit 91084538cdfe80230bf346ee9cb6e8bfe080d6d8
8342 Author: Patrick Donnelly <pdonnell@redhat.com>
8343 Date: Wed Sep 27 09:29:23 2017 -0700
8344
8345 mds: fix whitespace
8346
8347 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
8348 (cherry picked from commit 8a5d71bf4517e6a3c194c3e63e0283747b75d4b1)
8349
8350 commit 5b1306142feb820a6c4f6e180ba68e428985b3f1
8351 Author: ren.huanwen <ren.huanwen@zte.com.cn>
8352 Date: Mon Sep 18 15:51:29 2017 +0800
8353
8354 doc/cephfs: add client min cache and max cache ratio describe
8355
8356 Signed-off-by: ren.huanwen <ren.huanwen@zte.com.cn>
8357 (cherry picked from commit d879ff91e76f66f90364038920fc2c62dd18c449)
8358
8359 commit a39ab633cb97fd4fa0e1ef3e0e2e56709f980857
8360 Author: ren.huanwen <ren.huanwen@zte.com.cn>
8361 Date: Mon Sep 18 15:14:19 2017 +0800
8362
8363 mds: adding tunable features for caps_per_client
8364
8365 Sometimes we need to raise or lower the value of "max_caps_per_client" and
8366 "min_caps_per_client" to improve recall_client_state efficiency
8367
8368 Signed-off-by: ren.huanwen <ren.huanwen@zte.com.cn>
8369 (cherry picked from commit a07b376628505832f5528bd7f2b0faeabe9a5f5d)
8370
8371 commit 4ff28ab144b3a0adfea8ad8ddee750243c824d14
8372 Author: Sage Weil <sage@redhat.com>
8373 Date: Thu Sep 21 10:28:59 2017 -0400
8374
8375 osd/osd_types: make BACKFILL <-> "backfilling" for parser
8376
8377 We render BACKFILL as "backfilling"; make sure parse works that
8378 way too.
8379
8380 Signed-off-by: Sage Weil <sage@redhat.com>
8381 (cherry picked from commit 6fa40e44dc579a009edff7be95d3fd37defbc7f6)
8382
8383 commit 2a9cfa2ad256df11bc1c3d95720ef89d11813846
8384 Author: Sage Weil <sage@redhat.com>
8385 Date: Thu Sep 21 10:28:08 2017 -0400
8386
8387 osd/osd_types: remove weird BACKFILL state hack
8388
8389 Signed-off-by: Sage Weil <sage@redhat.com>
8390 (cherry picked from commit 5bcfaf4bd40fee9ea4bfd5ed086b51facc5fe78e)
8391
8392 commit 429804b6bd193611f7474174e45ce94d784fd184
8393 Author: Sage Weil <sage@redhat.com>
8394 Date: Tue Sep 19 15:47:23 2017 -0500
8395
8396 osd/PG: Cancel{Recovery,Backfill} -> Defer{Recovery,Backfill}
8397
8398 "Defer" is more accurate here; we aren't canceling anything, just
8399 rescheduling the work.
8400
8401 Signed-off-by: Sage Weil <sage@redhat.com>
8402 (cherry picked from commit 2e45497a20a0b61975fbf0cf851d417f31b35489)
8403
8404 commit 4cbd62ecdc42aa91045f7f5c7ce5dab0cb59c16e
8405 Author: Sage Weil <sage@redhat.com>
8406 Date: Tue Sep 19 14:53:31 2017 -0500
8407
8408 osd/PG: specify delay in Cancel{Recovery,Backfill}
8409
8410 For now it is always the retry interval, but later perhaps not!
8411
8412 Signed-off-by: Sage Weil <sage@redhat.com>
8413 (cherry picked from commit 597dfd11728b55ad181316ac10be7155e37a6ba9)
8414
8415 commit 86778de01166902612b3173f1d0687f13027a21f
8416 Author: Sage Weil <sage@redhat.com>
8417 Date: Tue Sep 19 14:49:05 2017 -0500
8418
8419 osd/PG: make some trivial events TrivialEvent
8420
8421 Signed-off-by: Sage Weil <sage@redhat.com>
8422 (cherry picked from commit 3eadfa087f3ff5338f87306fd384d1f4749b8005)
8423
8424 commit 6c529092e8f4bd1e2a4a4069bf9f319d49430ccb
8425 Author: Sage Weil <sage@redhat.com>
8426 Date: Tue Sep 19 14:44:50 2017 -0500
8427
8428 osd/PG: set {backfill,recovery}_wait when canceling backfill/recovery
8429
8430 The only caller currently is when we get as far as we can with backfill
8431 or recovery but still have unfound objects. In this case, go back into
8432 the *_wait state instead of appearing as though we are still doing
8433 something.
8434
8435 Signed-off-by: Sage Weil <sage@redhat.com>
8436 (cherry picked from commit 4b216771bd31e5712471e13ad32ee8a1e519eb30)
8437
8438 commit 06c31a6ceecf1c33e1456c746169961802903001
8439 Author: Yan, Zheng <zyan@redhat.com>
8440 Date: Wed Sep 27 22:19:06 2017 +0800
8441
8442 mds: make sure snap inode's last matches its parent dentry's last
8443
8444 This patch is for luminous only. The issue has been fixed in master
8445 branch in another way (change is much bigger)
8446
8447 Fixes: http://tracker.ceph.com/issues/21337
8448 Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
8449
8450 commit 1236e0f2e9e8724569cf5fc7d7d525c7fca6ad77
8451 Author: Yao Zongyou <yaozongyou@vip.qq.com>
8452 Date: Sun Sep 24 22:11:22 2017 +0800
8453
8454 rgw_file: fix write error when the write offset overlaps.
8455
8456 Fixes: http://tracker.ceph.com/issues/21455
8457
8458 Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
8459 (cherry picked from commit 872d73f945364002f0fa31762e6976db5b4b3c19)
8460
8461 commit 9aafc53ed4edca8bebb96bc36a0b37ce32c79a75
8462 Author: Alexandre Marangone <a.marangone@gmail.com>
8463 Date: Tue Sep 26 11:35:04 2017 -0700
8464
8465 rbdmap: fix umount when multiple mounts use the same RBD
8466
8467 When a Kubernetes Pod consumes a RBD it is mounted two
8468 times on the same host. When the host shutdown umount will
8469 fail leading to a hung system
8470
8471 Signed-off-by: Alexandre Marangone <amarango@redhat.com>
8472 (cherry picked from commit 40825daecedb2a3481021e4d36a367c339eb9b62)
8473
8474 commit 9915a2f600788c37fb42f39a766ce93b9ae4d816
8475 Merge: 3e7492b9ad 6b5f212b91
8476 Author: vasukulkarni <vasu.kulkarni@gmail.com>
8477 Date: Wed Sep 27 09:50:44 2017 -0700
8478
8479 Merge pull request #17953 from ceph/wip-ceph-ansible-bport
8480
8481 tests - ceph-ansible backports
8482
8483 commit 6b5f212b9170dbd99779527b41be233b9d40b5e4
8484 Author: Vasu Kulkarni <vasu@redhat.com>
8485 Date: Thu Sep 21 15:34:31 2017 -0700
8486
8487 use ovh instead of vps
8488
8489 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8490 (cherry picked from commit 56d1511bdfaee5a2a0d85bd606348632bfcbf09e)
8491 Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
8492
8493 commit ab5300218699c947f380b0437f931d559bdbf074
8494 Author: Sébastien Han <seb@redhat.com>
8495 Date: Tue Sep 26 14:05:37 2017 +0200
8496
8497 rbd-mirorr: does not start on reboot
8498
8499 The current systemd unit file misses 'PartOf=ceph-rbd-mirror.target',
8500 which results in the unit not starting after reboot.
8501 If you have ceph-rbd-mirror@rbd-mirror.ceph-rbd-mirror0, it won't start
8502 after reboot even if enabled.
8503 Adding 'PartOf=ceph-rbd-mirror.target' will enable
8504 ceph-rbd-mirror.target when ceph-rbd-mirror@rbd-mirror.ceph-rbd-mirror0
8505 gets enabled.
8506
8507 Signed-off-by: Sébastien Han <seb@redhat.com>
8508 (cherry picked from commit e6cd9570ba210c5f4501b6f4fa443245a22c4d6c)
8509
8510 commit 481da57cca2f43f3cb14beaaa22eff3b2f62c875
8511 Author: Kefu Chai <kchai@redhat.com>
8512 Date: Tue Sep 26 12:10:28 2017 +0800
8513
8514 doc/mgr: add "local pool" plugin to toc
8515
8516 Signed-off-by: Kefu Chai <kchai@redhat.com>
8517 (cherry picked from commit 0b831e7886daad5836ca3cb58c01c123f99a1cde)
8518
8519 commit 315e336f38d1bb0e821dbc1943447cc61f203e2c
8520 Author: Vasu Kulkarni <vasu@redhat.com>
8521 Date: Tue Sep 19 17:09:08 2017 -0700
8522
8523 qa/tests: skip test that use public bucket landsat-pds from AWS
8524
8525 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8526 (cherry picked from commit e11a1f773d8795dd9bd9819aaf229c6598e22ca6)
8527
8528 commit fc7db58fc5ed071436d5f0f6cc9dcd61e3276aea
8529 Author: Vasu Kulkarni <vasu@redhat.com>
8530 Date: Tue Sep 19 17:06:03 2017 -0700
8531
8532 qa/tests: update required ceph-ansbile vars
8533
8534 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8535 (cherry picked from commit 184d5e6bad46451b3a8c5787f56148566bb42f20)
8536
8537 commit 4342d80354c941d47598897ca7ec6a6b4928edf6
8538 Author: Vasu Kulkarni <vasu@redhat.com>
8539 Date: Tue Sep 19 17:03:46 2017 -0700
8540
8541 qa/tests: Fix ceph-ansible upstream vars
8542
8543 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8544 (cherry picked from commit 077904a0b5dffe9d64feade94cf30ffc92f1c0e5)
8545
8546 commit a3d43ad8f3e685a028e943b5aee9ec4720cba60b
8547 Author: Vasu Kulkarni <vasu@redhat.com>
8548 Date: Sun Sep 10 12:42:16 2017 -0700
8549
8550 Fix get_system_type failure due to invalid remote name
8551
8552 recent changes caused the remote name to be invalid, fix the
8553 arg passed to get_system_type
8554
8555 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8556 (cherry picked from commit 9fe58d5ed6bd2338271a9e003f51d80c2e440e23)
8557
8558 commit ea8ddc95a8336f37065edfd7f061601c5c4cac4b
8559 Author: Vasu Kulkarni <vasu@redhat.com>
8560 Date: Fri Sep 8 10:00:49 2017 -0700
8561
8562 Stop the mgr on node which is not client, this will ensure
8563 the client.0's mgr is active mgr for workunit to work.
8564
8565 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8566 (cherry picked from commit b1fd615e9f507d4243744b34887366086c1890ac)
8567
8568 commit 69bbaf5173c09afbf02b1894843570d403ad4235
8569 Author: Vasu Kulkarni <vasu@redhat.com>
8570 Date: Thu Sep 7 17:10:04 2017 -0700
8571
8572 Test ceph-mgr RESTful api
8573
8574 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8575 (cherry picked from commit e5b5a1b8c8d0e750d29fe41a16252dcb0adf449f)
8576
8577 commit 581656e3874822f958400c235241cddb07c4aca3
8578 Author: Vasu Kulkarni <vasu@redhat.com>
8579 Date: Thu Sep 7 16:54:51 2017 -0700
8580
8581 Add additional variables as required by ceph-ansible for upstream
8582 installation.
8583
8584 possible revert if those are made default
8585 issue: https://github.com/ceph/ceph-ansible/issues/1834
8586
8587 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8588 (cherry picked from commit e963bfd6ca0ea1525e37dc35bf3309548c7a3831)
8589
8590 commit 559a47997c7f6c1e8e86e2fd06759ded0e7cccd9
8591 Author: Vasu Kulkarni <vasu@redhat.com>
8592 Date: Fri Aug 18 11:35:54 2017 -0700
8593
8594 Rename folders to fix task order
8595
8596 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8597 (cherry picked from commit 9cc00c5c1a6e99323a4655aad5c093b8d87609f6)
8598
8599 commit 655b0733970c6798af087fdb886bf914711fef1b
8600 Author: Vasu Kulkarni <vasu@redhat.com>
8601 Date: Fri Aug 18 11:09:50 2017 -0700
8602
8603 use bluestore with dmcrypt option
8604
8605 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8606 (cherry picked from commit 1041c803f1f8f7be0edd0e78df352152fa3c4e6f)
8607
8608 commit 244689b36a2beb6dbd9beed429e5b46f4b714bc3
8609 Author: Vasu Kulkarni <vasu@redhat.com>
8610 Date: Fri Aug 18 11:08:00 2017 -0700
8611
8612 Add dmcrypt option
8613
8614 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8615 (cherry picked from commit f6de5d9f9e2a3666116311c146a8f2a45f3b8dbb)
8616
8617 commit d2ddcc0324a66b1cb67a640df987e5bc1a6f4887
8618 Author: Vasu Kulkarni <vasu@redhat.com>
8619 Date: Fri Aug 18 11:05:01 2017 -0700
8620
8621 Separate the main task from options
8622
8623 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8624 (cherry picked from commit 60d00e0eadda3a7a7cfbac2acdc81a4d55a27570)
8625
8626 commit 05f7ce97a8b94b5abcaddd7d125398c7d0118bbc
8627 Author: Vasu Kulkarni <vasu@redhat.com>
8628 Date: Fri Aug 18 10:47:22 2017 -0700
8629
8630 Catchup with recent changes with ceph-ansible
8631
8632 Adds osd_scenario and ceph_stable_release variables
8633
8634 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8635 (cherry picked from commit 0395b844884a63a2cb7480dcc40762df6915b403)
8636
8637 commit 58ffed6fb9e8695deb53edd7754aed56c73403bd
8638 Author: Vasu Kulkarni <vasu@redhat.com>
8639 Date: Thu Aug 24 11:02:20 2017 -0700
8640
8641 Add workaround for http://tracker.ceph.com/issues/20950
8642
8643 mgr bootstrap key differs on disk, rewrite the new key
8644 using auth get.
8645
8646 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8647 (cherry picked from commit 5c43c5972ddb04724c8659a1b8d71cda1e0acdfb)
8648
8649 commit c2284be89df724bbf1446b28cdf712722d7581a1
8650 Author: Vasu Kulkarni <vasu@redhat.com>
8651 Date: Thu Aug 24 09:24:52 2017 -0700
8652
8653 Add kraken to luminous upgrade case
8654
8655 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8656 (cherry picked from commit 71ea4987e0d55cc49e90dfbaf9722769cc892f3f)
8657
8658 commit 6cc150023f1dc2450bbf83ebdba8360c5693645c
8659 Author: Vasu Kulkarni <vasu@redhat.com>
8660 Date: Mon Aug 7 12:19:41 2017 -0700
8661
8662 Add kernel tar/untar and systemd task
8663
8664 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8665 (cherry picked from commit 526d4aef1cb73ffa6f73e1353dc06eed6cccb9f9)
8666
8667 commit 39eb7cb0bd77925d422c68aaed86fbd39bdfc80e
8668 Author: Vasu Kulkarni <vasu@redhat.com>
8669 Date: Tue Aug 1 16:32:42 2017 -0700
8670
8671 Restart services after upgrade
8672
8673 This seems to be an issue and should be fixed in our systemd scripts,
8674 need to discuss more on this.
8675
8676 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8677 (cherry picked from commit 2116f76a1f1fbb32ca5844c1d051e22b1b657e0f)
8678
8679 commit 566dada1f6a73b8be128167a425becea7ba110fe
8680 Author: Vasu Kulkarni <vasu@redhat.com>
8681 Date: Fri Jul 28 23:11:41 2017 -0700
8682
8683 since the roles are mapped inside ceph-deploy, store the roles that
8684 are mapped and use the new mapped role for upgrades during later
8685 stage.
8686
8687 eg: mon.a is mapped to mon.mira002 during install, store this mapping
8688 and durig upgrade map it back to appropriate name to find the hostname
8689 with that role
8690
8691 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8692 (cherry picked from commit 8a2b9a08095dc97e0e440cc900c650d5efb55a4f)
8693
8694 commit 093a13268dff5b1114294456e83e0e24bfd7be6d
8695 Author: Vasu Kulkarni <vasu@redhat.com>
8696 Date: Fri Jul 28 17:48:09 2017 -0700
8697
8698 Add doc string for missing ceph-deploy-branch
8699
8700 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8701 (cherry picked from commit e7a0a4f87f2fbea0c9e27341c952245f1ad34ab8)
8702
8703 commit df415e81887b06918731d7d3b7677ecab1ee2db5
8704 Author: Vasu Kulkarni <vasu@redhat.com>
8705 Date: Thu Jul 27 15:24:25 2017 -0700
8706
8707 use mon.a as ceph-admin node, the previous get_first_mon returns
8708 a sorted(mons)[0] as first mon.
8709
8710 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8711 (cherry picked from commit 407ce2613d37252e48c2a648b94b065ab070ec46)
8712
8713 commit 1128ae099cc350f29b243321bc2815aaf7bbfe80
8714 Author: Vasu Kulkarni <vasu@redhat.com>
8715 Date: Thu Jul 27 11:17:31 2017 -0700
8716
8717 use elif instead of else to handle cases for jewel install
8718
8719 jewel needs neither filestore or bluestore as an option, so provide none
8720 when running with jewel branch.
8721
8722 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8723 (cherry picked from commit f3ec7cabf66c76d712f77a4dfefe96f374507982)
8724
8725 commit 7db1550a55002d28d899aee6ec695604045edabb
8726 Author: Vasu Kulkarni <vasu@redhat.com>
8727 Date: Wed Jul 26 19:18:11 2017 -0700
8728
8729 Jewel to luminous upgrade scenario using ceph-deploy
8730
8731 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8732 (cherry picked from commit 9c85c76a90dcf46ec2bcc6840f4fc57ed86583b5)
8733
8734 commit ab219d2e985cd1c6a7fd17b5ced4db25cb0b7427
8735 Author: Vasu Kulkarni <vasu@redhat.com>
8736 Date: Wed Jul 26 18:56:08 2017 -0700
8737
8738 Add upgrade functionality using ceph-deploy
8739
8740 This is to test for customer like upgrade scenarios and to find
8741 any issues that may be related to systemd, packaging etc
8742
8743 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8744 (cherry picked from commit 9a73127c16d3395934d003024964ed1373d81083)
8745
8746 commit a145127bde2e2fb96a1fd2b821ed2b647e8ae223
8747 Author: Vasu Kulkarni <vasu@redhat.com>
8748 Date: Wed Jul 26 15:01:15 2017 -0700
8749
8750 Fix old flake8 issues
8751
8752 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8753 (cherry picked from commit b409c3d163194b0b65e26b0fbc93def8e17a10b4)
8754
8755 commit 28b3c242bdbfc655534cdd037966ed1dcddc978a
8756 Author: Vasu Kulkarni <vasu@redhat.com>
8757 Date: Wed Jul 26 14:58:50 2017 -0700
8758
8759 Add option to skip mgr install for old release
8760
8761 Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
8762 (cherry picked from commit a9be0c387ed2ae09227dad833c8647af110bd2de)
8763
8764 commit 82651da2d504913f2145085df8a89484308f3eba
8765 Author: huangjun <huangjun@xsky.com>
8766 Date: Wed Sep 20 00:04:04 2017 +0800
8767
8768 qa/ceph_manager: check pg state again before timedout
8769
8770 Pg state maybe all in active+clean when no recovering going on,
8771 so check it again before timedout.
8772
8773 Fixes: http://tracker.ceph.com/issues/21294
8774
8775 Signed-off-by: huangjun <huangjun@xsky.com>
8776 (cherry picked from commit fa40add7f0123dfeac30986f3d53cdfa77736a87)
8777
8778 commit 4017a26162706f1b6bed3f7b37174c8ca47b54ad
8779 Author: Sage Weil <sage@redhat.com>
8780 Date: Sun Sep 24 14:05:14 2017 -0400
8781
8782 qa/workunits/mgr/test_localpool: simple test for localpool mode
8783
8784 Signed-off-by: Sage Weil <sage@redhat.com>
8785 (cherry picked from commit 6383fa5b3004a606c15efd2be1b7ce5d57f05086)
8786
8787 commit 45a804f25bc42f03b0596b1ba394fb6be575d392
8788 Author: Sage Weil <sage@redhat.com>
8789 Date: Wed Sep 6 15:34:50 2017 -0400
8790
8791 pybind/mgr/localpool: module to automagically create localized pools
8792
8793 By default, this will create a pool per rack, 3x replication, with a host
8794 failure domain. Those parameters can be customized via mgr config-key
8795 options.
8796
8797 Signed-off-by: Sage Weil <sage@redhat.com>
8798 (cherry picked from commit 1a0f42b70a4c9fa68dc47f2f521d0f1e8f5bb220)
8799
8800 commit 430a140d38ba6b9e07c53d5a4a5c6232bef4fb0e
8801 Author: Sage Weil <sage@redhat.com>
8802 Date: Wed Sep 20 16:42:01 2017 -0400
8803
8804 mon/OSDMonitor: error out if setting ruleset-* ec profile property
8805
8806 We change ruleset -> crush back in dc7a2aaf7a34b1e6af0c7b79dc44a69974c1da23.
8807 If someone tries to use the old property, error out early, instead of
8808 silently not doing the thing they thought they told us to do.
8809
8810 Signed-off-by: Sage Weil <sage@redhat.com>
8811 (cherry picked from commit 6376d75eda648789b5e316a1ac2883708db7128e)
8812
8813 commit 1fc6a51a416761d9ccd172937cda1a6b1c11faad
8814 Author: John Spray <john.spray@redhat.com>
8815 Date: Sat Sep 23 13:48:36 2017 +0100
8816
8817 mon: show legacy health warning in `status` output
8818
8819 Previously you only got the text of this if you were
8820 either looking at "health detail" or if you had
8821 already set the preluminous_compat setting (in which
8822 case you presumably were already aware so the message
8823 isn't doing much).
8824
8825 Signed-off-by: John Spray <john.spray@redhat.com>
8826
8827 commit d5e583490d946242bdfd26e863dd0aac27c12e3c
8828 Author: Ramana Raja <rraja@redhat.com>
8829 Date: Wed Sep 20 20:27:22 2017 +0530
8830
8831 ceph_volume_client: perform snapshot operations in
8832
8833 ... client configured snap directory name, instead of in hard-coded
8834 '.snap' directory.
8835
8836 Fixes: http://tracker.ceph.com/issues/21476
8837
8838 Signed-off-by: Ramana Raja <rraja@redhat.com>
8839 (cherry picked from commit f4fc1722594ed007706b54901fb07a2a443d1b96)
8840
8841 commit e4164c43f5ec808c0420036d2a647a5a7d38a436
8842 Author: Carl Xiong <xiongc05@gmail.com>
8843 Date: Fri Sep 22 11:55:33 2017 +0800
8844
8845 ceph-disk: fix '--runtime' omission for ceph-osd service
8846
8847 f425a127b introduces a regression that ceph-disk omits "--runtime" when
8848 enabling ceph-osd@$ID.service units for device-backed OSDs.
8849
8850 Fixes: http://tracker.ceph.com/issues/21498
8851
8852 Signed-off-by: Carl Xiong <cxiong@suse.com>
8853 (cherry picked from commit a385b5b0c35106c9b44d81655983b2f7566b21cd)
8854
8855 commit faf3fec1a628c9c4f4791e33d7795ef719267cbc
8856 Author: Sage Weil <sage@redhat.com>
8857 Date: Wed Sep 13 18:33:21 2017 -0400
8858
8859 ceph-bluestore-tool: better default logging; --log-file and --log-level options
8860
8861 - keep derr going to stderr (so we see 'fsck error' messages)
8862 - hide the rest
8863 - add friendly --log-file option
8864
8865 Signed-off-by: Sage Weil <sage@redhat.com>
8866 (cherry picked from commit 9bd98b42fea1791935280f5ad19e5420d5303e03)
8867
8868 commit 2184e3077caa9de5f21cc901d26f6ecfb76de9e1
8869 Author: Sage Weil <sage@redhat.com>
8870 Date: Thu Sep 7 18:27:20 2017 -0400
8871
8872 ceph-bluestore-tool: add 'bluefs-bdev-expand' to expand wal or db usage
8873
8874 If you are using the wal or db devices, this will expand bluefs's usage to
8875 include the entire block device.
8876
8877 Signed-off-by: Sage Weil <sage@redhat.com>
8878 (cherry picked from commit aa4baad529835c1999ff9cc1a2f509c52a0cc699)
8879
8880 commit af9a43a47b1dd0d8bb9946d4b4a0ab9b5c39e427
8881 Author: Sage Weil <sage@redhat.com>
8882 Date: Thu Sep 7 18:20:27 2017 -0400
8883
8884 ceph-bluestore-tool: add 'bluefs-bdev-sizes' command
8885
8886 Show bdev sizes vs owned extents.
8887
8888 Signed-off-by: Sage Weil <sage@redhat.com>
8889 (cherry picked from commit 9e492f2a2217ee94670e9e0d6cf28e4b7bff5ad0)
8890
8891 commit 6a6678c52ac4aba7fd313ddc2cb3c013819fe28f
8892 Author: Sage Weil <sage@redhat.com>
8893 Date: Thu Sep 7 18:12:21 2017 -0400
8894
8895 ceph-bluestore-tool: factor out bluefs mount
8896
8897 Signed-off-by: Sage Weil <sage@redhat.com>
8898 (cherry picked from commit 86db2d7b09de4362d90fba834d61978860d73309)
8899
8900 commit 53f9941f28ac1435bf14f48d369b8ea03336c9d2
8901 Author: Sage Weil <sage@redhat.com>
8902 Date: Thu Sep 7 12:27:35 2017 -0400
8903
8904 os/ObjectStore: add repair interface
8905
8906 Signed-off-by: Sage Weil <sage@redhat.com>
8907 (cherry picked from commit c7b7a1f04f78fa62890c567d0ca53874c8d75eb7)
8908
8909 commit edd4d98fefe63ad31bf96fa61716b4ee079c0498
8910 Author: David Zafman <dzafman@redhat.com>
8911 Date: Fri Sep 8 17:53:07 2017 -0700
8912
8913 ceph-objectstore-tool: Make pg removal require --force
8914
8915 Add new export-remove to combine the 2 operations
8916
8917 Fixes: http://tracker.ceph.com/issues/21272
8918
8919 Signed-off-by: David Zafman <dzafman@redhat.com>
8920 (cherry picked from commit 3bb20f6d750915d176c7a34367dac966a20faa76)
8921
8922 commit bbe0f34cc81a8db873ef23cca0cdea8651411b86
8923 Author: David Zafman <dzafman@redhat.com>
8924 Date: Fri Sep 8 17:09:48 2017 -0700
8925
8926 ceph-objectstore-tool: Better messages for bad --journal-path
8927
8928 Signed-off-by: David Zafman <dzafman@redhat.com>
8929 (cherry picked from commit 49ca1fff7fc4360d2f3a9cac60c0ba651cbc4750)
8930
8931 commit fd7d53bacb10d5b2094f1f579c96899d8a0a4b4f
8932 Author: David Zafman <dzafman@redhat.com>
8933 Date: Wed Sep 6 20:41:50 2017 -0700
8934
8935 test: Fix ceph-objectstore-tool test for standalone and latest code
8936
8937 vstart.sh now defaults to bluestore, so specify filestore
8938 Set environment for run-standalone.sh and cmake build
8939 Create td/cot_dir as test directory
8940 Crush output format change
8941 Change dir into test directory
8942 Give a little time after pool creation
8943 Check for core files as ceph-helpers.sh does
8944
8945 Signed-off-by: David Zafman <dzafman@redhat.com>
8946 (cherry picked from commit 3ac219df2d635a08be52df3ad44cf0683de46af2)
8947
8948 commit 3e20e0f3071188f52b7a7c3f9e36b09305431ed0
8949 Author: David Zafman <dzafman@redhat.com>
8950 Date: Wed Sep 6 20:40:37 2017 -0700
8951
8952 test: Move ceph-objectstore-tool test to standalone
8953
8954 Signed-off-by: David Zafman <dzafman@redhat.com>
8955 (cherry picked from commit 495c32fd31b311d22f0d4509e896916bd2671615)
8956
8957 commit ddca5dbe04a2647218fabff6098691edd6b7a157
8958 Author: John Spray <john.spray@redhat.com>
8959 Date: Mon Aug 28 19:55:06 2017 +0100
8960
8961 mgr/prometheus: only turn - into _minus at end
8962
8963 ...of perf counter name.
8964
8965 So that mds_mem_dir- becomes mds_mem_dir_minus, but
8966 throttle-filestore_bytes becomes throttle_filestore_bytes.
8967
8968 At some point once this is all settled we should
8969 probably just change Ceph's internal perf counter
8970 naming to satisfy the major TSDB naming rules.
8971
8972 Signed-off-by: John Spray <john.spray@redhat.com>
8973 (cherry picked from commit 29ac9270d43a225bb2336adaaf813c12e12a715a)
8974
8975 commit 8375251d150397c0097718f6e93ed38e9e89cfbb
8976 Author: jermudgeon <jhaustin@gmail.com>
8977 Date: Sun Aug 27 21:26:28 2017 -0800
8978
8979 mgr/prometheus: Fix for MDS metrics
8980
8981 MDS metrics come in these forms:
8982
8983 mds_mem_dir #Directories
8984 mds_mem_dir+ #Directories opened
8985 mds_mem_dir- #Directories closed
8986
8987 In this case, continuing the trend of replacing all illegal characters with '_' results in…
8988
8989 mds_mem_dir #Directories
8990 mds_mem_dir_ #Directories opened
8991 mds_mem_dir_ #Directories closed
8992
8993 which is palpably a bad idea.
8994
8995 Suggested replacement for '+' = '_plus' seems fine, and a perusal of all metrics indicate that only MDS metrics end in '-' or '+' at this time.
8996
8997 Replacing '-' with '_minus' is probably less good for the general case, if anyone has a better idea…
8998
8999 I suppose another alternative would be to change MDS metrics so they don't use 'illegal' characters, but this also seems cumbersome and would break more third parties.
9000
9001 Fixes: http://tracker.ceph.com/issues/20899
9002 Signed-off-by: Jeremy H Austin <jhaustin@gmail.com>
9003 (cherry picked from commit d719cd04b294e90ab9d440ba7d033826c069a2de)
9004
9005 commit 3a037dda4273cea289641e93a006b2857147ee73
9006 Author: John Spray <john.spray@redhat.com>
9007 Date: Fri Sep 8 11:33:02 2017 -0400
9008
9009 mgr: fix py calls for dne service perf counters
9010
9011 Fixes: http://tracker.ceph.com/issues/21253
9012 Signed-off-by: John Spray <john.spray@redhat.com>
9013 (cherry picked from commit f9a4ca07acecd15986cbce61a6e118a6cb05af29)
9014
9015 commit 077b3601d6bf68167d1857b79bb3782e23bc8ccc
9016 Author: John Spray <john.spray@redhat.com>
9017 Date: Thu Jul 27 11:48:42 2017 -0400
9018
9019 mgr/restful: cleaner message when not configured
9020
9021 RuntimeError+backtrace prints should be for
9022 genuinely exceptional exceptions. For these
9023 known cases, we should just print the message cleanly.
9024
9025 http://tracker.ceph.com/issues/21292
9026 Signed-off-by: John Spray <john.spray@redhat.com>
9027 (cherry picked from commit f7a1d57dd0d6c29b8c57a5de624da33777403fe5)
9028
9029 commit 4c9d86bd86954cbee25a3ea2a60af063114f7790
9030 Author: Sage Weil <sage@redhat.com>
9031 Date: Tue Aug 8 13:59:41 2017 -0400
9032
9033 os/filestore: fix device/partition metadata detection
9034
9035 The UUID thing (a) relies on partition labels to work, which isn't
9036 always true (and won't be true for ceph-volume going forward), and
9037 (b) reportedly doesn't work anyway. The fd-based helper works
9038 just fine (even for vstart).
9039
9040 Fixes: http://tracker.ceph.com/issues/20944
9041 Signed-off-by: Sage Weil <sage@redhat.com>
9042 (cherry picked from commit e62862be0b68a17763e19ed8453436c457294505)
9043
9044 commit 49e030da55030068c35790f751ea6631a324e5c2
9045 Author: Yan Jun <yan.jun8@zte.com.cn>
9046 Date: Wed Sep 13 18:15:33 2017 +0800
9047
9048 test/config: regulate parameter order of ASSERT_EQ
9049
9050 Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
9051 (cherry picked from commit ccaba817dcd2c84c75cf0f784d90b78527c9f92b)
9052
9053 commit 85ab5c86aafa92a36078133d7da07db54f064f4b
9054 Author: Yan Jun <yan.jun8@zte.com.cn>
9055 Date: Tue Sep 12 11:20:34 2017 +0800
9056
9057 common: fix daemon abnormal exit at parsing invalid arguments
9058
9059 Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
9060 (cherry picked from commit 3f075372d1400806ae32e0e9210b9c15316dfe66)
9061
9062 commit d7cde5f316242caa86ef62690104228aafc58a42
9063 Author: Kefu Chai <kchai@redhat.com>
9064 Date: Thu Sep 7 13:12:15 2017 +0800
9065
9066 mon,monmap: use new style config opts
9067
9068 Signed-off-by: Kefu Chai <kchai@redhat.com>
9069 (cherry picked from commit 3124eb2148f5c6703c75b9e556ddb773898a6e55)
9070
9071 commit fe039e41d78f7d74c39cdc9034cadccf632e9ac2
9072 Author: Kefu Chai <kchai@redhat.com>
9073 Date: Thu Sep 7 12:47:36 2017 +0800
9074
9075 mon,option: set default value for mon_dns_srv_name
9076
9077 Fixes: http://tracker.ceph.com/issues/21204
9078 Signed-off-by: Kefu Chai <kchai@redhat.com>
9079 (cherry picked from commit 50207769f0c187cc8caf2bed3a1c94df409718e5)
9080
9081 commit b54c7ba225314cc3e67707ec8dbac4a7f8381929
9082 Author: John Spray <john.spray@redhat.com>
9083 Date: Wed Sep 6 12:57:40 2017 -0400
9084
9085 mon: fix `osd out` clog message
9086
9087 This was printing the absolute time instead of the period.
9088
9089 Fixes: http://tracker.ceph.com/issues/21249
9090 Signed-off-by: John Spray <john.spray@redhat.com>
9091 (cherry picked from commit f07480fec729d66f4cdc19a1c3bde3d185df1289)
9092
9093 commit d7f6b93af4ce1115a1bde5883421c8ad860aa53f
9094 Author: Jason Dillaman <dillaman@redhat.com>
9095 Date: Fri Sep 8 16:43:58 2017 -0400
9096
9097 rbd: mirror "get" actions now have cleaner error messages
9098
9099 Fixes: http://tracker.ceph.com/issues/21319
9100 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
9101 (cherry picked from commit 053be9847ff0052348aa259520d641923e57537d)
9102
9103 commit bb0874c9db50bbfbf84396a4f1308282102a1694
9104 Author: Jason Dillaman <dillaman@redhat.com>
9105 Date: Fri Sep 8 15:41:36 2017 -0400
9106
9107 cls/rbd: avoid recursively listing the watchers on rbd_mirroring object
9108
9109 Signed-off-by: Jason Dillaman <dillaman@redhat.com>
9110 (cherry picked from commit 79be496ac098859304efcabc7b5eb8afca6eca91)
9111
9112 commit 34af07f97a67ead7d00b4352aea6300ac737ad9b
9113 Author: Mykola Golub <mgolub@mirantis.com>
9114 Date: Fri Aug 18 20:08:12 2017 +0200
9115
9116 rbd-mirror: potential lockdep issue
9117
9118 (cycle between ImageReplayerAdminSocketHook and ImageReplayer locks)
9119
9120 Signed-off-by: Mykola Golub <mgolub@mirantis.com>
9121 (cherry picked from commit 226b1a3be16915c79e16106d42260687683e7a92)
9122
9123 commit 925f223b7a57eae382c168d4bc4f05f50dd7bf6b
9124 Author: Mykola Golub <mgolub@mirantis.com>
9125 Date: Fri Aug 11 14:27:41 2017 +0200
9126
9127 rbd-mirror: update asok hook name on image rename
9128
9129 Fixes: http://tracker.ceph.com/issues/20860
9130 Signed-off-by: Mykola Golub <mgolub@mirantis.com>
9131 (cherry picked from commit 9ddb5da3377029d11cb1089102d7146e9ee2537a)
9132
9133 commit fd207447d1acebbf7a62c0d03b3ec9025ac19fbd
9134 Author: lu.shasha <lu.shasha@eisoo.com>
9135 Date: Thu Aug 17 16:02:02 2017 +0800
9136
9137 rgw: fix lc process only schdule the first item of lc objects
9138
9139 If more than two bucket hash to the same lc object, only the first bucket will do lifecycle operation. Other buckets lifecycle will never be schduled.
9140
9141 Fixes: http://tracker.ceph.com/issues/21022
9142
9143 Signed-off-by: Shasha Lu <lu.shasha@eisoo.com>
9144 (cherry picked from commit 9561dc0a903d9021f64857762e73887ffe46c28e)
9145
9146 commit 5b5f0b5a33c638ec6f52d6936c60e5efd76eacab
9147 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9148 Date: Wed Aug 23 21:31:11 2017 +0200
9149
9150 rgw: fix accessing expired memory in PrefixableSignatureHelper.
9151
9152 Fixes: http://tracker.ceph.com/issues/21085
9153 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9154 (cherry picked from commit 9260d39ceb1ef39a32c8f1742c3069bb83d628f8)
9155
9156 commit d2be1e0ccb64021f770f28a6097f5468d375dbec
9157 Author: lu.shasha <lu.shasha@eisoo.com>
9158 Date: Fri Aug 25 15:05:52 2017 +0800
9159
9160 rgw: return bucket's location no matter which zonegroup it located in.
9161
9162 Get bucket location which is created in another zonegroup, will return "301 Moved Permanently".
9163
9164 Fixes: http://tracker.ceph.com/issues/21125
9165
9166 Signed-off-by: Shasha Lu <lu.shasha@eisoo.com>
9167 (cherry picked from commit 71d2eca3e00de19419fb07bf9346f5863b20d40f)
9168
9169 commit c4d6539374a02378209688dfa829caa39af0a214
9170 Author: Abhishek Lekshmanan <abhishek@suse.com>
9171 Date: Thu Aug 31 13:39:13 2017 +0200
9172
9173 rgw: rgw_rados: set_attrs now sets the same time for BI & object
9174
9175 `RGWRados::set_attrs()` used to set slightly different mtimes for the
9176 object and in the bucket dir entry as we do an object write and set the
9177 time at bucket index as the time at that point. Fix this by using the
9178 setting the same mtime for the object as well.
9179
9180 Fixes: http://tracker.ceph.com/issues/21200
9181 Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
9182 (cherry picked from commit 87e8e89fe11fa805739a2b85d1b009424641fa4e)
9183
9184 commit dfe42384fbce90ec4c315e10ebd6b4fc4234827b
9185 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9186 Date: Wed Dec 28 19:22:32 2016 +0100
9187
9188 rgw: calculate and print Swift's X-Account-Storage-Policy-* headers.
9189
9190 Fixes: http://tracker.ceph.com/issues/17932
9191 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9192 (cherry picked from commit 5e5c0677ba69f0d162df1da9a22b1fb56028baa4)
9193
9194 commit 6e4c63fb136d958e0b4fe279419978a322043201
9195 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9196 Date: Wed Dec 28 17:14:35 2016 +0100
9197
9198 rgw: bucket linking stores also the info about a placement rule.
9199
9200 Fixes: http://tracker.ceph.com/issues/17932
9201 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9202 (cherry picked from commit de7a8679af93457c10bf514c17a7cfc5327e745c)
9203
9204 commit 933f840094c3614466904f0fce32c2346a8f1709
9205 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9206 Date: Wed Dec 28 17:12:50 2016 +0100
9207
9208 rgw: convey placement rule in RGWBucketEnt and cls_user_bucket_entry.
9209
9210 Fixes: http://tracker.ceph.com/issues/17932
9211 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9212 (cherry picked from commit 5eca89f08d29ac6aa7b55a3b4fb5b4183bdc0496)
9213
9214 commit 5a1d0c42854fb35d44e63859d81074867f1a3295
9215 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9216 Date: Wed Dec 28 15:54:42 2016 +0100
9217
9218 rgw: clean-up around and implement the move semantics in RGWBucketEnt.
9219
9220 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9221 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9222 (cherry picked from commit 545dabe31a9ac231db4b8e3ce674ddfd9c91ee20)
9223
9224 commit bb92cc93ac32c1f98d7cfae778d684b94dd2de58
9225 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9226 Date: Tue Aug 29 19:16:20 2017 +0200
9227
9228 rgw: enforce the std::move semantic across the path of RGWUserBuckets.
9229
9230 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9231 (cherry picked from commit 4a7a4344840c873189331f22c8143ba031622d20)
9232
9233 commit 395e9a48d32db7dfe0419316772886b939a44233
9234 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9235 Date: Tue Aug 29 19:19:59 2017 +0200
9236
9237 rgw: {end_}marker params are handled during Swift's reversed account listing.
9238
9239 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9240 (cherry picked from commit 2f1f7a179d6a031c77929359313fc1fcc9f75bef)
9241
9242 commit 8582664267b2e72a836e27df859910481371dee0
9243 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9244 Date: Mon Aug 28 21:54:56 2017 +0200
9245
9246 rgw: add basic support for Swift's reversed account listings.
9247
9248 Fixes: http://tracker.ceph.com/issues/21148
9249 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9250 (cherry picked from commit 870f54806b7c1f570d2e82d3d2aa308b2178c6f0)
9251
9252 commit d61de49cf270fedb206530a9d3cc1b4970f2b484
9253 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9254 Date: Mon Aug 28 21:53:28 2017 +0200
9255
9256 rgw: abstract partial data processing in RGWListBuckets.
9257
9258 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9259 (cherry picked from commit a842dd09d584ff7636ec972646caff218df59c4b)
9260
9261 commit 957e221f1ffc73726187aba99e9e103291b0ba6f
9262 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9263 Date: Wed May 24 16:50:26 2017 +0200
9264
9265 rgw: list_objects() honors end_marker regardless of namespace.
9266
9267 This patch fixes a regression related to handling of the end_marker
9268 parameter during Swift's container listing operation. It has been
9269 introduced in a5d1fa0587184f43c69d8e03114b58d43f320781 and causes
9270 Tempest's test_list_container_contents_with_end_marker to fail.
9271
9272 Fixes: http://tracker.ceph.com/issues/18977
9273 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9274 (cherry picked from commit 09db1e412ef0853e7f345f813c8d452ec8354c36)
9275
9276 commit 004240eea79b02eb830f3c9e72de8e0216ff7557
9277 Author: Sage Weil <sage@redhat.com>
9278 Date: Sat Sep 9 22:47:06 2017 -0400
9279
9280 qa/standalong/mon/osd-pool-create: fewer pgs in test
9281
9282 This runs afoul of the new max pg per osd limit.
9283
9284 Signed-off-by: Sage Weil <sage@redhat.com>
9285 (cherry picked from commit c9ffeeebebe84111ce3be51c04170804bf2dbc74)
9286
9287 commit 54ba2dda2034dd80594f17261451832744d2c7bf
9288 Author: Sage Weil <sage@redhat.com>
9289 Date: Fri Sep 8 08:08:30 2017 -0400
9290
9291 mon/OSDMonitor: assume a minimum cluster size of 3
9292
9293 Signed-off-by: Sage Weil <sage@redhat.com>
9294 (cherry picked from commit 1010761e6ad392fcaa647ec0d1b3d071535adfb3)
9295
9296 commit f581731eaeb0f0c625f62928bf3724f8e705132c
9297 Author: Sage Weil <sage@redhat.com>
9298 Date: Fri Sep 1 14:45:12 2017 -0400
9299
9300 mon/OSDMonitor: prevent pg_num from exceeding mon_pg_warn_max_per_osd
9301
9302 Check total pg count for the cluster vs osd count and max pgs per osd
9303 before allowing pool creation, pg_num change, or pool size change.
9304
9305 "in" OSDs are the ones we distribute data too, so this should be the right
9306 count to use. (Whether they happen to be up or down at the moment is
9307 incidental.)
9308
9309 If the user really wants to create the pool, they can change the
9310 configurable limit.
9311
9312 Signed-off-by: Sage Weil <sage@redhat.com>
9313 (cherry picked from commit 3ea2e518d27e6c06182c2cb3d9c0b9a0dab8dd22)
9314
9315 commit acb2f280f03324e2ddb9d359e18ff2f0a3f897e6
9316 Author: Sage Weil <sage@redhat.com>
9317 Date: Wed Sep 6 11:41:07 2017 -0400
9318
9319 common/options: reduce mon_pg_warn_max_per_osd to 200
9320
9321 This is 2x the recommended target (100 per OSD).
9322
9323 Signed-off-by: Sage Weil <sage@redhat.com>
9324 (cherry picked from commit b7fa440a9802005c167f854e1d19f9dd4fa8dfff)
9325
9326 commit 119995a8f0ed70fb3e9efb5511576c44cfd6dbaa
9327 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9328 Date: Tue Sep 19 14:46:53 2017 +0200
9329
9330 rgw: rename the configurables for metadata limits to start with rgw_.
9331
9332 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9333 (cherry picked from commit 9b06985caec27fc102769e46799ca6608e80eb85)
9334
9335 commit 6080248f12e05a7478af1f8f31747da1aa9b881c
9336 Author: Radoslaw Zarzynski <rzarzyns@redhat.com>
9337 Date: Tue Aug 29 12:16:30 2017 +0200
9338
9339 rgw: return proper message when deleting non-empty Swift's container.
9340
9341 The bug that is fixed in this patch has been responsible for failing
9342 the Tempest's test_delete_non_empty_container test case.
9343
9344 The investigation has been made by: Marcus Watts <mwatts@redhat.com>.
9345
9346 Fixes: http://tracker.ceph.com/issues/21169
9347 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9348 (cherry picked from commit 308c8d3ab7e3e4978beccba2c27beb95e75cde22)
9349
9350 commit 71e37b1a10796ddfe786a2d389b0497ce1dc1bf4
9351 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9352 Date: Sun Nov 20 21:49:57 2016 +0100
9353
9354 rgw: seed::get_torrent_file returns errors in the usual way.
9355
9356 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9357 (cherry picked from commit 21ad80a1c237f8d243efaacd8218b29719a0a6b0)
9358
9359 commit 429f5e1d8b7ec114289ba45e7c896e264b15ec7c
9360 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9361 Date: Tue May 30 16:36:06 2017 +0200
9362
9363 rgw: add support for max_meta_count of Swift API's /info.
9364
9365 Fixes: http://tracker.ceph.com/issues/17934
9366 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9367 (cherry picked from commit 9e53c14a3398dfe55f6b816bb57c4b1b6d01c8ec)
9368
9369 commit 70e150cdfa108f469d85a27ad1a93952f71347e0
9370 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9371 Date: Tue May 30 22:19:33 2017 +0200
9372
9373 rgw: Swift API returns 400 Bad Request on too long container names.
9374
9375 Fixes: http://tracker.ceph.com/issues/17935
9376 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9377 (cherry picked from commit 1845e41292696da9e20ecd87b9260b44ee312aed)
9378
9379 commit 02c208a6b1ae335ab15c0fab3d9d6dba803037fa
9380 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9381 Date: Mon May 29 19:08:21 2017 +0200
9382
9383 rgw: honor custom rgw_err::message in Swift's error handling.
9384
9385 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9386 (cherry picked from commit e8516147d2926631fed98a793606bcbb0e6db9e1)
9387
9388 commit 912132b272dbf534e7594b40a78c5efcd51c9466
9389 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9390 Date: Mon May 29 18:02:23 2017 +0200
9391
9392 rgw: add support for max_meta_value_length of Swift API's /info.
9393
9394 Fixes: http://tracker.ceph.com/issues/17936
9395 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9396 (cherry picked from commit 06b1f25021924e0c55da0bc22216f31344735dfe)
9397
9398 commit cd219153978974a3711093912ca329ae5d1d997c
9399 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9400 Date: Mon Nov 21 19:34:48 2016 +0100
9401
9402 rgw: refactor rgw_get_request_metadata to reduce the number of dynallocs.
9403
9404 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9405 (cherry picked from commit 64b792326350c4c09ed5f829d082d4050bfb0408)
9406
9407 commit 4b82d1e25bf8f7be1915e7467cb822d5beea96a1
9408 Author: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9409 Date: Tue May 30 22:19:58 2017 +0200
9410
9411 rgw: add support for max_meta_name_length of Swift API's /info.
9412
9413 Fixes: http://tracker.ceph.com/issues/17938
9414 Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
9415 (cherry picked from commit 593d656dffd477943b8bd15153004d905b4b0d73)
9416
9417 commit fb7e6a581d063db10bb7e0cce4ae358068c7a2bd
9418 Author: Nathan Cutler <ncutler@suse.com>
9419 Date: Mon Sep 18 18:01:17 2017 +0200
9420
9421 tests: CentOS 7.4 is now the latest
9422
9423 Signed-off-by: Nathan Cutler <ncutler@suse.com>
9424 (cherry picked from commit 2311b64025cdb6131035aaf01e7c97486da12e15)
9425
9426 commit e25a583323a225dcfab0567c872247b33bf36f8f
9427 Author: xie xingguo <xie.xingguo@zte.com.cn>
9428 Date: Mon Sep 18 14:44:36 2017 +0800
9429
9430 osd/PrimaryLogPG: _delete_oid - fix incorrect 'legacy' flag
9431
9432 For pre-Luminous created objects, we shall default 'legacy' flag
9433 to true, so we can still create a snapdir object properly if necessary
9434 for Luminous backward compatibility.
9435
9436 Note that this patch is not going to land on master first
9437 (and hence can not be cherry-picked from master) because it will
9438 finally be deprecated by https://github.com/ceph/ceph/pull/17579,
9439 in which we are going to kill the snapdir object completely for Mimic.
9440
9441 Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
9442
9443 commit 5aa445897c293cae407454fadbbc47116a2cbe76
9444 Author: xie xingguo <xie.xingguo@zte.com.cn>
9445 Date: Sat Sep 16 10:04:56 2017 +0800
9446
9447 qa: fix pool-quota related tests
9448
9449 https://github.com/ceph/ceph/pull/17371 introduces support of
9450 per-pool space-full flag, which turns out to set both
9451 full and full_no_quota flags now if a pool is currently running out
9452 of quota.
9453
9454 Actually this test is fragile as long as we keep appending new flags
9455 at pool granularity, but let's not bother with that complexity now.
9456
9457 Fixes: http://tracker.ceph.com/issues/21409
9458 Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
9459 (cherry picked from commit 5dd3458eec7d6c56a71ee6f0fcdd45aa15a58ec7)
9460
9461 commit 00b44ecf4415710150e0646174174fbde0167f42
9462 Author: xie xingguo <xie.xingguo@zte.com.cn>
9463 Date: Mon Aug 28 15:51:28 2017 +0800
9464
9465 mon, osd: per pool space-full flag support
9466
9467 The newly introduced 'device-class' can be used to separate
9468 different type of devices into different pools, e.g, hdd-pool
9469 for backup data and all-flash-pool for DB applications.
9470
9471 However, if any osd of the cluster is currently running out
9472 of space (exceeding the predefined 'full' threshold), Ceph
9473 will mark the whole cluster as full and prevent writes to all pools,
9474 which turns out to be very wrong.
9475
9476 This patch instead makes the space 'full' control at pool granularity,
9477 which exactly leverages the pool quota logic but shall solve
9478 the above problem.
9479
9480 Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
9481 (cherry picked from commit b4ca5ae462c6f12ca48b787529938862646282cd)
9482
9483 Conflicts:
9484 slight confilicts in src/osd/OSDMap.h because
9485 e71626732452951ed9e6c489f15618424d15acf2 removed get_full_osd_util().
9486
9487 commit b064ed172a309aad4e8850110be4311466bf5894
9488 Author: Sage Weil <sage@redhat.com>
9489 Date: Thu Sep 14 10:02:33 2017 -0400
9490
9491 os/bluestore: repair 21089 on freelist init
9492
9493 Fix up the size inconsistency on freelist init. This way it will always
9494 happen after an upgrade... and before the user moves to something
9495 post-luminous.
9496
9497 Signed-off-by: Sage Weil <sage@redhat.com>
9498
9499 commit 1bf89aa3ce2f1fdb7979e536f6788c8dae275d47
9500 Author: Sage Weil <sage@redhat.com>
9501 Date: Thu Sep 14 10:01:25 2017 -0400
9502
9503 os/bluestore: fsck: remove fsck repair for 21089
9504
9505 This requires the user to run fsck, which they likely won't do.
9506
9507 Signed-off-by: Sage Weil <sage@redhat.com>
9508
9509 commit e9f143c681ab1a79b9c726cab55282d71ecfe1c7
9510 Author: Sage Weil <sage@redhat.com>
9511 Date: Wed Sep 13 23:03:07 2017 -0400
9512
9513 os/bluestore/KernelDevice: hack to inject bad device size
9514
9515 This conditionally reintroduces bug http://tracker.ceph.com/issues/21089,
9516 fixed by f6f1ae3724d593d3709d982c973ec18a25a47b6e, to aid in testing
9517 repair.
9518
9519 Signed-off-by: Sage Weil <sage@redhat.com>
9520
9521 commit 460268b5e9c9a77aae134049aa320977f02fc911
9522 Author: Patrick Donnelly <pdonnell@redhat.com>
9523 Date: Wed Aug 30 15:28:11 2017 -0700
9524
9525 ceph.in: validate service glob
9526
9527 Fixes: http://tracker.ceph.com/issues/21191
9528
9529 Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
9530 (cherry picked from commit 59bee1e7274934cebe0dcefd9fcedb6886a5e2d0)
9531
9532 commit 03e2a68e431eaa737b9e66c4d3b289e58d6cf19b
9533 Author: Nathan Cutler <ncutler@suse.com>
9534 Date: Wed Aug 30 10:17:31 2017 +0200
9535
9536 build/ops: python-numpy-devel build dependency for SUSE
9537
9538 Fixes: http://tracker.ceph.com/issues/21176
9539 Signed-off-by: Nathan Cutler <ncutler@suse.com>
9540 (cherry picked from commit 1586f2ca9ab94af85682945a3c7c7ebbd82c6e03)