1 pve-ha-manager (3.3-2) bullseye; urgency=medium
3 * fix #3826: fix restarting LRM/CRM when triggered by package management
4 system due to other updates
6 * lrm: also check CRM node-status for determining if there's a fence-request
7 and avoid starting up in that case to ensure that the current manager can
8 get our lock and do a clean fence -> unknown -> online FSM transition.
9 This avoids a problematic edge case where an admin manually removed all
10 services of a to-be-fenced node, and re-added them again before the
11 manager could actually get that nodes LRM lock.
13 * manage: handle edge case where a node gets seemingly stuck in 'fence'
14 state if all its services got manually removed by an admin before the
15 fence transition could be finished. While the LRM could come up again in
16 previous versions (it won't now, see above point) and start/stop services
17 got executed, the node was seen as unavailable for all recovery,
18 relocation and migrate actions.
20 -- Proxmox Support Team <support@proxmox.com> Wed, 19 Jan 2022 14:30:15 +0100
22 pve-ha-manager (3.3-1) bullseye; urgency=medium
24 * LRM: release lock and close watchdog if no service configured for >10min
26 * manager: make recovery actual state in finite state machine, showing a
27 clear transition from fence -> reocvery.
29 * fix #3415: never switch in error state on recovery, try to find a new node
30 harder. This improves using the HA manager for services with local
31 resources (e.g., local storage) to ensure it always gets started, which is
32 an OK use-case as long as the service is restricted to a group with only
33 that node. Previously failure of that node would have a high possibility
34 of the service going into the errors state, as no new node can be found.
35 Now it will retry finding a new node, and if one of the restricted set,
36 e.g., the node it was previous on, comes back up, it will start again
39 * recovery: allow disabling a in-recovery service manually
41 -- Proxmox Support Team <support@proxmox.com> Fri, 02 Jul 2021 20:03:29 +0200
43 pve-ha-manager (3.2-2) bullseye; urgency=medium
45 * fix systemd service restart behavior on package upgrade with Debian
48 -- Proxmox Support Team <support@proxmox.com> Mon, 24 May 2021 11:38:42 +0200
50 pve-ha-manager (3.2-1) bullseye; urgency=medium
52 * Re-build for Debian Bullseye / PVE 7
54 -- Proxmox Support Team <support@proxmox.com> Wed, 12 May 2021 20:55:53 +0200
56 pve-ha-manager (3.1-1) pve; urgency=medium
58 * allow 'with-local-disks' migration for replicated guests
60 -- Proxmox Support Team <support@proxmox.com> Mon, 31 Aug 2020 10:52:23 +0200
62 pve-ha-manager (3.0-9) pve; urgency=medium
64 * factor out service configured/delete helpers
66 * typo and grammar fixes
68 -- Proxmox Support Team <support@proxmox.com> Thu, 12 Mar 2020 13:17:36 +0100
70 pve-ha-manager (3.0-8) pve; urgency=medium
72 * bump LRM stop wait time to an hour
74 * do not mark maintenaned nodes as unkown
76 * api/status: extra handling of maintenance mode
78 -- Proxmox Support Team <support@proxmox.com> Mon, 02 Dec 2019 10:33:03 +0100
80 pve-ha-manager (3.0-6) pve; urgency=medium
82 * add 'migrate' node shutdown policy
84 * do simple fallback if node comes back online from maintenance
86 * account service to both, source and target during migration
88 * add 'After' ordering for SSH and pveproxy to LRM service, ensuring the node
89 stays accessible until HA services got moved or shutdown, depending on
92 -- Proxmox Support Team <support@proxmox.com> Tue, 26 Nov 2019 18:03:26 +0100
94 pve-ha-manager (3.0-5) pve; urgency=medium
96 * fix #1339: remove more locks from services IF the node got fenced
98 * adapt to qemu-server code refactoring
100 -- Proxmox Support Team <support@proxmox.com> Wed, 20 Nov 2019 20:12:49 +0100
102 pve-ha-manager (3.0-4) pve; urgency=medium
104 * use PVE::DataCenterConfig from new split-out cluster library package
106 -- Proxmox Support Team <support@proxmox.com> Mon, 18 Nov 2019 12:16:29 +0100
108 pve-ha-manager (3.0-3) pve; urgency=medium
110 * fix #1919, #1920: improve handling zombie (without node) services
112 * fix # 2241: VM resource: allow migration with local device, when not running
114 * HA status: render removal transition of service as 'deleting'
116 * fix #1140: add crm command 'stop', which allows to request immediate
117 service hard-stops if a timeout of zero (0) is passed
119 -- Proxmox Support Team <support@proxmox.com> Mon, 11 Nov 2019 17:04:35 +0100
121 pve-ha-manager (3.0-2) pve; urgency=medium
123 * services: update PIDFile to point directly to /run
125 * fix #2234: fix typo in service description
127 * Add missing Dependencies to pve-ha-simulator
129 -- Proxmox Support Team <support@proxmox.com> Thu, 11 Jul 2019 19:26:03 +0200
131 pve-ha-manager (3.0-1) pve; urgency=medium
133 * handle the case where a node gets fully purged
135 * Re-build for Debian Buster / PVE 6
137 -- Proxmox Support Team <support@proxmox.com> Wed, 22 May 2019 19:11:59 +0200
139 pve-ha-manager (2.0-9) unstable; urgency=medium
141 * get_ha_settings: cope with (temporarily) unavailable pmxcfs
143 * lrm: exit on restart and agent lock lost for > 90s
145 * service data: only set failed_nodes key if needed
147 -- Proxmox Support Team <support@proxmox.com> Thu, 04 Apr 2019 16:27:32 +0200
149 pve-ha-manager (2.0-8) unstable; urgency=medium
151 * address an issue in dpkg 1.18 with wrong trigger cycle detections if cyclic
152 dependencies are involed
154 -- Proxmox Support Team <support@proxmox.com> Wed, 06 Mar 2019 07:49:58 +0100
156 pve-ha-manager (2.0-7) unstable; urgency=medium
158 * fix #1842: do not pass forceStop to CT shutdown
160 * fix #1602: allow one to delete ignored services over API
162 * fix #1891: Add zsh command completion for ha-manager CLI tools
164 * fix #1794: VM resource: catch qmp command exceptions
166 * show sent emails in regression tests
168 -- Proxmox Support Team <support@proxmox.com> Mon, 04 Mar 2019 10:37:25 +0100
170 pve-ha-manager (2.0-6) unstable; urgency=medium
172 * fix #1378: allow one to specify a service shutdown policy
174 * remove some unused external dependencies from the standalone simulator
177 * document api result for ha resources
179 -- Proxmox Support Team <support@proxmox.com> Mon, 07 Jan 2019 12:59:27 +0100
181 pve-ha-manager (2.0-5) unstable; urgency=medium
183 * skip CRM and LRM work if last cfs update failed
185 * regression test system: allow to simulate cluster fs failures
187 * postinst: drop transitional cleanup for systemd watchdog mux socket
189 -- Proxmox Support Team <support@proxmox.com> Wed, 07 Feb 2018 11:00:12 +0100
191 pve-ha-manager (2.0-4) unstable; urgency=medium
193 * address timing issues happening when pve-cluster.service is being restarted
195 -- Proxmox Support Team <support@proxmox.com> Thu, 09 Nov 2017 11:46:50 +0100
197 pve-ha-manager (2.0-3) unstable; urgency=medium
199 * add ignore state for resources
201 * lrm/crm service: restart on API changes
203 * lrm.service: do not timeout on stop
205 * fix #1347: let postfix fill in FQDN in fence mails
207 * fix #1073: do not count backup-suspended VMs as running
209 -- Proxmox Support Team <support@proxmox.com> Fri, 13 Oct 2017 11:10:51 +0200
211 pve-ha-manager (2.0-2) unstable; urgency=medium
213 * explicitly sync journal when disabling watchdog updates
215 * always queue service stop if node shuts down
217 * Fix shutdown order of HA and storage services
219 * Resource/API: abort early if resource in error state
221 -- Proxmox Support Team <support@proxmox.com> Wed, 14 Jun 2017 07:49:59 +0200
223 pve-ha-manager (2.0-1) unstable; urgency=medium
225 * rebuild for PVE 5.0 / Debian Stretch
227 -- Proxmox Support Team <support@proxmox.com> Mon, 13 Mar 2017 11:31:53 +0100
229 pve-ha-manager (1.0-40) unstable; urgency=medium
231 * ha-simulator: allow adding service on runtime
233 * ha-simulator: allow deleting service via GUI
235 * ha-simulator: allow new service request states over gui
237 * ha-simulator: use JSON instead of Dumper for manager status view
239 -- Proxmox Support Team <support@proxmox.com> Tue, 24 Jan 2017 10:03:07 +0100
241 pve-ha-manager (1.0-39) unstable; urgency=medium
243 * add setup_environment hook to CLIHandler class
245 * ha-simulator: fix typo s/Mode/Node/
247 * is_node_shutdown: check for correct systemd targets
249 * Simulator: fix scrolling to end of cluster log view
251 * Simulator: do not use cursor position to insert log
253 -- Proxmox Support Team <support@proxmox.com> Thu, 12 Jan 2017 13:15:08 +0100
255 pve-ha-manager (1.0-38) unstable; urgency=medium
259 -- Proxmox Support Team <support@proxmox.com> Wed, 23 Nov 2016 11:46:21 +0100
261 pve-ha-manager (1.0-37) unstable; urgency=medium
263 * HA::Status: provide better/faster feedback
265 * Manager.pm: store flag to indicate successful start
267 * ha status: include common service attributes
269 * Groups.pm: add verbose_description for 'restricted'
271 * Resources.pm: use verbose_description for state
273 * pve-ha-group-node-list: add verbose_description
275 * ha-manager: remove 'enabled' and 'disabled' commands
277 * rename request state 'enabled' to 'started'
279 * get_pve_lock: correctly send a lock update request
281 -- Proxmox Support Team <support@proxmox.com> Tue, 22 Nov 2016 17:04:57 +0100
283 pve-ha-manager (1.0-36) unstable; urgency=medium
285 * Resources: implement 'stopped' state
287 * ha-manager: remove obsolet pod content
289 * Fix #1189: correct spelling in fence mail
291 * API/Status: avoid using HA Environment
293 * factor out resource config check and default set code
295 -- Proxmox Support Team <support@proxmox.com> Tue, 15 Nov 2016 16:42:07 +0100
297 pve-ha-manager (1.0-35) unstable; urgency=medium
299 * change service state to error if no recovery node is available
301 * cleanup backup & mounted locks after recovery (fixes #1100)
303 * add possibility to simulate locks from services
305 * don't run regression test when building the simulator package
307 -- Proxmox Support Team <support@proxmox.com> Thu, 15 Sep 2016 13:23:00 +0200
309 pve-ha-manager (1.0-34) unstable; urgency=medium
311 * fix race condition on slow resource commands in started state
313 -- Proxmox Support Team <support@proxmox.com> Mon, 12 Sep 2016 13:07:05 +0200
315 pve-ha-manager (1.0-33) unstable; urgency=medium
317 * relocate policy: try to avoid already failed nodes
319 * allow empty json status files
321 * more regression tests
323 -- Proxmox Support Team <support@proxmox.com> Fri, 22 Jul 2016 12:16:48 +0200
325 pve-ha-manager (1.0-32) unstable; urgency=medium
327 * use correct verify function for ha-group-node-list
329 * send email on fence failure and success
331 -- Proxmox Support Team <support@proxmox.com> Wed, 15 Jun 2016 17:01:12 +0200
333 pve-ha-manager (1.0-31) unstable; urgency=medium
335 * selcet_service_node: include all online nodes in default group
337 * LRM: do not count erroneous service as active
339 * fix relocate/restart trial count leak on service deletion
341 -- Proxmox Support Team <support@proxmox.com> Fri, 06 May 2016 08:26:10 +0200
343 pve-ha-manager (1.0-30) unstable; urgency=medium
345 * Env: allow debug logging
347 -- Proxmox Support Team <support@proxmox.com> Fri, 29 Apr 2016 16:50:34 +0200
349 pve-ha-manager (1.0-29) unstable; urgency=medium
351 * Resources: deny setting nonexistent group
353 -- Proxmox Support Team <support@proxmox.com> Wed, 20 Apr 2016 18:22:28 +0200
355 pve-ha-manager (1.0-28) unstable; urgency=medium
357 * Config: add get_service_status method
359 -- Proxmox Support Team <support@proxmox.com> Tue, 19 Apr 2016 08:41:22 +0200
361 pve-ha-manager (1.0-27) unstable; urgency=medium
363 * use pve-doc-generator to generate man pages
365 -- Proxmox Support Team <support@proxmox.com> Fri, 08 Apr 2016 08:25:07 +0200
367 pve-ha-manager (1.0-26) unstable; urgency=medium
369 * status: show added but not yet active services
371 * status: mark CRM as idle if no service is configured
373 -- Proxmox Support Team <support@proxmox.com> Tue, 15 Mar 2016 12:49:18 +0100
375 pve-ha-manager (1.0-25) unstable; urgency=medium
377 * Use config_file from PVE::QemuConfig
379 -- Proxmox Support Team <support@proxmox.com> Tue, 08 Mar 2016 11:50:49 +0100
381 pve-ha-manager (1.0-24) unstable; urgency=medium
383 * simulator: install all virtual resources
385 -- Proxmox Support Team <support@proxmox.com> Wed, 02 Mar 2016 10:30:40 +0100
387 pve-ha-manager (1.0-23) unstable; urgency=medium
389 * fix infinite started <=> migrate cycle
391 * exec_resource_agent: process error state early
393 * avoid out of sync command execution in LRM
395 * do not pass ETRY_AGAIN back to the CRM
397 -- Proxmox Support Team <support@proxmox.com> Wed, 24 Feb 2016 12:15:21 +0100
399 pve-ha-manager (1.0-22) unstable; urgency=medium
401 * fix 'change_service_location' misuse and recovery from fencing
403 * add VirtFail resource and use it in new regression tests
405 * improve relocation policy code in manager and LRM
407 * improve verbosity of API status call
409 -- Proxmox Support Team <support@proxmox.com> Mon, 15 Feb 2016 10:57:44 +0100
411 pve-ha-manager (1.0-21) unstable; urgency=medium
413 * Fix postinstall script not removing watchdog-mux.socket
415 -- Proxmox Support Team <support@proxmox.com> Thu, 04 Feb 2016 18:23:47 +0100
417 pve-ha-manager (1.0-20) unstable; urgency=medium
419 * LRM: do not release lock on shutdown errors
421 * Split up resources and move them to own sub folder
423 * Add virtual resources for tests and simulation
425 * add after_fork method to HA environment and use it in LRM
427 -- Proxmox Support Team <support@proxmox.com> Wed, 27 Jan 2016 17:05:23 +0100
429 pve-ha-manager (1.0-19) unstable; urgency=medium
431 * remove 'running' from migrate/relocate log message
433 * LRM: release agent lock on graceful shutdown
435 * LRM: release agent lock also on restart
437 * CRM: release lock on shutdown request
439 * TestHardware: correct shutdown/reboot behaviour of CRM and LRM
441 * resource agents: fix relocate
443 -- Proxmox Support Team <support@proxmox.com> Mon, 18 Jan 2016 12:41:08 +0100
445 pve-ha-manager (1.0-18) unstable; urgency=medium
447 * pve-ha-lrm.service: depend on lxc.service
449 * output watchdog module name if it gets loaded
451 * remove watchdog-mux.socket
453 -- Proxmox Support Team <support@proxmox.com> Tue, 12 Jan 2016 12:27:49 +0100
455 pve-ha-manager (1.0-17) unstable; urgency=medium
457 * Resources.pm: use PVE::API2::LXC
459 -- Proxmox Support Team <support@proxmox.com> Mon, 11 Jan 2016 12:25:38 +0100
461 pve-ha-manager (1.0-16) unstable; urgency=medium
463 * check_active_workers: fix typo /uuid/uid/
465 -- Proxmox Support Team <support@proxmox.com> Mon, 21 Dec 2015 10:21:30 +0100
467 pve-ha-manager (1.0-15) unstable; urgency=medium
469 * stop all resources on node shutdown (instead of freeze)
471 -- Proxmox Support Team <support@proxmox.com> Wed, 16 Dec 2015 10:33:30 +0100
473 pve-ha-manager (1.0-14) unstable; urgency=medium
475 * allow to configure watchdog module in /etc/default/pve-ha-manager
477 -- Proxmox Support Team <support@proxmox.com> Thu, 03 Dec 2015 11:09:47 +0100
479 pve-ha-manager (1.0-13) unstable; urgency=medium
481 * HA API: Fix permissions
483 -- Proxmox Support Team <support@proxmox.com> Fri, 30 Oct 2015 11:16:50 +0100
485 pve-ha-manager (1.0-12) unstable; urgency=medium
487 * Adding constants to gain more readability
489 * exec_resource_agent: return valid exit code instead of die's
493 -- Proxmox Support Team <support@proxmox.com> Thu, 29 Oct 2015 10:21:49 +0100
495 pve-ha-manager (1.0-11) unstable; urgency=medium
497 * add workaround for bug #775
499 -- Proxmox Support Team <support@proxmox.com> Wed, 21 Oct 2015 08:58:41 +0200
501 pve-ha-manager (1.0-10) unstable; urgency=medium
503 * better resource status check on addition and update
505 -- Proxmox Support Team <support@proxmox.com> Mon, 12 Oct 2015 18:26:24 +0200
507 pve-ha-manager (1.0-9) unstable; urgency=medium
509 * delete node from CRM status when deleted from cluster
511 -- Proxmox Support Team <support@proxmox.com> Tue, 29 Sep 2015 07:35:30 +0200
513 pve-ha-manager (1.0-8) unstable; urgency=medium
515 * Use new lock domain sub instead of storage lock
517 -- Proxmox Support Team <support@proxmox.com> Sat, 26 Sep 2015 10:36:09 +0200
519 pve-ha-manager (1.0-7) unstable; urgency=medium
521 * enhance ha-managers group commands
523 * vm_is_ha_managed: allow check on service state
527 -- Proxmox Support Team <support@proxmox.com> Mon, 21 Sep 2015 12:17:41 +0200
529 pve-ha-manager (1.0-6) unstable; urgency=medium
531 * implement bash completion for ha-manager
533 * implement recovery policy for services
535 * simulator: fix random output of manager status
537 -- Proxmox Support Team <support@proxmox.com> Wed, 16 Sep 2015 12:06:12 +0200
539 pve-ha-manager (1.0-5) unstable; urgency=medium
541 * Replacing hardcoded qemu commands with plugin calls
543 * improve error state behaviour
545 -- Proxmox Support Team <support@proxmox.com> Tue, 08 Sep 2015 08:45:36 +0200
547 pve-ha-manager (1.0-4) unstable; urgency=medium
549 * groups: encode nodes as hash (internally)
551 * add trigger for pve-api-updates
553 -- Proxmox Support Team <support@proxmox.com> Tue, 16 Jun 2015 09:59:03 +0200
555 pve-ha-manager (1.0-3) unstable; urgency=medium
557 * CRM: do not start if there is no resource.cfg file to avoid warnings
559 -- Proxmox Support Team <support@proxmox.com> Tue, 09 Jun 2015 14:35:09 +0200
561 pve-ha-manager (1.0-2) unstable; urgency=medium
563 * use Wants instead of Requires inside systemd service definitions
565 -- Proxmox Support Team <support@proxmox.com> Tue, 09 Jun 2015 09:33:24 +0200
567 pve-ha-manager (1.0-1) unstable; urgency=medium
569 * enable/start crm and lrm services by default
571 -- Proxmox Support Team <support@proxmox.com> Fri, 05 Jun 2015 10:03:53 +0200
573 pve-ha-manager (0.9-3) unstable; urgency=medium
575 * regression test improvements
577 -- Proxmox Support Team <support@proxmox.com> Fri, 10 Apr 2015 06:53:23 +0200
579 pve-ha-manager (0.9-2) unstable; urgency=medium
581 * issue warning if ha group does not exist
583 -- Proxmox Support Team <support@proxmox.com> Tue, 07 Apr 2015 09:52:07 +0200
585 pve-ha-manager (0.9-1) unstable; urgency=medium
587 * rename vm resource prefix: pvevm: => vm:
589 * add API to query ha status
591 * allow to use simply VMIDs as resource id
595 -- Proxmox Support Team <support@proxmox.com> Fri, 03 Apr 2015 06:18:05 +0200
597 pve-ha-manager (0.8-2) unstable; urgency=medium
599 * lrm: reduce TimeoutStopSec to 95
601 * lrm: set systemd killmode to 'process'
603 -- Proxmox Support Team <support@proxmox.com> Thu, 02 Apr 2015 08:48:24 +0200
605 pve-ha-manager (0.8-1) unstable; urgency=medium
607 * currecrtly send cfs lock update request
609 -- Proxmox Support Team <support@proxmox.com> Thu, 02 Apr 2015 08:18:00 +0200
611 pve-ha-manager (0.7-1) unstable; urgency=medium
613 * create /etc/pve/ha automatically
615 * use correct package for lock_ha_config
617 * fix ha-manager status when ha is unconfigured
619 * do not unlink watchdog socket when started via systemd
623 -- Proxmox Support Team <support@proxmox.com> Wed, 01 Apr 2015 11:05:08 +0200
625 pve-ha-manager (0.6-1) unstable; urgency=medium
627 * move configuration handling into PVE::HA::Config
629 * ha-manager status: add --verbose flag
631 * depend on qemu-server
633 -- Proxmox Support Team <support@proxmox.com> Fri, 27 Mar 2015 12:28:50 +0100
635 pve-ha-manager (0.5-1) unstable; urgency=medium
637 * implement service migration
639 * fix service dependencies (allow restart, reboot)
641 * freeze services during reboot/restart
643 -- Proxmox Support Team <support@proxmox.com> Thu, 26 Mar 2015 13:22:58 +0100
645 pve-ha-manager (0.4-1) unstable; urgency=medium
647 * increase fence_delay to 60 seconds
649 * fix regression test environment
651 * fix failover after master crash with pending fence action
653 -- Proxmox Support Team <support@proxmox.com> Wed, 25 Mar 2015 13:59:28 +0100
655 pve-ha-manager (0.3-1) unstable; urgency=medium
657 * really activate softdog
659 * correctly count active services
661 * implement fence_delay to avoid immediate fencing
663 * pve-ha-simulator: reset watchdog with poweroff
665 * pve-ha-simulator: use option nofailback for default groups
667 -- Proxmox Support Team <support@proxmox.com> Mon, 16 Mar 2015 13:03:23 +0100
669 pve-ha-manager (0.2-1) unstable; urgency=medium
671 * add ha-manager command line tool
673 * start implementing resources and groups API
675 -- Proxmox Support Team <support@proxmox.com> Fri, 13 Mar 2015 09:26:12 +0100
677 pve-ha-manager (0.1-1) unstable; urgency=low
681 -- Proxmox Support Team <support@proxmox.com> Wed, 18 Feb 2015 11:30:21 +0100