1 pve-ha-manager (3.5.0) bullseye; urgency=medium
3 * env: datacenter config: include crs (cluster-resource-scheduling) setting
5 * manager: use static resource scheduler when configured
7 * manager: avoid scoring nodes if maintenance fallback node is valid
9 * manager: avoid scoring nodes when not trying next and current node is
12 * usage: static: use service count on nodes as a fallback
14 -- Proxmox Support Team <support@proxmox.com> Fri, 18 Nov 2022 15:02:55 +0100
16 pve-ha-manager (3.4.0) bullseye; urgency=medium
18 * switch to native version formatting
20 * fix accounting of online services when moving services due to their source
21 node going gracefully nonoperational (maintenance mode). This ensures a
22 better balance of services on the cluster after such an operation.
24 -- Proxmox Support Team <support@proxmox.com> Fri, 22 Jul 2022 09:21:20 +0200
26 pve-ha-manager (3.3-4) bullseye; urgency=medium
28 * lrm: fix getting stuck on restart due to finished worker state not
31 -- Proxmox Support Team <support@proxmox.com> Wed, 27 Apr 2022 14:01:55 +0200
33 pve-ha-manager (3.3-3) bullseye; urgency=medium
35 * lrm: avoid possible job starvation on huge workloads
37 * lrm: increase run_worker loop-time for doing actually work to 80%
40 -- Proxmox Support Team <support@proxmox.com> Thu, 20 Jan 2022 18:05:33 +0100
42 pve-ha-manager (3.3-2) bullseye; urgency=medium
44 * fix #3826: fix restarting LRM/CRM when triggered by package management
45 system due to other updates
47 * lrm: also check CRM node-status for determining if there's a fence-request
48 and avoid starting up in that case to ensure that the current manager can
49 get our lock and do a clean fence -> unknown -> online FSM transition.
50 This avoids a problematic edge case where an admin manually removed all
51 services of a to-be-fenced node, and re-added them again before the
52 manager could actually get that nodes LRM lock.
54 * manage: handle edge case where a node gets seemingly stuck in 'fence'
55 state if all its services got manually removed by an admin before the
56 fence transition could be finished. While the LRM could come up again in
57 previous versions (it won't now, see above point) and start/stop services
58 got executed, the node was seen as unavailable for all recovery,
59 relocation and migrate actions.
61 -- Proxmox Support Team <support@proxmox.com> Wed, 19 Jan 2022 14:30:15 +0100
63 pve-ha-manager (3.3-1) bullseye; urgency=medium
65 * LRM: release lock and close watchdog if no service configured for >10min
67 * manager: make recovery actual state in finite state machine, showing a
68 clear transition from fence -> reocvery.
70 * fix #3415: never switch in error state on recovery, try to find a new node
71 harder. This improves using the HA manager for services with local
72 resources (e.g., local storage) to ensure it always gets started, which is
73 an OK use-case as long as the service is restricted to a group with only
74 that node. Previously failure of that node would have a high possibility
75 of the service going into the errors state, as no new node can be found.
76 Now it will retry finding a new node, and if one of the restricted set,
77 e.g., the node it was previous on, comes back up, it will start again
80 * recovery: allow disabling a in-recovery service manually
82 -- Proxmox Support Team <support@proxmox.com> Fri, 02 Jul 2021 20:03:29 +0200
84 pve-ha-manager (3.2-2) bullseye; urgency=medium
86 * fix systemd service restart behavior on package upgrade with Debian
89 -- Proxmox Support Team <support@proxmox.com> Mon, 24 May 2021 11:38:42 +0200
91 pve-ha-manager (3.2-1) bullseye; urgency=medium
93 * Re-build for Debian Bullseye / PVE 7
95 -- Proxmox Support Team <support@proxmox.com> Wed, 12 May 2021 20:55:53 +0200
97 pve-ha-manager (3.1-1) pve; urgency=medium
99 * allow 'with-local-disks' migration for replicated guests
101 -- Proxmox Support Team <support@proxmox.com> Mon, 31 Aug 2020 10:52:23 +0200
103 pve-ha-manager (3.0-9) pve; urgency=medium
105 * factor out service configured/delete helpers
107 * typo and grammar fixes
109 -- Proxmox Support Team <support@proxmox.com> Thu, 12 Mar 2020 13:17:36 +0100
111 pve-ha-manager (3.0-8) pve; urgency=medium
113 * bump LRM stop wait time to an hour
115 * do not mark maintenaned nodes as unkown
117 * api/status: extra handling of maintenance mode
119 -- Proxmox Support Team <support@proxmox.com> Mon, 02 Dec 2019 10:33:03 +0100
121 pve-ha-manager (3.0-6) pve; urgency=medium
123 * add 'migrate' node shutdown policy
125 * do simple fallback if node comes back online from maintenance
127 * account service to both, source and target during migration
129 * add 'After' ordering for SSH and pveproxy to LRM service, ensuring the node
130 stays accessible until HA services got moved or shutdown, depending on
133 -- Proxmox Support Team <support@proxmox.com> Tue, 26 Nov 2019 18:03:26 +0100
135 pve-ha-manager (3.0-5) pve; urgency=medium
137 * fix #1339: remove more locks from services IF the node got fenced
139 * adapt to qemu-server code refactoring
141 -- Proxmox Support Team <support@proxmox.com> Wed, 20 Nov 2019 20:12:49 +0100
143 pve-ha-manager (3.0-4) pve; urgency=medium
145 * use PVE::DataCenterConfig from new split-out cluster library package
147 -- Proxmox Support Team <support@proxmox.com> Mon, 18 Nov 2019 12:16:29 +0100
149 pve-ha-manager (3.0-3) pve; urgency=medium
151 * fix #1919, #1920: improve handling zombie (without node) services
153 * fix # 2241: VM resource: allow migration with local device, when not running
155 * HA status: render removal transition of service as 'deleting'
157 * fix #1140: add crm command 'stop', which allows to request immediate
158 service hard-stops if a timeout of zero (0) is passed
160 -- Proxmox Support Team <support@proxmox.com> Mon, 11 Nov 2019 17:04:35 +0100
162 pve-ha-manager (3.0-2) pve; urgency=medium
164 * services: update PIDFile to point directly to /run
166 * fix #2234: fix typo in service description
168 * Add missing Dependencies to pve-ha-simulator
170 -- Proxmox Support Team <support@proxmox.com> Thu, 11 Jul 2019 19:26:03 +0200
172 pve-ha-manager (3.0-1) pve; urgency=medium
174 * handle the case where a node gets fully purged
176 * Re-build for Debian Buster / PVE 6
178 -- Proxmox Support Team <support@proxmox.com> Wed, 22 May 2019 19:11:59 +0200
180 pve-ha-manager (2.0-9) unstable; urgency=medium
182 * get_ha_settings: cope with (temporarily) unavailable pmxcfs
184 * lrm: exit on restart and agent lock lost for > 90s
186 * service data: only set failed_nodes key if needed
188 -- Proxmox Support Team <support@proxmox.com> Thu, 04 Apr 2019 16:27:32 +0200
190 pve-ha-manager (2.0-8) unstable; urgency=medium
192 * address an issue in dpkg 1.18 with wrong trigger cycle detections if cyclic
193 dependencies are involed
195 -- Proxmox Support Team <support@proxmox.com> Wed, 06 Mar 2019 07:49:58 +0100
197 pve-ha-manager (2.0-7) unstable; urgency=medium
199 * fix #1842: do not pass forceStop to CT shutdown
201 * fix #1602: allow one to delete ignored services over API
203 * fix #1891: Add zsh command completion for ha-manager CLI tools
205 * fix #1794: VM resource: catch qmp command exceptions
207 * show sent emails in regression tests
209 -- Proxmox Support Team <support@proxmox.com> Mon, 04 Mar 2019 10:37:25 +0100
211 pve-ha-manager (2.0-6) unstable; urgency=medium
213 * fix #1378: allow one to specify a service shutdown policy
215 * remove some unused external dependencies from the standalone simulator
218 * document api result for ha resources
220 -- Proxmox Support Team <support@proxmox.com> Mon, 07 Jan 2019 12:59:27 +0100
222 pve-ha-manager (2.0-5) unstable; urgency=medium
224 * skip CRM and LRM work if last cfs update failed
226 * regression test system: allow to simulate cluster fs failures
228 * postinst: drop transitional cleanup for systemd watchdog mux socket
230 -- Proxmox Support Team <support@proxmox.com> Wed, 07 Feb 2018 11:00:12 +0100
232 pve-ha-manager (2.0-4) unstable; urgency=medium
234 * address timing issues happening when pve-cluster.service is being restarted
236 -- Proxmox Support Team <support@proxmox.com> Thu, 09 Nov 2017 11:46:50 +0100
238 pve-ha-manager (2.0-3) unstable; urgency=medium
240 * add ignore state for resources
242 * lrm/crm service: restart on API changes
244 * lrm.service: do not timeout on stop
246 * fix #1347: let postfix fill in FQDN in fence mails
248 * fix #1073: do not count backup-suspended VMs as running
250 -- Proxmox Support Team <support@proxmox.com> Fri, 13 Oct 2017 11:10:51 +0200
252 pve-ha-manager (2.0-2) unstable; urgency=medium
254 * explicitly sync journal when disabling watchdog updates
256 * always queue service stop if node shuts down
258 * Fix shutdown order of HA and storage services
260 * Resource/API: abort early if resource in error state
262 -- Proxmox Support Team <support@proxmox.com> Wed, 14 Jun 2017 07:49:59 +0200
264 pve-ha-manager (2.0-1) unstable; urgency=medium
266 * rebuild for PVE 5.0 / Debian Stretch
268 -- Proxmox Support Team <support@proxmox.com> Mon, 13 Mar 2017 11:31:53 +0100
270 pve-ha-manager (1.0-40) unstable; urgency=medium
272 * ha-simulator: allow adding service on runtime
274 * ha-simulator: allow deleting service via GUI
276 * ha-simulator: allow new service request states over gui
278 * ha-simulator: use JSON instead of Dumper for manager status view
280 -- Proxmox Support Team <support@proxmox.com> Tue, 24 Jan 2017 10:03:07 +0100
282 pve-ha-manager (1.0-39) unstable; urgency=medium
284 * add setup_environment hook to CLIHandler class
286 * ha-simulator: fix typo s/Mode/Node/
288 * is_node_shutdown: check for correct systemd targets
290 * Simulator: fix scrolling to end of cluster log view
292 * Simulator: do not use cursor position to insert log
294 -- Proxmox Support Team <support@proxmox.com> Thu, 12 Jan 2017 13:15:08 +0100
296 pve-ha-manager (1.0-38) unstable; urgency=medium
300 -- Proxmox Support Team <support@proxmox.com> Wed, 23 Nov 2016 11:46:21 +0100
302 pve-ha-manager (1.0-37) unstable; urgency=medium
304 * HA::Status: provide better/faster feedback
306 * Manager.pm: store flag to indicate successful start
308 * ha status: include common service attributes
310 * Groups.pm: add verbose_description for 'restricted'
312 * Resources.pm: use verbose_description for state
314 * pve-ha-group-node-list: add verbose_description
316 * ha-manager: remove 'enabled' and 'disabled' commands
318 * rename request state 'enabled' to 'started'
320 * get_pve_lock: correctly send a lock update request
322 -- Proxmox Support Team <support@proxmox.com> Tue, 22 Nov 2016 17:04:57 +0100
324 pve-ha-manager (1.0-36) unstable; urgency=medium
326 * Resources: implement 'stopped' state
328 * ha-manager: remove obsolet pod content
330 * Fix #1189: correct spelling in fence mail
332 * API/Status: avoid using HA Environment
334 * factor out resource config check and default set code
336 -- Proxmox Support Team <support@proxmox.com> Tue, 15 Nov 2016 16:42:07 +0100
338 pve-ha-manager (1.0-35) unstable; urgency=medium
340 * change service state to error if no recovery node is available
342 * cleanup backup & mounted locks after recovery (fixes #1100)
344 * add possibility to simulate locks from services
346 * don't run regression test when building the simulator package
348 -- Proxmox Support Team <support@proxmox.com> Thu, 15 Sep 2016 13:23:00 +0200
350 pve-ha-manager (1.0-34) unstable; urgency=medium
352 * fix race condition on slow resource commands in started state
354 -- Proxmox Support Team <support@proxmox.com> Mon, 12 Sep 2016 13:07:05 +0200
356 pve-ha-manager (1.0-33) unstable; urgency=medium
358 * relocate policy: try to avoid already failed nodes
360 * allow empty json status files
362 * more regression tests
364 -- Proxmox Support Team <support@proxmox.com> Fri, 22 Jul 2016 12:16:48 +0200
366 pve-ha-manager (1.0-32) unstable; urgency=medium
368 * use correct verify function for ha-group-node-list
370 * send email on fence failure and success
372 -- Proxmox Support Team <support@proxmox.com> Wed, 15 Jun 2016 17:01:12 +0200
374 pve-ha-manager (1.0-31) unstable; urgency=medium
376 * selcet_service_node: include all online nodes in default group
378 * LRM: do not count erroneous service as active
380 * fix relocate/restart trial count leak on service deletion
382 -- Proxmox Support Team <support@proxmox.com> Fri, 06 May 2016 08:26:10 +0200
384 pve-ha-manager (1.0-30) unstable; urgency=medium
386 * Env: allow debug logging
388 -- Proxmox Support Team <support@proxmox.com> Fri, 29 Apr 2016 16:50:34 +0200
390 pve-ha-manager (1.0-29) unstable; urgency=medium
392 * Resources: deny setting nonexistent group
394 -- Proxmox Support Team <support@proxmox.com> Wed, 20 Apr 2016 18:22:28 +0200
396 pve-ha-manager (1.0-28) unstable; urgency=medium
398 * Config: add get_service_status method
400 -- Proxmox Support Team <support@proxmox.com> Tue, 19 Apr 2016 08:41:22 +0200
402 pve-ha-manager (1.0-27) unstable; urgency=medium
404 * use pve-doc-generator to generate man pages
406 -- Proxmox Support Team <support@proxmox.com> Fri, 08 Apr 2016 08:25:07 +0200
408 pve-ha-manager (1.0-26) unstable; urgency=medium
410 * status: show added but not yet active services
412 * status: mark CRM as idle if no service is configured
414 -- Proxmox Support Team <support@proxmox.com> Tue, 15 Mar 2016 12:49:18 +0100
416 pve-ha-manager (1.0-25) unstable; urgency=medium
418 * Use config_file from PVE::QemuConfig
420 -- Proxmox Support Team <support@proxmox.com> Tue, 08 Mar 2016 11:50:49 +0100
422 pve-ha-manager (1.0-24) unstable; urgency=medium
424 * simulator: install all virtual resources
426 -- Proxmox Support Team <support@proxmox.com> Wed, 02 Mar 2016 10:30:40 +0100
428 pve-ha-manager (1.0-23) unstable; urgency=medium
430 * fix infinite started <=> migrate cycle
432 * exec_resource_agent: process error state early
434 * avoid out of sync command execution in LRM
436 * do not pass ETRY_AGAIN back to the CRM
438 -- Proxmox Support Team <support@proxmox.com> Wed, 24 Feb 2016 12:15:21 +0100
440 pve-ha-manager (1.0-22) unstable; urgency=medium
442 * fix 'change_service_location' misuse and recovery from fencing
444 * add VirtFail resource and use it in new regression tests
446 * improve relocation policy code in manager and LRM
448 * improve verbosity of API status call
450 -- Proxmox Support Team <support@proxmox.com> Mon, 15 Feb 2016 10:57:44 +0100
452 pve-ha-manager (1.0-21) unstable; urgency=medium
454 * Fix postinstall script not removing watchdog-mux.socket
456 -- Proxmox Support Team <support@proxmox.com> Thu, 04 Feb 2016 18:23:47 +0100
458 pve-ha-manager (1.0-20) unstable; urgency=medium
460 * LRM: do not release lock on shutdown errors
462 * Split up resources and move them to own sub folder
464 * Add virtual resources for tests and simulation
466 * add after_fork method to HA environment and use it in LRM
468 -- Proxmox Support Team <support@proxmox.com> Wed, 27 Jan 2016 17:05:23 +0100
470 pve-ha-manager (1.0-19) unstable; urgency=medium
472 * remove 'running' from migrate/relocate log message
474 * LRM: release agent lock on graceful shutdown
476 * LRM: release agent lock also on restart
478 * CRM: release lock on shutdown request
480 * TestHardware: correct shutdown/reboot behaviour of CRM and LRM
482 * resource agents: fix relocate
484 -- Proxmox Support Team <support@proxmox.com> Mon, 18 Jan 2016 12:41:08 +0100
486 pve-ha-manager (1.0-18) unstable; urgency=medium
488 * pve-ha-lrm.service: depend on lxc.service
490 * output watchdog module name if it gets loaded
492 * remove watchdog-mux.socket
494 -- Proxmox Support Team <support@proxmox.com> Tue, 12 Jan 2016 12:27:49 +0100
496 pve-ha-manager (1.0-17) unstable; urgency=medium
498 * Resources.pm: use PVE::API2::LXC
500 -- Proxmox Support Team <support@proxmox.com> Mon, 11 Jan 2016 12:25:38 +0100
502 pve-ha-manager (1.0-16) unstable; urgency=medium
504 * check_active_workers: fix typo /uuid/uid/
506 -- Proxmox Support Team <support@proxmox.com> Mon, 21 Dec 2015 10:21:30 +0100
508 pve-ha-manager (1.0-15) unstable; urgency=medium
510 * stop all resources on node shutdown (instead of freeze)
512 -- Proxmox Support Team <support@proxmox.com> Wed, 16 Dec 2015 10:33:30 +0100
514 pve-ha-manager (1.0-14) unstable; urgency=medium
516 * allow to configure watchdog module in /etc/default/pve-ha-manager
518 -- Proxmox Support Team <support@proxmox.com> Thu, 03 Dec 2015 11:09:47 +0100
520 pve-ha-manager (1.0-13) unstable; urgency=medium
522 * HA API: Fix permissions
524 -- Proxmox Support Team <support@proxmox.com> Fri, 30 Oct 2015 11:16:50 +0100
526 pve-ha-manager (1.0-12) unstable; urgency=medium
528 * Adding constants to gain more readability
530 * exec_resource_agent: return valid exit code instead of die's
534 -- Proxmox Support Team <support@proxmox.com> Thu, 29 Oct 2015 10:21:49 +0100
536 pve-ha-manager (1.0-11) unstable; urgency=medium
538 * add workaround for bug #775
540 -- Proxmox Support Team <support@proxmox.com> Wed, 21 Oct 2015 08:58:41 +0200
542 pve-ha-manager (1.0-10) unstable; urgency=medium
544 * better resource status check on addition and update
546 -- Proxmox Support Team <support@proxmox.com> Mon, 12 Oct 2015 18:26:24 +0200
548 pve-ha-manager (1.0-9) unstable; urgency=medium
550 * delete node from CRM status when deleted from cluster
552 -- Proxmox Support Team <support@proxmox.com> Tue, 29 Sep 2015 07:35:30 +0200
554 pve-ha-manager (1.0-8) unstable; urgency=medium
556 * Use new lock domain sub instead of storage lock
558 -- Proxmox Support Team <support@proxmox.com> Sat, 26 Sep 2015 10:36:09 +0200
560 pve-ha-manager (1.0-7) unstable; urgency=medium
562 * enhance ha-managers group commands
564 * vm_is_ha_managed: allow check on service state
568 -- Proxmox Support Team <support@proxmox.com> Mon, 21 Sep 2015 12:17:41 +0200
570 pve-ha-manager (1.0-6) unstable; urgency=medium
572 * implement bash completion for ha-manager
574 * implement recovery policy for services
576 * simulator: fix random output of manager status
578 -- Proxmox Support Team <support@proxmox.com> Wed, 16 Sep 2015 12:06:12 +0200
580 pve-ha-manager (1.0-5) unstable; urgency=medium
582 * Replacing hardcoded qemu commands with plugin calls
584 * improve error state behaviour
586 -- Proxmox Support Team <support@proxmox.com> Tue, 08 Sep 2015 08:45:36 +0200
588 pve-ha-manager (1.0-4) unstable; urgency=medium
590 * groups: encode nodes as hash (internally)
592 * add trigger for pve-api-updates
594 -- Proxmox Support Team <support@proxmox.com> Tue, 16 Jun 2015 09:59:03 +0200
596 pve-ha-manager (1.0-3) unstable; urgency=medium
598 * CRM: do not start if there is no resource.cfg file to avoid warnings
600 -- Proxmox Support Team <support@proxmox.com> Tue, 09 Jun 2015 14:35:09 +0200
602 pve-ha-manager (1.0-2) unstable; urgency=medium
604 * use Wants instead of Requires inside systemd service definitions
606 -- Proxmox Support Team <support@proxmox.com> Tue, 09 Jun 2015 09:33:24 +0200
608 pve-ha-manager (1.0-1) unstable; urgency=medium
610 * enable/start crm and lrm services by default
612 -- Proxmox Support Team <support@proxmox.com> Fri, 05 Jun 2015 10:03:53 +0200
614 pve-ha-manager (0.9-3) unstable; urgency=medium
616 * regression test improvements
618 -- Proxmox Support Team <support@proxmox.com> Fri, 10 Apr 2015 06:53:23 +0200
620 pve-ha-manager (0.9-2) unstable; urgency=medium
622 * issue warning if ha group does not exist
624 -- Proxmox Support Team <support@proxmox.com> Tue, 07 Apr 2015 09:52:07 +0200
626 pve-ha-manager (0.9-1) unstable; urgency=medium
628 * rename vm resource prefix: pvevm: => vm:
630 * add API to query ha status
632 * allow to use simply VMIDs as resource id
636 -- Proxmox Support Team <support@proxmox.com> Fri, 03 Apr 2015 06:18:05 +0200
638 pve-ha-manager (0.8-2) unstable; urgency=medium
640 * lrm: reduce TimeoutStopSec to 95
642 * lrm: set systemd killmode to 'process'
644 -- Proxmox Support Team <support@proxmox.com> Thu, 02 Apr 2015 08:48:24 +0200
646 pve-ha-manager (0.8-1) unstable; urgency=medium
648 * currecrtly send cfs lock update request
650 -- Proxmox Support Team <support@proxmox.com> Thu, 02 Apr 2015 08:18:00 +0200
652 pve-ha-manager (0.7-1) unstable; urgency=medium
654 * create /etc/pve/ha automatically
656 * use correct package for lock_ha_config
658 * fix ha-manager status when ha is unconfigured
660 * do not unlink watchdog socket when started via systemd
664 -- Proxmox Support Team <support@proxmox.com> Wed, 01 Apr 2015 11:05:08 +0200
666 pve-ha-manager (0.6-1) unstable; urgency=medium
668 * move configuration handling into PVE::HA::Config
670 * ha-manager status: add --verbose flag
672 * depend on qemu-server
674 -- Proxmox Support Team <support@proxmox.com> Fri, 27 Mar 2015 12:28:50 +0100
676 pve-ha-manager (0.5-1) unstable; urgency=medium
678 * implement service migration
680 * fix service dependencies (allow restart, reboot)
682 * freeze services during reboot/restart
684 -- Proxmox Support Team <support@proxmox.com> Thu, 26 Mar 2015 13:22:58 +0100
686 pve-ha-manager (0.4-1) unstable; urgency=medium
688 * increase fence_delay to 60 seconds
690 * fix regression test environment
692 * fix failover after master crash with pending fence action
694 -- Proxmox Support Team <support@proxmox.com> Wed, 25 Mar 2015 13:59:28 +0100
696 pve-ha-manager (0.3-1) unstable; urgency=medium
698 * really activate softdog
700 * correctly count active services
702 * implement fence_delay to avoid immediate fencing
704 * pve-ha-simulator: reset watchdog with poweroff
706 * pve-ha-simulator: use option nofailback for default groups
708 -- Proxmox Support Team <support@proxmox.com> Mon, 16 Mar 2015 13:03:23 +0100
710 pve-ha-manager (0.2-1) unstable; urgency=medium
712 * add ha-manager command line tool
714 * start implementing resources and groups API
716 -- Proxmox Support Team <support@proxmox.com> Fri, 13 Mar 2015 09:26:12 +0100
718 pve-ha-manager (0.1-1) unstable; urgency=low
722 -- Proxmox Support Team <support@proxmox.com> Wed, 18 Feb 2015 11:30:21 +0100