1 pve-ha-manager (3.4.0) bullseye; urgency=medium
3 * switch to native version formatting
5 * fix accounting of online services when moving services due to their source
6 node going gracefully nonoperational (maintenance mode). This ensures a
7 better balance of services on the cluster after such an operation.
9 -- Proxmox Support Team <support@proxmox.com> Fri, 22 Jul 2022 09:21:20 +0200
11 pve-ha-manager (3.3-4) bullseye; urgency=medium
13 * lrm: fix getting stuck on restart due to finished worker state not
16 -- Proxmox Support Team <support@proxmox.com> Wed, 27 Apr 2022 14:01:55 +0200
18 pve-ha-manager (3.3-3) bullseye; urgency=medium
20 * lrm: avoid possible job starvation on huge workloads
22 * lrm: increase run_worker loop-time for doing actually work to 80%
25 -- Proxmox Support Team <support@proxmox.com> Thu, 20 Jan 2022 18:05:33 +0100
27 pve-ha-manager (3.3-2) bullseye; urgency=medium
29 * fix #3826: fix restarting LRM/CRM when triggered by package management
30 system due to other updates
32 * lrm: also check CRM node-status for determining if there's a fence-request
33 and avoid starting up in that case to ensure that the current manager can
34 get our lock and do a clean fence -> unknown -> online FSM transition.
35 This avoids a problematic edge case where an admin manually removed all
36 services of a to-be-fenced node, and re-added them again before the
37 manager could actually get that nodes LRM lock.
39 * manage: handle edge case where a node gets seemingly stuck in 'fence'
40 state if all its services got manually removed by an admin before the
41 fence transition could be finished. While the LRM could come up again in
42 previous versions (it won't now, see above point) and start/stop services
43 got executed, the node was seen as unavailable for all recovery,
44 relocation and migrate actions.
46 -- Proxmox Support Team <support@proxmox.com> Wed, 19 Jan 2022 14:30:15 +0100
48 pve-ha-manager (3.3-1) bullseye; urgency=medium
50 * LRM: release lock and close watchdog if no service configured for >10min
52 * manager: make recovery actual state in finite state machine, showing a
53 clear transition from fence -> reocvery.
55 * fix #3415: never switch in error state on recovery, try to find a new node
56 harder. This improves using the HA manager for services with local
57 resources (e.g., local storage) to ensure it always gets started, which is
58 an OK use-case as long as the service is restricted to a group with only
59 that node. Previously failure of that node would have a high possibility
60 of the service going into the errors state, as no new node can be found.
61 Now it will retry finding a new node, and if one of the restricted set,
62 e.g., the node it was previous on, comes back up, it will start again
65 * recovery: allow disabling a in-recovery service manually
67 -- Proxmox Support Team <support@proxmox.com> Fri, 02 Jul 2021 20:03:29 +0200
69 pve-ha-manager (3.2-2) bullseye; urgency=medium
71 * fix systemd service restart behavior on package upgrade with Debian
74 -- Proxmox Support Team <support@proxmox.com> Mon, 24 May 2021 11:38:42 +0200
76 pve-ha-manager (3.2-1) bullseye; urgency=medium
78 * Re-build for Debian Bullseye / PVE 7
80 -- Proxmox Support Team <support@proxmox.com> Wed, 12 May 2021 20:55:53 +0200
82 pve-ha-manager (3.1-1) pve; urgency=medium
84 * allow 'with-local-disks' migration for replicated guests
86 -- Proxmox Support Team <support@proxmox.com> Mon, 31 Aug 2020 10:52:23 +0200
88 pve-ha-manager (3.0-9) pve; urgency=medium
90 * factor out service configured/delete helpers
92 * typo and grammar fixes
94 -- Proxmox Support Team <support@proxmox.com> Thu, 12 Mar 2020 13:17:36 +0100
96 pve-ha-manager (3.0-8) pve; urgency=medium
98 * bump LRM stop wait time to an hour
100 * do not mark maintenaned nodes as unkown
102 * api/status: extra handling of maintenance mode
104 -- Proxmox Support Team <support@proxmox.com> Mon, 02 Dec 2019 10:33:03 +0100
106 pve-ha-manager (3.0-6) pve; urgency=medium
108 * add 'migrate' node shutdown policy
110 * do simple fallback if node comes back online from maintenance
112 * account service to both, source and target during migration
114 * add 'After' ordering for SSH and pveproxy to LRM service, ensuring the node
115 stays accessible until HA services got moved or shutdown, depending on
118 -- Proxmox Support Team <support@proxmox.com> Tue, 26 Nov 2019 18:03:26 +0100
120 pve-ha-manager (3.0-5) pve; urgency=medium
122 * fix #1339: remove more locks from services IF the node got fenced
124 * adapt to qemu-server code refactoring
126 -- Proxmox Support Team <support@proxmox.com> Wed, 20 Nov 2019 20:12:49 +0100
128 pve-ha-manager (3.0-4) pve; urgency=medium
130 * use PVE::DataCenterConfig from new split-out cluster library package
132 -- Proxmox Support Team <support@proxmox.com> Mon, 18 Nov 2019 12:16:29 +0100
134 pve-ha-manager (3.0-3) pve; urgency=medium
136 * fix #1919, #1920: improve handling zombie (without node) services
138 * fix # 2241: VM resource: allow migration with local device, when not running
140 * HA status: render removal transition of service as 'deleting'
142 * fix #1140: add crm command 'stop', which allows to request immediate
143 service hard-stops if a timeout of zero (0) is passed
145 -- Proxmox Support Team <support@proxmox.com> Mon, 11 Nov 2019 17:04:35 +0100
147 pve-ha-manager (3.0-2) pve; urgency=medium
149 * services: update PIDFile to point directly to /run
151 * fix #2234: fix typo in service description
153 * Add missing Dependencies to pve-ha-simulator
155 -- Proxmox Support Team <support@proxmox.com> Thu, 11 Jul 2019 19:26:03 +0200
157 pve-ha-manager (3.0-1) pve; urgency=medium
159 * handle the case where a node gets fully purged
161 * Re-build for Debian Buster / PVE 6
163 -- Proxmox Support Team <support@proxmox.com> Wed, 22 May 2019 19:11:59 +0200
165 pve-ha-manager (2.0-9) unstable; urgency=medium
167 * get_ha_settings: cope with (temporarily) unavailable pmxcfs
169 * lrm: exit on restart and agent lock lost for > 90s
171 * service data: only set failed_nodes key if needed
173 -- Proxmox Support Team <support@proxmox.com> Thu, 04 Apr 2019 16:27:32 +0200
175 pve-ha-manager (2.0-8) unstable; urgency=medium
177 * address an issue in dpkg 1.18 with wrong trigger cycle detections if cyclic
178 dependencies are involed
180 -- Proxmox Support Team <support@proxmox.com> Wed, 06 Mar 2019 07:49:58 +0100
182 pve-ha-manager (2.0-7) unstable; urgency=medium
184 * fix #1842: do not pass forceStop to CT shutdown
186 * fix #1602: allow one to delete ignored services over API
188 * fix #1891: Add zsh command completion for ha-manager CLI tools
190 * fix #1794: VM resource: catch qmp command exceptions
192 * show sent emails in regression tests
194 -- Proxmox Support Team <support@proxmox.com> Mon, 04 Mar 2019 10:37:25 +0100
196 pve-ha-manager (2.0-6) unstable; urgency=medium
198 * fix #1378: allow one to specify a service shutdown policy
200 * remove some unused external dependencies from the standalone simulator
203 * document api result for ha resources
205 -- Proxmox Support Team <support@proxmox.com> Mon, 07 Jan 2019 12:59:27 +0100
207 pve-ha-manager (2.0-5) unstable; urgency=medium
209 * skip CRM and LRM work if last cfs update failed
211 * regression test system: allow to simulate cluster fs failures
213 * postinst: drop transitional cleanup for systemd watchdog mux socket
215 -- Proxmox Support Team <support@proxmox.com> Wed, 07 Feb 2018 11:00:12 +0100
217 pve-ha-manager (2.0-4) unstable; urgency=medium
219 * address timing issues happening when pve-cluster.service is being restarted
221 -- Proxmox Support Team <support@proxmox.com> Thu, 09 Nov 2017 11:46:50 +0100
223 pve-ha-manager (2.0-3) unstable; urgency=medium
225 * add ignore state for resources
227 * lrm/crm service: restart on API changes
229 * lrm.service: do not timeout on stop
231 * fix #1347: let postfix fill in FQDN in fence mails
233 * fix #1073: do not count backup-suspended VMs as running
235 -- Proxmox Support Team <support@proxmox.com> Fri, 13 Oct 2017 11:10:51 +0200
237 pve-ha-manager (2.0-2) unstable; urgency=medium
239 * explicitly sync journal when disabling watchdog updates
241 * always queue service stop if node shuts down
243 * Fix shutdown order of HA and storage services
245 * Resource/API: abort early if resource in error state
247 -- Proxmox Support Team <support@proxmox.com> Wed, 14 Jun 2017 07:49:59 +0200
249 pve-ha-manager (2.0-1) unstable; urgency=medium
251 * rebuild for PVE 5.0 / Debian Stretch
253 -- Proxmox Support Team <support@proxmox.com> Mon, 13 Mar 2017 11:31:53 +0100
255 pve-ha-manager (1.0-40) unstable; urgency=medium
257 * ha-simulator: allow adding service on runtime
259 * ha-simulator: allow deleting service via GUI
261 * ha-simulator: allow new service request states over gui
263 * ha-simulator: use JSON instead of Dumper for manager status view
265 -- Proxmox Support Team <support@proxmox.com> Tue, 24 Jan 2017 10:03:07 +0100
267 pve-ha-manager (1.0-39) unstable; urgency=medium
269 * add setup_environment hook to CLIHandler class
271 * ha-simulator: fix typo s/Mode/Node/
273 * is_node_shutdown: check for correct systemd targets
275 * Simulator: fix scrolling to end of cluster log view
277 * Simulator: do not use cursor position to insert log
279 -- Proxmox Support Team <support@proxmox.com> Thu, 12 Jan 2017 13:15:08 +0100
281 pve-ha-manager (1.0-38) unstable; urgency=medium
285 -- Proxmox Support Team <support@proxmox.com> Wed, 23 Nov 2016 11:46:21 +0100
287 pve-ha-manager (1.0-37) unstable; urgency=medium
289 * HA::Status: provide better/faster feedback
291 * Manager.pm: store flag to indicate successful start
293 * ha status: include common service attributes
295 * Groups.pm: add verbose_description for 'restricted'
297 * Resources.pm: use verbose_description for state
299 * pve-ha-group-node-list: add verbose_description
301 * ha-manager: remove 'enabled' and 'disabled' commands
303 * rename request state 'enabled' to 'started'
305 * get_pve_lock: correctly send a lock update request
307 -- Proxmox Support Team <support@proxmox.com> Tue, 22 Nov 2016 17:04:57 +0100
309 pve-ha-manager (1.0-36) unstable; urgency=medium
311 * Resources: implement 'stopped' state
313 * ha-manager: remove obsolet pod content
315 * Fix #1189: correct spelling in fence mail
317 * API/Status: avoid using HA Environment
319 * factor out resource config check and default set code
321 -- Proxmox Support Team <support@proxmox.com> Tue, 15 Nov 2016 16:42:07 +0100
323 pve-ha-manager (1.0-35) unstable; urgency=medium
325 * change service state to error if no recovery node is available
327 * cleanup backup & mounted locks after recovery (fixes #1100)
329 * add possibility to simulate locks from services
331 * don't run regression test when building the simulator package
333 -- Proxmox Support Team <support@proxmox.com> Thu, 15 Sep 2016 13:23:00 +0200
335 pve-ha-manager (1.0-34) unstable; urgency=medium
337 * fix race condition on slow resource commands in started state
339 -- Proxmox Support Team <support@proxmox.com> Mon, 12 Sep 2016 13:07:05 +0200
341 pve-ha-manager (1.0-33) unstable; urgency=medium
343 * relocate policy: try to avoid already failed nodes
345 * allow empty json status files
347 * more regression tests
349 -- Proxmox Support Team <support@proxmox.com> Fri, 22 Jul 2016 12:16:48 +0200
351 pve-ha-manager (1.0-32) unstable; urgency=medium
353 * use correct verify function for ha-group-node-list
355 * send email on fence failure and success
357 -- Proxmox Support Team <support@proxmox.com> Wed, 15 Jun 2016 17:01:12 +0200
359 pve-ha-manager (1.0-31) unstable; urgency=medium
361 * selcet_service_node: include all online nodes in default group
363 * LRM: do not count erroneous service as active
365 * fix relocate/restart trial count leak on service deletion
367 -- Proxmox Support Team <support@proxmox.com> Fri, 06 May 2016 08:26:10 +0200
369 pve-ha-manager (1.0-30) unstable; urgency=medium
371 * Env: allow debug logging
373 -- Proxmox Support Team <support@proxmox.com> Fri, 29 Apr 2016 16:50:34 +0200
375 pve-ha-manager (1.0-29) unstable; urgency=medium
377 * Resources: deny setting nonexistent group
379 -- Proxmox Support Team <support@proxmox.com> Wed, 20 Apr 2016 18:22:28 +0200
381 pve-ha-manager (1.0-28) unstable; urgency=medium
383 * Config: add get_service_status method
385 -- Proxmox Support Team <support@proxmox.com> Tue, 19 Apr 2016 08:41:22 +0200
387 pve-ha-manager (1.0-27) unstable; urgency=medium
389 * use pve-doc-generator to generate man pages
391 -- Proxmox Support Team <support@proxmox.com> Fri, 08 Apr 2016 08:25:07 +0200
393 pve-ha-manager (1.0-26) unstable; urgency=medium
395 * status: show added but not yet active services
397 * status: mark CRM as idle if no service is configured
399 -- Proxmox Support Team <support@proxmox.com> Tue, 15 Mar 2016 12:49:18 +0100
401 pve-ha-manager (1.0-25) unstable; urgency=medium
403 * Use config_file from PVE::QemuConfig
405 -- Proxmox Support Team <support@proxmox.com> Tue, 08 Mar 2016 11:50:49 +0100
407 pve-ha-manager (1.0-24) unstable; urgency=medium
409 * simulator: install all virtual resources
411 -- Proxmox Support Team <support@proxmox.com> Wed, 02 Mar 2016 10:30:40 +0100
413 pve-ha-manager (1.0-23) unstable; urgency=medium
415 * fix infinite started <=> migrate cycle
417 * exec_resource_agent: process error state early
419 * avoid out of sync command execution in LRM
421 * do not pass ETRY_AGAIN back to the CRM
423 -- Proxmox Support Team <support@proxmox.com> Wed, 24 Feb 2016 12:15:21 +0100
425 pve-ha-manager (1.0-22) unstable; urgency=medium
427 * fix 'change_service_location' misuse and recovery from fencing
429 * add VirtFail resource and use it in new regression tests
431 * improve relocation policy code in manager and LRM
433 * improve verbosity of API status call
435 -- Proxmox Support Team <support@proxmox.com> Mon, 15 Feb 2016 10:57:44 +0100
437 pve-ha-manager (1.0-21) unstable; urgency=medium
439 * Fix postinstall script not removing watchdog-mux.socket
441 -- Proxmox Support Team <support@proxmox.com> Thu, 04 Feb 2016 18:23:47 +0100
443 pve-ha-manager (1.0-20) unstable; urgency=medium
445 * LRM: do not release lock on shutdown errors
447 * Split up resources and move them to own sub folder
449 * Add virtual resources for tests and simulation
451 * add after_fork method to HA environment and use it in LRM
453 -- Proxmox Support Team <support@proxmox.com> Wed, 27 Jan 2016 17:05:23 +0100
455 pve-ha-manager (1.0-19) unstable; urgency=medium
457 * remove 'running' from migrate/relocate log message
459 * LRM: release agent lock on graceful shutdown
461 * LRM: release agent lock also on restart
463 * CRM: release lock on shutdown request
465 * TestHardware: correct shutdown/reboot behaviour of CRM and LRM
467 * resource agents: fix relocate
469 -- Proxmox Support Team <support@proxmox.com> Mon, 18 Jan 2016 12:41:08 +0100
471 pve-ha-manager (1.0-18) unstable; urgency=medium
473 * pve-ha-lrm.service: depend on lxc.service
475 * output watchdog module name if it gets loaded
477 * remove watchdog-mux.socket
479 -- Proxmox Support Team <support@proxmox.com> Tue, 12 Jan 2016 12:27:49 +0100
481 pve-ha-manager (1.0-17) unstable; urgency=medium
483 * Resources.pm: use PVE::API2::LXC
485 -- Proxmox Support Team <support@proxmox.com> Mon, 11 Jan 2016 12:25:38 +0100
487 pve-ha-manager (1.0-16) unstable; urgency=medium
489 * check_active_workers: fix typo /uuid/uid/
491 -- Proxmox Support Team <support@proxmox.com> Mon, 21 Dec 2015 10:21:30 +0100
493 pve-ha-manager (1.0-15) unstable; urgency=medium
495 * stop all resources on node shutdown (instead of freeze)
497 -- Proxmox Support Team <support@proxmox.com> Wed, 16 Dec 2015 10:33:30 +0100
499 pve-ha-manager (1.0-14) unstable; urgency=medium
501 * allow to configure watchdog module in /etc/default/pve-ha-manager
503 -- Proxmox Support Team <support@proxmox.com> Thu, 03 Dec 2015 11:09:47 +0100
505 pve-ha-manager (1.0-13) unstable; urgency=medium
507 * HA API: Fix permissions
509 -- Proxmox Support Team <support@proxmox.com> Fri, 30 Oct 2015 11:16:50 +0100
511 pve-ha-manager (1.0-12) unstable; urgency=medium
513 * Adding constants to gain more readability
515 * exec_resource_agent: return valid exit code instead of die's
519 -- Proxmox Support Team <support@proxmox.com> Thu, 29 Oct 2015 10:21:49 +0100
521 pve-ha-manager (1.0-11) unstable; urgency=medium
523 * add workaround for bug #775
525 -- Proxmox Support Team <support@proxmox.com> Wed, 21 Oct 2015 08:58:41 +0200
527 pve-ha-manager (1.0-10) unstable; urgency=medium
529 * better resource status check on addition and update
531 -- Proxmox Support Team <support@proxmox.com> Mon, 12 Oct 2015 18:26:24 +0200
533 pve-ha-manager (1.0-9) unstable; urgency=medium
535 * delete node from CRM status when deleted from cluster
537 -- Proxmox Support Team <support@proxmox.com> Tue, 29 Sep 2015 07:35:30 +0200
539 pve-ha-manager (1.0-8) unstable; urgency=medium
541 * Use new lock domain sub instead of storage lock
543 -- Proxmox Support Team <support@proxmox.com> Sat, 26 Sep 2015 10:36:09 +0200
545 pve-ha-manager (1.0-7) unstable; urgency=medium
547 * enhance ha-managers group commands
549 * vm_is_ha_managed: allow check on service state
553 -- Proxmox Support Team <support@proxmox.com> Mon, 21 Sep 2015 12:17:41 +0200
555 pve-ha-manager (1.0-6) unstable; urgency=medium
557 * implement bash completion for ha-manager
559 * implement recovery policy for services
561 * simulator: fix random output of manager status
563 -- Proxmox Support Team <support@proxmox.com> Wed, 16 Sep 2015 12:06:12 +0200
565 pve-ha-manager (1.0-5) unstable; urgency=medium
567 * Replacing hardcoded qemu commands with plugin calls
569 * improve error state behaviour
571 -- Proxmox Support Team <support@proxmox.com> Tue, 08 Sep 2015 08:45:36 +0200
573 pve-ha-manager (1.0-4) unstable; urgency=medium
575 * groups: encode nodes as hash (internally)
577 * add trigger for pve-api-updates
579 -- Proxmox Support Team <support@proxmox.com> Tue, 16 Jun 2015 09:59:03 +0200
581 pve-ha-manager (1.0-3) unstable; urgency=medium
583 * CRM: do not start if there is no resource.cfg file to avoid warnings
585 -- Proxmox Support Team <support@proxmox.com> Tue, 09 Jun 2015 14:35:09 +0200
587 pve-ha-manager (1.0-2) unstable; urgency=medium
589 * use Wants instead of Requires inside systemd service definitions
591 -- Proxmox Support Team <support@proxmox.com> Tue, 09 Jun 2015 09:33:24 +0200
593 pve-ha-manager (1.0-1) unstable; urgency=medium
595 * enable/start crm and lrm services by default
597 -- Proxmox Support Team <support@proxmox.com> Fri, 05 Jun 2015 10:03:53 +0200
599 pve-ha-manager (0.9-3) unstable; urgency=medium
601 * regression test improvements
603 -- Proxmox Support Team <support@proxmox.com> Fri, 10 Apr 2015 06:53:23 +0200
605 pve-ha-manager (0.9-2) unstable; urgency=medium
607 * issue warning if ha group does not exist
609 -- Proxmox Support Team <support@proxmox.com> Tue, 07 Apr 2015 09:52:07 +0200
611 pve-ha-manager (0.9-1) unstable; urgency=medium
613 * rename vm resource prefix: pvevm: => vm:
615 * add API to query ha status
617 * allow to use simply VMIDs as resource id
621 -- Proxmox Support Team <support@proxmox.com> Fri, 03 Apr 2015 06:18:05 +0200
623 pve-ha-manager (0.8-2) unstable; urgency=medium
625 * lrm: reduce TimeoutStopSec to 95
627 * lrm: set systemd killmode to 'process'
629 -- Proxmox Support Team <support@proxmox.com> Thu, 02 Apr 2015 08:48:24 +0200
631 pve-ha-manager (0.8-1) unstable; urgency=medium
633 * currecrtly send cfs lock update request
635 -- Proxmox Support Team <support@proxmox.com> Thu, 02 Apr 2015 08:18:00 +0200
637 pve-ha-manager (0.7-1) unstable; urgency=medium
639 * create /etc/pve/ha automatically
641 * use correct package for lock_ha_config
643 * fix ha-manager status when ha is unconfigured
645 * do not unlink watchdog socket when started via systemd
649 -- Proxmox Support Team <support@proxmox.com> Wed, 01 Apr 2015 11:05:08 +0200
651 pve-ha-manager (0.6-1) unstable; urgency=medium
653 * move configuration handling into PVE::HA::Config
655 * ha-manager status: add --verbose flag
657 * depend on qemu-server
659 -- Proxmox Support Team <support@proxmox.com> Fri, 27 Mar 2015 12:28:50 +0100
661 pve-ha-manager (0.5-1) unstable; urgency=medium
663 * implement service migration
665 * fix service dependencies (allow restart, reboot)
667 * freeze services during reboot/restart
669 -- Proxmox Support Team <support@proxmox.com> Thu, 26 Mar 2015 13:22:58 +0100
671 pve-ha-manager (0.4-1) unstable; urgency=medium
673 * increase fence_delay to 60 seconds
675 * fix regression test environment
677 * fix failover after master crash with pending fence action
679 -- Proxmox Support Team <support@proxmox.com> Wed, 25 Mar 2015 13:59:28 +0100
681 pve-ha-manager (0.3-1) unstable; urgency=medium
683 * really activate softdog
685 * correctly count active services
687 * implement fence_delay to avoid immediate fencing
689 * pve-ha-simulator: reset watchdog with poweroff
691 * pve-ha-simulator: use option nofailback for default groups
693 -- Proxmox Support Team <support@proxmox.com> Mon, 16 Mar 2015 13:03:23 +0100
695 pve-ha-manager (0.2-1) unstable; urgency=medium
697 * add ha-manager command line tool
699 * start implementing resources and groups API
701 -- Proxmox Support Team <support@proxmox.com> Fri, 13 Mar 2015 09:26:12 +0100
703 pve-ha-manager (0.1-1) unstable; urgency=low
707 -- Proxmox Support Team <support@proxmox.com> Wed, 18 Feb 2015 11:30:21 +0100