]>
git.proxmox.com Git - pve-storage.git/log
Wolfgang Bumiller [Tue, 23 May 2017 07:04:47 +0000 (09:04 +0200)]
migrate: replace target ip parameter with sshinfo parameter
Wolfgang Bumiller [Mon, 22 May 2017 08:16:21 +0000 (10:16 +0200)]
migrate: snapshot parameter for use with replication
Fabian Grünbichler [Fri, 12 May 2017 13:01:08 +0000 (15:01 +0200)]
migrate: cleanup: $free is always defined
Wolfgang Bumiller [Fri, 12 May 2017 09:56:11 +0000 (11:56 +0200)]
migrate: query transfer stream formats
Wolfgang Bumiller [Fri, 12 May 2017 09:56:10 +0000 (11:56 +0200)]
api: add import/export format querying
Wolfgang Bumiller [Fri, 12 May 2017 09:56:09 +0000 (11:56 +0200)]
migrate: snapshot parameter for incremental transfer
Wolfgang Bumiller [Fri, 12 May 2017 09:56:08 +0000 (11:56 +0200)]
migrate: use pvesm import/export for zfs
The only leftover zfs specific part here is the zfs format
type parameter.
Wolfgang Bumiller [Fri, 12 May 2017 09:56:07 +0000 (11:56 +0200)]
free: added snapshot parameter
Wolfgang Bumiller [Fri, 12 May 2017 09:56:06 +0000 (11:56 +0200)]
pvesm: import/export commands
Dietmar Maurer [Wed, 10 May 2017 05:20:00 +0000 (07:20 +0200)]
Revert "Include incremental zfs send in storage_migrate."
This reverts commit
4537523b5af8846a6de659e718ab1a81db882e1b .
We want to use send/receive for this - patch will follow.
Dietmar Maurer [Wed, 10 May 2017 05:06:35 +0000 (07:06 +0200)]
do not install replication code
The code introduces a cyclic package dependency, so we need to
move it to pve-manager package.
Dietmar Maurer [Wed, 10 May 2017 05:02:42 +0000 (07:02 +0200)]
volume_snapshot_list: remove $ip parameter
We want to handle ssh connections somewhere else (not inside the
storage plugins).
Dietmar Maurer [Wed, 10 May 2017 04:58:44 +0000 (06:58 +0200)]
Revert "Include new storage function volume_send."
This reverts commit
b76774e57fe66a483a7544ec5a05ba2e998eb836 .
Dietmar Maurer [Wed, 10 May 2017 04:55:42 +0000 (06:55 +0200)]
Revert "Add ip parameter in zfs_request to execute on remote host."
This reverts commit
c4bb4a3d1999c600565865313a7c1e1dc58a1cb8 .
Dietmar Maurer [Wed, 10 May 2017 04:55:00 +0000 (06:55 +0200)]
Revert "Add function volume_snapshot_delete_remote."
This reverts commit
4bd0b38f53f41fb8dfd4a6a6a3748e332b7727eb .
Dietmar Maurer [Wed, 10 May 2017 04:51:26 +0000 (06:51 +0200)]
Revert "Include pve-replica cronjob."
This reverts commit
fd69be974c30e43837dddff50a1c378514923359 .
Dietmar Maurer [Tue, 9 May 2017 09:45:12 +0000 (11:45 +0200)]
PVE::ReplicationTools::update_conf - correctly catch exception
Dietmar Maurer [Tue, 9 May 2017 05:11:07 +0000 (07:11 +0200)]
ReplicationTools.pm: call PVE::INotify::nodename inside methods
so that we can overwrite it using Test::MockModule. This makes writing
regression tests easier.
Dietmar Maurer [Tue, 9 May 2017 05:08:17 +0000 (07:08 +0200)]
ReplicationTools.pm_ do not pass $local_node to volume_snapshot_list
Dietmar Maurer [Tue, 9 May 2017 04:35:03 +0000 (06:35 +0200)]
ReplicationTools.pm: rename $get_guestconfig to get_guest_config
make it a real sub
Dietmar Maurer [Tue, 9 May 2017 04:23:23 +0000 (06:23 +0200)]
rename get_syncable_guestdisks to get_replicatable_volumes
Dietmar Maurer [Tue, 9 May 2017 04:20:24 +0000 (06:20 +0200)]
ReplicationTools: use get_replicatable_volumes()
Dietmar Maurer [Mon, 8 May 2017 10:05:39 +0000 (12:05 +0200)]
PVE::ReplicationTools::get_node_ip - do not pass noerr to PVE::Cluster::remote_node_ip()
We need an IP address.
Dietmar Maurer [Mon, 8 May 2017 08:22:57 +0000 (10:22 +0200)]
PVE::ReplicationTools - s/delet/delete/
Dietmar Maurer [Mon, 8 May 2017 07:29:57 +0000 (09:29 +0200)]
use consistent snapshot prefix for replicas
Dietmar Maurer [Mon, 8 May 2017 06:47:28 +0000 (08:47 +0200)]
PVE::ReplicationTools::destroy_all_snapshots - never delete local disks
Dietmar Maurer [Mon, 8 May 2017 05:57:04 +0000 (07:57 +0200)]
PVE::ReplicationTools::sync_guest - do not add snapname to disks_status
Because it is not used at all.
Dietmar Maurer [Mon, 8 May 2017 05:39:47 +0000 (07:39 +0200)]
PVE::ReplicationTools:sync_disk - use $lastsync instead of $job->{lastsync}
Because tghis is the parsed (untainted) value, and we pass this a parameter
to cleanup_snapshot.
Dietmar Maurer [Mon, 8 May 2017 05:36:20 +0000 (07:36 +0200)]
PVE::ReplicationTools::sync_guest - use integer compare for lastsync
Dietmar Maurer [Mon, 8 May 2017 04:55:12 +0000 (06:55 +0200)]
PVE::ReplicationTools::get_snapshot - remove dead code
This function makes no sense and is not used.
Dietmar Maurer [Mon, 8 May 2017 04:42:24 +0000 (06:42 +0200)]
PVE::ReplicationTools: new helper get_ssh_cmd()
Dietmar Maurer [Mon, 8 May 2017 04:28:58 +0000 (06:28 +0200)]
PVE::ReplicationTools::cleanup_snapshot - make sure ip is defined
Dietmar Maurer [Sat, 6 May 2017 15:20:52 +0000 (17:20 +0200)]
use 'eq' instead of regex for simple equality test.
Dietmar Maurer [Fri, 5 May 2017 15:48:29 +0000 (17:48 +0200)]
PVE::ReplicationTools - coding style cleanup
Dietmar Maurer [Fri, 5 May 2017 13:45:27 +0000 (15:45 +0200)]
PVE::ReplicationTools::get_node_ip() - fix arguments for mtunnel
Dietmar Maurer [Fri, 5 May 2017 13:38:52 +0000 (15:38 +0200)]
PVE::ReplicationTools - add missing "use PVE::INotify;"
Dietmar Maurer [Fri, 5 May 2017 13:32:38 +0000 (15:32 +0200)]
PVE::ReplicationTools - remove unused var $cluster_nodes
Dietmar Maurer [Fri, 5 May 2017 13:30:58 +0000 (15:30 +0200)]
PVE::ReplicationTools - only use required modules (remove Time::Local)
Dietmar Maurer [Fri, 5 May 2017 13:27:08 +0000 (15:27 +0200)]
PVE::ReplicationTools - remove useless call to cfs_update
Dietmar Maurer [Fri, 5 May 2017 09:55:34 +0000 (11:55 +0200)]
PVE::API2::Storage::Replication - add reasonable permission checks
Dietmar Maurer [Fri, 5 May 2017 09:23:25 +0000 (11:23 +0200)]
pvesr run: remove wrong permission check
Dietmar Maurer [Fri, 5 May 2017 09:18:30 +0000 (11:18 +0200)]
pvesr: move destroy_job into API class, remove wrong permission checks.
Dietmar Maurer [Fri, 5 May 2017 08:54:10 +0000 (10:54 +0200)]
PVE::API2::Storage::Replication->jobs(): return array
Dietmar Maurer [Fri, 5 May 2017 08:31:51 +0000 (10:31 +0200)]
pvesr: rename list => jobs, call API
to avoid code duplication. I also removed the functioanlity to query
jobs on other nodes, because it is clumsy and not really needed.
Dietmar Maurer [Fri, 5 May 2017 08:01:26 +0000 (10:01 +0200)]
PVE::API2::Storage::Replication - add directory index
Dietmar Maurer [Fri, 5 May 2017 07:18:14 +0000 (09:18 +0200)]
renamed: PVE/API2/StorageReplication.pm -> PVE/API2/Storage/Replication.pm
Wolfgang Bumiller [Fri, 28 Apr 2017 11:55:53 +0000 (13:55 +0200)]
bump version to 5.0-4
Wolfgang Bumiller [Fri, 28 Apr 2017 09:31:46 +0000 (11:31 +0200)]
replica: get_syncable_disks: skip disks with replica=0
Wolfgang Bumiller [Fri, 28 Apr 2017 09:27:59 +0000 (11:27 +0200)]
replica: add missing import
Wolfgang Bumiller [Fri, 28 Apr 2017 08:31:17 +0000 (10:31 +0200)]
replica: cleanup
Wolfgang Link [Mon, 24 Apr 2017 15:15:33 +0000 (17:15 +0200)]
Include pve-replica cronjob.
This is the timer for pvesr run.
Wolfgang Link [Mon, 24 Apr 2017 15:15:32 +0000 (17:15 +0200)]
Include incremental zfs send in storage_migrate.
When replica is enabled and the target host is the reptarget,
the most VM data are on the new target.
Wolfgang Link [Mon, 24 Apr 2017 15:15:31 +0000 (17:15 +0200)]
This patch will include storage asynchronous replication.
It is possible to synchronise a volume to an other node in a defined interval.
So if a node fail there will be an copy of the volumes from a VM
on an other node.
With this copy it is possible to start the VM on this node.
Wolfgang Link [Mon, 24 Apr 2017 15:15:30 +0000 (17:15 +0200)]
Add replicate as new storage feature.
This feature shows that the storage can send and receive images.
Wolfgang Link [Mon, 24 Apr 2017 15:15:29 +0000 (17:15 +0200)]
Add function volume_snapshot_delete_remote.
This function we need for replica to handle snapshots on remote nodes.
Wolfgang Link [Mon, 24 Apr 2017 15:15:28 +0000 (17:15 +0200)]
Add ip parameter in zfs_request to execute on remote host.
We need this function to delete remote snapshots.
Wolfgang Link [Mon, 24 Apr 2017 15:15:27 +0000 (17:15 +0200)]
Include new storage function volume_snapshot_list.
Returns a list of snapshots (youngest snap first) form a given volid.
It is possible to use a prefix to filter the list.
Wolfgang Link [Mon, 24 Apr 2017 15:15:26 +0000 (17:15 +0200)]
Include new storage function volume_send.
If the storage backend support import and export
we can send the contend to a remote host.
Fabian Grünbichler [Mon, 10 Apr 2017 14:22:08 +0000 (16:22 +0200)]
bump version to 5.0-3
Fabian Grünbichler [Mon, 10 Apr 2017 13:29:29 +0000 (15:29 +0200)]
fix run_command return code handling
Fabian Grünbichler [Tue, 21 Mar 2017 09:12:02 +0000 (10:12 +0100)]
bump version to 5.0-2
Fabian Grünbichler [Tue, 21 Mar 2017 09:11:42 +0000 (10:11 +0100)]
rbd: fix rados df parser for luminous
Fabian Grünbichler [Fri, 10 Mar 2017 08:24:11 +0000 (09:24 +0100)]
bump version to 5.0-1
Fabian Grünbichler [Fri, 10 Mar 2017 08:23:51 +0000 (09:23 +0100)]
buildsys: update make upload target for stretch
Dominik Csapak [Wed, 1 Mar 2017 11:03:40 +0000 (12:03 +0100)]
remove immutable flag also for subvols on directory storage
or else the removal of such templates (with rootfs size 0) fails
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Fabian Grünbichler [Fri, 24 Feb 2017 11:23:23 +0000 (12:23 +0100)]
bump version to 4.0-76
Fabian Grünbichler [Thu, 23 Feb 2017 08:22:57 +0000 (09:22 +0100)]
rbd: fix exit from 'rbd ls -l' parser
Wolfgang Bumiller [Mon, 20 Feb 2017 09:05:21 +0000 (10:05 +0100)]
bump version to 4.0-75
Wolfgang Bumiller [Mon, 20 Feb 2017 09:00:57 +0000 (10:00 +0100)]
rbd: minor regex fixup
Fabian Grünbichler [Fri, 3 Feb 2017 12:00:16 +0000 (13:00 +0100)]
rbd: fix typo
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Fri, 3 Feb 2017 12:00:15 +0000 (13:00 +0100)]
rbd: use consistent image name schemes
since we allow vm-ID-whatever when allocating images, we
should also include those when listing them.
note: '@' is reserved for snapshots in ceph, so it is safe to
skip lines including an '@' in the image name.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Fri, 3 Feb 2017 12:00:14 +0000 (13:00 +0100)]
rbd: use 'rbd ls' without '-l' to find free names
with more than a few images, 'rbd ls -l' gets rather slow
compared to a simple 'rbd ls'. since we only need to check
existing image names for finding a free one, the latter is
sufficient.
example with ~400 rbd images:
$ time rbd ls -p ceph-vm > /dev/null
real 0m0.027s
user 0m0.012s
sys 0m0.008s
$ time rbd ls -l -p ceph-vm > /dev/null
real 0m5.250s
user 0m1.632s
sys 0m0.584s
a linked clone of two disks on the same setup accordingly
also shows a massive speedup:
$ time qm clone 1000 10000 -snap test
create linked clone of drive scsi0 (ceph-vm:vm-1000-disk-2)
clone vm-1000-disk-2: vm-1000-disk-2 snapname test to
vm-10000-disk-1
create linked clone of drive scsi1 (ceph-vm:vm-1000-disk-1)
clone vm-1000-disk-1: vm-1000-disk-1 snapname test to
vm-10000-disk-2
real 0m11.157s
user 0m3.752s
sys 0m1.308s
$ time qm clone 1000 10000 -snap test
create linked clone of drive scsi1 (ceph-vm:vm-1000-disk-1)
clone vm-1000-disk-1: vm-1000-disk-1 snapname test to
vm-10000-disk-1
create linked clone of drive scsi0 (ceph-vm:vm-1000-disk-2)
clone vm-1000-disk-2: vm-1000-disk-2 snapname test to
vm-10000-disk-2
real 0m0.872s
user 0m0.652s
sys 0m0.096s
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dietmar Maurer [Sun, 12 Feb 2017 09:10:50 +0000 (10:10 +0100)]
bump version to 4.0-47
Dietmar Maurer [Sun, 12 Feb 2017 08:55:50 +0000 (09:55 +0100)]
fix bug #1280: Can't locate object method "root@pam"
This was introduced by commit
04a13668b9b6e15d3aed36ba00ad538b99a9dc15 .
Wolfgang Bumiller [Mon, 6 Feb 2017 10:50:37 +0000 (11:50 +0100)]
buildsys: use gzip -n to disable timestamps
Wolfgang Bumiller [Mon, 6 Feb 2017 10:50:15 +0000 (11:50 +0100)]
buildsys: use fakeroot for dpkg-deb
Wolfgang Bumiller [Mon, 6 Feb 2017 10:50:01 +0000 (11:50 +0100)]
buildsys: make job safety
Fabian Grünbichler [Fri, 20 Jan 2017 09:03:34 +0000 (10:03 +0100)]
extract_vzdump_config: handle RE consistently
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Fri, 20 Jan 2017 09:03:33 +0000 (10:03 +0100)]
weaken matching for vzdump config extract filename
to allow "pvesm extractconfig filename" when in the dump
directory.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dietmar Maurer [Thu, 19 Jan 2017 08:14:03 +0000 (09:14 +0100)]
bump version to 4.0-73
Dietmar Maurer [Wed, 18 Jan 2017 16:14:07 +0000 (17:14 +0100)]
PVE::Storage: new helper check_volume_access()
Copied from PVE::RPCEnvironment to avoid cyclic dependency
(pve-storgae => pve-access-control => pve-storage).
Dietmar Maurer [Wed, 18 Jan 2017 16:12:43 +0000 (17:12 +0100)]
fixes for new PVE::RPCEnvironment implementation
Use PVE::RPCEnvironment->is_worker() instead of
PVE::RPCEnvironment::is_worker().
Wolfgang Bumiller [Tue, 17 Jan 2017 09:32:23 +0000 (10:32 +0100)]
fix #1252: rbd: delete snapshots when using krbd
Dmitry Petuhov [Mon, 16 Jan 2017 07:45:09 +0000 (10:45 +0300)]
Fix RBD resize with krbd option enabled.
With krbd we resize volume and tell QemuSever to notify running QEMU
with zero $size by returning undef.
Signed-off-by: Dmitry Petuhov <mityapetuhov@gmail.com>
Dietmar Maurer [Thu, 12 Jan 2017 13:06:00 +0000 (14:06 +0100)]
bump version to 4.0-72
Dietmar Maurer [Thu, 12 Jan 2017 12:27:43 +0000 (13:27 +0100)]
add setup_environment hook to CLIHandler class
and use run_cli_handler instead of depreciated run_cli.
Alexandre Derumier [Sun, 8 Jan 2017 13:04:41 +0000 (14:04 +0100)]
sheepdog : volume_resize return if running
fix : https://forum.proxmox.com/threads/sheepdog-disk-resize-not-working.31760/
Signed-off-by: Alexandre Derumier <aderumier@odiso.com>
Dominik Csapak [Thu, 5 Jan 2017 10:11:52 +0000 (11:11 +0100)]
fix #1099 (again): map cciss/c0d0 to cciss!c0d0
there was still a point where we got the wrong string
on createosd we get the devpath (/dev/cciss/c0d0)
but need the info from get_disks, which looks in /sys/block
where it needs to be cciss!c0d0
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Fabian Grünbichler [Mon, 2 Jan 2017 13:27:04 +0000 (14:27 +0100)]
fix #1135: always clean up ZFS snapshots on migration
otherwise there are situations where snapshots are left
behind for already sent volumes. also include more warnings.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dietmar Maurer [Sat, 24 Dec 2016 09:55:31 +0000 (10:55 +0100)]
storage_migrate: use bs=4k to copy images with dd
The default block size is 512 bytes, and is quite slow. We do not
want to use blocks bigger than 4k, because we want to detect empty
blocks (sparse).
Dietmar Maurer [Thu, 22 Dec 2016 11:16:32 +0000 (12:16 +0100)]
bump version to 4.0-71
Wolfgang Link [Mon, 19 Dec 2016 14:15:37 +0000 (15:15 +0100)]
Add function get_blockdev.
This function will return you the block device of a given partition path.
Wolfgang Link [Mon, 19 Dec 2016 14:15:36 +0000 (15:15 +0100)]
Add new function part_num
With this function you get the partnum of a dev.
Dietmar Maurer [Wed, 30 Nov 2016 16:23:10 +0000 (17:23 +0100)]
bump version to 4.0-70
Dominik Csapak [Wed, 30 Nov 2016 15:36:02 +0000 (16:36 +0100)]
change regression test for crucial
as we now can parse the wearout
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Dominik Csapak [Wed, 30 Nov 2016 15:36:01 +0000 (16:36 +0100)]
add crucial smart attribute for wear leveling
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Dominik Csapak [Wed, 30 Nov 2016 15:36:00 +0000 (16:36 +0100)]
correct regression test for sandisk ssds
in my initial patch series for the regression test, i failed to notice
the missing attributes for the sandisk ssds (which had not been parsed)
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Dominik Csapak [Wed, 30 Nov 2016 15:35:59 +0000 (16:35 +0100)]
catch '---' in threshold output of sandisk ssds
sandisk ssds have a default threshold of '---' on nearly all fields,
which prevents our parsing
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Dietmar Maurer [Tue, 29 Nov 2016 08:31:37 +0000 (09:31 +0100)]
bump versuion to 4.0-69
Dominik Csapak [Mon, 28 Nov 2016 12:34:19 +0000 (13:34 +0100)]
use qemu gluster blockdriver for linked clone creation
this works around a bug, where qemu does not align the qcow2 file
when using the filesystem directly, and the gluster blockdriver
refuses to read from it
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>