]>
git.proxmox.com Git - pve-storage.git/log
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:02 +0000 (10:04 +0200)]
migrate: don't include the hostname in rsync's rsh command
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:01 +0000 (10:04 +0200)]
migrate: use the correct IP with rsync
Dietmar Maurer [Thu, 8 Jun 2017 06:45:22 +0000 (08:45 +0200)]
ZFSPoolPlugin.pm: remove unused code
Dietmar Maurer [Wed, 7 Jun 2017 04:36:55 +0000 (06:36 +0200)]
PVE::Storage::volume_snapshot_list - remove comment about ordering
Some storage types supports arbitrary snapshot trees, so there is
no strict ordering relation.
Dietmar Maurer [Wed, 7 Jun 2017 04:20:07 +0000 (06:20 +0200)]
PVE::Storage::volume_snapshot_list - remove $prefix parameter
Always return the full list of snapshots. Users of this library can easily
filter with a simply 'grep' instead.
Dietmar Maurer [Wed, 7 Jun 2017 04:12:50 +0000 (06:12 +0200)]
remove unused replication code (moved to pve-manager)
Fabian Grünbichler [Wed, 17 May 2017 09:42:38 +0000 (11:42 +0200)]
build: run tests when building deb
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:37 +0000 (11:42 +0200)]
disktest: exit with -1 in case of failures
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:36 +0000 (11:42 +0200)]
zfstest: exit with -1 in case of failures
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:35 +0000 (11:42 +0200)]
zfstest: skip tests if ZFS is not available
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:34 +0000 (11:42 +0200)]
zfstest: remove unused variable
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:33 +0000 (11:42 +0200)]
zfstest: fix typos
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:32 +0000 (11:42 +0200)]
zfstest: use truncate instead of dd
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:31 +0000 (11:42 +0200)]
zfstest: improve reset behaviour
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:30 +0000 (11:42 +0200)]
zfstest: wait for devices to settle after creation
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:29 +0000 (11:42 +0200)]
zfstest: fix test description
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:28 +0000 (11:42 +0200)]
zfstest: fix test 17 to actually deactivate storage
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dominik Csapak [Tue, 16 May 2017 12:53:54 +0000 (14:53 +0200)]
fix #1379: return size as number instead of string
this caused the webinterface to sort alphabetically instead of numerical
when sorting by image size
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Wolfgang Bumiller [Tue, 30 May 2017 13:30:08 +0000 (15:30 +0200)]
migrate: add insecure parameter
This uses mtunnel's new -run-command parameter in
combination with the ssh-info's network cidr option to use
an unprotected TCP port.
Wolfgang Bumiller [Mon, 29 May 2017 13:16:58 +0000 (15:16 +0200)]
migrate: implement rate limiting
Note that it does not apply to the local 'mkdir && cp' case.
Dietmar Maurer [Thu, 1 Jun 2017 07:42:23 +0000 (09:42 +0200)]
bump version to 5.0-5
Wolfgang Bumiller [Tue, 23 May 2017 10:30:20 +0000 (12:30 +0200)]
Revert "free: added snapshot parameter"
This reverts commit
a26e1abc70e087a7f42e8197ef080222990a680f .
Wolfgang Bumiller [Tue, 23 May 2017 10:30:19 +0000 (12:30 +0200)]
migrate: cleanup & fixup
The volume_snapshot call was missing the condition when to
create a snapshot. Make the whole logic easier to follow
with a $migration_snapshot boolean.
Also get rid of the remote `pvesm free -snapshot` call by
using import's new -delete-snapshot parameter.
Wolfgang Bumiller [Tue, 23 May 2017 10:30:18 +0000 (12:30 +0200)]
import: add -delete-snapshot parameter
This deletes a snapshot on *success*, done directly in the
CLI handler, as the rollback/delete on failure is already
happening inside the plugin's import method.
Wolfgang Bumiller [Tue, 23 May 2017 07:04:47 +0000 (09:04 +0200)]
migrate: replace target ip parameter with sshinfo parameter
Wolfgang Bumiller [Mon, 22 May 2017 08:16:21 +0000 (10:16 +0200)]
migrate: snapshot parameter for use with replication
Fabian Grünbichler [Fri, 12 May 2017 13:01:08 +0000 (15:01 +0200)]
migrate: cleanup: $free is always defined
Wolfgang Bumiller [Fri, 12 May 2017 09:56:11 +0000 (11:56 +0200)]
migrate: query transfer stream formats
Wolfgang Bumiller [Fri, 12 May 2017 09:56:10 +0000 (11:56 +0200)]
api: add import/export format querying
Wolfgang Bumiller [Fri, 12 May 2017 09:56:09 +0000 (11:56 +0200)]
migrate: snapshot parameter for incremental transfer
Wolfgang Bumiller [Fri, 12 May 2017 09:56:08 +0000 (11:56 +0200)]
migrate: use pvesm import/export for zfs
The only leftover zfs specific part here is the zfs format
type parameter.
Wolfgang Bumiller [Fri, 12 May 2017 09:56:07 +0000 (11:56 +0200)]
free: added snapshot parameter
Wolfgang Bumiller [Fri, 12 May 2017 09:56:06 +0000 (11:56 +0200)]
pvesm: import/export commands
Dietmar Maurer [Wed, 10 May 2017 05:20:00 +0000 (07:20 +0200)]
Revert "Include incremental zfs send in storage_migrate."
This reverts commit
4537523b5af8846a6de659e718ab1a81db882e1b .
We want to use send/receive for this - patch will follow.
Dietmar Maurer [Wed, 10 May 2017 05:06:35 +0000 (07:06 +0200)]
do not install replication code
The code introduces a cyclic package dependency, so we need to
move it to pve-manager package.
Dietmar Maurer [Wed, 10 May 2017 05:02:42 +0000 (07:02 +0200)]
volume_snapshot_list: remove $ip parameter
We want to handle ssh connections somewhere else (not inside the
storage plugins).
Dietmar Maurer [Wed, 10 May 2017 04:58:44 +0000 (06:58 +0200)]
Revert "Include new storage function volume_send."
This reverts commit
b76774e57fe66a483a7544ec5a05ba2e998eb836 .
Dietmar Maurer [Wed, 10 May 2017 04:55:42 +0000 (06:55 +0200)]
Revert "Add ip parameter in zfs_request to execute on remote host."
This reverts commit
c4bb4a3d1999c600565865313a7c1e1dc58a1cb8 .
Dietmar Maurer [Wed, 10 May 2017 04:55:00 +0000 (06:55 +0200)]
Revert "Add function volume_snapshot_delete_remote."
This reverts commit
4bd0b38f53f41fb8dfd4a6a6a3748e332b7727eb .
Dietmar Maurer [Wed, 10 May 2017 04:51:26 +0000 (06:51 +0200)]
Revert "Include pve-replica cronjob."
This reverts commit
fd69be974c30e43837dddff50a1c378514923359 .
Dietmar Maurer [Tue, 9 May 2017 09:45:12 +0000 (11:45 +0200)]
PVE::ReplicationTools::update_conf - correctly catch exception
Dietmar Maurer [Tue, 9 May 2017 05:11:07 +0000 (07:11 +0200)]
ReplicationTools.pm: call PVE::INotify::nodename inside methods
so that we can overwrite it using Test::MockModule. This makes writing
regression tests easier.
Dietmar Maurer [Tue, 9 May 2017 05:08:17 +0000 (07:08 +0200)]
ReplicationTools.pm_ do not pass $local_node to volume_snapshot_list
Dietmar Maurer [Tue, 9 May 2017 04:35:03 +0000 (06:35 +0200)]
ReplicationTools.pm: rename $get_guestconfig to get_guest_config
make it a real sub
Dietmar Maurer [Tue, 9 May 2017 04:23:23 +0000 (06:23 +0200)]
rename get_syncable_guestdisks to get_replicatable_volumes
Dietmar Maurer [Tue, 9 May 2017 04:20:24 +0000 (06:20 +0200)]
ReplicationTools: use get_replicatable_volumes()
Dietmar Maurer [Mon, 8 May 2017 10:05:39 +0000 (12:05 +0200)]
PVE::ReplicationTools::get_node_ip - do not pass noerr to PVE::Cluster::remote_node_ip()
We need an IP address.
Dietmar Maurer [Mon, 8 May 2017 08:22:57 +0000 (10:22 +0200)]
PVE::ReplicationTools - s/delet/delete/
Dietmar Maurer [Mon, 8 May 2017 07:29:57 +0000 (09:29 +0200)]
use consistent snapshot prefix for replicas
Dietmar Maurer [Mon, 8 May 2017 06:47:28 +0000 (08:47 +0200)]
PVE::ReplicationTools::destroy_all_snapshots - never delete local disks
Dietmar Maurer [Mon, 8 May 2017 05:57:04 +0000 (07:57 +0200)]
PVE::ReplicationTools::sync_guest - do not add snapname to disks_status
Because it is not used at all.
Dietmar Maurer [Mon, 8 May 2017 05:39:47 +0000 (07:39 +0200)]
PVE::ReplicationTools:sync_disk - use $lastsync instead of $job->{lastsync}
Because tghis is the parsed (untainted) value, and we pass this a parameter
to cleanup_snapshot.
Dietmar Maurer [Mon, 8 May 2017 05:36:20 +0000 (07:36 +0200)]
PVE::ReplicationTools::sync_guest - use integer compare for lastsync
Dietmar Maurer [Mon, 8 May 2017 04:55:12 +0000 (06:55 +0200)]
PVE::ReplicationTools::get_snapshot - remove dead code
This function makes no sense and is not used.
Dietmar Maurer [Mon, 8 May 2017 04:42:24 +0000 (06:42 +0200)]
PVE::ReplicationTools: new helper get_ssh_cmd()
Dietmar Maurer [Mon, 8 May 2017 04:28:58 +0000 (06:28 +0200)]
PVE::ReplicationTools::cleanup_snapshot - make sure ip is defined
Dietmar Maurer [Sat, 6 May 2017 15:20:52 +0000 (17:20 +0200)]
use 'eq' instead of regex for simple equality test.
Dietmar Maurer [Fri, 5 May 2017 15:48:29 +0000 (17:48 +0200)]
PVE::ReplicationTools - coding style cleanup
Dietmar Maurer [Fri, 5 May 2017 13:45:27 +0000 (15:45 +0200)]
PVE::ReplicationTools::get_node_ip() - fix arguments for mtunnel
Dietmar Maurer [Fri, 5 May 2017 13:38:52 +0000 (15:38 +0200)]
PVE::ReplicationTools - add missing "use PVE::INotify;"
Dietmar Maurer [Fri, 5 May 2017 13:32:38 +0000 (15:32 +0200)]
PVE::ReplicationTools - remove unused var $cluster_nodes
Dietmar Maurer [Fri, 5 May 2017 13:30:58 +0000 (15:30 +0200)]
PVE::ReplicationTools - only use required modules (remove Time::Local)
Dietmar Maurer [Fri, 5 May 2017 13:27:08 +0000 (15:27 +0200)]
PVE::ReplicationTools - remove useless call to cfs_update
Dietmar Maurer [Fri, 5 May 2017 09:55:34 +0000 (11:55 +0200)]
PVE::API2::Storage::Replication - add reasonable permission checks
Dietmar Maurer [Fri, 5 May 2017 09:23:25 +0000 (11:23 +0200)]
pvesr run: remove wrong permission check
Dietmar Maurer [Fri, 5 May 2017 09:18:30 +0000 (11:18 +0200)]
pvesr: move destroy_job into API class, remove wrong permission checks.
Dietmar Maurer [Fri, 5 May 2017 08:54:10 +0000 (10:54 +0200)]
PVE::API2::Storage::Replication->jobs(): return array
Dietmar Maurer [Fri, 5 May 2017 08:31:51 +0000 (10:31 +0200)]
pvesr: rename list => jobs, call API
to avoid code duplication. I also removed the functioanlity to query
jobs on other nodes, because it is clumsy and not really needed.
Dietmar Maurer [Fri, 5 May 2017 08:01:26 +0000 (10:01 +0200)]
PVE::API2::Storage::Replication - add directory index
Dietmar Maurer [Fri, 5 May 2017 07:18:14 +0000 (09:18 +0200)]
renamed: PVE/API2/StorageReplication.pm -> PVE/API2/Storage/Replication.pm
Wolfgang Bumiller [Fri, 28 Apr 2017 11:55:53 +0000 (13:55 +0200)]
bump version to 5.0-4
Wolfgang Bumiller [Fri, 28 Apr 2017 09:31:46 +0000 (11:31 +0200)]
replica: get_syncable_disks: skip disks with replica=0
Wolfgang Bumiller [Fri, 28 Apr 2017 09:27:59 +0000 (11:27 +0200)]
replica: add missing import
Wolfgang Bumiller [Fri, 28 Apr 2017 08:31:17 +0000 (10:31 +0200)]
replica: cleanup
Wolfgang Link [Mon, 24 Apr 2017 15:15:33 +0000 (17:15 +0200)]
Include pve-replica cronjob.
This is the timer for pvesr run.
Wolfgang Link [Mon, 24 Apr 2017 15:15:32 +0000 (17:15 +0200)]
Include incremental zfs send in storage_migrate.
When replica is enabled and the target host is the reptarget,
the most VM data are on the new target.
Wolfgang Link [Mon, 24 Apr 2017 15:15:31 +0000 (17:15 +0200)]
This patch will include storage asynchronous replication.
It is possible to synchronise a volume to an other node in a defined interval.
So if a node fail there will be an copy of the volumes from a VM
on an other node.
With this copy it is possible to start the VM on this node.
Wolfgang Link [Mon, 24 Apr 2017 15:15:30 +0000 (17:15 +0200)]
Add replicate as new storage feature.
This feature shows that the storage can send and receive images.
Wolfgang Link [Mon, 24 Apr 2017 15:15:29 +0000 (17:15 +0200)]
Add function volume_snapshot_delete_remote.
This function we need for replica to handle snapshots on remote nodes.
Wolfgang Link [Mon, 24 Apr 2017 15:15:28 +0000 (17:15 +0200)]
Add ip parameter in zfs_request to execute on remote host.
We need this function to delete remote snapshots.
Wolfgang Link [Mon, 24 Apr 2017 15:15:27 +0000 (17:15 +0200)]
Include new storage function volume_snapshot_list.
Returns a list of snapshots (youngest snap first) form a given volid.
It is possible to use a prefix to filter the list.
Wolfgang Link [Mon, 24 Apr 2017 15:15:26 +0000 (17:15 +0200)]
Include new storage function volume_send.
If the storage backend support import and export
we can send the contend to a remote host.
Fabian Grünbichler [Mon, 10 Apr 2017 14:22:08 +0000 (16:22 +0200)]
bump version to 5.0-3
Fabian Grünbichler [Mon, 10 Apr 2017 13:29:29 +0000 (15:29 +0200)]
fix run_command return code handling
Fabian Grünbichler [Tue, 21 Mar 2017 09:12:02 +0000 (10:12 +0100)]
bump version to 5.0-2
Fabian Grünbichler [Tue, 21 Mar 2017 09:11:42 +0000 (10:11 +0100)]
rbd: fix rados df parser for luminous
Fabian Grünbichler [Fri, 10 Mar 2017 08:24:11 +0000 (09:24 +0100)]
bump version to 5.0-1
Fabian Grünbichler [Fri, 10 Mar 2017 08:23:51 +0000 (09:23 +0100)]
buildsys: update make upload target for stretch
Dominik Csapak [Wed, 1 Mar 2017 11:03:40 +0000 (12:03 +0100)]
remove immutable flag also for subvols on directory storage
or else the removal of such templates (with rootfs size 0) fails
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Fabian Grünbichler [Fri, 24 Feb 2017 11:23:23 +0000 (12:23 +0100)]
bump version to 4.0-76
Fabian Grünbichler [Thu, 23 Feb 2017 08:22:57 +0000 (09:22 +0100)]
rbd: fix exit from 'rbd ls -l' parser
Wolfgang Bumiller [Mon, 20 Feb 2017 09:05:21 +0000 (10:05 +0100)]
bump version to 4.0-75
Wolfgang Bumiller [Mon, 20 Feb 2017 09:00:57 +0000 (10:00 +0100)]
rbd: minor regex fixup
Fabian Grünbichler [Fri, 3 Feb 2017 12:00:16 +0000 (13:00 +0100)]
rbd: fix typo
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Fri, 3 Feb 2017 12:00:15 +0000 (13:00 +0100)]
rbd: use consistent image name schemes
since we allow vm-ID-whatever when allocating images, we
should also include those when listing them.
note: '@' is reserved for snapshots in ceph, so it is safe to
skip lines including an '@' in the image name.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Fri, 3 Feb 2017 12:00:14 +0000 (13:00 +0100)]
rbd: use 'rbd ls' without '-l' to find free names
with more than a few images, 'rbd ls -l' gets rather slow
compared to a simple 'rbd ls'. since we only need to check
existing image names for finding a free one, the latter is
sufficient.
example with ~400 rbd images:
$ time rbd ls -p ceph-vm > /dev/null
real 0m0.027s
user 0m0.012s
sys 0m0.008s
$ time rbd ls -l -p ceph-vm > /dev/null
real 0m5.250s
user 0m1.632s
sys 0m0.584s
a linked clone of two disks on the same setup accordingly
also shows a massive speedup:
$ time qm clone 1000 10000 -snap test
create linked clone of drive scsi0 (ceph-vm:vm-1000-disk-2)
clone vm-1000-disk-2: vm-1000-disk-2 snapname test to
vm-10000-disk-1
create linked clone of drive scsi1 (ceph-vm:vm-1000-disk-1)
clone vm-1000-disk-1: vm-1000-disk-1 snapname test to
vm-10000-disk-2
real 0m11.157s
user 0m3.752s
sys 0m1.308s
$ time qm clone 1000 10000 -snap test
create linked clone of drive scsi1 (ceph-vm:vm-1000-disk-1)
clone vm-1000-disk-1: vm-1000-disk-1 snapname test to
vm-10000-disk-1
create linked clone of drive scsi0 (ceph-vm:vm-1000-disk-2)
clone vm-1000-disk-2: vm-1000-disk-2 snapname test to
vm-10000-disk-2
real 0m0.872s
user 0m0.652s
sys 0m0.096s
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dietmar Maurer [Sun, 12 Feb 2017 09:10:50 +0000 (10:10 +0100)]
bump version to 4.0-47
Dietmar Maurer [Sun, 12 Feb 2017 08:55:50 +0000 (09:55 +0100)]
fix bug #1280: Can't locate object method "root@pam"
This was introduced by commit
04a13668b9b6e15d3aed36ba00ad538b99a9dc15 .
Wolfgang Bumiller [Mon, 6 Feb 2017 10:50:37 +0000 (11:50 +0100)]
buildsys: use gzip -n to disable timestamps
Wolfgang Bumiller [Mon, 6 Feb 2017 10:50:15 +0000 (11:50 +0100)]
buildsys: use fakeroot for dpkg-deb