]>
git.proxmox.com Git - pve-storage.git/log
Dietmar Maurer [Thu, 22 Jun 2017 07:05:29 +0000 (09:05 +0200)]
re-add changes to PVE/Storage/Plugin.pm (fixup previous commit)
This was removed by accident.
Dietmar Maurer [Thu, 22 Jun 2017 06:36:11 +0000 (08:36 +0200)]
bump version to 5.0-6
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:39 +0000 (14:59 +0200)]
migrate: only use import/export
This replaces the path-based and lvm/thin special cases in
storage_migrate with the already generic-enough zfspool
case which is already using import/export and does not
directly depend on zfs anymore.
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:37 +0000 (14:59 +0200)]
lvm: import/export: implement raw+size format
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:36 +0000 (14:59 +0200)]
import/export: new formats: raw, tar, qcow2, vmdk
All of them have a `+size` prefix to show that they're not
"pure raw" or "pure tar" streams, because some storage may
need to know in advance how much storage to allocate.
The formats are explained in comments.
PVE::Storage::Plugin now has default implementations for
these for non-incremental streams exporting the current
(rather than a snapshot state).
To use qcow2 or vmdk formats $with_snapshots must be true,
otherwise raw/tar will be used where $with_snapshots must
be false.
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:35 +0000 (14:59 +0200)]
export: add missing format query call parameter
Fabian Grünbichler [Mon, 12 Jun 2017 08:14:54 +0000 (10:14 +0200)]
build: remove fakeroot from dpkg-buildpackage
Fabian Grünbichler [Mon, 12 Jun 2017 08:13:55 +0000 (10:13 +0200)]
build: add substitution variable
Fabian Grünbichler [Mon, 12 Jun 2017 08:13:38 +0000 (10:13 +0200)]
build: reformat b-d and depends
Thomas Lamprecht [Fri, 9 Jun 2017 15:20:09 +0000 (17:20 +0200)]
change from dpkg-deb to dpkg-buildpackage
add debian directory and move the respective files there and add
missing (rules, compat).
Move control.in to control as no sed search & replacement must be
done. Add a Source section to the control file.
Rename the "check" Makefile target to "test" so that the dh_auto_test
helper executes it automatically on build.
Move the verify_api check to this target.
Cleanup the "clean" target and remove outdated commented out stuff
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:03 +0000 (10:04 +0200)]
migrate: insecure: untaint the received ip/port
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:02 +0000 (10:04 +0200)]
migrate: don't include the hostname in rsync's rsh command
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:01 +0000 (10:04 +0200)]
migrate: use the correct IP with rsync
Dietmar Maurer [Thu, 8 Jun 2017 06:45:22 +0000 (08:45 +0200)]
ZFSPoolPlugin.pm: remove unused code
Dietmar Maurer [Wed, 7 Jun 2017 04:36:55 +0000 (06:36 +0200)]
PVE::Storage::volume_snapshot_list - remove comment about ordering
Some storage types supports arbitrary snapshot trees, so there is
no strict ordering relation.
Dietmar Maurer [Wed, 7 Jun 2017 04:20:07 +0000 (06:20 +0200)]
PVE::Storage::volume_snapshot_list - remove $prefix parameter
Always return the full list of snapshots. Users of this library can easily
filter with a simply 'grep' instead.
Dietmar Maurer [Wed, 7 Jun 2017 04:12:50 +0000 (06:12 +0200)]
remove unused replication code (moved to pve-manager)
Fabian Grünbichler [Wed, 17 May 2017 09:42:38 +0000 (11:42 +0200)]
build: run tests when building deb
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:37 +0000 (11:42 +0200)]
disktest: exit with -1 in case of failures
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:36 +0000 (11:42 +0200)]
zfstest: exit with -1 in case of failures
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:35 +0000 (11:42 +0200)]
zfstest: skip tests if ZFS is not available
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:34 +0000 (11:42 +0200)]
zfstest: remove unused variable
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:33 +0000 (11:42 +0200)]
zfstest: fix typos
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:32 +0000 (11:42 +0200)]
zfstest: use truncate instead of dd
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:31 +0000 (11:42 +0200)]
zfstest: improve reset behaviour
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:30 +0000 (11:42 +0200)]
zfstest: wait for devices to settle after creation
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:29 +0000 (11:42 +0200)]
zfstest: fix test description
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:28 +0000 (11:42 +0200)]
zfstest: fix test 17 to actually deactivate storage
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dominik Csapak [Tue, 16 May 2017 12:53:54 +0000 (14:53 +0200)]
fix #1379: return size as number instead of string
this caused the webinterface to sort alphabetically instead of numerical
when sorting by image size
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Wolfgang Bumiller [Tue, 30 May 2017 13:30:08 +0000 (15:30 +0200)]
migrate: add insecure parameter
This uses mtunnel's new -run-command parameter in
combination with the ssh-info's network cidr option to use
an unprotected TCP port.
Wolfgang Bumiller [Mon, 29 May 2017 13:16:58 +0000 (15:16 +0200)]
migrate: implement rate limiting
Note that it does not apply to the local 'mkdir && cp' case.
Dietmar Maurer [Thu, 1 Jun 2017 07:42:23 +0000 (09:42 +0200)]
bump version to 5.0-5
Wolfgang Bumiller [Tue, 23 May 2017 10:30:20 +0000 (12:30 +0200)]
Revert "free: added snapshot parameter"
This reverts commit
a26e1abc70e087a7f42e8197ef080222990a680f .
Wolfgang Bumiller [Tue, 23 May 2017 10:30:19 +0000 (12:30 +0200)]
migrate: cleanup & fixup
The volume_snapshot call was missing the condition when to
create a snapshot. Make the whole logic easier to follow
with a $migration_snapshot boolean.
Also get rid of the remote `pvesm free -snapshot` call by
using import's new -delete-snapshot parameter.
Wolfgang Bumiller [Tue, 23 May 2017 10:30:18 +0000 (12:30 +0200)]
import: add -delete-snapshot parameter
This deletes a snapshot on *success*, done directly in the
CLI handler, as the rollback/delete on failure is already
happening inside the plugin's import method.
Wolfgang Bumiller [Tue, 23 May 2017 07:04:47 +0000 (09:04 +0200)]
migrate: replace target ip parameter with sshinfo parameter
Wolfgang Bumiller [Mon, 22 May 2017 08:16:21 +0000 (10:16 +0200)]
migrate: snapshot parameter for use with replication
Fabian Grünbichler [Fri, 12 May 2017 13:01:08 +0000 (15:01 +0200)]
migrate: cleanup: $free is always defined
Wolfgang Bumiller [Fri, 12 May 2017 09:56:11 +0000 (11:56 +0200)]
migrate: query transfer stream formats
Wolfgang Bumiller [Fri, 12 May 2017 09:56:10 +0000 (11:56 +0200)]
api: add import/export format querying
Wolfgang Bumiller [Fri, 12 May 2017 09:56:09 +0000 (11:56 +0200)]
migrate: snapshot parameter for incremental transfer
Wolfgang Bumiller [Fri, 12 May 2017 09:56:08 +0000 (11:56 +0200)]
migrate: use pvesm import/export for zfs
The only leftover zfs specific part here is the zfs format
type parameter.
Wolfgang Bumiller [Fri, 12 May 2017 09:56:07 +0000 (11:56 +0200)]
free: added snapshot parameter
Wolfgang Bumiller [Fri, 12 May 2017 09:56:06 +0000 (11:56 +0200)]
pvesm: import/export commands
Dietmar Maurer [Wed, 10 May 2017 05:20:00 +0000 (07:20 +0200)]
Revert "Include incremental zfs send in storage_migrate."
This reverts commit
4537523b5af8846a6de659e718ab1a81db882e1b .
We want to use send/receive for this - patch will follow.
Dietmar Maurer [Wed, 10 May 2017 05:06:35 +0000 (07:06 +0200)]
do not install replication code
The code introduces a cyclic package dependency, so we need to
move it to pve-manager package.
Dietmar Maurer [Wed, 10 May 2017 05:02:42 +0000 (07:02 +0200)]
volume_snapshot_list: remove $ip parameter
We want to handle ssh connections somewhere else (not inside the
storage plugins).
Dietmar Maurer [Wed, 10 May 2017 04:58:44 +0000 (06:58 +0200)]
Revert "Include new storage function volume_send."
This reverts commit
b76774e57fe66a483a7544ec5a05ba2e998eb836 .
Dietmar Maurer [Wed, 10 May 2017 04:55:42 +0000 (06:55 +0200)]
Revert "Add ip parameter in zfs_request to execute on remote host."
This reverts commit
c4bb4a3d1999c600565865313a7c1e1dc58a1cb8 .
Dietmar Maurer [Wed, 10 May 2017 04:55:00 +0000 (06:55 +0200)]
Revert "Add function volume_snapshot_delete_remote."
This reverts commit
4bd0b38f53f41fb8dfd4a6a6a3748e332b7727eb .
Dietmar Maurer [Wed, 10 May 2017 04:51:26 +0000 (06:51 +0200)]
Revert "Include pve-replica cronjob."
This reverts commit
fd69be974c30e43837dddff50a1c378514923359 .
Dietmar Maurer [Tue, 9 May 2017 09:45:12 +0000 (11:45 +0200)]
PVE::ReplicationTools::update_conf - correctly catch exception
Dietmar Maurer [Tue, 9 May 2017 05:11:07 +0000 (07:11 +0200)]
ReplicationTools.pm: call PVE::INotify::nodename inside methods
so that we can overwrite it using Test::MockModule. This makes writing
regression tests easier.
Dietmar Maurer [Tue, 9 May 2017 05:08:17 +0000 (07:08 +0200)]
ReplicationTools.pm_ do not pass $local_node to volume_snapshot_list
Dietmar Maurer [Tue, 9 May 2017 04:35:03 +0000 (06:35 +0200)]
ReplicationTools.pm: rename $get_guestconfig to get_guest_config
make it a real sub
Dietmar Maurer [Tue, 9 May 2017 04:23:23 +0000 (06:23 +0200)]
rename get_syncable_guestdisks to get_replicatable_volumes
Dietmar Maurer [Tue, 9 May 2017 04:20:24 +0000 (06:20 +0200)]
ReplicationTools: use get_replicatable_volumes()
Dietmar Maurer [Mon, 8 May 2017 10:05:39 +0000 (12:05 +0200)]
PVE::ReplicationTools::get_node_ip - do not pass noerr to PVE::Cluster::remote_node_ip()
We need an IP address.
Dietmar Maurer [Mon, 8 May 2017 08:22:57 +0000 (10:22 +0200)]
PVE::ReplicationTools - s/delet/delete/
Dietmar Maurer [Mon, 8 May 2017 07:29:57 +0000 (09:29 +0200)]
use consistent snapshot prefix for replicas
Dietmar Maurer [Mon, 8 May 2017 06:47:28 +0000 (08:47 +0200)]
PVE::ReplicationTools::destroy_all_snapshots - never delete local disks
Dietmar Maurer [Mon, 8 May 2017 05:57:04 +0000 (07:57 +0200)]
PVE::ReplicationTools::sync_guest - do not add snapname to disks_status
Because it is not used at all.
Dietmar Maurer [Mon, 8 May 2017 05:39:47 +0000 (07:39 +0200)]
PVE::ReplicationTools:sync_disk - use $lastsync instead of $job->{lastsync}
Because tghis is the parsed (untainted) value, and we pass this a parameter
to cleanup_snapshot.
Dietmar Maurer [Mon, 8 May 2017 05:36:20 +0000 (07:36 +0200)]
PVE::ReplicationTools::sync_guest - use integer compare for lastsync
Dietmar Maurer [Mon, 8 May 2017 04:55:12 +0000 (06:55 +0200)]
PVE::ReplicationTools::get_snapshot - remove dead code
This function makes no sense and is not used.
Dietmar Maurer [Mon, 8 May 2017 04:42:24 +0000 (06:42 +0200)]
PVE::ReplicationTools: new helper get_ssh_cmd()
Dietmar Maurer [Mon, 8 May 2017 04:28:58 +0000 (06:28 +0200)]
PVE::ReplicationTools::cleanup_snapshot - make sure ip is defined
Dietmar Maurer [Sat, 6 May 2017 15:20:52 +0000 (17:20 +0200)]
use 'eq' instead of regex for simple equality test.
Dietmar Maurer [Fri, 5 May 2017 15:48:29 +0000 (17:48 +0200)]
PVE::ReplicationTools - coding style cleanup
Dietmar Maurer [Fri, 5 May 2017 13:45:27 +0000 (15:45 +0200)]
PVE::ReplicationTools::get_node_ip() - fix arguments for mtunnel
Dietmar Maurer [Fri, 5 May 2017 13:38:52 +0000 (15:38 +0200)]
PVE::ReplicationTools - add missing "use PVE::INotify;"
Dietmar Maurer [Fri, 5 May 2017 13:32:38 +0000 (15:32 +0200)]
PVE::ReplicationTools - remove unused var $cluster_nodes
Dietmar Maurer [Fri, 5 May 2017 13:30:58 +0000 (15:30 +0200)]
PVE::ReplicationTools - only use required modules (remove Time::Local)
Dietmar Maurer [Fri, 5 May 2017 13:27:08 +0000 (15:27 +0200)]
PVE::ReplicationTools - remove useless call to cfs_update
Dietmar Maurer [Fri, 5 May 2017 09:55:34 +0000 (11:55 +0200)]
PVE::API2::Storage::Replication - add reasonable permission checks
Dietmar Maurer [Fri, 5 May 2017 09:23:25 +0000 (11:23 +0200)]
pvesr run: remove wrong permission check
Dietmar Maurer [Fri, 5 May 2017 09:18:30 +0000 (11:18 +0200)]
pvesr: move destroy_job into API class, remove wrong permission checks.
Dietmar Maurer [Fri, 5 May 2017 08:54:10 +0000 (10:54 +0200)]
PVE::API2::Storage::Replication->jobs(): return array
Dietmar Maurer [Fri, 5 May 2017 08:31:51 +0000 (10:31 +0200)]
pvesr: rename list => jobs, call API
to avoid code duplication. I also removed the functioanlity to query
jobs on other nodes, because it is clumsy and not really needed.
Dietmar Maurer [Fri, 5 May 2017 08:01:26 +0000 (10:01 +0200)]
PVE::API2::Storage::Replication - add directory index
Dietmar Maurer [Fri, 5 May 2017 07:18:14 +0000 (09:18 +0200)]
renamed: PVE/API2/StorageReplication.pm -> PVE/API2/Storage/Replication.pm
Wolfgang Bumiller [Fri, 28 Apr 2017 11:55:53 +0000 (13:55 +0200)]
bump version to 5.0-4
Wolfgang Bumiller [Fri, 28 Apr 2017 09:31:46 +0000 (11:31 +0200)]
replica: get_syncable_disks: skip disks with replica=0
Wolfgang Bumiller [Fri, 28 Apr 2017 09:27:59 +0000 (11:27 +0200)]
replica: add missing import
Wolfgang Bumiller [Fri, 28 Apr 2017 08:31:17 +0000 (10:31 +0200)]
replica: cleanup
Wolfgang Link [Mon, 24 Apr 2017 15:15:33 +0000 (17:15 +0200)]
Include pve-replica cronjob.
This is the timer for pvesr run.
Wolfgang Link [Mon, 24 Apr 2017 15:15:32 +0000 (17:15 +0200)]
Include incremental zfs send in storage_migrate.
When replica is enabled and the target host is the reptarget,
the most VM data are on the new target.
Wolfgang Link [Mon, 24 Apr 2017 15:15:31 +0000 (17:15 +0200)]
This patch will include storage asynchronous replication.
It is possible to synchronise a volume to an other node in a defined interval.
So if a node fail there will be an copy of the volumes from a VM
on an other node.
With this copy it is possible to start the VM on this node.
Wolfgang Link [Mon, 24 Apr 2017 15:15:30 +0000 (17:15 +0200)]
Add replicate as new storage feature.
This feature shows that the storage can send and receive images.
Wolfgang Link [Mon, 24 Apr 2017 15:15:29 +0000 (17:15 +0200)]
Add function volume_snapshot_delete_remote.
This function we need for replica to handle snapshots on remote nodes.
Wolfgang Link [Mon, 24 Apr 2017 15:15:28 +0000 (17:15 +0200)]
Add ip parameter in zfs_request to execute on remote host.
We need this function to delete remote snapshots.
Wolfgang Link [Mon, 24 Apr 2017 15:15:27 +0000 (17:15 +0200)]
Include new storage function volume_snapshot_list.
Returns a list of snapshots (youngest snap first) form a given volid.
It is possible to use a prefix to filter the list.
Wolfgang Link [Mon, 24 Apr 2017 15:15:26 +0000 (17:15 +0200)]
Include new storage function volume_send.
If the storage backend support import and export
we can send the contend to a remote host.
Fabian Grünbichler [Mon, 10 Apr 2017 14:22:08 +0000 (16:22 +0200)]
bump version to 5.0-3
Fabian Grünbichler [Mon, 10 Apr 2017 13:29:29 +0000 (15:29 +0200)]
fix run_command return code handling
Fabian Grünbichler [Tue, 21 Mar 2017 09:12:02 +0000 (10:12 +0100)]
bump version to 5.0-2
Fabian Grünbichler [Tue, 21 Mar 2017 09:11:42 +0000 (10:11 +0100)]
rbd: fix rados df parser for luminous
Fabian Grünbichler [Fri, 10 Mar 2017 08:24:11 +0000 (09:24 +0100)]
bump version to 5.0-1
Fabian Grünbichler [Fri, 10 Mar 2017 08:23:51 +0000 (09:23 +0100)]
buildsys: update make upload target for stretch
Dominik Csapak [Wed, 1 Mar 2017 11:03:40 +0000 (12:03 +0100)]
remove immutable flag also for subvols on directory storage
or else the removal of such templates (with rootfs size 0) fails
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>