]>
git.proxmox.com Git - pve-storage.git/log
Wolfgang Link [Tue, 10 Oct 2017 07:43:52 +0000 (09:43 +0200)]
Add logfung in storage_migrate
The log function is used by storage replication to redirect the output in the correct log.
Emmanuel Kasper [Mon, 9 Oct 2017 08:39:18 +0000 (10:39 +0200)]
ISCSIPlugin: Use long options for readability
We otherwise use the long options everywhere in the plugin.
This will build the following command:
iscsiadm --mode session --sid 1 --rescan
Rescanning session [sid: 1, target: xxx, portal: yyy]
Fabian Grünbichler [Wed, 4 Oct 2017 09:05:33 +0000 (11:05 +0200)]
build: reformat debian/control
using wrap-and-sort -abt
Wolfgang Bumiller [Tue, 12 Sep 2017 11:46:44 +0000 (13:46 +0200)]
bump version to 5.0-15
Fabian Grünbichler [Mon, 11 Sep 2017 10:31:06 +0000 (12:31 +0200)]
rbd: support auth=none if pveceph-managed
preserve the old behaviour of selecting auth_supported based on the
existence of the keyring, but limit it to external clusters.
this allows switching 'auth XXX required' in the pveceph-managed
ceph.conf while still automatically copying the keyring when adding a
storage.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Thu, 7 Sep 2017 11:18:17 +0000 (13:18 +0200)]
require libpve-common-perl >= 5.0-17
the new is_mountpoint uses PVE::JSONSchema::parse_boolean
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Thu, 7 Sep 2017 10:51:26 +0000 (12:51 +0200)]
rbd: create ceph keyring dir before copying
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Tue, 5 Sep 2017 12:59:33 +0000 (14:59 +0200)]
rbd: manage keyring for pveceph storages
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Tue, 5 Sep 2017 12:59:32 +0000 (14:59 +0200)]
rbd: implement handling of unset monhost
add /etc/pve/ceph.conf to commands / option strings instead
of the monitor list provided via the 'monhost' option.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Tue, 5 Sep 2017 12:59:31 +0000 (14:59 +0200)]
rbd: refactor cmdline helpers
these were line by line identical except for the binary path
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Tue, 5 Sep 2017 12:59:30 +0000 (14:59 +0200)]
rbd: make monhost option optional
to allow differentiating between user-created external RBD storage
entries (WITH monhost), and those created and managed by pveceph
(without).
making monhost non-fixed allows easily opting into the managed behaviour via
'pvesm set STORAGE -delete monhost', but is also helpful for external clusters
(i.e., after adding or removing a monitor you need to update the monhost
parameter..)
adapt description accordingly.
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Wolfgang Bumiller [Fri, 28 Jul 2017 07:52:43 +0000 (09:52 +0200)]
dir: allow a path as is_mountpoint value
This turns is_mountpoint more into export(5)'s `mountpoint`
property.
Given the directory storage with the properties:
path /a/b/c
is_mountpoint $value
$value = yes
Same as before, /a/b/c must be mounted.
$value = no (or not set)
Same as before, no effect.
$value = /a/b
New: /a/b must be mounted (as opposed to /a/b/c)
Wolfgang Bumiller [Thu, 10 Aug 2017 11:27:11 +0000 (13:27 +0200)]
bump version to 5.0-14
Wolfgang Bumiller [Thu, 10 Aug 2017 11:24:40 +0000 (13:24 +0200)]
cleanup: call defined() early
No need to carry around a hash we don't need if we get one.
Philip Abernethy [Thu, 10 Aug 2017 11:14:52 +0000 (13:14 +0200)]
Fix #1474: Fixes input and output of print_storage
Accommodates changes in
44ae567 and
d40e27d by
reordering checks to allow for proper filtering
of disabled storages. Also reorders two checks to
prevent autovivification resulting in disabled
storages always showing in output.
Fabian Grünbichler [Tue, 8 Aug 2017 09:11:05 +0000 (11:11 +0200)]
bump version to 5.0-13
Dominik Csapak [Fri, 4 Aug 2017 14:32:48 +0000 (16:32 +0200)]
add info about bluestore to disklist
this patch adds information about bluestore/db/wal to the disklist,
and we set the journal count only when we have at least one journal on
the disk
also adapt the regression tests
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Wolfgang Bumiller [Thu, 27 Jul 2017 12:17:02 +0000 (14:17 +0200)]
pvesm: remove superfluous space after N/A
Thomas Lamprecht [Thu, 27 Jul 2017 10:16:46 +0000 (12:16 +0200)]
pvesm status: improve output and its format
Add column names at top of output, this allows easier understanding
of what each column means.
Use leading spaces on the percentage column so that this is lined up.
Switch out the 1/0 from the active column with the actual status
(active, inactive, disabled).
Show N/A if storage is disabled.
Use $res->{total} instead of calculating a sum of used and available.
Remove wrong rounding - if we want to display 2 digits from the
fractional part we would need to add 0.005 not 0.5, this made the
result quite wrong depending on the storage size.
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
Thomas Lamprecht [Thu, 27 Jul 2017 10:16:45 +0000 (12:16 +0200)]
storage_info: return also disabled storages
in the Storage/Status API call we have a 'enabled' param which had no
effect because storage_info only returned enabled one way or the
other.
This affected also `pvesm status` which uses the Storage/Status API
call.
So push also disabled storages to the info array but only activate
and get their status when thei are enabled.
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
Dietmar Maurer [Tue, 4 Jul 2017 04:13:54 +0000 (06:13 +0200)]
bump version to 5.0-12
Wolfgang Link [Mon, 3 Jul 2017 15:12:52 +0000 (17:12 +0200)]
fix ceph_version_parser
Ceph change ceph version output.
full output of 'ceph --version'
Luminous 'ceph version 12.1.0 (
262617c9f16c55e863693258061c5b25dea5b086 ) luminous (dev)'
Jewel 'ceph version 10.2.7 (
50e863e0f4bc8f4b9e31156de690d765af245185 )'
Wolfgang Bumiller [Fri, 30 Jun 2017 07:22:33 +0000 (09:22 +0200)]
bump version to 5.0-11
Emmanuel Kasper [Thu, 29 Jun 2017 12:48:13 +0000 (14:48 +0200)]
Fixes: #1415 do not block pvestatd when nfsd is stopped on the server side
Wrap the -d test with run_or_get_killed sub this test
can make pvestatd hang on I/O wait when a nfsd process is stopped
This might help with other file based storages, for instance
directory storages on unplugged USB devices.
Dietmar Maurer [Tue, 27 Jun 2017 04:20:04 +0000 (06:20 +0200)]
bump version to 5.0-10
Dietmar Maurer [Tue, 27 Jun 2017 04:17:58 +0000 (06:17 +0200)]
PVE::Storage::storage_can_replicate - hew helper
Dietmar Maurer [Thu, 22 Jun 2017 15:36:34 +0000 (17:36 +0200)]
bump version to 5.0-9
Wolfgang Bumiller [Thu, 22 Jun 2017 12:21:52 +0000 (14:21 +0200)]
import/export: drop the 'subvol/' prefix from 'tar+size'
It was deemed an unnecessary overhead.
Also add a comment about the effect (or lack thereof) of
user namespace uid mappings.
Emmanuel Kasper [Thu, 22 Jun 2017 08:42:39 +0000 (10:42 +0200)]
Fix #1424: allow tar.xz templates upload
Dietmar Maurer [Thu, 22 Jun 2017 10:49:31 +0000 (12:49 +0200)]
bump version to 5.0-8
Wolfgang Bumiller [Thu, 22 Jun 2017 10:24:39 +0000 (12:24 +0200)]
import/export: use our standard tar flags
Custom plugins may reuse
@PVE::Storage::Plugin::COMMON_TAR_FLAGS as well.
Wolfgang Bumiller [Thu, 22 Jun 2017 10:24:38 +0000 (12:24 +0200)]
storage_migrate: with_snapshots parameter
Since the migration code already has to check snapshots and
we still want to be able to migrate raw disks, we cannot
always pass -with-snapshots 1.
Dietmar Maurer [Thu, 22 Jun 2017 07:07:27 +0000 (09:07 +0200)]
bump version to 5.0-7
Dietmar Maurer [Thu, 22 Jun 2017 07:05:29 +0000 (09:05 +0200)]
re-add changes to PVE/Storage/Plugin.pm (fixup previous commit)
This was removed by accident.
Dietmar Maurer [Thu, 22 Jun 2017 06:36:11 +0000 (08:36 +0200)]
bump version to 5.0-6
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:39 +0000 (14:59 +0200)]
migrate: only use import/export
This replaces the path-based and lvm/thin special cases in
storage_migrate with the already generic-enough zfspool
case which is already using import/export and does not
directly depend on zfs anymore.
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:37 +0000 (14:59 +0200)]
lvm: import/export: implement raw+size format
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:36 +0000 (14:59 +0200)]
import/export: new formats: raw, tar, qcow2, vmdk
All of them have a `+size` prefix to show that they're not
"pure raw" or "pure tar" streams, because some storage may
need to know in advance how much storage to allocate.
The formats are explained in comments.
PVE::Storage::Plugin now has default implementations for
these for non-incremental streams exporting the current
(rather than a snapshot state).
To use qcow2 or vmdk formats $with_snapshots must be true,
otherwise raw/tar will be used where $with_snapshots must
be false.
Wolfgang Bumiller [Wed, 21 Jun 2017 12:59:35 +0000 (14:59 +0200)]
export: add missing format query call parameter
Fabian Grünbichler [Mon, 12 Jun 2017 08:14:54 +0000 (10:14 +0200)]
build: remove fakeroot from dpkg-buildpackage
Fabian Grünbichler [Mon, 12 Jun 2017 08:13:55 +0000 (10:13 +0200)]
build: add substitution variable
Fabian Grünbichler [Mon, 12 Jun 2017 08:13:38 +0000 (10:13 +0200)]
build: reformat b-d and depends
Thomas Lamprecht [Fri, 9 Jun 2017 15:20:09 +0000 (17:20 +0200)]
change from dpkg-deb to dpkg-buildpackage
add debian directory and move the respective files there and add
missing (rules, compat).
Move control.in to control as no sed search & replacement must be
done. Add a Source section to the control file.
Rename the "check" Makefile target to "test" so that the dh_auto_test
helper executes it automatically on build.
Move the verify_api check to this target.
Cleanup the "clean" target and remove outdated commented out stuff
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:03 +0000 (10:04 +0200)]
migrate: insecure: untaint the received ip/port
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:02 +0000 (10:04 +0200)]
migrate: don't include the hostname in rsync's rsh command
Wolfgang Bumiller [Tue, 6 Jun 2017 08:04:01 +0000 (10:04 +0200)]
migrate: use the correct IP with rsync
Dietmar Maurer [Thu, 8 Jun 2017 06:45:22 +0000 (08:45 +0200)]
ZFSPoolPlugin.pm: remove unused code
Dietmar Maurer [Wed, 7 Jun 2017 04:36:55 +0000 (06:36 +0200)]
PVE::Storage::volume_snapshot_list - remove comment about ordering
Some storage types supports arbitrary snapshot trees, so there is
no strict ordering relation.
Dietmar Maurer [Wed, 7 Jun 2017 04:20:07 +0000 (06:20 +0200)]
PVE::Storage::volume_snapshot_list - remove $prefix parameter
Always return the full list of snapshots. Users of this library can easily
filter with a simply 'grep' instead.
Dietmar Maurer [Wed, 7 Jun 2017 04:12:50 +0000 (06:12 +0200)]
remove unused replication code (moved to pve-manager)
Fabian Grünbichler [Wed, 17 May 2017 09:42:38 +0000 (11:42 +0200)]
build: run tests when building deb
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:37 +0000 (11:42 +0200)]
disktest: exit with -1 in case of failures
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:36 +0000 (11:42 +0200)]
zfstest: exit with -1 in case of failures
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:35 +0000 (11:42 +0200)]
zfstest: skip tests if ZFS is not available
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:34 +0000 (11:42 +0200)]
zfstest: remove unused variable
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:33 +0000 (11:42 +0200)]
zfstest: fix typos
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:32 +0000 (11:42 +0200)]
zfstest: use truncate instead of dd
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:31 +0000 (11:42 +0200)]
zfstest: improve reset behaviour
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:30 +0000 (11:42 +0200)]
zfstest: wait for devices to settle after creation
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:29 +0000 (11:42 +0200)]
zfstest: fix test description
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Fabian Grünbichler [Wed, 17 May 2017 09:42:28 +0000 (11:42 +0200)]
zfstest: fix test 17 to actually deactivate storage
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
Dominik Csapak [Tue, 16 May 2017 12:53:54 +0000 (14:53 +0200)]
fix #1379: return size as number instead of string
this caused the webinterface to sort alphabetically instead of numerical
when sorting by image size
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
Wolfgang Bumiller [Tue, 30 May 2017 13:30:08 +0000 (15:30 +0200)]
migrate: add insecure parameter
This uses mtunnel's new -run-command parameter in
combination with the ssh-info's network cidr option to use
an unprotected TCP port.
Wolfgang Bumiller [Mon, 29 May 2017 13:16:58 +0000 (15:16 +0200)]
migrate: implement rate limiting
Note that it does not apply to the local 'mkdir && cp' case.
Dietmar Maurer [Thu, 1 Jun 2017 07:42:23 +0000 (09:42 +0200)]
bump version to 5.0-5
Wolfgang Bumiller [Tue, 23 May 2017 10:30:20 +0000 (12:30 +0200)]
Revert "free: added snapshot parameter"
This reverts commit
a26e1abc70e087a7f42e8197ef080222990a680f .
Wolfgang Bumiller [Tue, 23 May 2017 10:30:19 +0000 (12:30 +0200)]
migrate: cleanup & fixup
The volume_snapshot call was missing the condition when to
create a snapshot. Make the whole logic easier to follow
with a $migration_snapshot boolean.
Also get rid of the remote `pvesm free -snapshot` call by
using import's new -delete-snapshot parameter.
Wolfgang Bumiller [Tue, 23 May 2017 10:30:18 +0000 (12:30 +0200)]
import: add -delete-snapshot parameter
This deletes a snapshot on *success*, done directly in the
CLI handler, as the rollback/delete on failure is already
happening inside the plugin's import method.
Wolfgang Bumiller [Tue, 23 May 2017 07:04:47 +0000 (09:04 +0200)]
migrate: replace target ip parameter with sshinfo parameter
Wolfgang Bumiller [Mon, 22 May 2017 08:16:21 +0000 (10:16 +0200)]
migrate: snapshot parameter for use with replication
Fabian Grünbichler [Fri, 12 May 2017 13:01:08 +0000 (15:01 +0200)]
migrate: cleanup: $free is always defined
Wolfgang Bumiller [Fri, 12 May 2017 09:56:11 +0000 (11:56 +0200)]
migrate: query transfer stream formats
Wolfgang Bumiller [Fri, 12 May 2017 09:56:10 +0000 (11:56 +0200)]
api: add import/export format querying
Wolfgang Bumiller [Fri, 12 May 2017 09:56:09 +0000 (11:56 +0200)]
migrate: snapshot parameter for incremental transfer
Wolfgang Bumiller [Fri, 12 May 2017 09:56:08 +0000 (11:56 +0200)]
migrate: use pvesm import/export for zfs
The only leftover zfs specific part here is the zfs format
type parameter.
Wolfgang Bumiller [Fri, 12 May 2017 09:56:07 +0000 (11:56 +0200)]
free: added snapshot parameter
Wolfgang Bumiller [Fri, 12 May 2017 09:56:06 +0000 (11:56 +0200)]
pvesm: import/export commands
Dietmar Maurer [Wed, 10 May 2017 05:20:00 +0000 (07:20 +0200)]
Revert "Include incremental zfs send in storage_migrate."
This reverts commit
4537523b5af8846a6de659e718ab1a81db882e1b .
We want to use send/receive for this - patch will follow.
Dietmar Maurer [Wed, 10 May 2017 05:06:35 +0000 (07:06 +0200)]
do not install replication code
The code introduces a cyclic package dependency, so we need to
move it to pve-manager package.
Dietmar Maurer [Wed, 10 May 2017 05:02:42 +0000 (07:02 +0200)]
volume_snapshot_list: remove $ip parameter
We want to handle ssh connections somewhere else (not inside the
storage plugins).
Dietmar Maurer [Wed, 10 May 2017 04:58:44 +0000 (06:58 +0200)]
Revert "Include new storage function volume_send."
This reverts commit
b76774e57fe66a483a7544ec5a05ba2e998eb836 .
Dietmar Maurer [Wed, 10 May 2017 04:55:42 +0000 (06:55 +0200)]
Revert "Add ip parameter in zfs_request to execute on remote host."
This reverts commit
c4bb4a3d1999c600565865313a7c1e1dc58a1cb8 .
Dietmar Maurer [Wed, 10 May 2017 04:55:00 +0000 (06:55 +0200)]
Revert "Add function volume_snapshot_delete_remote."
This reverts commit
4bd0b38f53f41fb8dfd4a6a6a3748e332b7727eb .
Dietmar Maurer [Wed, 10 May 2017 04:51:26 +0000 (06:51 +0200)]
Revert "Include pve-replica cronjob."
This reverts commit
fd69be974c30e43837dddff50a1c378514923359 .
Dietmar Maurer [Tue, 9 May 2017 09:45:12 +0000 (11:45 +0200)]
PVE::ReplicationTools::update_conf - correctly catch exception
Dietmar Maurer [Tue, 9 May 2017 05:11:07 +0000 (07:11 +0200)]
ReplicationTools.pm: call PVE::INotify::nodename inside methods
so that we can overwrite it using Test::MockModule. This makes writing
regression tests easier.
Dietmar Maurer [Tue, 9 May 2017 05:08:17 +0000 (07:08 +0200)]
ReplicationTools.pm_ do not pass $local_node to volume_snapshot_list
Dietmar Maurer [Tue, 9 May 2017 04:35:03 +0000 (06:35 +0200)]
ReplicationTools.pm: rename $get_guestconfig to get_guest_config
make it a real sub
Dietmar Maurer [Tue, 9 May 2017 04:23:23 +0000 (06:23 +0200)]
rename get_syncable_guestdisks to get_replicatable_volumes
Dietmar Maurer [Tue, 9 May 2017 04:20:24 +0000 (06:20 +0200)]
ReplicationTools: use get_replicatable_volumes()
Dietmar Maurer [Mon, 8 May 2017 10:05:39 +0000 (12:05 +0200)]
PVE::ReplicationTools::get_node_ip - do not pass noerr to PVE::Cluster::remote_node_ip()
We need an IP address.
Dietmar Maurer [Mon, 8 May 2017 08:22:57 +0000 (10:22 +0200)]
PVE::ReplicationTools - s/delet/delete/
Dietmar Maurer [Mon, 8 May 2017 07:29:57 +0000 (09:29 +0200)]
use consistent snapshot prefix for replicas
Dietmar Maurer [Mon, 8 May 2017 06:47:28 +0000 (08:47 +0200)]
PVE::ReplicationTools::destroy_all_snapshots - never delete local disks
Dietmar Maurer [Mon, 8 May 2017 05:57:04 +0000 (07:57 +0200)]
PVE::ReplicationTools::sync_guest - do not add snapname to disks_status
Because it is not used at all.
Dietmar Maurer [Mon, 8 May 2017 05:39:47 +0000 (07:39 +0200)]
PVE::ReplicationTools:sync_disk - use $lastsync instead of $job->{lastsync}
Because tghis is the parsed (untainted) value, and we pass this a parameter
to cleanup_snapshot.
Dietmar Maurer [Mon, 8 May 2017 05:36:20 +0000 (07:36 +0200)]
PVE::ReplicationTools::sync_guest - use integer compare for lastsync
Dietmar Maurer [Mon, 8 May 2017 04:55:12 +0000 (06:55 +0200)]
PVE::ReplicationTools::get_snapshot - remove dead code
This function makes no sense and is not used.
Dietmar Maurer [Mon, 8 May 2017 04:42:24 +0000 (06:42 +0200)]
PVE::ReplicationTools: new helper get_ssh_cmd()
Dietmar Maurer [Mon, 8 May 2017 04:28:58 +0000 (06:28 +0200)]
PVE::ReplicationTools::cleanup_snapshot - make sure ip is defined