tahoe-lafs/tahoe-lafs
tahoe-lafs/tahoe-lafs
2
0
Fork 0
Code Issues Pull Requests23 Packages Projects Releases1 Wiki Activity
5,886 Commits 200 Branches 89 Tags 162 MiB
e0f8942abd
Commit Graph

5886 Commits

Author SHA1 Message Date
David-Sarah Hopwood
e0f8942abd openstack_container.py: remove a superfluous argument to get_auth_info_locked. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
46b00cfbd6 accounting_crawler.py: disable removing leasedb entries for disappeared shares. 
This works around ticket  for now.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
96291392d3 openstack_container.py: avoid logging secrets in request headers. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
70b8d5ac67 docs: add references to OpenStack/cloud backend in configuration.rst and running.rst. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
fa2cf092e3 OpenStack: generalize to support multiple auth protocols, and add V2 protocol. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
f311418382 OpenStack: add _http_request helper. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
4e04008e75 openstack_container.py: factor out HTTP response code checking. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
ea8ec9c137 docs/backends/cloud.rst: add documentation for OpenStack config parameters. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
956601dd16 openstack_container.py: improve name of _auth_lock; simplify by using DeferredLock.run. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
27d4810349 OpenStack: change provider names to rackspace.com and rackspace.co.uk. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
7db6c7f028 test_storage.py: add tests for OpenStackContainer. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:55 +01:00
David-Sarah Hopwood
f53ef0baf1 openstack_container.py: disable or remove debug prints. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
3a76e63690 openstack_container.py: fix a bug in type of ContainerListing.is_truncated. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
4f1b51a26c Move classes common to mock and OpenStack cloud services, to cloud_common.py. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
18a30d4d25 test_storage.py: refactor OpenStackCloudBackend to make it easier to add new tests. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
ed6ee84786 OpenStack: mostly complete implementation of OpenStackContainer. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
b9a9f9f30b OpenStack: improve logging in openstack_container.py. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
e85b97b253 OpenStack: add openstack.container config parameter. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
5792a602a5 Add test for OpenStack authentication client. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
b20f10ee10 openstack_container.py: add shutdown() to avoid unclean reactor errors in tests. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
a4d66b49d0 openstack_container.py: add _ prefix to private attributes. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
6a4f26456c setup.py: add allmydata.storage.backends.cloud.openstack module. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
ff8cd14fac test_client.py: add OpenStack config tests. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
0da49ed0d7 test_client.py: cleanups to S3 config tests. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
0e7e3bc51e OpenStack service: add AuthenticationClient. 
Configure using properties relevant to OpenStack.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
2dc48bc8c5 Add stub OpenStack container impl. as a copy of S3 container impl. 
Generalize the container instantiation to work for either.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
3c54924ecd Fix interface violations introduced in cloud merge. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
Daira Hopwood
9160181d83 Make backupdb use dbutil. 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:54 +01:00
Daira Hopwood
d29cfe15a5 Comment changes for ticket ref 
Signed-off-by: Daira Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
598cd91f70 Makefile: have 'make tmpfstest' unmount and remove stale temp directories. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
5438f4b35b Makefile: the timing for 'make tmpfstest' should exclude filesystem 
mounting/unmounting and entering the password if needed.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
Daira Hopwood
d6d759f590 Makefile: allow tmpfs size to be more easily overridden, and use 500 MiB by default (rebased). 
(The kernel will only allocate space that is used; the limit is just in case
tests write more than expected.)

Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
cd67298d66 test_runner.py: add test for 'tahoe debug trial'. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
Daira Hopwood
9b18949c91 Fixes to tests. Some tests are applied to multiple backends. 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
c896cfc2c1 Fixes to test infrastructure. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
03e02eeece Miscellaneous corrections and additions. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
b2b91a6aaf Changes to crawler classes (ShareCrawler and AccountingCrawler). 
Pass in a Clock to allow (in theory) deterministic testing, although this isn't used yet by tests.
Simplify the generic ShareCrawler code by not attempting to track state during processing
of a single prefix.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
Daira Hopwood
a79d3d69fb Changes to fileutil. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
97268cc95f Fix bugs in Accountant. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
David-Sarah Hopwood
d0d17ff152 Simplify Account. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:54 +01:00
Daira Hopwood
230e57906d Changes to debug.py. 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:53 +01:00
Daira Hopwood
cdbc1bcf36 Changes to node classes (Node, Client and StorageServer). 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:53 +01:00
Daira Hopwood
26aa98b9f4 Changes to Bucket{Reader,Writer} and disk backend (rebased). 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:53 +01:00
David-Sarah Hopwood
5a5622ce1d Changes and additions to interface documentation. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 01:33:53 +01:00
Daira Hopwood
7202791c3f Add new files for cloud merge (rebased). 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 01:33:33 +01:00
David-Sarah Hopwood
8faca7bc72 Move BucketWriter and BucketReader to storage/bucket.py. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 00:47:02 +01:00
David-Sarah Hopwood
434f781432 Move code around and add new directories for cloud backend merge. 
Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 00:47:02 +01:00
David-Sarah Hopwood
8c92b50a33 Add dependency on our fork of txAWS (0.2.1.post5). 
Add 'six' to ignorable package list because it is a dependency of txAWS via python-dateutil.

Signed-off-by: David-Sarah Hopwood <david-sarah@jacaranda.org>
 2014-04-09 00:47:02 +01:00
Daira Hopwood
61727bf2ec .gitignore: changes to facilitate cloud backend merge (rebased). 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 00:46:57 +01:00
Daira Hopwood
c24a0b8270 Add documentation for each storage backend (rebased). 
Signed-off-by: Daira Hopwood <daira@jacaranda.org>
 2014-04-09 00:43:30 +01:00