how does the whole system handle lots of file-upload tasks? #337

New Issue

zooko · 2008-03-10T19:51:16Z

zooko commented

2008-03-10 19:51:16 +00:00

Fabrice, the entrepeneur behind Allmydata, says that our reference test should be 25,000 files and 100 GB -- "VERY WELL and RELIABLY!". He says this is necessary to be competitive with Carbonite, Mozy, etc.. He promises to raise the bar to 100,000 files and 500 GB as soon as we reach 25,000 files and 100 GB. ;-)

This ticket is to implement automated measurements of the performance of the lots of file-upload tasks (with various levels of parallelism?), connecting to some relatively stable grid.

Fabrice, the entrepeneur behind Allmydata, says that our reference test should be 25,000 files and 100 GB -- "VERY WELL and RELIABLY!". He says this is necessary to be competitive with Carbonite, Mozy, etc.. He promises to raise the bar to 100,000 files and 500 GB as soon as we reach 25,000 files and 100 GB. ;-) This ticket is to implement automated measurements of the performance of the lots of file-upload tasks (with various levels of parallelism?), connecting to some relatively stable grid.

zooko added the

labels 2008-03-10 19:51:16 +00:00

zooko added this to the eventually milestone 2008-03-10 19:51:16 +00:00

zooko commented

2008-03-10 19:51:48 +00:00

To what degree the Tahoe node sees the file-upload tasks as parallel or sequential is up to the Windows native client, and invisible to this automated test.

zooko changed title from ~~how does the Windows native client handle lots of file-upload tasks?~~ to how does the whole system including the Windows native client handle lots of file-upload tasks?

2008-03-10 19:54:59 +00:00

zooko commented

2008-03-10 19:59:32 +00:00

Note that we have to do this test manually before making a release of the allmydata.com backup product (and if we don't, Fabrice will). This ticket is about automating that process.

Note that we *have* to do this test manually before making a release of the allmydata.com backup product (and if we don't, Fabrice will). This ticket is about automating that process.

tahoe-lafs changed title from ~~how does the whole system including the Windows native client handle lots of file-upload tasks?~~ to how does the whole system handle lots of file-upload tasks?

2011-01-03 02:46:22 +00:00

Sign in to join this conversation.