High-level benchmarking suite, as part of attempt to speed up Tahoe #3955

Open
opened 2022-12-14 15:48:10 +00:00 by itamarst · 1 comment

We should have a broader benchmarking attempt, involving:

  • Defining metrics
  • Defining goals

Two aspects:

  • User experience
  • Server-side load

UX is probably more important at this point, but eventually if that's finished server load will become an issue.

Metrics:

  • Latency (single upload/download)
  • Throughput (batch uploads/downloads)

Bottlenecks will be network latency, CPU, network bandwidth. If we've hit point where network bandwidth is the bottleneck, we're done optimizing.

Throughput depends on usage patterns of:

  • tahoe cp
  • tahoe backup
  • sftp
  • Magic Folders
  • Third party backup tools that integrate with Tahoe (duplicaty? duplicati? borg?)

Knobs: number of backend storage servers, network latency.

We should have a broader benchmarking attempt, involving: - Defining metrics - Defining goals Two aspects: - User experience - Server-side load UX is probably more important at this point, but eventually if that's finished server load will become an issue. Metrics: - Latency (single upload/download) - Throughput (batch uploads/downloads) Bottlenecks will be network latency, CPU, network bandwidth. If we've hit point where network bandwidth is the bottleneck, we're done optimizing. Throughput depends on usage patterns of: - `tahoe cp` - `tahoe backup` - sftp - Magic Folders - Third party backup tools that integrate with Tahoe (duplicaty? duplicati? borg?) Knobs: number of backend storage servers, network latency.
itamarst added the
unknown
normal
task
n/a
labels 2022-12-14 15:48:10 +00:00
itamarst added this to the undecided milestone 2022-12-14 15:48:10 +00:00
itamarst changed title from High-level benchmarking suite to High-level benchmarking suite, as part of attempt to speed up Tahoe 2022-12-14 15:48:28 +00:00
Author

Might want to get https://github.com/tahoe-lafs/tahoe-lafs/pull/1208 merged and then rely on the code that was refactored out of the tests.

Might want to get <https://github.com/tahoe-lafs/tahoe-lafs/pull/1208> merged and then rely on the code that was refactored out of the tests.
itamarst modified the milestone from undecided to Performance and Benchmarking 2023-08-17 17:14:07 +00:00
Sign in to join this conversation.
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Reference: tahoe-lafs/trac-2024-07-25#3955
No description provided.