backupdb: add directory cache #606

Closed
opened 2009-02-06 04:18:23 +00:00 by warner · 3 comments

We can speed up the #598 "tahoe backup" command even more by caching tahoe-side read-only directory contents. At the moment, we have to read every Tahoe directory to find out whether we can share it with a new backup or not. With a table in the backupdb that maps dircap to hash of its contents, we can avoid those reads, and get rid of almost all of the network IO involved in a null backup.

We can speed up the #598 "tahoe backup" command even more by caching tahoe-side read-only directory contents. At the moment, we have to read every Tahoe directory to find out whether we can share it with a new backup or not. With a table in the backupdb that maps dircap to hash of its contents, we can avoid those reads, and get rid of almost all of the network IO involved in a null backup.
warner added the
code-frontend-cli
major
enhancement
1.2.0
labels 2009-02-06 04:18:23 +00:00
warner added this to the undecided milestone 2009-02-06 04:18:23 +00:00

If you like this ticket, you might also like #465 (add a mutable-file cache), #316 (add caching to tahoe proper?), and #300 (macfuse: need some sort of caching).

If you like this ticket, you might also like #465 (add a mutable-file cache), #316 (add caching to tahoe proper?), and #300 (macfuse: need some sort of caching).
Author

now that we've got immutable dirnodes, and I'm working on using them in "tahoe backup" (#828), I want the 1.6.0 release to include this feature, so that "tahoe backup" will be super-efficient.

now that we've got immutable dirnodes, and I'm working on using them in "tahoe backup" (#828), I want the 1.6.0 release to include this feature, so that "tahoe backup" will be super-efficient.
warner modified the milestone from undecided to 1.6.0 2009-11-18 07:48:50 +00:00
Author

Done, in changeset:9901a08fd30efa87.

Done, in changeset:9901a08fd30efa87.
warner added the
fixed
label 2009-11-27 22:47:48 +00:00
Sign in to join this conversation.
No Milestone
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Reference: tahoe-lafs/trac-2024-07-25#606
No description provided.