durusmail: qp: Re: Anyone Replaced Durus with MySQL or Postgres in QP?
Anyone Replaced Durus with MySQL or Postgres in QP?
2007-09-11
2007-09-11
2007-09-20
2007-09-20
Anyone Replaced Durus with MySQL or Postgres inQP?
2007-09-11
Re: Anyone Replaced Durus with MySQL or Postgres in QP?
2007-09-12
Michael Watkins (4 parts)
2007-09-13
2007-09-13
2007-09-13
2007-09-13
2007-09-13
2007-09-13
2007-09-13
Re: Anyone Replaced Durus with MySQL or Postgres in QP?
David Binger
2007-09-13
On Sep 12, 2007, at 11:29 PM, Michael Watkins wrote:

> Incidentally, I did some very limited testing (more throwing mud at
> the wall than anything) of a 5M object Durus with either Shelf or
> File storage and didn't come away from that noticing much in the way
> of surprising differences. It might be I wasn't paying attention
> though... what ought one expect to see with the newer ShelfStorage?

After the ShelfStorage is packed, you should see a huge difference.
ShelfStorage does not load the packed index at startup or ever, so
the 100 bytes per object rule only applies to objects commited since
the last pack.  Since packing can happen at any time on a live server,
this means that the memory footprint and startup time of shelf storage
is reduced to essentially constant time:  you can have a billion objects
in a packed ShelfStorage database and startup time will still be
very small.  The only thing startup does on a packed ShelfStorage
is read the headers of the file and determine the one offset of the
start
of the packed index.


reply