Will Dyson on Wed, 12 Jun 2002 03:09:34 -0400


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PLUG] Optimizatoins? MySQL, 1.2Gb tables, lots of random selects...


Michael F. Robbins wrote:
On Tue, 2002-06-11 at 18:22, Walt Mankowski wrote:

On Tue, Jun 11, 2002 at 11:14:38AM -0400, Kyle R . Burton wrote:

(varchar 15), and a blob column.  The average size of the blob column
is about 1k (1099 bytes) - it has to be a blob (it's binary data - a
compressed data structure).


Depending on the specifics of the application, it may make more sense to
store your data structure right on the filesystem
(/path/to/mydata/PRIMARYKEY or similar). I've found that reading a few
kilobytes from a blob is quite slow: overhead in translating from
BDB/InnoDB/whatever to raw data, then transferring it to your app. You'll probably waste some unused inode space because of your small file
sizes, but it might be worth it. However, I could certainly see that a
directory with a million files would cause many problems of its own.

Small files, large directories. These are the circumstances in which ReiserFS really shines. It does effecient packing of file tails and uses B-trees to store directories.


This is not to say that there would be no overhead, but it would degrade much slower than ext2/3.

--
Will Dyson
"Back off man, I'm a scientist!" -Dr. Peter Venkman


______________________________________________________________________ Philadelphia Linux Users Group - http://www.phillylinux.org Announcements-http://lists.phillylinux.org/mail/listinfo/plug-announce General Discussion - http://lists.phillylinux.org/mail/listinfo/plug