[Bioperl-l] Large databases
hlapp at gmx.net
Thu Nov 30 11:29:51 EST 2006
You are aware that you are getting close (or possibly beyond,
depending on the exact numbers and if there is any overhead for each
integer) the 2GB signed int boundary? Did you make sure that your dbm
version is 64-bit enabled and supports 64 bit for filesize?
On Nov 30, 2006, at 1:22 AM, Daniel Jupiter wrote:
> Hi all.
> I'm new to this list, so if my question is misdirected, or
> inappropriate, please let me know.
> The question concerns databases/hashes. I would like to have a
> rather large hash file. Say 10,000 keys, each with a data field
> containing roughly 50,000 integers. For whatever reason, the dbm
> implementation on Mac OSX does not seem to like things of this size.
> Several strange things happen. First, file size seem to increase
> exponentially, as I increase the data field size. Additionally, in
> certain situations, I am returned a rather strange error concerning
> an uninitialized variable, which has in fact been initialized.
> In great confusion, I'm just curious as to whether there is a work
> around for dealing with such large amounts of data, or somewhere
> with good documentation on using hashes.
> Daniel C. Jupiter, Ph.D.
> Postdoctoral Research Associate
> Department of Systems Biology and Translational Medicine
> College of Medicine
> Texas A&M University Health Science Center
> 702 SW H.K. Dodgen Loop
> Temple, TX 76504
> 979.997.2106 | Fax 254.742.7145
> djupitern at tamu.edu | www.tamhsc.edu
> Bioperl-l mailing list
> Bioperl-l at lists.open-bio.org
: Hilmar Lapp -:- Durham, NC -:- hlapp at gmx dot net :
More information about the Bioperl-l