Data Storage advice required (Was: What is the best implementation for this problem?)

[Jef Patat]

Hi all,

I'm designing an application in which i download stock data as a *.csv file, one file for each stock, which contains 10 columns with floats.

I'm wondering what way is the best way to store these data.

Obviously I do not want to keep x files for x stocks since x might become quite large over time.

I have been reading about xml but that seems like an awefull lot of overhead compared to csv.

Since, in a later stadium, I would like to make it open source I would also like to do this in a correct way.

How would you guys solve this? Please give a little motivation so everybody can learn out of the answers.

Thanks a lot guru's

kind regards

Jef Patat

[cjard]

you have data and youre wondering where to base it.. ;)

[Dmorley]

Yeah, a database is the ideal solution for what you are asking....a well designed db will be able to handle any number of files.

If you want your program to become opensource in the end, then maybe think about using an opensource db engine (mySql (http://www.mysql.org/), Firebird (http://www.firebirdsql.org/) ) to store your info.