NYCPHP Meetup

[chalu at egenius.com]

Try to use Btree as in binary tree. In a folder with many files like more than 50,000, it will crawl. Any would.

That is why in Zope, there is a binary tree by Andy Mckay (is that Andy's work?) to deal with this type of stuff.
 
Or you can create many folders (simulating btree with folders). Create hashes (indices) to store where XML files are at. 

However, the fact you have that many files is like a need to re-think your solution. Perhaps, you can use Sleepycat DB. 

All the best

Larry Chuon <LarryC at indexstock.com> wrote ..
> I'm doing everything that you mention below.  Each file associates with
> a
> product.  It also has an image as well.  The image will have IPTC header
> that describe the product, price, model, make and etc.  Let me know if
> you
> need more info.  Thanks.
> 
> -----Original Message-----
> From: Jon Baer [mailto:jonbaer at jonbaer.net]
> Sent: Tuesday, May 06, 2003 4:46 PM
> To: NYPHP Talk
> Subject: Re: [nycphp-talk] XML files
> 
> What are you looking to do with the files? (ie, display, query, export,
> etc)
> . when in doubt, go SAX :-)
> 
> - Jon
> 
> ----- Original Message -----
> From: "Larry Chuon" <LarryC at indexstock.com>
> To: "NYPHP Talk" <talk at nyphp.org>
> Sent: Tuesday, May 06, 2003 1:41 PM
> Subject: [nycphp-talk] XML files
> 
> 
> > I have nearly a million XML files generated from the database for products
> > in my OSSuite application.  What is the best way to handle so many tiny
> > files?  Windows crawl to its knees when I try to open up the directory
> where
> > the files locate at.  Is there a way to optimize disk I/O?
> >
> >
> >
> >
> >
> >
> >
> 
> 
> 
> 
> 
> 
> --- Unsubscribe at http://nyphp.org/list/ ---