forum.vdsworld.com

DW · Contributor Joined: 21 Mar 2003 Posts: 175 Location: UK

What the best way to open files in a list or edit box?

I have files that I want to open, there size can be anything from a few bytes to 10meg +

I have tried loading it into a list but it runs out of memory.
Wordpad can do it, so how can I make VDS do it?

Mac · Posted: Wed Apr 21, 2004 12:03 pm Post subject:

Dr. Dread can prolly help ya on this - he has experience with
very large files (much more than 10 mb) in VDS.

A little more detail on what you're trying to accomplish might
help - it's possible that direct file IO might be a better choice.

Also (depending on what version of VDS ya have) a standard
VDS EDIT box is limited to either 32k or 64k. Wink

Cheers, Mac Smile

DW · Contributor Joined: 21 Mar 2003 Posts: 175 Location: UK

Ok sure.

I have a huge list of hosts, and its always growing.
I am trying to come up with a good way to manage them, which I though I had done until I loaded a large file, then it started crashing on me.

vtol · Posted: Thu Apr 22, 2004 1:57 am Post subject:

You could maybe have VDS split them if certain size, or use VDS BINfile.

Dr. Dread · Posted: Thu Apr 22, 2004 6:42 am Post subject:

vtol · Posted: Sat Apr 24, 2004 7:50 am Post subject:

Whats a list componet ? You mean DLL?

bbelcher · Contributor Joined: 30 Jul 2002 Posts: 172

I've been playing with opening very large files with Tommy vdslist around 200 meg. and it seams to work great I takes about 1 to 2 minutes to load the file but then to add the contents to a edit box that takes a little longer total time about 12 minutes. Thats becouse of the 3 + million lines. This was done on a p4 2.0 gig, 256 meg ram 1.4 gig swap file. If your swap file is not big enough then it won’t add the content to an edit box. It would be nice if you could load say 10 meg chunks into the edit control. Also for a little time comparison I did the same thing with the vdsug.dll and total time was about 9.5 minutes. But then as Dr. Dread mentioned you have to work out the list type functions.

Mac · Posted: Sat Apr 24, 2004 3:46 pm Post subject:

Hey bbelcher,

When you used VDSug.dll, did ya change the size of the
file read buffer? The default is 4k, but can be set to any
size ya want. If ya set it to the file size, it can then read
the complete file without a loop (if ya have enough RAM). Wink

Example:
%%bufsize = @ug(FILEREADBUFSIZE, 1024000)

BTW, direct file IO searching/editing is much faster than
using lists - not sure why you guys want to load 200 mb.
Surely ya ain't gonna scroll thru that much data... Confused

Cheers, Mac Smile

bbelcher · Contributor Joined: 30 Jul 2002 Posts: 172

I used part of your example

Mac · Posted: Sat Apr 24, 2004 4:45 pm Post subject:

OK, just curious. Wink

Cheers, Mac Smile