Discussion Locked

publishing large ASCII text documents

0 helpful
7 replies
Closed to new repliesThis discussion is closed. It stays readable, but it takes no new replies.

I need to create a large archive of confidential ASCII text documents and publish them, preferrably through the intranet if possible. most of the documents are quite small, only a few Ks. So I initially thought publishing them through a web serverwould work But some are massive, 2GB or bigger. and when I try to publish them...they kill the virtual memory.

I know very little about web publishing, so what I have done so far is just kludging together a basic website through FrontPage 2000.
Can anyone recommend a good product for publishing documents through the web? I've checked out a couple already. Report2Web seemed great..but boss didnt want to float the bill. Tried out Seagate Info 7 which is free, but overly complex for what we need to do. We currently cut the documents to CD and pass them around as we get more...but we're trying to eliminate the clutter of stacks upon stacks of CDs

Thanks!
Tim Menke
tmenke@rev.state.ne.us

7 replies

by mbarker734

Have you considered zipping the files. You can create a self extracting zip file that your user can download and the expand. A text file will compress to very little size. One of the best files to compress actually.

PKZip or WinZip will work very well for this.

Good luck,

Mark

by voodoov

I was able to compress one of our 200MB files down to 10MB which was very cool.

The problem though is that we need something that will search through the documents for a user specified keyword and then pull up the relevant document. because, as it is right now, they have to sift through each document manually until they find what they need. So picking out the file, downloading it, (even 10MB would take a while to download even on an intranet), decrompessing it, then doing a keyword search would take the user longer than it would presently.

We currently use Folio Views 3.1 as the viewer (yeah i know its ancient), but despite its age, it VERY QUICKLY pulls up even the large 200MB+ files for viewing and searching. opening these files in wordpad or even Word takes a lot longer We want to replace folio views badly because we're switching to win2k eventually and it doesnt work well on it. and its a long process to convert the txt files to nfo format. We take the larger 2GB+ files, and break them down into 200MB chunks and put 3 of them on a CD. So something that could also eliminate that step would also be pretty useful, but thats a luxury, not a necessity

We need something that provides a search engine so that users can search through all the documents for a specified keyword and then pulls up the relevent document, and we also need those documents (or at least the relevant info IN the document that the user is searching for) to be brought up in a reasonableamount of time.

I apologize for not being more specific.

by shmaltz

Try braking up each file into smaller files. When someone wants the whole document give to them the option to download it in zip format or to download 1 part at a time.

by voodoov

We already break the files down into smaller 200MB files.

Zipping the files help us for archiving the files onto CD. But zipping the files for the users does save space, but for the users, it makes things take even longer. They still have to open the file...do the keyword search..if it has what they want...great..but if not..close the file, and open another and lather rinse repeat. The users would have to add an extra step of zipping and unzipping which doesnt help us even though it does save space.

We don't need to JUST publish the files. we need something that allows the user to search for the keywords they need without having to open every single file manually because they dont always know what file the info they are looking for is in.

We currently publish the smaller files on the LAN on a shared directory. Sometimes the users know exactly what file to search..but sometimes they don't..so they have to open each file..do a search...and keep doing that for every file until they find it. We need something that searches all the files for them. When we get enough files..we cut them to CD and make copies for each division that needs them. The big 6GB+ files that we get at the beginning of each year never get published to the lan..we cut them down into 200MB chunks and cut them directly to CD. But its a long process because the files are sent to us on tape..and the tape reader is slow..once it finally chunks out a fragment of the TXT file, we convert it to a flat file...which takes a half hour or more...THEN we convert it to NFO for Folio which takes a couple hours a least for EACH fragment and there are usually 10-15+ fragments for each file. The all the parts of the file end up taking up to 10 CDs...then we have to make 10 copies of each CD for the various divisions. so as you can see..this process needs to go!

by shmaltz

I have two suggestions:
1. Devide them into smaller files and use an application to search in all the files. Return to the user only that small portion of the file that came up with thru the search then give them the option to download the whole file (either in few files or one file).
2. Put the text into a database (again if you have to break it up in the database also do it) then use the database to search for the keywords once the database finds it output the text to a HTML file or point the use to the original file and give them the option to download it.

by voodoov

I like the 2nd suggestion. The problem is, however, I know very little about databases. I'll probably have to refer to our programming staff to help me.

Thanks! :)

This discussion is closed to new replies.