TEXT PARSING HELP PLEASE

Okay,

We are soon going to have a 2,600 page text file that reports configuration information on a cyber machine. We are going to have close to 500 machine reports for a total of 1.3 million pages on configuration data. I need a program specifically tailored to text parsing or recommendations on how to approach this. We are going to be importing this into a DB.

I have plenty of parsing experience through my engineering class, but not with this much data and not in a non-development environment.

Any help is sincerely appreciated.