View Single Post
  #1   Report Post  
Posted to microsoft.public.excel.programming
exceluserforeman exceluserforeman is offline
external usenet poster
 
Posts: 45
Default Parsing Huge Files of Text

Hi,
What a dilemna!

Write a macro to:

Using the "File Open" method, you can implement the "Start at Rows" option

By importing chunks of data, say 20,000 rows at a time, you can then analyse
your data, save it as "Rows 1 to 20000.txt"
and do this as many times as it takes. The next save as file name would be
"Rows 20001 to 40000.txt"

You may end up with up to or more than 50 text files.

Depending on the length of the cell value you could use another macro to
open the first file to append
open next file to read the data
and then append it to the first file.

I will not give you the code here because you probably know it already.

If you need help, let me know. See my stuff at:
http://www.geocities.com/excelmarksway
http://au.geocities.com/windsofmark

- -Mark


"ajocius" wrote:


Group,
As a test engineer I must compile and crunch large amounts of data
(up to a million rows of data) prior to a new product launch. In the
past we (I) manually separate, sum, analyze numbers. With my new found
application called VBA I'd like to perform this number crunching in
Excel. Now I know Excel has a row limit size. Once each group of data
is parsed into columns, my net would be only several hundred thousand
rows with the rest of the data being discarded. My question, is this
possible in Excel? And if it isn't what can I use as an intermediate
step before crunching in Excel?

Tony


--
ajocius
------------------------------------------------------------------------
ajocius's Profile: http://www.excelforum.com/member.php...o&userid=17695
View this thread: http://www.excelforum.com/showthread...hreadid=482412