Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1   Report Post  
Posted to microsoft.public.excel.programming
external usenet poster
 
Posts: 45
Default Parsing Huge Files of Text

Hi,
What a dilemna!

Write a macro to:

Using the "File Open" method, you can implement the "Start at Rows" option

By importing chunks of data, say 20,000 rows at a time, you can then analyse
your data, save it as "Rows 1 to 20000.txt"
and do this as many times as it takes. The next save as file name would be
"Rows 20001 to 40000.txt"

You may end up with up to or more than 50 text files.

Depending on the length of the cell value you could use another macro to
open the first file to append
open next file to read the data
and then append it to the first file.

I will not give you the code here because you probably know it already.

If you need help, let me know. See my stuff at:
http://www.geocities.com/excelmarksway
http://au.geocities.com/windsofmark

- -Mark


"ajocius" wrote:


Group,
As a test engineer I must compile and crunch large amounts of data
(up to a million rows of data) prior to a new product launch. In the
past we (I) manually separate, sum, analyze numbers. With my new found
application called VBA I'd like to perform this number crunching in
Excel. Now I know Excel has a row limit size. Once each group of data
is parsed into columns, my net would be only several hundred thousand
rows with the rest of the data being discarded. My question, is this
possible in Excel? And if it isn't what can I use as an intermediate
step before crunching in Excel?

Tony


--
ajocius
------------------------------------------------------------------------
ajocius's Profile: http://www.excelforum.com/member.php...o&userid=17695
View this thread: http://www.excelforum.com/showthread...hreadid=482412


Reply
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Huge files... why? fungus Excel Discussion (Misc queries) 7 May 13th 07 03:59 AM
why do pivot tables create such huge files? jabba406 Excel Discussion (Misc queries) 1 February 14th 06 09:39 AM
Huge Files Dont Know Why Dejan Excel Discussion (Misc queries) 12 January 14th 06 12:51 AM
Saving Excel files takes a huge amount of time Heavy Excel user Excel Discussion (Misc queries) 6 January 12th 06 12:11 PM
Excel 2000 importing huge ASCII files into different sheets Goran Stjepanovic Excel Programming 2 February 25th 04 09:30 AM


All times are GMT +1. The time now is 06:59 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"