Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1   Report Post  
Posted to microsoft.public.excel.programming
J@Y J@Y is offline
external usenet poster
 
Posts: 127
Default Searching through text - Speed issue

I was searching a list of 100 key words in a 1 million line text file. I used
two methods of looping the search:
1. I loop through all lines in the text file for each key word
2. I loop through all key words for each line in the text file

Both ways search through 100 times 1 million lines. How come after many
tests, the second method is about 30% faster than the first?
  #2   Report Post  
Posted to microsoft.public.excel.programming
external usenet poster
 
Posts: 703
Default Searching through text - Speed issue

I would chance at guess at this:

1) You are hitting the disk 100 times to re-read the text file for each
search (or, if you have read the entire text file into one humongous array,
you are still hitting the disk multiple times due to the large array being
swapped out in a system page file.)

2) You are reading the file once from beginning to end while checking
against a very small array of search items entirely in local memory.

That's about the best I can guess about system stuff.


"J@Y" wrote:

I was searching a list of 100 key words in a 1 million line text file. I used
two methods of looping the search:
1. I loop through all lines in the text file for each key word
2. I loop through all key words for each line in the text file

Both ways search through 100 times 1 million lines. How come after many
tests, the second method is about 30% faster than the first?

Reply
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Speed Issue Stephgill Excel Discussion (Misc queries) 0 October 9th 08 12:01 PM
Speed Issue after updating cells Simon Day Excel Discussion (Misc queries) 0 October 8th 08 03:10 PM
Speed issue with Multilple Web Queries [email protected] Excel Programming 1 March 1st 07 02:43 AM
Calculation speed issue Steve M Excel Discussion (Misc queries) 4 January 14th 06 02:18 AM
Dynamic Ranges: Speed Issue Sige Excel Worksheet Functions 5 December 12th 05 09:28 PM


All times are GMT +1. The time now is 04:54 AM.

Powered by vBulletin® Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright ©2004-2024 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"