View Single Post
  #5   Report Post  
Posted to microsoft.public.excel.programming
cardan cardan is offline
external usenet poster
 
Posts: 112
Default Linking Large Text Database to Excel

On May 5, 7:49*pm, "Gary Keramidas" wrote:
i actually automated a specific call report for a credit union. it was a
report that they needed to fill out. they would retrieve the gl income and
balance data from their server and then i would populate the report with the
correct amounts.

doesn't really help. just thought i'd mention it since you mentioned a call
report.
--

Gary Keramidas
Excel 2003

"cardan" wrote in message

...
Hello, I have a large database issue I hope someone can help me with.
It is hard to explain so I have tried to be as descriptive as possible
without losing sight of my problem.

OVERALL QUESTION
Is there a way to have my Excel workbook search a very large text
database outside the Excel file?
I am working with an extremely large data set and my Excel file is
starting to get too large (20M) that I need to figure out a way to
reduce file size (and maybe increase functionality and flexibility).

QUICK BACKGROUND
Every bank in the US is required to report their financial statements
on a quarterly basis called Call Reports. This information is
available free and online on the FDIC website. * There are about 7,500
banks nationally that report. *These reports contain maybe 1,000
different numbers, each given its own code (i.e. Total Assets is
RCON2170- I’ll call them RCON #’s for short) and every bank uses the
same template.

I am able to download this data in bulk form into a zipped text folder
which I then extract. *This folder will now contains about 40
different text files – each named for a section in the report (ie.
RCCI is the balance sheet section). * The Banks unique identifier is
listed in column A and the number code (RCON) is listed in row 1.
(Each bank identifier and number code are unique). *The whole unzipped
folder is approximately 65M.

CURRENT SETUP
Of these 40 sections mentioned, I need about 6 of the sections in my
Excel file. Right now I convert the sections I need into an Excel
format (Convert with a Tab Delimited) and put it into my model. I have
template tabs that uses the INDEX-MATCH formulas to find the right
number based on the RCON code and the banks unique identifier. *This
setup allows for comparisons amongst different banks. All the user has
to do is input the banks unique identifier and it will return the
appropriate numbers based on the RCON number. (Sometimes we will do 10
banks side by side). The INDEX MATCH works very well.

THE PROBLEM
The issue is that each tab represents a section of the report. Each
section lists each bank (7,500) and contains approximately 100 RCON
numbers (a data set of 750,000 fields per tab). *My file for a
quarterly report is approximately 20M. *Is there a way to have my
Excel workbook search the text files for the appropriate RCON number
and the banks unique identifier? *That way I can keep my files limited
in size and may be able to include previous Call Reports for Trend
Analysis.

Any help would be extremely appreciated. *(Also let me know if this
format is acceptable to understand my issues :)


Thank you for the reply. It sounds we are on opposite ends of the
Call Report, you feed the info into it, and I extract it. The model I
have is kinda cool and robust, just too large.