Home |
Search |
Today's Posts |
#1
![]()
Posted to microsoft.public.excel.programming
|
|||
|
|||
![]()
Hello, I have a large database issue I hope someone can help me with.
It is hard to explain so I have tried to be as descriptive as possible without losing sight of my problem. OVERALL QUESTION Is there a way to have my Excel workbook search a very large text database outside the Excel file? I am working with an extremely large data set and my Excel file is starting to get too large (20M) that I need to figure out a way to reduce file size (and maybe increase functionality and flexibility). QUICK BACKGROUND Every bank in the US is required to report their financial statements on a quarterly basis called Call Reports. This information is available free and online on the FDIC website. There are about 7,500 banks nationally that report. These reports contain maybe 1,000 different numbers, each given its own code (i.e. Total Assets is RCON2170- I’ll call them RCON #’s for short) and every bank uses the same template. I am able to download this data in bulk form into a zipped text folder which I then extract. This folder will now contains about 40 different text files – each named for a section in the report (ie. RCCI is the balance sheet section). The Banks unique identifier is listed in column A and the number code (RCON) is listed in row 1. (Each bank identifier and number code are unique). The whole unzipped folder is approximately 65M. CURRENT SETUP Of these 40 sections mentioned, I need about 6 of the sections in my Excel file. Right now I convert the sections I need into an Excel format (Convert with a Tab Delimited) and put it into my model. I have template tabs that uses the INDEX-MATCH formulas to find the right number based on the RCON code and the banks unique identifier. This setup allows for comparisons amongst different banks. All the user has to do is input the banks unique identifier and it will return the appropriate numbers based on the RCON number. (Sometimes we will do 10 banks side by side). The INDEX MATCH works very well. THE PROBLEM The issue is that each tab represents a section of the report. Each section lists each bank (7,500) and contains approximately 100 RCON numbers (a data set of 750,000 fields per tab). My file for a quarterly report is approximately 20M. Is there a way to have my Excel workbook search the text files for the appropriate RCON number and the banks unique identifier? That way I can keep my files limited in size and may be able to include previous Call Reports for Trend Analysis. Any help would be extremely appreciated. (Also let me know if this format is acceptable to understand my issues :) |
Thread Tools | Search this Thread |
Display Modes | |
|
|
![]() |
||||
Thread | Forum | |||
Linking Excel to a text file database | Excel Programming | |||
Need formula in excel for filtering large database | Excel Worksheet Functions | |||
Large Database Problem-linking worksheets and printing | Excel Discussion (Misc queries) | |||
Linking an Excel database to MS AutoRoute | Excel Discussion (Misc queries) | |||
Linking Large Access Table into Excel | Links and Linking in Excel |