1 |
dpavlin |
1 |
<HTML> |
2 |
|
|
<META name="keywords" content="Virtual Data Warehouse, real-time data warehouse, |
3 |
|
|
spoofing Oracle, spoofing Net8, tnslsnr protocol, Net8 Protocol, |
4 |
|
|
data warehouse, real-time, oracle"> |
5 |
|
|
<Head> |
6 |
|
|
<title>Virtual Data Warehouse</title> |
7 |
|
|
<h3>Virtual Data Warehouse</h3 |
8 |
|
|
</head> |
9 |
|
|
<BODY> |
10 |
|
|
|
11 |
|
|
I call this a Virtual Data Warehouse. From a quick search on the Web it looks like |
12 |
|
|
this term is being used for real-time access to data on differing platforms (i.e. you |
13 |
|
|
have an Oracle database, an Access DB, an Excel Spreadsheet...). I'm using the term |
14 |
|
|
to refer to real-time data access from a single source, similar to a conventional |
15 |
|
|
data-warehouse, but without having to create the actual tables and populate them regularly. |
16 |
|
|
The data is generated by code at run-time from the low-level database and translated into the higher level |
17 |
|
|
warehouse schema. |
18 |
|
|
(The Virtual Data Warehouse can be used against heterogeneous data sources - the data |
19 |
|
|
retrieval functions can access any data source you can get to from perl.) |
20 |
|
|
<P> |
21 |
|
|
Of interest to you low-level Net8/Oracle types is the "oracle server" component |
22 |
|
|
of the warehouse that <a href=ora_obj_srvr.html>spoofs Oracle Net8</a>. It |
23 |
|
|
does this in order to act as a middle-man between the Hummingbird BI Query |
24 |
|
|
desktop client (a graphical point-and-click sql query builder) and the |
25 |
|
|
warehouse server, which pulls higher-level data from the real database. |
26 |
|
|
<P> |
27 |
|
|
Lex/Yacc hackers may want to look over the <a href=parser_code.html>SQL parser</a> which embeds the warehouse server. I lifted the lex/yacc code from the |
28 |
|
|
O'Reilly lex/yacc book, added embedded perl, and enhanced so it would pass |
29 |
|
|
the parsed query to the warehouse server. I'm sure this could be improved a |
30 |
|
|
lot and I welcome suggestions! |
31 |
|
|
<P> |
32 |
|
|
SCT/Sungard Banner Student Information System programmers may want to check out the |
33 |
|
|
<a href=wou_pm.html>library of data retrieval functions</a> we use in our warehouse. |
34 |
|
|
Of course you can use the warehouse code against any schema you define in |
35 |
|
|
<a href=obj_srvr_tables.txt>obj_srvr.tables</a>, which maps the high-level |
36 |
|
|
warehouse schema to functions that build it at run time. |
37 |
|
|
<P> |
38 |
|
|
<a href=readme_vdw.txt>A more complete description of the virtual warehouse</a> |
39 |
|
|
<P> |
40 |
|
|
<a href=vdw_code.html>The warehouse server</a> |
41 |
|
|
<P> |
42 |
|
|
<a href=data_flow.html>Diagram of data flow</a> |
43 |
|
|
<P> |
44 |
|
|
If you want to contribute to this project with code or suggestions, or if you have |
45 |
|
|
questions about how to use the warehouse or how to build the code, please contact me |
46 |
|
|
at <a href="mailto:hickerj@wou.edu">hickerj@wou.edu</a> |
47 |
|
|
<P> |
48 |
|
|
<a href=index.html>Back to Homepage</a> |
49 |
|
|
|
50 |
|
|
|
51 |
|
|
</BODY> |
52 |
|
|
</HTML> |