Handling multiple fact tables in Qlikview

Question

I have a PostgreSQL database containing various education data such school-level test scores and enrollment figures. I need to separate enrollment from test scores because

Answer 1

Seeing the popularity of this question, I'm going to add my actual solution to the mix so people have an example to work from, which for some reason is really hard to find for such a common problem...

I proceeded with creating a Link Table. This solution still to this day feels like a hack as it creates one huge table containing the Cartesian product of every one of your keys in all of your fact tables... but it does work.

The problem: You have multiple fact tables in your database; an occurrence in almost every database ever. Some (or all) of these fact tables share the same key fields; no problem, right? Wrong. Unfortunately, due to Qlik's associative nature, instead of each one of your fact tables linking nicely to their lookup tables, your fact tables are now associating with each other and wreaking havoc on your data model; creating circular references and untold amounts of synthetic keys.

The Solution: Create a Link Table. Sounds simple, right? Well, it is, but it's also very poorly documented and hard to understand without an initial explanation. You might be wondering... what's a Link Table? It is the Cartesian product of all keys from all of your fact tables. How does this correct the problem? It removes all of the unwanted associations between your fact tables as each will now only contain a single unique concatenated key. Those unique keys will associate with the Link Table only, which contains all your unique concatenated keys as well as all the individual keys. The Link Table will subsequently associate with your lookup tables and all will be well.

Implementation:

This implementation will use the two tables contained in my question above; test_scores_fact and enrollment_fact.

test_scores_fact     |    enrollment_fact      |    school            |    gender         |   ...
----------------     |    ---------------      |    ------            |    ------         |   ---
school_code (FK)     |    school_code (FK)     |    school_code (PK)  |    gender_id (PK) |
test_code (FK)       |    grade_id (FK)        |    school_name (FK)  |    gender_desc    |
grade_id (FK)        |    ethnicity_id (FK)    |    address           |    ...            |
gender_id (FK)       |    gender_id (FK)       |    ...               |
ethnicity_id (FK)    |    number_enrolled (F)  | 
subject_id (FK)      |
test_score (F)       |

FK = Foreign Key
PK = Primary Key
F = Fact

As you can see, the two fact tables have overlapping keys, school_code, grade_id, gender_id, and ethnicity_id. In a relational model, each key field has a corresponding table with additional information about the key. This model does not jive with Qlikview's associative nature as Qlikview associates tables based on the name of a field; even when you don't want it to. You do want like named fields to associate to their lookup tables, however you don't want like named fields in your fact tables to associate. Unfortunately you cannot stop this behavior. You must implement a Link Table...

1. In your Qlikview script, create a temporary fact table, which loads in all fields from your database table:

   [temp_test_scores]:
   LOAD school_code,
        test_code,
        grade_id,
        gender_id,
        ethnicity_id,
        subject_id,
        test_score;
   SQL SELECT * FROM 
   

2. Concatenate your keys and remove all individual keys:

   [test_scores]:
   LOAD school_code & '_' test_code & '_' grade_id & '_' gender_id & '_' ethnicity_id & '_' subject_id as test_key,
        test_score
   RESIDENT [temp_test_scores];
   

3. Repeat Steps 1 & 2 for each fact table:

   [temp_enrollment]:
   LOAD school_code,
        grade_id,
        ethnicity_id,
        gender_id,
        number_enrolled;
   SQL SELECT * FROM 
   
   [enrollment]:
   LOAD school_code & '_' & grade_id & '_' & ethnicity_id & '_' & gender_id as enrollment_key,
        number_enrolled
   RESIDENT [temp_enrollment];
   

4. Create your Link Table by concatenating your individual keys into a single table:

   [temp_link_table]:
   LOAD DISTINCT
       school_code,
       test_code,
       grade_id,
       gender_id,
       ethnicity_id,
       subject_id
   RESIDENT [temp_test_scores];
   
   CONCATENATE ([temp_link_table])
   LOAD DISTINCT
       school_code,
       grade_id,
       ethnicity_id,
       gender_id,
       number_enrolled
   RESIDENT [temp_enrollment];
   
   /**
    * The final Link Table will contain all of the individual keys one time as well as your concatenated keys
    */
   [link_table]:
   LOAD DISTINCT
       school_code,
       test_code,
       grade_id,
       gender_id,
       ethnicity_id,
       subject_id,
       school_code & '_' test_code & '_' grade_id & '_' gender_id & '_' ethnicity_id & '_' subject_id as test_key,
       school_code & '_' & grade_id & '_' & ethnicity_id & '_' & gender_id as enrollment_key
   RESIDENT  [temp_link_table]
   

5. Drop your temp tables so they do not appear in your data model:

   DROP TABLE [temp_test_scores];
   DROP TABLE [temp_enrollment];
   DROP TABLE [temp_link_table];
   

This will remove all associations between your fact tables as there now exist no common field names between them. Each fact table will link to the link table via the created concatenated key. The link table will then associate with each individual lookup table. Your Qlikview data model will not contain any synthetic keys or circular references.

If you create another fact table in the future, just follow steps 1 & 2 again, and add any new individual keys to the Link Table and also add the new concatenated key to the Link Table as well. It scales with little effort.

Good Luck!