Since Data Import cubes don't have the concept of a filter, the Strategy engine cannot just compare the filter of the Intelligent Cube at the time of publication vs. filter at current time, to incrementally refresh the data. For the case of Data Import Intelligent Cubes, the engine compares the tuples (coordinates) of existing data with the new data and replaces/updates the data as per the refresh option chosen. This concept has been explained below with a couple of examples.
Consider a data import dataset which has been imported into Strategy. The data in this cube is as given below. The columns ID1 and ID2 correspond to attributes and M1 corresponds to a metric.
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Now, update the source of the data import (for example, the Excel sheet) with an additional row by adding new IDs corresponding to ID1 and ID2 (the 2 attributes) and corresponding metric data. Also, update the metric data corresponding to the 3rd row above to 330.6. (for row where ID1=3 and ID2=30). When the 2nd refresh option 'update existing data and add new data' is chosen and the cube is republished, the data now in the Intelligent Cube is as given below. A 4th gets added corresponding to the newly added attribute tuple and the metric data gets updated for the existing attribute tuple (3,30).
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Now, update the data in the source data to just change the data for ID2 in the 4th row. Leave ID1=4, but change ID2 to 50 and change M1 to 40.2. Republishing the cube again with the same update option 'update existing data and add new data', the data in the cube is as shown below. The previous row with ID1=4 and ID2=40 is NOT replaced with ID1=4 and ID2=50. This is because the existing ID data is compared with the new data and data corresponding to the new attributes is added. The combination of data for ID1 and ID2 in the cube is 4, 40 (a coordinate or tuple that is used to look at the collection of attribute data) and as a matching tuple is not found in the new source, the existing row is not updated and new row is added corresponding to the new tuple for (4,50).
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 | Drew Bachman
Sr. Consultant & Upgrade Technical SME
ParStream 3.0.0 32-bit PostgreSQL ODBC driver (psqlODBC)SupportedID1ID2M1110100.1220230.433033.6ID1ID2M1110100.1220230.4330330.6440323.2ID1ID2M1110100.1220230.4330330.6440323.245040.2 |
If a new column is added to the data import data source and the cube is republished, there is no effect. In other words, the new column will NOT get mapped automatically in the existing Intelligent Cube. For a new column to be added to an existing Intelligent Cube, users need to edit an existing Intelligent Cube and map the new column manually, as shown below:
