Build Settings and Data Accumulation Behavior

When you build your ElastiCube, data is imported and accumulated based on the following settings:

Build Options

There are two primary Build Options, Build Schema Changes and Build Entire ElastiCube.

To access Build Options, click Build in the main menu of the ElastiCube Manager. See also Building the ElastiCube.

While building the ElastiCube with schema changes or entire ElastiCube builds, you can continue to run queries. In the event that the build fails, Sisense restores the original version of the ElastiCube and attempts the build again. While Sisense restores the original ElastiCube, some downtime may occur while Sisense copies and pastes the ElastiCube on your drive. The downtime is the amount of time it takes to copy and paste the ElastiCube locally. If you require high availability for your data, Sisense provides this through ElastiCube Sets. Note: When Sisense restores an ElastiCube a copy of the original ElastiCube is created. You should verify that your server can store multiple copies ElastiCubes until the restoration process is complete.

For more information on how to customize your builds, see Field Build Behavior and Table Build Behavior below.

Field Build Behavior

You can select a specific integer or date field that will be used to determine whether to accumulate data at the time of the build. The field will act as an index, and if the index value is greater in a subsequent build then data will be accumulated for the table.

To select the integer or date field within a table as the parameter to accumulate by, click on the field name, and then select Is Accumulated by.

Accumulation behavior for integers and for dates are as follows:

Integer

When you select an integer, only source rows with a value greater than the maximum index value in the ElastiCube table will be inserted. Existing data in the ElastiCube table will not be modified or deleted.

Note: Some data sources (for example, CSV files) do not support accumulating data on the field level, and in such cases data will be duplicated. See Accumulative Build Support below.

The following image demonstrates this logic (when supported):

After Load 1, the maximum index value is 3. In Load 2, the source index value of 2 is not inserted (since it is less than 3), but the source index value of 4 is inserted (since it is greater than 3).

Table Build Behavior

A table’s Build Behavior lets you define whether to import and replace data for the entire table or bring in only accumulated data at the time of the ElastiCube build.

To select a table’s Build behavior, click the table’s header and then Additional Preferences.

The following options exist:

Build Options Working Together with Table and Field Behavior

The following table describes how data will be imported using different build options and table behavior combinations.

 Replace DataAccumulate DataIgnore when unchanged
Build Entire ElastiCubeReplaces all data at the time of build.Only adds additional data to existing table data. If a field in the table is marked as Accumulate by, then data is accumulated only for the selected field. Note: If enabled, an additional checkbox exists to delete all existing data during the build.Ignores tables that have remained unchanged, unless changes have occurred in the table schema. Note: If enabled, an additional checkbox exists to delete all existing data during the build.
Build Schema ChangesAll data remains unchanged during the build.If a field in the table is marked as Accumulate by, then data is accumulated only for the selected field.Ignores tables that have remained unchanged, unless changes have occurred in the table schema.
Note: Tables with accumulative build settings are highlighted with a dark blue color.

Accumulative Build Support

The following list displays different data sources and their support for accumulating data on the table and field levels.

Data Source ProviderAccumulate by TableAccumulate by Field
OracleYesYes
MySQLYesYes
MS SQLYesYes
PostgreSQLYesYes
ODBCYesNo
OLEDBYesNo
HiveYesYes
MS ExcelYesNo
CSV fileYesNo
MS AccessYesNo
SalesforceYesNo
Google AdWordsYesNo
Google AnalyticsNoNo
Google SpreadsheetsYesNo
FacebookYesYes
Facebook AdsYesYes
HubSpotYesYes
DynamoDBYesYes
ZenDeskYesNo
Amazon RedshiftYesYes
Heroku PostgresYesYes
DB2YesYes
TeradataYesYes
MongoDB (ODBC)YesYes