EducationSoftwareStrategy.com
StrategyCommunity

Knowledge Base

Product

Community

Knowledge Base

TopicsBrowse ArticlesDeveloper Zone

Product

Download SoftwareProduct DocumentationSecurity Hub

Education

Tutorial VideosSolution GalleryEducation courses

Community

GuidelinesGrandmastersEvents
x_social-icon_white.svglinkedin_social-icon_white.svg
Strategy logoCommunity

© Strategy Inc. All Rights Reserved.

LegalTerms of UsePrivacy Policy
  1. Home
  2. Topics

KB480817: Cloudera Impala Best Practices for Performance


Norman Matos

Associate Scrum Master • Strategy


This article explains how to manipulate Cloudera Impala for improved performance.

This tutorial explores the optimization of the performance of Cloudera Impala in Strategy using the following means:
1. Cloudera Impala Information Catalog Workaround
2. Using Cloudera Impala Modeling Features
3. Query Optimization
4. Query Generation
 

Cloudera Impala Information Catalog Workaround

Current Limitation
Strategy Developer only allows ODBC calls to query the Impala Catalog and bring in schema/table/datatype information into Strategy for reporting. In the case of a significant number of tables/schemas, this leads to poor performance. This has been identified as a workflow limitation in Developer.
Workaround
There exists a work-around to allow customers to overcome this performance issue and use Strategy with Impala 2.x This enhances the warehouse catalog with the ability to specify Namespaces. We have a documented way to use a SQL statement that can be used to bring back the column mappings for Impala as outlined below.
 
Prerequisites: Existing CDH environment utilizes MySQL as the Hive metastore. Sqoop libraries have to be installed on this CDH environment.
Hadoop environment with Impala can be configured with MySQL as the Hive Metastore. This tutorial assumes that the customer’s metastore is MySQL since that’s the most common platform. If the  metastore is some other platform, then the SQOOP statements will need to be changed accordingly.
 
Run the following 4 SQOOP statements to import the tables from the Hive metastore into Impala locally. We need 4 tables – DBS, SDS, COLUMNS_V2, and TBLS from the MySQL metastore.
 

  • Create a database on Hive/Impala. You can name it however you like, for our example we are calling it “metastore”.
  • Import the tables using the following 4 statements:


 
sqoop import -m 1 --connect jdbc:mysql://<HOST>:3306/<HIVEMETASTOREDB> -- username=<uid> --password=<pwd> --table DBS --hive-import --hive-overwrite --hive-table dbs --hive-database metastore
 
sqoop import -m 1 --connect jdbc:mysql://<HOST>:3306/<HIVEMETASTOREDB> -- username=<uid> --password=<pwd> --table TBLS --hive-import --hive-overwrite --hive-table tbls --hive-database metastore
 
sqoop import -m 1 --connect jdbc:mysql://<HOST>:3306/<HIVEMETASTOREDB> -- username=<uid> --password=<pwd> --table COLUMNS_V2 --hive-import --hive-overwrite --hive-table columns_v2 --hive-database metastore
 
sqoop import -m 1 --connect jdbc:mysql://<HOST>:3306/<HIVEMETASTOREDB> -- username=<uid> --password=<pwd> --table SDS  --hive-import --hive-overwrite --hive-table sds --hive-database metastore
 
The above process creates local copies of these 4 databases in Impala/Hive, so in case of any update to the data or new databases/tables being added, the user should run a SQOOP job to update these tables. The following is an example:
 
sqoop import -m 1 --connect jdbc:mysql://<HOST>:3306/<HIVEMETASTOREDB> --username=<uid_for_mysqldb> --password=< uid_for_mysqldb> --table DBS --hive-import --hive-overwrite --hive-table dbs --hive-database metastore
 
You can create a SQOOP job and schedule it to make sure all of your updated data gets reflected correctly in Impala, if there are any updates.
 
sqoop job --create sdsjob -- import -m 1 --connect jdbc:mysql://<server name>:3306/hivedb --username=<uid> --password=<pwd>
--table SDS
--hive-import
--hive-overwrite
--hive-table SDS
--hive-database metastore
 
You would then execute the job to make sure your catalog is always up to date.
sqoop job --exec sdsjob
This prompts for password.
 
You should then refresh your Impala metadata after any sqoop job. This can be done by running the following statement in Impala to refresh the tables and the metadata:
impala-shell -q "INVALIDATE METADATA"
 
Once the metastore tables are pulled into Impala, you should create the following 2 views:
1. V_TABLES:
create view metastore.v_tables (NAME_SPACE, TAB_NAME) as
select distinct d.name, t.tbl_name from metastore.tbls t join metastore.dbs d ON t.db_id = d.db_id;
2. V_COLUMNS:
Create view metastore.v_columns
as
SELECT t.tbl_name TAB_NAME,
c.column_name COL_NAME,
d.name NAME_SPACE,
case when c.type_name like 'char(%' then 'char' when c.type_name like 'varchar(%' then 'varchar' when c.type_name like 'decimal(%' then 'decimal' else c.type_name end DATA_TYPE,
regexp_replace((case when c.type_name like '%har(%' then regexp_extract(c.type_name, '(\\().*?',0) else null end),'[^[:digit:]]','') DATA_LEN,
regexp_replace( regexp_extract((case when c.type_name like 'decimal(%' then regexp_extract(c.type_name, '(\\().*?',0) else null end),'.*?(\\,)',0),'[^[:digit:]]','')  DATA_PREC,
regexp_replace( regexp_extract((case when c.type_name like 'decimal(%' then regexp_extract(c.type_name, '(\\().*?',0) else null end),'(\\,).*?',0),'[^[:digit:]]','')  DATA_SCALE
  FROM metastore.tbls t
 JOIN metastore.dbs d
 ON t.db_id = d.db_id
 JOIN metastore.sds s
 ON t.sd_id = s.sd_id
 JOIN metastore.columns_v2 c
 ON s.cd_id = c.cd_id;
 
 
How to enable Catalog Statements in Strategy
 
This can be done via Strategy Developer.
 
1. Click on your project – Schema from the toolbar-> Click on Warehouse Catalog

ka0PW0000000tvlYAA_0EM440000002dV2.png

 
2. In the Warehouse catalog, click on Read settings on the left panel; you will see 2 options to connect to the catalog. Switch from “Use standard ODBC Calls..” to “Use one or more SQL Statements…” option. Click the Settings button on the right.
 

ka0PW0000000tvlYAA_0EM440000002dV7.png

 
 
 
 
3. Click on “Use Default” for both top and bottom sections that contain the SQL. Make sure to edit your name_space clause so that you replace the default with the actual name of the name space containing your information catalog tables that were pulled into Impala via SQOOP.

ka0PW0000000tvlYAA_0EM440000002dVC.png

 
Below is the suggested Catalog SQL based on the v_columns and v_tables views that were created. The wildcard #?DATABASE_NAME?# should be replaced with your information catalog name space. This is “metastore” in our example.
 
Column SQL:
 
SELECT DISTINCT name_space NAME_SPACE, TAB_NAME TAB_NAME FROM metastore.v_tables
where name_space = '#?DATABASE_NAME?#'
 
Table SQL:
 
SELECT DISTINCT name_space NAME_SPACE, TAB_NAME TAB_NAME, COL_NAME COL_NAME, DATA_TYPE, DATA_LEN,  DATA_PREC,
DATA_SCALE FROM metastore.v_columns WHERE TAB_NAME IN (#TABLE_LIST#) and name_space =  '#?DATABASE_NAME?#' order by 1,2,3
 
4. After all of the above is done, users should now see all the tables available in Impala. It is now possible to pull over the tables that are needed to the right panel of the WH catalog and start using them in the project. This can lead to potential improvement in performance.
 

ka0PW0000000tvlYAA_0EM440000002dVH.png

 

Using Cloudera Impala Modeling Features

Strategy recommends use of the following modeling features in Impala to improve query execution time and performance:

  • Parquet File format:


Impala can query different Hadoop file formats. The file format used for an Impala table has significant performance consequences.Some file formats include compression support that affects the size of data on the disk and, consequently, the amount of I/O and CPU resources required to deserialize data. The amounts of I/O and CPU resources required can be a limiting factor in query performance since querying often begins with moving and decompressing data.
 
Parquet is a column-oriented binary file format recommended by Cloudera for highly efficient processing of large-scale queries. Parquet is especially good for queries scanning particular columns within a table, for example to query "wide" tables with many columns, or to perform aggregation operations such as SUM() and AVG() that need to process most or all of the values from a column. Each data file contains the values for a set of rows (the "row group"). Within a data file, the values from each column are organized so that they are all adjacent, enabling good compression for the values from that column. Queries against a Parquet table can retrieve and analyze these values from any column quickly and with minimal I/O.
 
By default Impala will create tables in text format but can create tables in Parquet file format when specifying the “STORED AS” clause.
 
Impala can optimize queries on Parquet tables, especially join queries, better when statistics are available for all the tables. Issue the COMPUTE STATS statement for each table after substantial amounts of data are loaded into or appended to it. 
Strategy recommends organizing tables in Impala in Parquet format for large scale analytical processing. Other file formats might provide better performance in specific use cases (e.g. a table in text format might allow for near-real time analytical processing when the underlying text file is appended by another application).
 
Strategy’s VLDB settings to generate PARQUET format in Temporary tables
By default Strategy will generate temporary tables in text format under the assumption that the temporary table is generally small, and a conversion into Parquet format will add more overhead than the extra processing required by using the default file format.
In specific reporting situations this behavior can be over-written on a report-by-report basis by specifying the following VLDB parameters:
 


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


CONFIGAUDITINGConfigure connection mapview, set, and refresh the connection map for a projectCONFIGCONNECTIONMAPConfigure governingproject level: view and set project governing settings
server level: view and set governing settings for all projects and for Intelligence ServerCONFIGGOVERNINGConfigure group membershipadd or remove users to a user group (Note: this also requires the Create And Edit Users And Groups privilege)CONFIGGROUPMEMBERSConfigure history listsview and set the History List propertiesCONFIGHISTORYLISTConfigure language settingsuse the User Language Preferences ManagerCONFIGLANGUAGEConfigure project basicview and change project settings, and use MDUpdate utilityCONFIGPROJECTBASICConfigure project data sourceview and change the project’s primary data source, and add and remove database instances for use in data marts, Freeform SQL, Query Builder, and MDXCONFIGPROJECTDATASOURCEConfigure security settingsview and change server-level security settingsCONFIGSECURITYConfigure server basiccreate, view, and change the server definitionCONFIGSERVERBASICConfigure statisticsview and change the statistics configurationCONFIGSTATSConfigure subscription settingsset up email notifications for successful subscriptionsCONFIGSUBSCRIPTIONSETTINGSCreate and edit contacts and addressescreate and modify contacts and addressesUSECONTACTMANAGERCreate and edit database instances and connectionscreate and modify database instances and database connections, and set the number of database threads for each database instance and the prioritization map of each database instanceUSEDBINSTANCEMANAGERCreate and edit database loginscreate and modify database loginsUSEDBLOGINMANAGERCreate and edit schedules and eventscreate and modify schedules and eventsUSESCHEDULEMANAGERCreate and edit security filterscreate and modify security filtersDEFINESECURITYFILTERCreate and edit security rolescreate and modify security rolesUSESECURITYROLEMANAGERCreate and edit users and groupscreate and modify users and user groups (Note: To enable or disable users you must have the Enable User privilege. To grant or revoke privileges you must have the Grant/Revoke Privilege privilege.)USEUSERMANAGERCreate configuration objectscreate configuration objects (Note: This privilege is inherently granted for use of Object Manager if you have the Use Object Manager privilege)CREATECONFIGOBJECTDuplicate projectuse the Project Duplication Wizard to duplicate a projectDUPLICATEPROJECTEdit project statususe the Project Status EditorUSEPROJECTSTATUSEDITOREnable Intelligence Server administration from Webin Web, access the Intelligence Server Administration pageENABLEADMINISTRATIONFROMWEBEnable userenable or disable users (Note: when this privilege is granted, the Create And Edit Users And Groups privilege is automatically granted as well.)ENABLEUSERFire eventstrigger eventsFIREEVENTGrant/Revoke privilegegrant and revoke privileges to users (Note: To grant or revoke the Bypass All Object Security Access Checks privilege to another user, you must have the Bypass All Object Security Access Checks privilege.)GRANTPRIVILEGESIdle and Resume projectidle and resume projectsIDLEPROJECTLink users and groups to external accountslink Strategy users and groups to users and groups from sources such as Windows NT, LDAP, or a databaseLINKTOEXTERNALACCOUNTLoad and Unload projectload and unload projects, and configure which projects are loaded on which cluster nodes at startupLOADPROJECTSMonitor cachesuse the Cache Monitor; view information for all caches in a projectUSECACHEMONITORMonitor Clusteruse the Cluster view of the System Maintenance MonitorUSECLUSTERMONITORMonitor Cubesuse the Intelligent Cube Monitor; view information for all Intelligent Cubes in a projectUSECUBEMONITORMonitor Database Connectionsuse the Database Connection Monitor; view information for all database connections in a projectUSEDBCONNMONITORMonitor History Listsuse the History List Monitor; view information for all history list messages in a projectHISTORYLISTMONITORMonitor Jobsuse the Job Monitor; view information for all jobs in a projectUSEJOBMONITORMonitor Projectuse the Project view of the System Maintenance MonitorUSEPROJECTMONITORMonitor Subscriptionsuse the Subscription Manager; view information for all subscriptions in a project (Note: Scheduled administrative tasks are only visible if the user has the privilege corresponding to the administrative task)USESCHEDULEMONITORMonitor User Connectionsuse the User Connection Monitor; view information for all user connections in a projectUSEUSERCONNMONITORReset user passwordchange the passwords of other usersRESETUSERPASSWORDSServer performance counter monitoringThis privilege is deprecated. Server performance can be monitored through Enterprise Manager.PERFCOUNTERMONITORINGWeb administrationaccess the Strategy Web Administrator page and assign Project defaultsWEBADMINAvoid_Code_Injection valueCSV - string begins with +, -, =,
@ and no | in the middleCSV - string begins with +, -, =,
@ and with | in the middleExcel - string begins with +, -,
=, @ not setNYY0NNN1NYN2NNY3NYY4YYN5YYN6YYY7YYN ▫ To allow users to use local transactions during offline mode, select Enable smart client in the Document Properties dialog. Transaction data submitted during offline mode (a local transaction) is written back to the local dataset when the Internet connection is reestablished, and any document pointing to this local dataset receives this transaction data change. For detailed information about local transactions and steps to enable them in a document, see the Document Creation Guide .  ▫ To disable local transactions during offline mode, select Disable smart client. (Default) ▫ To inherit the Smart client setting from the project, select Use project-level behavior.VLDB CategoryVLDB Property SettingValueTablesIntermediate TTPermanent TableTablesCreate Post StringSTORED AS PARQUETTablesTable Creation TypeExplicit


 
For example:
 
create table ZZMQ00 (
   MONTH_ID  INT,
   SUBCAT_ID DOUBLE
STORED AS PARQUET;
 
INSERT INTO TABLE ZZMQ00
select  a12.MONTH_ID   MONTH_ID,
        a13.SUBCAT_ID  SUBCAT_ID
from    …
 

  • HDFS caching

HDFS caching provides performance and scalability benefits in production environments where Impala queries and other Hadoop jobs operate on quantities of data much larger than the physical RAM on the data nodes, making it impractical to rely on the Linux OS cache, which only keeps the most recently used data in memory. Data read from the HDFS cache avoids the overhead of checksumming and memory-to-memory copying involved when using data from the Linux OS cache.
 
Impala can use the HDFS caching feature to make more effective use of RAM, so that repeated queries can take advantage of data "pinned" in memory regardless of how much data is processed overall. The HDFS caching feature lets you designate a subset of frequently accessed data to be pinned permanently in memory, remaining in the cache across multiple queries and never being evicted. This technique is suitable for tables or partitions that are frequently accessed and are small enough to fit entirely within the HDFS memory cache.
 
Strategy recommends turning on HDFS caching assuming sufficient memory resources are available on the Impala cluster. First we decide how much memory to devote to the HDFS cache on each host. The total memory available for cached data is the sum of the cache sizes on all the hosts. We then issue hdfs cacheadmin commands to set up one or more cache pools, owned by the same user as the Impala daemon (typically impala). For example:
 


hdfs cacheadmin -addPool four_gig_pool -owner impala -limit 4000000000

 
The optimal configuration from a performance point of view is to reserve sufficient memory to load all table data for Strategy query processing into memory.
 
Assuming this is not possible, Strategy recommends loading the most frequently accessed tables/partitions into memory. It is possible to find out the most commonly accessed tables using Strategy Enterprise Manager.
 
Begin by choosing which tables or partitions to cache. For example, these might be lookup tables that are accessed by many different join queries, or partitions corresponding to the most recent time period that are analyzed by different reports or ad hoc queries.
 
In your SQL statements, you specify logical divisions such as tables and partitions to be cached. Impala translates these requests into HDFS-level directives that apply to particular directories and files.
 
Strategy does not recommend using the HDFS cache for temporary tables generated in multi-pass reports because these are highly temporary in nature and will benefit from OS level caching.
 
For further details on HDFS Caching, see the CDH documentation.
 
HDFS Caching is transparent to Strategy; hence once the settings are done on the Impala server side, the performance substantially improves on Strategy side. There is no explicit setting on the Strategy side to reflect HDFS Caching.
 

  • Table partitioning


In Impala, Table partitioning is a common optimization approach. In a partitioned table, data are usually stored in different directories, with partitioning column values encoded in the path of each partition directory. The Parquet data source is now able to discover and infer partitioning information automatically. Note that Partitioning on base tables is transparent to Strategy. At this time, Strategy does not create partitioned intermediate tables.
 

Query Optimization 


 
SQL Global Optimization
This setting can substantially reduce the number of SQL passes generated by Strategy. In Strategy, SQL Global Optimization reduces the total number of SQL passes with the following optimizations:

  • Eliminates unused SQL passes, e.g. a temp table is created but not referenced in a later pass
  • Reuses redundant SQL passes
  • E.g. exact same temp table is created multiple times a single temp table is created
  • Combines SQL passes where the SELECT list is different
    • E.g. two temp tables that have the same FROM clause, same JOINs, same WHERE clause, same GROUP BY SELECT lists are combined into single SELECT statement
  • Combines SQL passes where the WHERE clause is different
    • E.g. two temp tables that have the same SELECT list, same FROM clause, same JOINs, same GROUP BY predicates from the WHERE clause are moved into CASE statements in the SELECT list


 
The default setting for Impala is to enable SQL Global Optimization at its highest level. If your Database Instance is configured as an earlier version of Impala, you may have to enable this setting manually. For more information, see the System Administration Guide.
 
Set Operator Optimization
This setting is used to combine multiple subqueries into a single subquery using set operators (i.e. UNION, INTERSECT, EXCEPT). The default setting for Impala is to disable Set Operator Optimization as currently Impala doesn’t support set operators completely.
 
The relevant setting can be enabled in the DB instance if required.
 

Query Generation


 
Sub Query Type
There are many cases in which the SQL Engine generates subqueries (i.e. query blocks in the WHERE clause):

  • Reports that use Relationship Filters
  • Reports that use “NOT IN” set qualification, e.g. AND NOT or AND NOT
  • Reports that use Attribute qualification with M-M relationships, e.g. show Revenue by Category, filter on Catalog
  • Reports that “raise the level” of a filter, e.g. dimensional metric at Region level, but qualify on Store
  • Reports that use non-aggregatable metrics, e.g. inventory metrics
  • Reports that use Dimensional extensions
  • Reports that use Attribute to attribute comparison in the filter


 
The default setting for Sub Query Type for Impala is Option 3 – “WHERE COL1 IN (SELECT SQ.COL1 …) FALLING BACK TO EXISTS (SELECT * … ) FOR MULTIPLE COLUMNS IN.
This setting instructs the SQL Engine to generate a nested subquery.
 
For example:
select a31.ITEM_NBR ITEM_NBR,
sum(a31.REG_SLS_DLR) REG_SLS_DLR
from REGION_ITEM a31
where ((a31.ITEM_NBR)
in (select r21.ITEM_NBR ITEM_NBR,
from REGION_ITEM r21,
LOOKUP_DAY r22
where r21.CUR_TRN_DT = r22.CUR_TRN_DT
and r22.SEASON_ID in (199501)))
group by a31.ITEM_NBR
 
Some reports may perform better with Option 5 – “Use temporary table, falling back to IN for correlated subquery”. This setting instructs the query generation engine to handle non-correlated sub queries using temporary tables while correlated subqueries use the IN subquery syntax.
 
The other settings are not likely to be advantageous with Impala.
 


Comment

0 comments

Details

Knowledge Article

Published:

August 7, 2017

Last Updated:

February 26, 2024