EducationSoftwareStrategy.com
StrategyCommunity

Knowledge Base

Product

Community

Knowledge Base

TopicsBrowse ArticlesDeveloper Zone

Product

Download SoftwareProduct DocumentationSecurity Hub

Education

Tutorial VideosSolution GalleryEducation courses

Community

GuidelinesGrandmastersEvents
x_social-icon_white.svglinkedin_social-icon_white.svg
Strategy logoCommunity

© Strategy Inc. All Rights Reserved.

LegalTerms of UsePrivacy Policy
  1. Home
  2. Topics

KB299479: How to improve cube publishing time when performing data import against CSV and Text files


Community Admin

• Strategy


This article discusses how the Data Import functionality utilizes multiple threads to improve the cube publishing time, when performing a data import against CSV/Text files

SUMMARY
Starting with Strategy 10.4, the Data Import functionality utilizes multiple threads to improve the cube publishing time, when performing a data import against CSV/Text files. This enhancement only applies to Windows, Linux and Mac OS. The performance improvement varies based on the CPU cores, memory, file size and the Operation System. In some cases, users may desire to fine tune the performance and set the threshold in their own environment.
 
There are 2 keys in particular that govern this behavior:
"CSVParsingThreadNumber" is used to set the number of threads in multi-thread parser.
"CSVThresholdBigFileMin" is the file size threshold. If the file size is larger than the threshold, the multi-thread parser will be triggered.
 
CONFIGURATION
These keys do not exist out of the box and must be manually added as explained below:
 

  1. For Windows 64-bit Operating Systems, the registry key should be added to the system registry under the following key:


       HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\MicroStrategy\DSS Suite

  1. For Linux and Mac, the registry keys should be added to the MSIReg.reg, located in the home directory of the Strategy installation. The new entries should be added under the following entry:


HKEY_LOCAL_MACHINE\SOFTWARE\MicroStrategy\DSS Suite

 
3. Addthe key "CSVThresholdBigFileMin" under [HKEY_LOCAL_MACHINE\SOFTWARE\MicroStrategy\DSS Suite] in MSIReg.reg to modify the big file threshold. The value unit is MB. If the file size is larger than the threshold, the multi-thread parser will be triggered. 
4. Also, add the entry "CSVParsingThreadNumber" in the same location. 
5. Restart the Intelligence Server once the entries are added or modified. 
 
For example, if the file size is larger than 1GB and the multi-thread parser is used, the key resembles the following:

[HKEY_LOCAL_MACHINE\SOFTWARE\MicroStrategy\DSS Suite]
"CSVThresholdBigFileMin"="1024"
"CSVParsingThreadNumber"="4"

 
WARNING:
Modifying registry values incorrectly may cause serious, system-wide problems that may require the re-installation of Microsoft Windows or the Strategy installation on Linux. Modification of the registry is done at the user's own risk. Since these are user-initiated changes, they are not covered by any Strategy warranty. If using Microsoft Windows NT, the user should backup the registry and/or update an Emergency Repair Disk (ERD) prior to alterations.


Comment

0 comments

Details

Knowledge Article

Published:

June 15, 2017

Last Updated:

June 15, 2017