EducationSoftwareStrategy.com
StrategyCommunity

Knowledge Base

Product

Community

Knowledge Base

TopicsBrowse ArticlesDeveloper Zone

Product

Download SoftwareProduct DocumentationSecurity Hub

Education

Tutorial VideosSolution GalleryEducation courses

Community

GuidelinesGrandmastersEvents
x_social-icon_white.svglinkedin_social-icon_white.svg
Strategy logoCommunity

© Strategy Inc. All Rights Reserved.

LegalTerms of UsePrivacy Policy
  1. Home
  2. Topics

KB426628: AtScale Gateway


Community Admin

• Strategy


AtScale is a Big Data optimization technology that enhances a BI tools ability to interact with large amounts of data. AtScale’s self-tuning optimization engine ensures interactive performance for data consumers on even the largest data sets due to the automatic creation of aggregate tables. You can effortless connect to this technology with MicroStrategy too.

Connecting to AtScale:
When you install AtScale, it ships and configures multiple drivers (underneath the hood) for a user to establish connection. There is an admin page in the AtScale web interface that defines the connection parameters needed to connect to these various drivers. The following are examples of these connections:

  • JDBC               jdbc:hive2://<<atscalelocation>>:11111/facttable
  • MDX               http:// ://<<atscalelocation>>:10502/default/atscale
  • ODBC & SQL <<atscalelocation>>:11111
ka04W0000014868QAA_0EM440000002Umz.png

*atscale.com

AtScale is an implementation of MSAS on Hadoop:

Yahoo had the largest MSAS ever built working with their Hadoop system. They wanted to make it bigger and were a big Hadoop contributor – the main contributor. So they wrote their own version of MSAS. It was meant to be an MDX Engine for Hadoop.
The main process : You build a cube with AtScale and define metrics, attributes and hierarchies over Hadoop data. Then we read data from the cube, and not directly from the Hadoop sources. They create a virtual cube and have strategies and technologies for optimizing how/when the aggregates in the cube are materialized.
Aggregate Configuration:
From the AtScale web portal a user will then define various relationship tables on top of a fact table. This then enables AtScale to generate various aggregate tables for users to connect to, providing a seamless way for users to navigate through their BigData data repositories. They have three different types of aggregate tables:
 

  • User-Defined Aggregate Tables – Typically used in situations where partitioned tables want to be queried (if a fact table is two years of transaction data partitioned by month, a user can run a query against a specific month and only a subset of the partitions will be accessed.)
  • Demand-Defined Aggregate Tables - This is the true bread and butter of the AtScale engine. AtScale auto-generates an aggregate table as soon as a query is executed that exceeds a prescribed set of rows. The next time this table is accessed, the AtScale engine will check if the query can be optimized through the use of an aggregate table. 
  • Predicted-Defined Aggregate Tables – Designed to generate aggregates on-the-fly before a customer ever executes a query. This “machine learning” tool will aggregate tables. Aggregates will only be aggregated to a level where attributes have low or normal cardinality.

 
These aggregate tables will be created as tables in the Hcatalog and will persist on disk even when the AtScale engine reaches memory capacity or turns off. These aggregates can be rerun/recalculated as frequently as an administrator would like. 
 
AtScale Example
The following is an example of AtScale at work creating a “Demand-Defined” Aggregate table. 

  1. A user queries a table –  Summary Fact
  2. AtScale’s first query takes a significant amount of time and the engine determines that an aggregate table is needed
  3. The aggregate table is defined
  4. The next time this query is run, the aggregate table will be accessed
  5. The aggregate table will be loaded into AtScale memory (“active”) for quicker query performance until aggregate table memory limit has been reached (defined in AtScale properities)
  6. Overtime, AtScale Aggregates and cubes can be updated- incrementally or completely refreshed


 
Connecting to AtScale
The most frequent way we see customers connecting to Strategy is through the Hive ODBC driver. As mentioned in the previous community post, AtScale preconfigures the Hive Thrift Server 2 to point to the AtScale Server. An administrator can then define a connection through the ODBC administrator.

ka04W0000014868QAA_0EM440000002Un4.png

 
Once this is done, an administrator will find that this connection operates in much the same way as other drivers. Our advanced technology team has confirmed that Strategy can:

  • import tables from AtScale into Warehouse Catalog in Strategy Developer
  • Create Attributes and Facts
  • Build reports with filters
  • Connect live to the AtScale table (via data import)
  • import tables into live connect cube or in memory cube 


 Comparing AtScale to SparkSQL
After proving Strategy can connect to AtScale, a performance test was then run comparing SparkSQL to AtScale. In order to run this test, the aggregate tables that would normally be autogenerated in AtScale needed to be manually created so they could be accessed by SparkSQL. With similar amount of cluster resources set, we saw similar performance between SparkSQL and AtScale when executing various reports against these aggregate tables.


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds


Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Advanced Settings tab. Right click an Object → Get Info (need Read permission on the Object). Users without this privilege will not see the Edit icon for Properties on Advanced Settings tab.NameDescriptionBrowseA User/User Group with this right should be informed about the existence of the target object when browsing a list of objects.ReadA User/User Group with this right should be able to examine the complete definition of the target object in metadata or in memory.
 ExecuteA User/User Group with this right should be permitted to execute queries built using the target object.UseA User/User Group with this right should be permitted to include references to the target object in the definition of other objects.ModifyA User/User Group with this right is permitted to modify the target object and save the modification to metadata.DeleteA User/User Group with this right is permitted to delete the target object from metadata.Control*A User/User Group with this right is permitted to modify the access control list of the target. Display NamePermissions IncludedView  Browse, Read, Use, and ExecuteModifyEverything in View, Write, and DeleteFull ControlAll PermissionsDenyNo PermissionsIncorrectCorrectIncorrectCorrect

Best Practices ⟩



Authentication ⟩



Authorization ⟩



Encryption ⟩



Web Security


Report Title

Table Size
Report Size
AtScale Time*

SparkSQL Time*

Report 1

~500K
250
7 seconds

6 seconds

Report 2

~10M
10,000
7 seconds

6 seconds

Report 3

~100M
10,000
9 seconds

7 seconds

Report 4

~1 Billion
1,000
9 seconds

11 seconds

*Spark.executor.cores=200
While most reports saw the same performance, AtScale outperforms SparkSQL (and any other Big Data technology) when analyzing partitioned fact tables. For instance, if a fact table is partitioned by month and a query is looking for the sum of sales in February, AtScale will only access the partitions where month=February. 
  KB426628


Comment

0 comments

Details

Knowledge Article

Published:

July 11, 2017

Last Updated:

July 12, 2023