KB441883: “DataNucleus requires this table to perform its persistence operations” error occurs when starting the HGoS Engine in MicroStrategy 10.x

SYMPTOM:
 
“DataNucleus requires this table to perform its persistence operations” error occurs when starting the HGoS Engine with /opt/hgos-0.1.0/sbin/start-hgos.sh in Strategy 10.x.
 
For The errors happen in both local and yarn mode. Following exception in logged in hgos log.
 

17/03/06 18:57:01 INFO DataNucleus.JDO: Exception thrown
Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrect, or you need to enable "datanucleus.autoCreateTables"
org.datanucleus.store.rdbms.exceptions.MissingTableException: Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrect, or you need to enable "datanucleus.autoCreateTables"
at org.datanucleus.store.rdbms.table.AbstractTable.exists(AbstractTable.java:485)
at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.performTablesValidation(RDBMSStoreManager.java:3380)
at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.addClassTablesAndValidate(RDBMSStoreManager.java:3190)
at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.run(RDBMSStoreManager.java:2841)
at org.datanucleus.store.rdbms.AbstractSchemaTransaction.execute(AbstractSchemaTransaction.java:122)
at org.datanucleus.store.rdbms.RDBMSStoreManager.addClasses(RDBMSStoreManager.java:1605)
at org.datanucleus.store.AbstractStoreManager.addClass(AbstractStoreManager.java:954)
at org.datanucleus.store.rdbms.RDBMSStoreManager.getDatastoreClass(RDBMSStoreManager.java:679)
at org.datanucleus.store.rdbms.RDBMSStoreManager.getPropertiesForGenerator(RDBMSStoreManager.java:2045)
at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1365)
at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827)
at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571)

 
 
CAUSE:
 
This is a known issue with Strategy 10.x.
 
Strategy Hadoop Gateway requires a Hive component to load ORC files, and basic metadata needs to be created to establish the Hive component. Modifying the structure of Metastore tables is not permitted by default.
 
 
ACTION:
 
 
This issue has been fixed in Strategy 10.8 GA. Upgrade to this version to take advantage of the fix.
 
 
 
WORKAROUND:
 
There are two workarounds available:
 

• To enable Metastore modification, add the following section to /etc/hive/conf/hive-site.xml.

<property>
    <name>datanucleus.autoCreateSchema</name>
    <value>true</value>
</property>

 

• Alternatively, the Hive component can be disabled if not going to import ORC files. Set the property hgos.spark.enable value to false in the Strategy Hadoop Gateway configuration file 

<Strategy Hadoop Gateway installation path>/conf/hgos-spark

 
 
 
Article Reference Number: KB441883