vcenter inventory service failed to start

vcenter 5.1 inventory is failing to start on one of my vcenters. I looks at the ds.log and here it is

1364037, 5.1.0, Win32, release

[2014-08-10 07:19:36,035 WrapperListener_start_runner INFO com.vmware.vim.dataservices.WrapperListenerImpl] Starting service

[2014-08-10 07:19:36,098 WrapperListener_start_runner INFO org.springframework.context.support.ClassPathXmlApplicationContext] Refreshing org.springframework.context.support.ClassPathXmlApplicationContext@5e785d65: display name [org.springframework.context.support.ClassPathXmlApplicationContext@5e785d65]; startup date [Sun Aug 10 07:19:36 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:36,176 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/server-config.xml]

[2014-08-10 07:19:36,628 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/vmomi-server-config.xml]

[2014-08-10 07:19:36,675 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/query-server-config.xml]

[2014-08-10 07:19:36,706 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/tagging-config.xml]

[2014-08-10 07:19:36,722 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/provider-config.xml]

[2014-08-10 07:19:36,753 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/security-config.xml]

[2014-08-10 07:19:36,784 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/authorization-config.xml]

[2014-08-10 07:19:36,909 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [server/config/sso-config.xml]

[2014-08-10 07:19:37,049 WrapperListener_start_runner INFO org.springframework.context.support.ClassPathXmlApplicationContext] Bean factory for application context [org.springframework.context.support.ClassPathXmlApplicationContext@5e785d65]: org.springframework.beans.factory.support.DefaultListableBeanFactory@6c1989b5

[2014-08-10 07:19:37,158 WrapperListener_start_runner INFO org.springframework.beans.factory.config.PropertyPlaceholderConfigurer] Loading properties file from class path resource [dataservice.properties]

[2014-08-10 07:19:37,190 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@6c1989b5: defining beans [propertyConfigurer,instanceUUID,endpointType,serviceName,vlsi-server,authFilter,dataservice,moService,dsVmomiServlet,dsVmodlContext,vmodlVersionMap,httpResponseCorrelator,dsAdapterServer,syncValidator,authValidator,privilegeValidator,authorizer,dsVersion1,internalDsVersion1,dsVersion2,internalDsVersion2,dsv1BodyHandler,internalDsv1BodyHandler,dsv2BodyHandler,internalDsv2BodyHandler,correlationStep,dispatcherStep,validationStartStep,invocationStep,filterStartStep,completionStep,continuerStep,dispatcher,executor,fedInstance,sdReconfig,sdProvider,storeDirectory,storeFactory,queryPool,providerPool,store,serviceFactory,filterFactory,remotePrincipalHelper,service,authCallback,queryservlet,n2rservlet,statusservlet,healthservlet,tagManager,registerTagProvider,tagProvider,sdFixer,vpx,providermgr,pushservlet,pushprocessor,atomservlet,authSessionPool,memCache,authQueryHandlerRegistry,srmProviderAuthQueryHandler,caches,permissionsCache,rolesAndPrivilegesCache,authProvider,authorizationManager,userSessionManager,sessionManager,authChecker,authHelper,certUtil,vcAuthManager,authenticationservlet,authorizationConfig,serviceLocator,certificateProvider,moSessionManager,adapterServerCertInjector,adminClientFactoryWrapper,groupCheckClientFactoryWrapper,tokenProvider,adminClientWrapper,groupCheckClientWrapper,ssoPrincipalFactory,domainNameNormalizer,dsSolutionInfo,dsPrivateKey,dsCertificate,stsExecutor,stsClientFactoryWrapper]; root of factory hierarchy

[2014-08-10 07:19:37,190 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Refreshing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@73d32e45: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@73d32e45]; startup date [Sun Aug 10 07:19:37 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:37,190 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [com/vmware/vim/binding/vmodl/context.xml]

[2014-08-10 07:19:37,205 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Bean factory for application context [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@73d32e45]: org.springframework.beans.factory.support.DefaultListableBeanFactory@7229c204

[2014-08-10 07:19:37,205 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@7229c204: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:37,314 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Closing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@73d32e45: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@73d32e45]; startup date [Sun Aug 10 07:19:37 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:37,314 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@7229c204: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:37,314 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Refreshing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@4743bf3d: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@4743bf3d]; startup date [Sun Aug 10 07:19:37 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:37,314 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [com/vmware/vim/binding/vmodl/query/context.xml]

[2014-08-10 07:19:37,314 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Bean factory for application context [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@4743bf3d]: org.springframework.beans.factory.support.DefaultListableBeanFactory@26789869

[2014-08-10 07:19:37,314 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@26789869: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:37,424 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Closing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@4743bf3d: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@4743bf3d]; startup date [Sun Aug 10 07:19:37 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:37,424 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@26789869: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:37,424 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Refreshing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@51f21c50: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@51f21c50]; startup date [Sun Aug 10 07:19:37 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:37,424 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [com/vmware/vim/binding/vim/context.xml]

[2014-08-10 07:19:38,001 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Bean factory for application context [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@51f21c50]: org.springframework.beans.factory.support.DefaultListableBeanFactory@e1bdb58

[2014-08-10 07:19:38,001 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@e1bdb58: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:42,806 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Closing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@51f21c50: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@51f21c50]; startup date [Sun Aug 10 07:19:37 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:42,806 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@e1bdb58: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:42,806 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Refreshing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@69a10f82: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@69a10f82]; startup date [Sun Aug 10 07:19:42 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:42,806 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [com/vmware/vim/binding/dataservice/context.xml]

[2014-08-10 07:19:42,806 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Bean factory for application context [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@69a10f82]: org.springframework.beans.factory.support.DefaultListableBeanFactory@12b3f93c

[2014-08-10 07:19:42,806 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@12b3f93c: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:42,821 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Closing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@69a10f82: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@69a10f82]; startup date [Sun Aug 10 07:19:42 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:42,821 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@12b3f93c: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:42,821 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Refreshing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@806bc2f: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@806bc2f]; startup date [Sun Aug 10 07:19:42 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:42,821 WrapperListener_start_runner INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader] Loading XML bean definitions from class path resource [com/vmware/vim/binding/lookup/context.xml]

[2014-08-10 07:19:42,821 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Bean factory for application context [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@806bc2f]: org.springframework.beans.factory.support.DefaultListableBeanFactory@555214b9

[2014-08-10 07:19:42,821 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@555214b9: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:42,837 WrapperListener_start_runner INFO com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext] Closing com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@806bc2f: display name [com.vmware.vim.vmomi.core.types.impl.VmodlContextImpl$NonValidatingClassPathXmlApplicationContext@806bc2f]; startup date [Sun Aug 10 07:19:42 PDT 2014]; root of context hierarchy

[2014-08-10 07:19:42,837 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@555214b9: defining beans [context]; root of factory hierarchy

[2014-08-10 07:19:43,071 WrapperListener_start_runner INFO com.vmware.vim.query.server.store.impl.QueryPerfLogger] Giving xDB 0 cache pages

[2014-08-10 07:19:43,508 WrapperListener_start_runner INFO org.springframework.beans.factory.support.DefaultListableBeanFactory] Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@6c1989b5: defining beans [propertyConfigurer,instanceUUID,endpointType,serviceName,vlsi-server,authFilter,dataservice,moService,dsVmomiServlet,dsVmodlContext,vmodlVersionMap,httpResponseCorrelator,dsAdapterServer,syncValidator,authValidator,privilegeValidator,authorizer,dsVersion1,internalDsVersion1,dsVersion2,internalDsVersion2,dsv1BodyHandler,internalDsv1BodyHandler,dsv2BodyHandler,internalDsv2BodyHandler,correlationStep,dispatcherStep,validationStartStep,invocationStep,filterStartStep,completionStep,continuerStep,dispatcher,executor,fedInstance,sdReconfig,sdProvider,storeDirectory,storeFactory,queryPool,providerPool,store,serviceFactory,filterFactory,remotePrincipalHelper,service,authCallback,queryservlet,n2rservlet,statusservlet,healthservlet,tagManager,registerTagProvider,tagProvider,sdFixer,vpx,providermgr,pushservlet,pushprocessor,atomservlet,authSessionPool,memCache,authQueryHandlerRegistry,srmProviderAuthQueryHandler,caches,permissionsCache,rolesAndPrivilegesCache,authProvider,authorizationManager,userSessionManager,sessionManager,authChecker,authHelper,certUtil,vcAuthManager,authenticationservlet,authorizationConfig,serviceLocator,certificateProvider,moSessionManager,adapterServerCertInjector,adminClientFactoryWrapper,groupCheckClientFactoryWrapper,tokenProvider,adminClientWrapper,groupCheckClientWrapper,ssoPrincipalFactory,domainNameNormalizer,dsSolutionInfo,dsPrivateKey,dsCertificate,stsExecutor,stsClientFactoryWrapper]; root of factory hierarchy

[2014-08-10 07:19:43,508 WrapperListener_start_runner FATAL com.vmware.vim.dataservices.WrapperListenerImpl] Error starting service:

org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'instanceUUID' defined in class path resource [server/config/server-config.xml]: Cannot resolve reference to bean 'store' while setting bean property 'targetObject'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'storeFactory' defined in class path resource [server/config/query-server-config.xml]: Invocation of init method failed; nested exception is com.xhive.error.XhiveException: IO_ERROR

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:275)

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:104)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1244)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1008)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:470)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)

at java.security.AccessController.doPrivileged(Native Method)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)

at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:423)

at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:729)

at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:381)

at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:139)

at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:93)

at com.vmware.vim.dataservices.DataService.getService(DataService.java:213)

at com.vmware.vim.dataservices.WrapperListenerImpl.start(WrapperListenerImpl.java:52)

at org.tanukisoftware.wrapper.WrapperManager$12.run(WrapperManager.java:3560)

Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'storeFactory' defined in class path resource [server/config/query-server-config.xml]: Invocation of init method failed; nested exception is com.xhive.error.XhiveException: IO_ERROR

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1336)

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:471)