Fixing a Stopped Solr Crawl

  • Updated

In Ektron 9.10, the Solr crawl may stop, (seen on the Workarea's Solr Search Node Information screen > Process Status tab).

Manifold Not Running

In any other Ektron version, you see the following in your search server's Manifold logs.

WARN  - 2014-03-24 20:03:10.663; lockmanager.FileLockObject; (Document delete stuffer thread) - Attempt to set file lock 'C:\Program Files (x86)\Ektron\Search2.0\ManifoldCF\core\.\crawldb\syncharea\737\563\lock-_Cache_JOBSTATUSES.lock' failed: Access is denied
java.io.IOException: Access is denied
    at java.io.WinNTFileSystem.createFileExclusively(Native Method)
    at java.io.File.createNewFile(File.java:1006)
    at org.apache.manifoldcf.core.lockmanager.FileLockObject.grabFileLock(FileLockObject.java:221)
    at org.apache.manifoldcf.core.lockmanager.FileLockObject.clearGlobalReadLock(FileLockObject.java:193)
    at org.apache.manifoldcf.core.lockmanager.LockObject.leaveReadLock(LockObject.java:389)
    at org.apache.manifoldcf.core.lockmanager.BaseLockManager.leaveRead(BaseLockManager.java:1365)
    at org.apache.manifoldcf.core.lockmanager.BaseLockManager.leave(BaseLockManager.java:1818)
    at org.apache.manifoldcf.core.lockmanager.BaseLockManager.leaveLocks(BaseLockManager.java:825)
    at org.apache.manifoldcf.core.lockmanager.LockManager.leaveLocks(LockManager.java:371)
    at org.apache.manifoldcf.core.cachemanager.CacheManager.leaveCache(CacheManager.java:667)
    at org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:179)
    at org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:191)
    at org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.performQuery(DBInterfaceHSQLDB.java:940)
    at org.apache.manifoldcf.core.database.BaseTable.performQuery(BaseTable.java:236)
    at org.apache.manifoldcf.crawler.jobs.Jobs.deletingJobsPresent(Jobs.java:2623)
    at org.apache.manifoldcf.crawler.jobs.JobManager.getNextDeletableDocuments(JobManager.java:1454)
    at org.apache.manifoldcf.crawler.system.DocumentDeleteStufferThread.run(DocumentDeleteStufferThread.java:108)

ERROR - 2014-03-24 20:32:34.935; lockmanager.FileLockObject; (Idle cleanup thread) - Couldn't write to lock file; disk may be full.  Shutting down process; locks may be left dangling.  You must cleanup before restarting.
java.io.FileNotFoundException: C:\Program Files (x86)\Ektron\Search2.0\ManifoldCF\core\.\crawldb\syncharea\612\956\lock-_SERVICELOCK__REPOSITORYCONNECTORPOOL_8d28f9db.file (Access is denied)
    at java.io.FileOutputStream.open(Native Method)
    at java.io.FileOutputStream.(FileOutputStream.java:221)
    at java.io.FileOutputStream.(FileOutputStream.java:171)
    at java.io.FileWriter.(FileWriter.java:90)
    at org.apache.manifoldcf.core.lockmanager.FileLockObject.writeFile(FileLockObject.java:403)
    at org.apache.manifoldcf.core.lockmanager.FileLockObject.obtainGlobalWriteLockNoWait(FileLockObject.java:85)
    at org.apache.manifoldcf.core.lockmanager.LockObject.enterWriteLockNoWait(LockObject.java:111)
    at org.apache.manifoldcf.core.lockmanager.LockObject.enterWriteLock(LockObject.java:73)
    at org.apache.manifoldcf.core.lockmanager.BaseLockManager.enterWrite(BaseLockManager.java:1126)
    at org.apache.manifoldcf.core.lockmanager.BaseLockManager.enterWriteLock(BaseLockManager.java:763)
    at org.apache.manifoldcf.core.lockmanager.BaseLockManager.updateServiceData(BaseLockManager.java:262)
    at org.apache.manifoldcf.core.lockmanager.LockManager.updateServiceData(LockManager.java:108)
    at org.apache.manifoldcf.core.connectorpool.ConnectorPool$Pool.pollAll(ConnectorPool.java:652)
    at org.apache.manifoldcf.core.connectorpool.ConnectorPool.pollAllConnectors(ConnectorPool.java:338)
    at org.apache.manifoldcf.crawler.repositoryconnectorpool.RepositoryConnectorPool.pollAllConnectors(RepositoryConnectorPool.java:124)
    at org.apache.manifoldcf.crawler.system.IdleCleanupThread.run(IdleCleanupThread.java:69)

 

  1. On your Search Server, open the Local Services panel and stop these services.  
    • Windows search service
    • Windows defender service
  2. On each service's Properties screen, go to the General tab and set Startup Type to Disabled .

NOTE: This issue can also be caused by any Anti Virus Software running on the server (eg McAfee). If the search server has AV software running, then a folder exclusion on the Ektron Search 2.0 tree should be added to the AV configuration. The default path for this would be C:\Program Files (x86)\Ektron\Search2.0