Examples of InfinispanDirectory

org.infinispan.lucene.InfinispanDirectory
An implementation of Lucene's {@link org.apache.lucene.store.Directory} which uses Infinispan to store Lucene indices.As the RAMDirectory the data is stored in memory, but provides some additional flexibility:
Passivation, LRU or LIRS Bigger indexes can be configured to passivate cleverly selected chunks of data to a cache store. This can be a local filesystem, a network filesystem, a database or custom cloud stores like S3. See Infinispan's core documentation for a full list of available implementations, or {@link org.infinispan.loaders.CacheStore} to implement more.
Non-volatile memory The contents of the index can be stored in it's entirety in such a store, so that on shutdown or crash of the system data is not lost. A copy of the index will be copied to the store in sync or async depending on configuration; In case you enable Infinispan's clustering even in case of async the segments are always duplicated synchronosly to other nodes, so you can benefit from good reliability even while choosing the asynchronous mode to write the index to the slowest store implementations.

Real-time change propagation All changes done on a node are propagated at low latency to other nodes of the cluster; this was designed especially for interactive usage of Lucene, so that after an IndexWriter commits on one node new IndexReaders opened on any node of the cluster will be able to deliver updated search results.

Distributed heap Infinispan acts as a shared heap for the purpose of total memory consumption, so you can avoid hitting the slower disks even if the total size of the index can't fit in the memory of a single node: network is faster than disks, especially if the index is bigger than the memory available to cache it.

Distributed locking As default Lucene Directory implementations a global lock needs to protect the index from having more than an IndexWriter open; in case of a replicated or distributed index you need to enable a cluster-wide {@link org.apache.lucene.store.LockFactory}. This implementation uses by default {@link org.infinispan.lucene.locking.BaseLockFactory}; in case you want to apply changes during a JTA transaction see also {@link org.infinispan.lucene.locking.TransactionalLockFactory}.

Combined store patterns It's possible to combine different stores and passivation policies, so that each nodes shares the index changes quickly to other nodes, offloads less frequently used data to a per-node local filesystem, and the cluster also coordinates to keeps a safe copy on a shared store.
@since 4.0 @author Sanne Grinovero @author Lukasz Moren @see org.apache.lucene.store.Directory @see org.apache.lucene.store.LockFactory @see org.infinispan.lucene.locking.BaseLockFactory @see org.infinispan.lucene.locking.TransactionalLockFactory

Examples of org.infinispan.lucene.InfinispanDirectory

   }
   
   @Test
   public void profileTestInfinispanDirectoryWithNetworkDelayZero() throws InterruptedException, IOException {
      // TestingUtil.setDelayForCache(cache, 0, 0);
      InfinispanDirectory dir = new InfinispanDirectory(cache, cache, cache, indexName, CHUNK_SIZE);
      stressTestDirectory(dir, "InfinispanClustered-delayedIO:0");
      verifyDirectoryState();
   }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

   }


   @Test
   public void profileTestInfinispanDirectoryWithNetworkDelay4() throws Exception {
      TestingUtil.setDelayForCache(cache, 4, 4);
      InfinispanDirectory dir = new InfinispanDirectory(cache, cache, cache, indexName, CHUNK_SIZE);
      stressTestDirectory(dir, "InfinispanClustered-delayedIO:4");
      verifyDirectoryState();
   }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

   }


   @Test
   public void profileTestInfinispanDirectoryWithHighNetworkDelay40() throws Exception {
      TestingUtil.setDelayForCache(cache, 40, 40);
      InfinispanDirectory dir = new InfinispanDirectory(cache, cache, cache, indexName, CHUNK_SIZE);
      stressTestDirectory(dir, "InfinispanClustered-delayedIO:40");
      verifyDirectoryState();
   }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

   @Test
   public void profileInfinispanLocalDirectory() throws InterruptedException, IOException {
      CacheContainer cacheContainer = CacheTestSupport.createLocalCacheManager();
      try {
         cache = cacheContainer.getCache();
         InfinispanDirectory dir = new InfinispanDirectory(cache, cache, cache, indexName, CHUNK_SIZE);
         stressTestDirectory(dir, "InfinispanLocal");
         verifyDirectoryState();
      } finally {
         cacheContainer.stop();
      }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

      verifyBoth(cache0, cache1);
   }
   
   @Override
   Directory createDirectory(Cache cache) {
      return new InfinispanDirectory(cache, INDEX_NAME, CHUNK_SIZE,
               new LocalLockMergingSegmentReadLocker(cache, INDEX_NAME));
   }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

      DirectoryIntegrityCheck.assertFileExistsHavingRLCount(cache0, fileName, INDEX_NAME, expectedReadcount, CHUNK_SIZE, expectRegisteredInFat);
      DirectoryIntegrityCheck.assertFileExistsHavingRLCount(cache1, fileName, INDEX_NAME, expectedReadcount, CHUNK_SIZE, expectRegisteredInFat);
   }
   
   Directory createDirectory(Cache cache) {
      return new InfinispanDirectory(cache, INDEX_NAME, CHUNK_SIZE,
               new DistributedSegmentReadLocker(cache, INDEX_NAME));
   }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

    log.debug( "Starting InfinispanDirectory" );
    cacheManager = context.requestService( CacheManagerServiceProvider.class );
    Cache metadataCache = cacheManager.getCache( metadataCacheName );
    Cache dataCache = cacheManager.getCache( dataCacheName );
    Cache lockingCache = cacheManager.getCache( lockingCacheName );
    directory = new InfinispanDirectory( metadataCache, dataCache, lockingCache, directoryProviderName, chunkSize );
    DirectoryProviderHelper.initializeIndexIfNeeded( directory );
    log.debug( "Initialized Infinispan index: '{}'", directoryProviderName );
  }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

   @Test
   public void testIndexWritingAndFinding() throws IOException {
      final String indexName = "indexName";
      final Cache cache0 = cache(0, "lucene");
      final Cache cache1 = cache(1, "lucene");
      Directory dirA = new InfinispanDirectory(cache0, indexName);
      Directory dirB = new InfinispanDirectory(cache1, indexName);
      writeTextToIndex(dirA, 0, "hi from node A");
      assertTextIsFoundInIds(dirA, "hi", 0);
      assertTextIsFoundInIds(dirB, "hi", 0);
      writeTextToIndex(dirB, 1, "hello node A, how are you?");
      assertTextIsFoundInIds(dirA, "hello", 1);
      assertTextIsFoundInIds(dirB, "hello", 1);
      assertTextIsFoundInIds(dirA, "node", 1, 0); // node is keyword in both documents id=0 and id=1
      assertTextIsFoundInIds(dirB, "node", 1, 0);
      removeByTerm(dirA, "from");
      assertTextIsFoundInIds(dirB, "node", 1);
      dirA.close();
      dirB.close();
      DirectoryIntegrityCheck.verifyDirectoryStructure(cache0, "indexName");
      DirectoryIntegrityCheck.verifyDirectoryStructure(cache1, "indexName");
   }

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

   public static void main(String[] args) throws IOException {
      DefaultCacheManager cacheManager = new DefaultCacheManager("config-samples/lucene-demo-cache-config.xml");
      cacheManager.start();
      try {
         Cache<?, ?> cache = cacheManager.getCache();
         InfinispanDirectory directory = new InfinispanDirectory(cache);
         DemoDriver driver = new DemoDriver(directory, cache);
         driver.run();
      }
      finally {
         cacheManager.stop();

View Full Code Here

Examples of org.infinispan.lucene.InfinispanDirectory

    cacheManager = context.requestService( CacheManagerServiceProvider.class );
    cacheManager.startCaches( metadataCacheName, dataCacheName, lockingCacheName );
    Cache metadataCache = cacheManager.getCache( metadataCacheName );
    Cache dataCache = cacheManager.getCache( dataCacheName );
    Cache lockingCache = cacheManager.getCache( lockingCacheName );
    directory = new InfinispanDirectory( metadataCache, dataCache, lockingCache, directoryProviderName, chunkSize );
    DirectoryProviderHelper.initializeIndexIfNeeded( directory );
    log.debugf( "Initialized Infinispan index: '%s'", directoryProviderName );
  }

View Full Code Here

0 1 2

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.