Examples of JournalImpl

org.activeio.journal.active.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Conncurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivated (due to a new mark) are resized to thier original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
@version $Revision: 1.1 $
org.apache.activeio.journal.active.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Concurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivate (due to a new mark) are resized to their original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
@version $Revision: 1.1 $
org.codehaus.activemq.journal.impl.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Conncurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivated (due to a new mark) are resized to thier original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
This class is a thing wrapper around a LogFileManager. It may be possible to extends this class so that it manages multiple LogFileManager objects to allow logging to multiple physical disks. @version $Revision: 1.3 $
org.hornetq.core.journal.impl.JournalImpl

A circular log implementation.
Look at {@link JournalImpl#load(LoaderCallback)} for the file layout @author Tim Fox @author Clebert Suconic

Examples of org.hornetq.core.journal.impl.JournalImpl


   private void getJmsBindings() throws Exception
   {
      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(config.getBindingsDirectory());


      Journal jmsJournal = new JournalImpl(1024 * 1024,
                                           2,
                                           config.getJournalCompactMinFiles(),
                                           config.getJournalCompactPercentage(),
                                           bindingsJMS,
                                           "hornetq-jms",
                                           "jms",
                                           1);


      jmsJournal.start();


      List<RecordInfo> data = new ArrayList<>();


      ArrayList<PreparedTransactionInfo> list = new ArrayList<>();


      HornetQServerLogger.LOGGER.debug("Reading jms bindings journal from " + config.getBindingsDirectory());


      jmsJournal.load(data, list, null);


      for (RecordInfo record : data)
      {
         long id = record.id;

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(journalLocation, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
         defaultValues.getJournalMinFiles(),
         0,
         0,
         messagesFF,
         "hornetq-data",
         "hq",
         1);


      messagesJournal.start();


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();
      ArrayList<PreparedTransactionInfo> txs = new ArrayList<PreparedTransactionInfo>();


      messagesJournal.load(records, txs, null, false);


      PageCursorsInfo cursorInfo = new PageCursorsInfo();




      for (RecordInfo record : records)

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      journalDir = config.getJournalDirectory();


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, criticalErrorListener);


      Journal localBindings = new JournalImpl(1024 * 1024,
         2,
         config.getJournalCompactMinFiles(),
         config.getJournalCompactPercentage(),
         bindingsFF,
         "hornetq-bindings",
         "bindings",
         1);


      bindingsJournal = localBindings;
      originalBindingsJournal = localBindings;


      if (journalDir == null)
      {
         throw new NullPointerException("journal-dir is null");
      }


      createJournalDir = config.isCreateJournalDir();


      syncNonTransactional = config.isJournalSyncNonTransactional();


      syncTransactional = config.isJournalSyncTransactional();


      if (config.getJournalType() == JournalType.ASYNCIO)
      {
         HornetQServerLogger.LOGGER.journalUseAIO();


         journalFF = new AIOSequentialFileFactory(journalDir,
            config.getJournalBufferSize_AIO(),
            config.getJournalBufferTimeout_AIO(),
            config.isLogJournalWriteRate(),
            criticalErrorListener);
      }
      else if (config.getJournalType() == JournalType.NIO)
      {
         HornetQServerLogger.LOGGER.journalUseNIO();
         journalFF = new NIOSequentialFileFactory(journalDir,
            true,
            config.getJournalBufferSize_NIO(),
            config.getJournalBufferTimeout_NIO(),
            config.isLogJournalWriteRate(),
            criticalErrorListener);
      }
      else
      {
         throw HornetQMessageBundle.BUNDLE.invalidJournalType2(config.getJournalType());
      }


      idGenerator = new BatchingIDGenerator(0, JournalStorageManager.CHECKPOINT_BATCH_SIZE, this);


      Journal localMessage = new JournalImpl(config.getJournalFileSize(),
         config.getJournalMinFiles(),
         config.getJournalCompactMinFiles(),
         config.getJournalCompactPercentage(),
         journalFF,
         "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      createDir = config.isCreateBindingsDir();


      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(journalDir);


      Journal localJMS = new JournalImpl(1024 * 1024,
                                              2,
                                              config.getJournalCompactMinFiles(),
                                              config.getJournalCompactPercentage(),
                                              bindingsJMS,
                                              "hornetq-jms",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      journalDir = config.getJournalDirectory();


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, criticalErrorListener);


      Journal localBindings = new JournalImpl(1024 * 1024,
         2,
         config.getJournalCompactMinFiles(),
         config.getJournalCompactPercentage(),
         bindingsFF,
         "hornetq-bindings",
         "bindings",
         1);


      bindingsJournal = localBindings;
      originalBindingsJournal = localBindings;


      if (journalDir == null)
      {
         throw new NullPointerException("journal-dir is null");
      }


      createJournalDir = config.isCreateJournalDir();


      syncNonTransactional = config.isJournalSyncNonTransactional();


      syncTransactional = config.isJournalSyncTransactional();


      if (config.getJournalType() == JournalType.ASYNCIO)
      {
         HornetQServerLogger.LOGGER.journalUseAIO();


         journalFF = new AIOSequentialFileFactory(journalDir,
            config.getJournalBufferSize_AIO(),
            config.getJournalBufferTimeout_AIO(),
            config.isLogJournalWriteRate(),
            criticalErrorListener);
      }
      else if (config.getJournalType() == JournalType.NIO)
      {
         HornetQServerLogger.LOGGER.journalUseNIO();
         journalFF = new NIOSequentialFileFactory(journalDir,
            true,
            config.getJournalBufferSize_NIO(),
            config.getJournalBufferTimeout_NIO(),
            config.isLogJournalWriteRate(),
            criticalErrorListener);
      }
      else
      {
         throw HornetQMessageBundle.BUNDLE.invalidJournalType2(config.getJournalType());
      }


      idGenerator = new BatchingIDGenerator(0, JournalStorageManager.CHECKPOINT_BATCH_SIZE, this);


      Journal localMessage = new JournalImpl(config.getJournalFileSize(),
         config.getJournalMinFiles(),
         config.getJournalCompactMinFiles(),
         config.getJournalCompactPercentage(),
         journalFF,
         "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      createDir = config.isCreateBindingsDir();


      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(journalDir);


      Journal localJMS = new JournalImpl(1024 * 1024,
                                              2,
                                              config.getJournalCompactMinFiles(),
                                              config.getJournalCompactPercentage(),
                                              bindingsJMS,
                                              "hornetq-jms",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      journalDir = config.getJournalDirectory();


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, criticalErrorListener);


      Journal localBindings = new JournalImpl(1024 * 1024,
                                              2,
                                              config.getJournalCompactMinFiles(),
                                              config.getJournalCompactPercentage(),
                                              bindingsFF,
                                              "hornetq-bindings",
                                              "bindings",
                                              1);


      if (replicator != null)
      {
         bindingsJournal = new ReplicatedJournal((byte)0, localBindings, replicator);
      }
      else
      {
         bindingsJournal = localBindings;
      }


      if (journalDir == null)
      {
         throw new NullPointerException("journal-dir is null");
      }


      createJournalDir = config.isCreateJournalDir();


      syncNonTransactional = config.isJournalSyncNonTransactional();


      syncTransactional = config.isJournalSyncTransactional();


      if (config.getJournalType() == JournalType.ASYNCIO)
      {
         JournalStorageManager.log.info("Using AIO Journal");


         journalFF = new AIOSequentialFileFactory(journalDir,
                                                  config.getJournalBufferSize_AIO(),
                                                  config.getJournalBufferTimeout_AIO(),
                                                  config.isLogJournalWriteRate(),
                                                  criticalErrorListener);
      }
      else if (config.getJournalType() == JournalType.NIO)
      {
         JournalStorageManager.log.info("Using NIO Journal");
         journalFF = new NIOSequentialFileFactory(journalDir,
                                                  true,
                                                  config.getJournalBufferSize_NIO(),
                                                  config.getJournalBufferTimeout_NIO(),
                                                  config.isLogJournalWriteRate(),
                                                  criticalErrorListener);
      }
      else
      {
         throw new IllegalArgumentException("Unsupported journal type " + config.getJournalType());
      }


      if (config.isBackup() && !config.isSharedStore())
      {
         idGenerator = null;
      }
      else
      {
         idGenerator = new BatchingIDGenerator(0, JournalStorageManager.CHECKPOINT_BATCH_SIZE, bindingsJournal);
      }
      Journal localMessage = new JournalImpl(config.getJournalFileSize(),
                                             config.getJournalMinFiles(),
                                             config.getJournalCompactMinFiles(),
                                             config.getJournalCompactPercentage(),
                                             journalFF,
                                             "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

   public static void describeBindingJournal(final String bindingsDir) throws Exception
   {


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, null);


      JournalImpl bindings = new JournalImpl(1024 * 1024, 2, -1, 0, bindingsFF, "hornetq-bindings", "bindings", 1);


      describeJournal(bindingsFF, bindings);
   }

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(messagesDir, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
                                                    defaultValues.getJournalMinFiles(),
                                                    0,
                                                    0,
                                                    messagesFF,
                                                    "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      ArrayList<Pair<Long, Long>> transactedRecords = new ArrayList<Pair<Long, Long>>();


      final CountDownLatch latchDone = new CountDownLatch(1);
      final CountDownLatch latchWait = new CountDownLatch(1);
      journal = new JournalImpl(fileSize, minFiles, 0, 0, fileFactory, filePrefix, fileExtension, maxAIO)
      {


         @Override
         protected SequentialFile createControlFile(final List<JournalFile> files,
                                                    final List<JournalFile> newFiles,

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.