Examples of JournalImpl

org.activeio.journal.active.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Conncurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivated (due to a new mark) are resized to thier original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
@version $Revision: 1.1 $
org.apache.activeio.journal.active.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Concurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivate (due to a new mark) are resized to their original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
@version $Revision: 1.1 $
org.codehaus.activemq.journal.impl.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Conncurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivated (due to a new mark) are resized to thier original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
This class is a thing wrapper around a LogFileManager. It may be possible to extends this class so that it manages multiple LogFileManager objects to allow logging to multiple physical disks. @version $Revision: 1.3 $
org.hornetq.core.journal.impl.JournalImpl

A circular log implementation.
Look at {@link JournalImpl#load(LoaderCallback)} for the file layout @author Tim Fox @author Clebert Suconic

Examples of org.hornetq.core.journal.impl.JournalImpl


      journalDir = config.getJournalDirectory();


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, criticalErrorListener);


      Journal localBindings = new JournalImpl(1024 * 1024,
                                              2,
                                              config.getJournalCompactMinFiles(),
                                              config.getJournalCompactPercentage(),
                                              bindingsFF,
                                              "hornetq-bindings",
                                              "bindings",
                                              1);


      if (replicator != null)
      {
         bindingsJournal = new ReplicatedJournal((byte)0, localBindings, replicator);
      }
      else
      {
         bindingsJournal = localBindings;
      }


      if (journalDir == null)
      {
         throw new NullPointerException("journal-dir is null");
      }


      createJournalDir = config.isCreateJournalDir();


      syncNonTransactional = config.isJournalSyncNonTransactional();


      syncTransactional = config.isJournalSyncTransactional();


      if (config.getJournalType() == JournalType.ASYNCIO)
      {
         JournalStorageManager.log.info("Using AIO Journal");


         journalFF = new AIOSequentialFileFactory(journalDir,
                                                  config.getJournalBufferSize_AIO(),
                                                  config.getJournalBufferTimeout_AIO(),
                                                  config.isLogJournalWriteRate(),
                                                  criticalErrorListener);
      }
      else if (config.getJournalType() == JournalType.NIO)
      {
         JournalStorageManager.log.info("Using NIO Journal");
         journalFF = new NIOSequentialFileFactory(journalDir,
                                                  true,
                                                  config.getJournalBufferSize_NIO(),
                                                  config.getJournalBufferTimeout_NIO(),
                                                  config.isLogJournalWriteRate(),
                                                  criticalErrorListener);
      }
      else
      {
         throw new IllegalArgumentException("Unsupported journal type " + config.getJournalType());
      }


      if (config.isBackup() && !config.isSharedStore())
      {
         idGenerator = null;
      }
      else
      {
         idGenerator = new BatchingIDGenerator(0, JournalStorageManager.CHECKPOINT_BATCH_SIZE, bindingsJournal);
      }
      Journal localMessage = new JournalImpl(config.getJournalFileSize(),
                                             config.getJournalMinFiles(),
                                             config.getJournalCompactMinFiles(),
                                             config.getJournalCompactPercentage(),
                                             journalFF,
                                             "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

   public static void describeBindingJournal(final String bindingsDir) throws Exception
   {


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, null);


      JournalImpl bindings = new JournalImpl(1024 * 1024, 2, -1, 0, bindingsFF, "hornetq-bindings", "bindings", 1);


      describeJournal(bindingsFF, bindings);
   }

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(messagesDir, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
                                                    defaultValues.getJournalMinFiles(),
                                                    0,
                                                    0,
                                                    messagesFF,
                                                    "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(journalLocation, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
         defaultValues.getJournalMinFiles(),
         0,
         0,
         messagesFF,
         "hornetq-data",
         "hq",
         1);


      messagesJournal.start();


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();
      ArrayList<PreparedTransactionInfo> txs = new ArrayList<PreparedTransactionInfo>();


      messagesJournal.load(records, txs, null, false);


      PageCursorsInfo cursorInfo = new PageCursorsInfo();




      for (RecordInfo record : records)

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


   private void getJmsBindings() throws Exception
   {
      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(config.getBindingsDirectory());


      Journal jmsJournal = new JournalImpl(1024 * 1024,
            2,
            config.getJournalCompactMinFiles(),
            config.getJournalCompactPercentage(),
            bindingsJMS,
            "hornetq-jms",
            "jms",
            1);


      jmsJournal.start();


      List<RecordInfo> data = new ArrayList<>();


      ArrayList<PreparedTransactionInfo> list = new ArrayList<>();


      HornetQServerLogger.LOGGER.debug("Reading jms bindings journal from " + config.getBindingsDirectory());


      jmsJournal.load(data, list, null);


      for (RecordInfo record : data)
      {
         long id = record.id;

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      createDir = config.isCreateBindingsDir();


      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(journalDir);


      Journal localJMS = new JournalImpl(1024 * 1024,
                                         2,
                                         config.getJournalCompactMinFiles(),
                                         config.getJournalCompactPercentage(),
                                         bindingsJMS,
                                         "hornetq-jms",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      createDir = config.isCreateBindingsDir();


      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(journalDir);


      Journal localJMS = new JournalImpl(1024 * 1024,
                                              2,
                                              config.getJournalCompactMinFiles(),
                                              config.getJournalCompactPercentage(),
                                              bindingsJMS,
                                              "hornetq-jms",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(journalLocation, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
         defaultValues.getJournalMinFiles(),
         0,
         0,
         messagesFF,
         "hornetq-data",
         "hq",
         1);


      messagesJournal.start();


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();
      ArrayList<PreparedTransactionInfo> txs = new ArrayList<PreparedTransactionInfo>();


      messagesJournal.load(records, txs, null, false);


      PageCursorsInfo cursorInfo = new PageCursorsInfo();




      for (RecordInfo record : records)

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(journalLocation, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
                                                    defaultValues.getJournalMinFiles(),
                                                    0,
                                                    0,
                                                    messagesFF,
                                                    "hornetq-data",
                                                    "hq",
                                                    1);


      messagesJournal.start();


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();
      ArrayList<PreparedTransactionInfo> txs = new ArrayList<PreparedTransactionInfo>();


      messagesJournal.load(records, txs, null, false);


      PageCursorsInfo cursorInfo = new PageCursorsInfo();




      for (RecordInfo record : records)

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

               }


            }
         }


         JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
                                                       defaultValues.getJournalMinFiles(),
                                                       0,
                                                       0,
                                                       messagesFF,
                                                       journalName,
                                                       exension,
                                                       1);


         messagesJournal.start();


         messagesJournal.loadInternalOnly();




         for (long tx : txsToRollback)
         {
            System.out.println("Rolling back " + tx);


            try
            {
               messagesJournal.appendRollbackRecord(tx, true);
            }
            catch (Throwable e)
            {
               e.printStackTrace();
            }
         }




         for (long id : idsToDelete)
         {
            System.out.println("Deleting record " + id);


            try
            {
               messagesJournal.appendDeleteRecord(id, true);
            }
            catch (Throwable e)
            {
               e.printStackTrace();
            }
         }


         messagesJournal.stop();


      }
      catch (Exception e)
      {
         e.printStackTrace();

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.