Examples of com.cloudera.flume.agent.diskfailover.DiskFailoverManager

Package com.cloudera.flume.agent.diskfailover

Examples of com.cloudera.flume.agent.diskfailover.DiskFailoverManager

com.cloudera.flume.agent.diskfailover.DiskFailoverManager
This is the interface for providing durability of events until the reach the permanent store. This is intended to be used after a detected failure and has a slightly different state machine than the WALManager's. Different implementations can be encapsulated by this interface. Implementations of this interface must be thread safe -- it may be called from different threads.

    // get handle to roller in dfo log roller to provide data
    AgentFailChainSink afcs = (AgentFailChainSink) snk.getSink();
    BackOffFailOverSink bofos = (BackOffFailOverSink) ((CompositeSink) afcs.snk)
        .getSink();
    DiskFailoverDeco dfo = (DiskFailoverDeco) bofos.getBackup();
    DiskFailoverManager dfm = dfo.getFailoverManager();
    RollSink dfoWriter = dfo.getDFOWriter();
    dfoWriter.rotate(); // allow dfo retry thread to go.


    // give data some time to show up.
    Clock.sleep(1000);

View Full Code Here

  }


  public DiskFailoverManager addDFOManager(String dfonode) {
    Preconditions.checkArgument(dfonode != null);
    FlumeConfiguration conf = FlumeConfiguration.get();
    DiskFailoverManager wm = new NaiveFileFailoverManager(new File(new File(
        conf.getAgentLogsDir()), dfonode));
    synchronized (failoverMans) {
      failoverMans.put(dfonode, wm);
      return wm;
    }

View Full Code Here

  /**
   * Atomically gets an existing dfo for the given node or creates a new one.
   */
  public DiskFailoverManager getAddDFOManager(String dfonode) {
    synchronized (failoverMans) {
      DiskFailoverManager dfoman = getDFOManager(dfonode);


      if (dfoman == null) {
        dfoman = addDFOManager(dfonode);
      }
      return dfoman;

View Full Code Here

  }


  public DiskFailoverManager addDFOManager(String dfonode) {
    Preconditions.checkArgument(dfonode != null);
    FlumeConfiguration conf = FlumeConfiguration.get();
    DiskFailoverManager wm = new NaiveFileFailoverManager(new File(new File(
        conf.getAgentLogsDir()), dfonode));
    synchronized (failoverMans) {
      failoverMans.put(dfonode, wm);
      return wm;
    }

View Full Code Here

  /**
   * Atomically gets an existing dfo for the given node or creates a new one.
   */
  public DiskFailoverManager getAddDFOManager(String dfonode) {
    synchronized (failoverMans) {
      DiskFailoverManager dfoman = getDFOManager(dfonode);


      if (dfoman == null) {
        dfoman = addDFOManager(dfonode);
      }
      return dfoman;

View Full Code Here

  }


  public DiskFailoverManager addDFOManager(String dfonode) {
    Preconditions.checkArgument(dfonode != null);
    FlumeConfiguration conf = FlumeConfiguration.get();
    DiskFailoverManager wm = new NaiveFileFailoverManager(new File(new File(
        conf.getAgentLogsDir()), dfonode));
    synchronized (failoverMans) {
      failoverMans.put(dfonode, wm);
      return wm;
    }

View Full Code Here

  /**
   * Atomically gets an existing dfo for the given node or creates a new one.
   */
  public DiskFailoverManager getAddDFOManager(String dfonode) {
    synchronized (failoverMans) {
      DiskFailoverManager dfoman = getDFOManager(dfonode);


      if (dfoman == null) {
        dfoman = addDFOManager(dfonode);
      }
      return dfoman;

View Full Code Here

TOP

Related Classes of com.cloudera.flume.agent.diskfailover.DiskFailoverManager

com.cloudera.flume.agent.FlumeNode

com.cloudera.flume.agent.TestAgentFailChainSink

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.