Examples of com.cloudera.util.BackoffPolicy

com.cloudera.util.BackoffPolicy

This is the interface for state containing backoff algorithms. Basically, when a new algorithm is instantiated, reset is called. Reset should be called after every successful calls. When a call fails, call backoff. This updates states held by the BackoffAlgo, (such as increasing retry time). When we are in a failure state, call isRetryOk to check with the backupAlgo to determine if its criteria has been met to retry. (and then call reset if it succeeds). Some backoff algos may want the ability to give up -- one can check this by calling isFailed. If ever isFailed returns true, it will remain in that state until reset is called. Note that this only does calculations and tracks the backoff state but doesn't actually do backoffs (e.g. do blocking sleeps)! This is intended to be pluggable with other potentially more sophisticated backoff policies.

    EventSink fail4eva = mock(EventSink.Base.class);
    doThrow(new IOException("mock exception")).when(fail4eva).open();
    doReturn(new ReportEvent("stub")).when(fail4eva).getReport();


    // max 5s, backoff initially at 10ms
    BackoffPolicy bop = new CappedExponentialBackoff(10, 5000);


    final InsistentOpenDecorator<EventSink> insistent = new InsistentOpenDecorator<EventSink>(
        fail4eva, bop);
    final StubbornAppendSink<EventSink> stubborn = new StubbornAppendSink<EventSink>(
        insistent);


    long initMs = FlumeConfiguration.get().getInsistentOpenInitBackoff();
    long cumulativeMaxMs = FlumeConfiguration.get()
        .getFailoverMaxCumulativeBackoff();
    long maxMs = FlumeConfiguration.get().getFailoverMaxSingleBackoff();
    BackoffPolicy backoff1 = new CumulativeCappedExponentialBackoff(initMs,
        maxMs, cumulativeMaxMs);
    BackoffPolicy backoff2 = new CumulativeCappedExponentialBackoff(initMs,
        maxMs, cumulativeMaxMs);


    // the collector snk has ack checking logic, retry and reopen logic, and
    // needs an extra mask before rolling, writing to disk and forwarding acks
    // (roll detect).

Examples of com.cloudera.util.BackoffPolicy

Related Classes of com.cloudera.util.BackoffPolicy