Examples of voldemort.client.rebalance.RebalanceBatchPlan

voldemort.client.rebalance.RebalanceBatchPlan
Constructs a batch plan that goes from currentCluster to finalCluster. The partition-stores included in the move are based on those listed in storeDefs. This batch plan is execution-agnostic, i.e., a plan is generated and later stealer- versus donor-based execution of that plan is decided. Long term, its unclear if the notion of RebalanceBatchPlan separate from RebalancePlan is needed. Batching tends to increase the overall cost of rebalancing and has historically been error prone. (I.e., the transition between batches has had intermittent failures.) Its value, if any, lies in allowing long-running (days or weeks) rebalancing jobs to have interim checkpoints such that single node failures don't force a restart from initial state. Should consider deprecating batching after zone expansion and zone shrinking have been done successfully as short (less than a day or two), single-batch rebalances.

     * @return list of tasks for this batch plan
     */
    public static List<RebalanceTaskInfo> getBatchPlan(Cluster currentCluster,
                                                       Cluster finalCluster,
                                                       List<StoreDefinition> storeDef) {
        RebalanceBatchPlan rebalancePlan = new RebalanceBatchPlan(currentCluster,
                                                                  finalCluster,
                                                                  storeDef);
        return rebalancePlan.getBatchPlan();
    }

View Full Code Here

     */
    public static List<RebalanceTaskInfo> getBatchPlan(Cluster currentCluster,
                                                       List<StoreDefinition> currentStoreDefs,
                                                       Cluster finalCluster,
                                                       List<StoreDefinition> finalStoreDefs) {
        RebalanceBatchPlan rebalancePlan = new RebalanceBatchPlan(currentCluster,
                                                                  currentStoreDefs,
                                                                  finalCluster,
                                                                  finalStoreDefs);
        return rebalancePlan.getBatchPlan();
    }

View Full Code Here

        for(ByteArray key: this.proxyPutTestSecondaryEntries.keySet()) {
            this.secondaryEntriesMoved.remove(key);
        }
        assertTrue("Not enough secondary entries", primaryEntriesMoved.size() > 1);


        RebalanceBatchPlan RebalanceBatchPlan = new
                RebalanceBatchPlan(currentCluster,
                                   targetCluster,
                                   Lists.newArrayList(storeDef));
        List<RebalanceTaskInfo> plans =
                Lists.newArrayList(RebalanceBatchPlan.getBatchPlan());


        // Set into rebalancing state
        for(RebalanceTaskInfo partitionPlan: plans) {
            servers[partitionPlan.getStealerId()].getMetadataStore()
                                                 .put(MetadataStore.SERVER_STATE_KEY,

View Full Code Here

TOP

Related Classes of voldemort.client.rebalance.RebalanceBatchPlan

voldemort.cluster.Node

voldemort.ClusterTestUtils

voldemort.routing.StoreRoutingPlan

voldemort.store.rebalancing.RedirectingStoreTest

voldemort.utils.MoveMap

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.