Examples of PartitionExchange

org.apache.giraph.graph.partition.PartitionExchange
Describes what is required to send and wait for in a potential partition exchange between workers.
org.apache.giraph.partition.PartitionExchange
Describes what is required to send and wait for in a potential partition exchange between workers.

Examples of org.apache.giraph.graph.partition.PartitionExchange

        // 2. Send all the partitions to their destination workers in a random
        //    fashion.
        // 3. Notify completion with a ZooKeeper stamp
        // 4. Wait for all my dependencies to be done (if any)
        // 5. Add the partitions to myself.
        PartitionExchange partitionExchange =
            workerGraphPartitioner.updatePartitionOwners(
                getWorkerInfo(), masterSetPartitionOwners, getPartitionMap());
        commService.fixPartitionIdToSocketAddrMap();


        Map<WorkerInfo, List<Integer>> workerPartitionMap =
            partitionExchange.getSendWorkerPartitionMap();
        if (!workerPartitionMap.isEmpty()) {
            sendWorkerPartitions(workerPartitionMap);
        }


        Set<WorkerInfo> myDependencyWorkerSet =
            partitionExchange.getMyDependencyWorkerSet();
        Set<String> workerIdSet = new HashSet<String>();
        for (WorkerInfo workerInfo : myDependencyWorkerSet) {
            if (workerIdSet.add(workerInfo.getHostnameId()) != true) {
                throw new IllegalStateException(
                    "exchangeVertexPartitions: Duplicate entry " + workerInfo);

View Full Code Here

Examples of org.apache.giraph.partition.PartitionExchange

    // 2. Send all the partitions to their destination workers in a random
    //    fashion.
    // 3. Notify completion with a ZooKeeper stamp
    // 4. Wait for all my dependencies to be done (if any)
    // 5. Add the partitions to myself.
    PartitionExchange partitionExchange =
        workerGraphPartitioner.updatePartitionOwners(
            getWorkerInfo(), masterSetPartitionOwners, getPartitionStore());
    workerClient.openConnections();


    Map<WorkerInfo, List<Integer>> sendWorkerPartitionMap =
        partitionExchange.getSendWorkerPartitionMap();
    if (!getPartitionStore().isEmpty()) {
      sendWorkerPartitions(sendWorkerPartitionMap);
    }


    Set<WorkerInfo> myDependencyWorkerSet =
        partitionExchange.getMyDependencyWorkerSet();
    Set<String> workerIdSet = new HashSet<String>();
    for (WorkerInfo tmpWorkerInfo : myDependencyWorkerSet) {
      if (!workerIdSet.add(tmpWorkerInfo.getHostnameId())) {
        throw new IllegalStateException(
            "exchangeVertexPartitions: Duplicate entry " + tmpWorkerInfo);

View Full Code Here

Examples of org.apache.giraph.partition.PartitionExchange

    // 2. Send all the partitions to their destination workers in a random
    //    fashion.
    // 3. Notify completion with a ZooKeeper stamp
    // 4. Wait for all my dependencies to be done (if any)
    // 5. Add the partitions to myself.
    PartitionExchange partitionExchange =
        workerGraphPartitioner.updatePartitionOwners(
            getWorkerInfo(), masterSetPartitionOwners);
    workerClient.openConnections();


    Map<WorkerInfo, List<Integer>> sendWorkerPartitionMap =
        partitionExchange.getSendWorkerPartitionMap();
    if (!getPartitionStore().isEmpty()) {
      sendWorkerPartitions(sendWorkerPartitionMap);
    }


    Set<WorkerInfo> myDependencyWorkerSet =
        partitionExchange.getMyDependencyWorkerSet();
    Set<String> workerIdSet = new HashSet<String>();
    for (WorkerInfo tmpWorkerInfo : myDependencyWorkerSet) {
      if (!workerIdSet.add(tmpWorkerInfo.getHostnameId())) {
        throw new IllegalStateException(
            "exchangeVertexPartitions: Duplicate entry " + tmpWorkerInfo);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.