Package org.apache.spark.network.shuffle

Examples of org.apache.spark.network.shuffle.ExternalShuffleBlockHandler


  @Override
  protected void serviceInit(Configuration conf) {
    // If authentication is enabled, set up the shuffle server to use a
    // special RPC handler that filters out unauthenticated fetch requests
    boolean authEnabled = conf.getBoolean(SPARK_AUTHENTICATE_KEY, DEFAULT_SPARK_AUTHENTICATE);
    RpcHandler rpcHandler = new ExternalShuffleBlockHandler();
    if (authEnabled) {
      secretManager = new ShuffleSecretManager();
      rpcHandler = new SaslRpcHandler(rpcHandler, secretManager);
    }
View Full Code Here

TOP

Related Classes of org.apache.spark.network.shuffle.ExternalShuffleBlockHandler

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.