Examples of MiniYARNCluster

org.apache.hadoop.yarn.server.MiniYARNCluster

Embedded Yarn minicluster for testcases that need to interact with a cluster.

In a real cluster, resource request matching is done using the hostname, and by default Yarn minicluster works in the exact same way as a real cluster.

If a testcase needs to use multiple nodes and exercise resource request matching to a specific node, then the property {@YarnConfiguration.RM_SCHEDULER_INCLUDE_PORT_IN_NODE_NAME} should be settrue in the configuration used to initialize the minicluster.

With this property set to true, the matching will be done using the hostname:port of the namenodes. In such case, the AM must do resource request using hostname:port as the location.

                config.set("yarn.log.dir", "/tmp/yarn-logs");
                dfsCluster = new MiniDFSCluster.Builder(config)
                                 .numDataNodes(1)
                                 .startupOption(StartupOption.FORMAT)
                                 .build();
                yarnCluster = new MiniYARNCluster("mongo-hadoop", 1, 1, 1);
                yarnCluster.init(config);


                URL url = Thread.currentThread().getContextClassLoader().getResource("yarn-site.xml");
                if (url == null) {
                    throw new RuntimeException("Could not find 'yarn-site.xml' dummy file in classpath");

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of MiniYARNCluster

Examples of org.apache.hadoop.yarn.server.MiniYARNCluster