Examples of org.apache.hadoop.util.LinuxMemoryCalculatorPlugin

org.apache.hadoop.util.LinuxMemoryCalculatorPlugin
Plugin to calculate virtual and physical memories on Linux systems.

    if (!System.getProperty("os.name").startsWith("Linux")) {
      return;
    }


    JobConf conf = new JobConf();
    LinuxMemoryCalculatorPlugin plugin = new LinuxMemoryCalculatorPlugin();
    conf.setLong("totalVmemOnTT", plugin.getVirtualMemorySize());
    conf.setLong("totalPmemOnTT", plugin.getPhysicalMemorySize());


    try {
      setUpCluster(conf);
      runSleepJob(miniMRCluster.createJobConf());
      verifyTestResults();

View Full Code Here

    if (!System.getProperty("os.name").startsWith("Linux")) {
      return;
    }


    JobConf conf = new JobConf();
    LinuxMemoryCalculatorPlugin plugin = new LinuxMemoryCalculatorPlugin();
    conf.setLong("totalVmemOnTT", plugin.getVirtualMemorySize());
    conf.setLong("totalPmemOnTT", plugin.getPhysicalMemorySize());


    try {
      setUpCluster(conf);
      runSleepJob(miniMRCluster.createJobConf());
      verifyTestResults();

View Full Code Here

    if (!System.getProperty("os.name").startsWith("Linux")) {
      return;
    }


    JobConf conf = new JobConf();
    LinuxMemoryCalculatorPlugin plugin = new LinuxMemoryCalculatorPlugin();
    conf.setLong("totalVmemOnTT", plugin.getVirtualMemorySize());
    conf.setLong("totalPmemOnTT", plugin.getPhysicalMemorySize());
    conf.setLong("reservedVmemOnTT", 1 * 1024 * 1024 * 1024L);
    conf.setLong("reservedPmemOnTT", 512 * 1024 * 1024L);
    conf.setLong(
        TaskTracker.MAPRED_TASKTRACKER_VMEM_RESERVED_PROPERTY,
        1 * 1024 * 1024 * 1024L);

View Full Code Here

TOP

Related Classes of org.apache.hadoop.util.LinuxMemoryCalculatorPlugin

org.apache.hadoop.mapred.TestTTMemoryReporting

java.io.FileReader

java.io.BufferedReader

java.util.regex.Matcher

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.