Examples of FSMBuilder

org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder

FSM Builder Input: start/end pairs i.e. JobHistory data Input handling is controlled by choosing a custom mapper that is able to parse the desired input format (e.g. JobHistory lines) One map class is provided for each type of input data provided Each map class "standardizes" the different input log types to the standardized internal FSMIntermedEntry representation Currently available mapper classes: DataNodeClientTraceMapper TaskTrackerClientTraceMapper JobHistoryTaskDataMapper Parameterizing choice of mapper class - read in as config parameter Output is standardized, regardless of input, and is generated by the common reducer

          fsmConf.set("chukwa.salsa.fsm.mapclass", mapper);
          args[k]=outputDir+mapper;
          Path outputPath = new Path(args[k]);
          outputPaths.add(outputPath);
          if(hasData) {
            int res = ToolRunner.run(fsmConf, new FSMBuilder(), args);
            log.debug("Job Status: "+res);
          }
        }
      }
      // Find the mapreduce output and load to MDL.

          fsmConf.set("chukwa.salsa.fsm.mapclass", mapper);
          args[k]=outputDir+mapper;
          Path outputPath = new Path(args[k]);
          outputPaths.add(outputPath);
          if(hasData) {
            int res = ToolRunner.run(fsmConf, new FSMBuilder(), args);
          }
        }
      }
      // Find the mapreduce output and load to MDL.
      for(Path outputPath : outputPaths) {

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of FSMBuilder

Examples of org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder

Examples of org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder