Examples of org.apache.crunch.DoFn

org.apache.crunch.DoFn
Base class for all data processing functions in Crunch.
Note that all {@code DoFn} instances implement {@link Serializable}, and thus all of their non-transient member variables must implement {@code Serializable} as well. If your DoFn depends on non-serializableclasses for data processing, they may be declared as {@code transient} andinitialized in the DoFn's {@code initialize} method.

      }
      
      Map<String, Object> settings = new HashMap<String, Object>();
      settings.put(TypedSettings.DRY_RUN_SETTING_NAME, opts.isDryRun);
      
      DoFn morphlineFn = new MorphlineFn(
          morphlineFileContents, 
          opts.morphlineId, 
          morphlineVariables,
          settings,
          opts.inputFileFormat != null

View Full Code Here

TOP

Related Classes of org.apache.crunch.DoFn

org.apache.hadoop.mapreduce.TaskAttemptID

org.apache.solr.crunch.CrunchIndexerTool

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.