Examples of ShellBolt

backtype.storm.task.ShellBolt

A bolt that shells out to another process to process tuples. ShellBolt communicates with that process over stdio using a special protocol. An ~100 line library is required to implement that protocol, and adapter libraries currently exist for Ruby and Python.

To run a ShellBolt on a cluster, the scripts that are shelled out to must be in the resources directory within the jar submitted to the master. During development/testing on a local machine, that resources directory just needs to be on the classpath.

When creating topologies using the Java API, subclass this bolt and implement the IRichBolt interface to create components for the topology that use other languages. For example:

 public class MyBolt extends ShellBolt implements IRichBolt { public MyBolt() { super("python", "mybolt.py"); } public void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(new Fields("field1", "field2")); } }

      rtn=Thrift.instantiateJavaObject((JavaObject) componentObject);
    }else if (componentObject instanceof ShellComponent) {
      if (spouts.containsKey(component_id)) {
        rtn=new ShellSpout((ShellComponent) componentObject);
      } else {
        rtn= new ShellBolt((ShellComponent) componentObject);
      }
    }else{
      rtn=componentObject;
    }
    return rtn;

      rtn = Thrift.instantiateJavaObject((JavaObject) componentObject);
    } else if (componentObject instanceof ShellComponent) {
      if (spouts.containsKey(component_id)) {
        rtn = new ShellSpout((ShellComponent) componentObject);
      } else {
        rtn = new ShellBolt((ShellComponent) componentObject);
      }
    } else {
      rtn = componentObject;
    }
    return rtn;

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of ShellBolt

Examples of backtype.storm.task.ShellBolt

Examples of backtype.storm.task.ShellBolt