Examples of DAGNode

com.twitter.ambrose.model.DAGNode
Class that represents a Job node in the DAG. The job name must not be null. At DAG creation time the jobID will probably be null. Ideally this will be set on the node when the job is started, and the node will be sent as a
```
Event.Type.JOB_STARTED
```
event. This class can be converted to JSON as-is by doing something like this: ObjectMapper om = new ObjectMapper(); om.getSerializationConfig().set(SerializationConfig.Feature.INDENT_OUTPUT, true); String json = om.writeValueAsString(dagNode);

Examples of com.twitter.ambrose.model.DAGNode

    if (dagMap == null) {
      print("No dagNodeNameMap found for " + workflowId);
    } else {
      print(String.format("Found %d dapMap entries", dagMap.size()));
      for (Map.Entry<String, DAGNode> entry : dagMap.entrySet()) {
        DAGNode node = entry.getValue();
        String jobId = node.getJob() != null ? node.getJob().getId() : null;
        print(String.format("%s: nodeName=%s jobId=%s successors=%s",
            entry.getKey(), node.getName(), jobId, node.getSuccessorNames()));
      }
    }


    List<Event> events = service.getEventsSinceId(workflowId, -1);
    print(String.format("Found %d events", events.size()));

View Full Code Here

Examples of com.twitter.ambrose.model.DAGNode

          ", name: " + node.getName() + ", features: " + Arrays.toString(features));
    }


    // second pass connects the edges
    for (Map.Entry<OperatorKey, MapReduceOper> entry : planKeys.entrySet()) {
      DAGNode node = this.dagNodeNameMap.get(entry.getKey().toString());
      List<DAGNode<? extends Job>> successorNodeList = Lists.newArrayList();
      List<MapReduceOper> successors = plan.getSuccessors(entry.getValue());


      if (successors != null) {
        for (MapReduceOper successor : successors) {
          DAGNode<? extends Job> successorNode =
              this.dagNodeNameMap.get(successor.getOperatorKey().toString());
          successorNodeList.add(successorNode);
        }
      }
      node.setSuccessors(successorNodeList);
    }


    AmbroseUtils.sendDagNodeNameMap(statsWriteService, scriptId, dagNodeNameMap);
  }

View Full Code Here

Examples of com.twitter.ambrose.model.DAGNode

      String nodeName = baseFlowStep.getName();
      String[] features = getNodeFeatures(baseFlowStep.getGraph());
      // create a new DAGNode of this flowStep
      CascadingJob job = new CascadingJob();
      job.setFeatures(features);
      DAGNode newNode = new DAGNode(nodeName, job);
      // Add the new node to the Map of <nodeName, DAGNodes>
      dagNamesMap.put(nodeName, newNode);
    }


    // Loop again to set the successors for each node after nodes are created.

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.