Examples of HiveJob

com.taobao.zeus.jobs.sub.HiveJob
添加重试功能，如果任务在10分钟内失败，则进行重试 @author zhoufang
com.twitter.ambrose.hive.HiveJob
Subclass of Job used to hold initialization logic and Hive-specific bindings for a Job. Encapsulates all information related to a run of a Hive job. A job might have counters, job configuration and job metrics. Job metrics is metadata about the job run that isn't set in the job configuration. @author Lorand Bendig

Examples of com.taobao.zeus.jobs.sub.HiveJob

    hp.setProperty("hadoop.mapred.job.zeus_id", "zeus_debug_"+history.getId());
    List<Job> pres = new ArrayList<Job>(1);
    pres.add(new DownloadJob(jobContext));
    Job core = null;
    if(history.getJobRunType()==JobRunType.Hive){
      core =new HiveJob(jobContext,applicationContext);
    }else if(history.getJobRunType()==JobRunType.Shell){
      core=new HadoopShellJob(jobContext);
    }
    Job job=new WithProcesserJob(jobContext, pres, new ArrayList<Job>(), core, applicationContext);
    return job;

View Full Code Here

Examples of com.taobao.zeus.jobs.sub.HiveJob

    if(jobBean.getJobDescriptor().getJobType()==JobRunType.MapReduce){
      core=new MapReduceJob(jobContext);
    }else if(jobBean.getJobDescriptor().getJobType()==JobRunType.Shell){
      core=new HadoopShellJob(jobContext);
    }else if(jobBean.getJobDescriptor().getJobType()==JobRunType.Hive){
      core=new HiveJob(jobContext,applicationContext);
    }
    
    Job job=new WithProcesserJob(jobContext, pres, posts, core,applicationContext);
    
    return job;

View Full Code Here

Examples of com.twitter.ambrose.hive.HiveJob

    metrics.put("somemetric", 6);
    Properties properties = new Properties();
    properties.setProperty("someprop", "propvalue");
    String[] aliases = new String[] { "alias1" };
    String[] features = new String[] { "feature1" };
    hiveJob = new HiveJob(aliases, features);
  }

View Full Code Here

Examples of com.twitter.ambrose.hive.HiveJob

      "  \"id\" : 2," +
      "  \"timestamp\" : 1374569908754" +
      "}";


    Event<?> event = Event.fromJson(json);
    @SuppressWarnings("unchecked")
    HiveJob job = ((DAGNode<HiveJob>) event.getPayload()).getJob();
    assertEquals("job_201307231015_0004 (Stage-1, query-id: ...22c4ea289895)", job.getId());
    assertArrayEquals(new String[] { "src" }, job.getAliases());
    assertArrayEquals(new String[] { "SELECT", "FILTER" }, job.getFeatures());
    assertNotNull(job.getMetrics());
    assertEquals(123, job.getMetrics().get("somemetric"));
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.