Examples of AvroObjectInspectorGenerator

com.linkedin.haivvreo.AvroObjectInspectorGenerator
An AvroObjectInspectorGenerator takes an Avro schema and creates the three data structures Hive needs to work with Avro-encoded data: * A list of the schema field names * A list of those fields equivalent types in Hive * An ObjectInspector capable of working with an instance of that datum.
org.apache.hadoop.hive.serde2.avro.AvroObjectInspectorGenerator
An AvroObjectInspectorGenerator takes an Avro schema and creates the three data structures Hive needs to work with Avro-encoded data: * A list of the schema field names * A list of those fields equivalent types in Hive * An ObjectInspector capable of working with an instance of that datum.

Examples of com.linkedin.haivvreo.AvroObjectInspectorGenerator


  @Test
  public void objectInspectorsAreCached() throws SerDeException {
    // Verify that Hive is caching the object inspectors for us.
    Schema s = Schema.parse(KITCHEN_SINK_SCHEMA);
    AvroObjectInspectorGenerator aoig = new AvroObjectInspectorGenerator(s);


    Schema s2 = Schema.parse(KITCHEN_SINK_SCHEMA);
    AvroObjectInspectorGenerator aoig2 = new AvroObjectInspectorGenerator(s2);




    assertEquals(aoig.getObjectInspector(), aoig2.getObjectInspector());
    // For once we actually want reference equality in Java.
    assertTrue(aoig.getObjectInspector() == aoig2.getObjectInspector());
  }

View Full Code Here

Examples of org.apache.hadoop.hive.serde2.avro.AvroObjectInspectorGenerator

   * @param sb StringBuilder to hold the generated struct
   * @throws SerDeException if something goes wrong while generating the struct
   * */
  private static void generateAvroStructFromSchema(Schema schema, StringBuilder sb)
      throws SerDeException {
    AvroObjectInspectorGenerator avig = new AvroObjectInspectorGenerator(schema);


    sb.append("struct<");


    // Get the column names and their corresponding types
    List<String> columnNames = avig.getColumnNames();
    List<TypeInfo> columnTypes = avig.getColumnTypes();


    if (columnNames.size() != columnTypes.size()) {
      throw new AssertionError("The number of column names should be the same as column types");
    }

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.