Examples of com.cloudera.cdk.data.DatasetDescriptor

com.cloudera.cdk.data.DatasetDescriptor

The structural definition of a {@link Dataset}.

Each {@code Dataset} has an associated {@link Schema} and optional{@link PartitionStrategy} defined at the time of creation. Instances of thisclass are used to hold this information. Users are strongly encouraged to use the inner {@link Builder} to create new instances.


    // Construct a local filesystem dataset repository rooted at /tmp/hello-cdk
    DatasetRepository repo = DatasetRepositories.open("repo:file:/tmp/hello-cdk");


    // Create a dataset of Hellos
    DatasetDescriptor descriptor = new DatasetDescriptor.Builder()
        .schema(Hello.class).build();
    Dataset<Hello> hellos = repo.create("hellos", descriptor);


    // Write some Hellos in to the dataset
    DatasetWriter<Hello> writer = hellos.newWriter();

View Full Code Here


    // Construct a filesystem dataset repository rooted at /tmp/data
    DatasetRepository repo = DatasetRepositories.open("repo:hdfs:/tmp/data");


    // Create a dataset of products with the Avro schema in the repository
    DatasetDescriptor descriptor = new DatasetDescriptor.Builder()
        .schema(Product.class)
        .build();
    Dataset<Product> products = repo.create("products", descriptor);


    // Get a writer for the dataset and write some products to it

View Full Code Here


    // Construct a local filesystem dataset repository rooted at /tmp/data
    DatasetRepository repo = DatasetRepositories.open("repo:hdfs:/tmp/data");


    // Create a dataset of events with the Avro schema in the repository
    DatasetDescriptor descriptor = new DatasetDescriptor.Builder()
        .schemaUri("resource:event.avsc")
        .build();
    repo.create("events", descriptor);


    return 0;

View Full Code Here

0 1 2 3 4

TOP

Related Classes of com.cloudera.cdk.data.DatasetDescriptor

com.cloudera.cdk.data.filesystem.FileSystemDatasetRepository

com.cloudera.cdk.data.filesystem.FileSystemMetadataProvider

com.cloudera.cdk.data.filesystem.PartitionedDatasetWriter

com.cloudera.cdk.data.filesystem.TestCSVFileReader

com.cloudera.cdk.data.filesystem.TestFileSystemDatasetRepository

com.cloudera.cdk.data.filesystem.TestFileSystemMetadataProvider

com.cloudera.cdk.data.filesystem.TestMultiFileDatasetReader

com.cloudera.cdk.data.hbase.avro.example.UserProfileDatasetExample

com.cloudera.cdk.data.hbase.avro.HBaseDatasetReaderTest

com.cloudera.cdk.data.hbase.DaoViewTest

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.