Examples of WaitingRoom

org.apache.hadoop.hdfs.server.namenode.WaitingRoom
A utility that alows users to add files to a "waiting room" instead of deleting them so that any file linked by some snapshot is not deleted permanently. The file system must moveFileToWaitingRoom() rather than delete(), except if delete() is called by the Waiting RoomPurger. Implements a Runnable Waiting Room Purger which can be run as a Daemon to lazily remove unnecessary files from the waiting room.

Examples of org.apache.hadoop.hdfs.server.namenode.WaitingRoom

    }


    maxLeaseUpdateThreads = conf.getInt("fs.snapshot.leaseupdatethreads", 100);


    // Waiting room purge thread
    purgeThread = new Daemon((new WaitingRoom(conf)).getPurger());
    purgeThread.start();


    // Get namenode rpc connection
    nameNodeAddr = NameNode.getAddress(conf);
    namenode = (NamenodeProtocol) RPC.waitForProxy(NamenodeProtocol.class,

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.namenode.WaitingRoom

    }


    maxLeaseUpdateThreads = conf.getInt("fs.snapshot.leaseupdatethreads", 100);


    // Waiting room purge thread
    purgeThread = new Daemon((new WaitingRoom(conf)).getPurger());
    purgeThread.start();


    // Get namenode rpc connection
    nameNodeAddr = NameNode.getAddress(conf);
    namenode = (NamenodeProtocol) RPC.waitForProxy(NamenodeProtocol.class,

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.namenode.WaitingRoom

    Configuration conf = new Configuration();
    MiniDFSCluster cluster = new MiniDFSCluster(conf, 1, true, null);
    cluster.waitClusterUp();
    FileSystem fs = cluster.getFileSystem();


    WaitingRoom wr = new WaitingRoom(conf);
    WaitingRoomPurger purger = wr.getPurger();
    SnapshotNode ssNode = new SnapshotNode(conf);
    ssNode.shutdownWaitingRoomPurger();


    String wrPath = conf.get("fs.snapshot.waitingroom", "/.WR");    
    String ssDir = conf.get("fs.snapshot.dir", "/.SNAPSHOT");


    Path foo = new Path("/foo");
    Path bar = new Path("/hadoop/bar");
    Path mash = new Path("/hadoop/mash");


    FSDataOutputStream stream;


    // Create foo
    stream = fs.create(foo);
    stream.writeByte(0);
    stream.close();
    
    // Move foo to waiting room.
    assertTrue(wr.moveToWaitingRoom(foo));
    
    // Create snapshot
    ssNode.createSnapshot("first", false); // contains nothing


    // Create bar (V1)
    stream = fs.create(bar);
    stream.write(0);
    stream.close();


    // Create mash (empty)
    stream = fs.create(mash);
    stream.close();


    // Create snapshot
    ssNode.createSnapshot("second", false); // contains bar (V1), mash


    // Move mash, bar to waiting room
    assertTrue(wr.moveToWaitingRoom(mash));
    assertTrue(wr.moveToWaitingRoom(bar));


    // Create bar (V2)
    stream = fs.create(bar);
    stream.write(0);
    stream.close();

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.