List of listStatus() Examples

Examples of listStatus()

eu.stratosphere.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.accumulo.server.fs.VolumeManager.listStatus()
org.apache.flink.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.flink.core.fs.local.LocalFileSystem.listStatus()
org.apache.hadoop.fs.FileContext.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f is the path @return an iterator that traverses statuses of the files/directories in the given path @throws AccessControlException If access is denied @throws FileNotFoundException If f does not exist @throws UnsupportedFileSystemException If file system for f isnot supported @throws IOException If an I/O error occurredExceptions applicable to file systems accessed over RPC: @throws RpcClientException If an exception occurred in the RPC client @throws RpcServerException If an exception occurred in the RPC server @throws UnexpectedServerException If server implementation throws undeclared exception to RPC server
org.apache.hadoop.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.hadoop.fs.HarFileSystem.listStatus()
liststatus returns the children of a directory after looking up the index files.
org.apache.hadoop.fs.InMemoryFileSystem.listStatus()
Directory operations are not supported
org.apache.hadoop.fs.LocalFileSystem.listStatus()
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus()
List all the entries of a directory Note that this operation is not atomic for a large directory. The entries of a directory may be fetched from NameNode multiple times. It only guarantees that each name occurs once if a directory undergoes changes between the calls.
org.apache.hadoop.hdfs.web.WebHdfsFileSystem.listStatus()
org.apache.hadoop.mapreduce.test.system.JTClient.listStatus()
org.apache.hadoop.mapreduce.test.system.TTClient.listStatus()
org.apache.pig.piggybank.storage.partition.PathPartitionHelper.listStatus()
This method is called by the FileInputFormat to find the input paths for which splits should be calculated.
If applyDateRanges == true: Then the HiveRCDateSplitter is used to apply filtering on the input files.
Else the default FileInputFormat listStatus method is used. @param ctx JobContext @param loaderClass this is chosen to be a subclass of LoadFunc to maintain some consistency.
tachyon.client.TachyonFS.listStatus()
If the path is a directory, return all the direct entries in it. If the path is a file, return its ClientFileInfo. @param path the target directory/file path @return A list of ClientFileInfo, null if the file or folder does not exist. @throws IOException

Examples of eu.stratosphere.core.fs.FileSystem.listStatus()

    final FileSystem fs = path.getFileSystem();
    final FileStatus pathFile = fs.getFileStatus(path);


    if (pathFile.isDir()) {
      // input is directory. list all contained files
      final FileStatus[] dir = fs.listStatus(path);
      for (int i = 0; i < dir.length; i++) {
        if (!dir[i].isDir()) {
          files.add(dir[i]);
          totalLength += dir[i].getLen();
        }

View Full Code Here

Examples of org.apache.accumulo.server.fs.VolumeManager.listStatus()

      throw new ThriftTableOperationException(tableId, null, TableOperation.BULK_IMPORT, TableOperationExceptionType.BULK_BAD_ERROR_DIRECTORY, errorDir
          + " does not exist");
    if (!errorStatus.isDir())
      throw new ThriftTableOperationException(tableId, null, TableOperation.BULK_IMPORT, TableOperationExceptionType.BULK_BAD_ERROR_DIRECTORY, errorDir
          + " is not a directory");
    if (fs.listStatus(errorPath).length != 0)
      throw new ThriftTableOperationException(tableId, null, TableOperation.BULK_IMPORT, TableOperationExceptionType.BULK_BAD_ERROR_DIRECTORY, errorDir
          + " is not empty");


    ZooArbitrator.start(Constants.BULK_ARBITRATOR_TYPE, tid);

View Full Code Here

Examples of org.apache.flink.core.fs.FileSystem.listStatus()

    if(!acceptFile(pathFile)) {
      throw new IOException("The given file does not pass the file-filter");
    }
    if (pathFile.isDir()) {
      // input is directory. list all contained files
      final FileStatus[] dir = fs.listStatus(path);
      for (int i = 0; i < dir.length; i++) {
        if (!dir[i].isDir() && acceptFile(dir[i])) {
          files.add(dir[i]);
          totalLength += dir[i].getLen();
          // as soon as there is one deflate file in a directory, we can not split it

View Full Code Here

Examples of org.apache.flink.core.fs.local.LocalFileSystem.listStatus()


      // check that lfs recognizes directory..
      assertTrue(localstatus1.isDir());


      // get status for files in this (empty) directory..
      final FileStatus[] statusforfiles = lfs.listStatus(pathtotmpdir);


      // no files in there.. hence, must be zero
      assertTrue(statusforfiles.length == 0);


      // check that lfs can delete directory..

View Full Code Here

Examples of org.apache.hadoop.fs.FileContext.listStatus()

    String logicalHost = fs.getUri().getHost();
    Configuration haClientConf = fs.getConf();
    
    FileContext fc = FileContext.getFileContext(haClientConf);
    Path root = new Path("/");
    fc.listStatus(root);
    fc.listStatus(fc.makeQualified(root));
    fc.getDefaultFileSystem().getCanonicalServiceName();


    // Ensure that the logical hostname was never resolved.
    Mockito.verify(spyNS, Mockito.never()).lookupAllHostAddr(Mockito.eq(logicalHost));

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    // out under the tabledir.  If here under splitdir still, then the split did
    // not complete.  Try and do cleanup.  This code WILL NOT catch the case
    // where we successfully created daughter a but regionserver crashed during
    // the creation of region b.  In this case, there'll be an orphan daughter
    // dir in the filesystem.  TOOD: Fix.
    FileStatus [] daughters = fs.listStatus(splitdir, new FSUtils.DirFilter(fs));
    for (int i = 0; i < daughters.length; i++) {
      cleanupDaughterRegion(fs, r.getTableDir(),
        daughters[i].getPath().getName());
    }
    cleanupSplitDir(r.getFilesystem(), splitdir);

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

      LOG.info("Moving files from " + src + " into containing region " + dst);
      // FileSystem.rename is inconsistent with directories -- if the
      // dst (foo/a) exists and is a dir, and the src (foo/b) is a dir,
      // it moves the src into the dst dir resulting in (foo/a/b).  If
      // the dst does not exist, and the src a dir, src becomes dst. (foo/b)
      for (FileStatus hfile : fs.listStatus(src)) {
        boolean success = fs.rename(hfile.getPath(), dst);
        if (success) {
          fileMoves++;
        }
      }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    if (fs.isFile(p)) {
      return;
    }


    if (fs.getFileStatus(p).isDir()) {
      FileStatus[] fss= fs.listStatus(p);
      for (FileStatus status : fss) {
        debugLsr(conf, status.getPath(), errors);
      }
    }
  }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

   * overlapping regions.
   */
  private void adoptHdfsOrphan(HbckInfo hi) throws IOException {
    Path p = hi.getHdfsRegionDir();
    FileSystem fs = p.getFileSystem(getConf());
    FileStatus[] dirs = fs.listStatus(p);
    if (dirs == null) {
      LOG.warn("Attempt to adopt ophan hdfs region skipped becuase no files present in " +
          p + ". This dir could probably be deleted.");
      return ;
    }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    for (FileStatus cf : dirs) {
      String cfName= cf.getPath().getName();
      // TODO Figure out what the special dirs are
      if (cfName.startsWith(".") || cfName.equals("splitlog")) continue;


      FileStatus[] hfiles = fs.listStatus(cf.getPath());
      for (FileStatus hfile : hfiles) {
        byte[] start, end;
        HFile.Reader hf = null;
        try {
          CacheConfig cacheConf = new CacheConfig(getConf());

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.