Save This Page
Home » hadoop-0.14.4 » org.apache » hadoop » fs » [javadoc | source]
org.apache.hadoop.fs
abstract public class: ChecksumFileSystem [javadoc | source]
java.lang.Object
   org.apache.hadoop.conf.Configured
      org.apache.hadoop.fs.FileSystem
         org.apache.hadoop.fs.FilterFileSystem
            org.apache.hadoop.fs.ChecksumFileSystem

All Implemented Interfaces:
    Configurable

Direct Known Subclasses:
    InMemoryFileSystem, LocalFileSystem, ChecksumDistributedFileSystem

Abstract Checksumed FileSystem. It provide a basice implementation of a Checksumed FileSystem, which creates a checksum file for each raw file. It generates & verifies checksums at the client side.
Fields inherited from org.apache.hadoop.fs.FilterFileSystem:
fs
Fields inherited from org.apache.hadoop.fs.FileSystem:
LOG
Constructor:
 public ChecksumFileSystem(FileSystem fs) 
Method from org.apache.hadoop.fs.ChecksumFileSystem Summary:
completeLocalOutput,   copyFromLocalFile,   copyToLocalFile,   copyToLocalFile,   create,   delete,   getApproxChkSumLength,   getBytesPerSum,   getChecksumFile,   getChecksumFileLength,   getRawFileSystem,   isChecksumFile,   listPaths,   listPaths,   lock,   mkdirs,   open,   release,   rename,   reportChecksumFailure,   setReplication,   startLocalOutput
Methods from org.apache.hadoop.fs.FilterFileSystem:
checkPath,   close,   completeLocalOutput,   copyFromLocalFile,   copyToLocalFile,   create,   delete,   exists,   getConf,   getDefaultBlockSize,   getDefaultReplication,   getFileCacheHints,   getFileStatus,   getName,   getUri,   getWorkingDirectory,   initialize,   listPaths,   lock,   makeQualified,   mkdirs,   open,   release,   rename,   setReplication,   setWorkingDirectory,   startLocalOutput
Methods from org.apache.hadoop.fs.FileSystem:
checkPath,   close,   closeAll,   completeLocalOutput,   copyFromLocalFile,   copyFromLocalFile,   copyToLocalFile,   copyToLocalFile,   create,   create,   create,   create,   create,   create,   create,   create,   createNewFile,   delete,   exists,   get,   get,   getBlockSize,   getContentLength,   getDefaultBlockSize,   getDefaultReplication,   getFileCacheHints,   getFileStatus,   getLength,   getLocal,   getName,   getNamed,   getReplication,   getUri,   getUsed,   getWorkingDirectory,   globPaths,   globPaths,   initialize,   isDirectory,   isFile,   listPaths,   listPaths,   listPaths,   listPaths,   lock,   makeQualified,   mkdirs,   moveFromLocalFile,   moveToLocalFile,   open,   open,   parseArgs,   release,   rename,   setReplication,   setWorkingDirectory,   startLocalOutput
Methods from org.apache.hadoop.conf.Configured:
getConf,   setConf
Methods from java.lang.Object:
equals,   getClass,   hashCode,   notify,   notifyAll,   toString,   wait,   wait,   wait
Method from org.apache.hadoop.fs.ChecksumFileSystem Detail:
 public  void completeLocalOutput(Path fsOutputFile,
    Path tmpLocalFile) throws IOException 
 public  void copyFromLocalFile(boolean delSrc,
    Path src,
    Path dst) throws IOException 
 public  void copyToLocalFile(boolean delSrc,
    Path src,
    Path dst) throws IOException 
    The src file is under FS, and the dst is on the local disk. Copy it from FS control to the local dst name.
 public  void copyToLocalFile(Path src,
    Path dst,
    boolean copyCrc) throws IOException 
    The src file is under FS, and the dst is on the local disk. Copy it from FS control to the local dst name. If src and dst are directories, the copyCrc parameter determines whether to copy CRC files.
 public FSDataOutputStream create(Path f,
    boolean overwrite,
    int bufferSize,
    short replication,
    long blockSize,
    Progressable progress) throws IOException 
    Opens an FSDataOutputStream at the indicated Path with write-progress reporting.
 public boolean delete(Path f) throws IOException 
    Get rid of Path f, whether a true file or dir.
 public static double getApproxChkSumLength(long size) 
 public int getBytesPerSum() 
    Return the bytes Per Checksum
 public Path getChecksumFile(Path file) 
    Return the name of the checksum file associated with a file.
 public long getChecksumFileLength(Path file,
    long fileSize) 
    Return the length of the checksum file given the size of the actual file.
 public FileSystem getRawFileSystem() 
    get the raw file system
 public static boolean isChecksumFile(Path file) 
    Return true iff file is a checksum file name.
 public Path[] listPaths(Path[] files) throws IOException 
    Filter raw files in the given pathes using the default checksum filter.
 public Path[] listPaths(Path f) throws IOException 
    Filter raw files in the given path using the default checksum filter.
 public  void lock(Path f,
    boolean shared) throws IOException 
 public boolean mkdirs(Path f) throws IOException 
 public FSDataInputStream open(Path f,
    int bufferSize) throws IOException 
    Opens an FSDataInputStream at the indicated Path.
 public  void release(Path f) throws IOException 
 public boolean rename(Path src,
    Path dst) throws IOException 
    Rename files/dirs
 public boolean reportChecksumFailure(Path f,
    FSDataInputStream in,
    long inPos,
    FSDataInputStream sums,
    long sumsPos) 
    Report a checksum error to the file system.
 public boolean setReplication(Path src,
    short replication) throws IOException 
    Set replication for an existing file. Implement the abstract setReplication of FileSystem
 public Path startLocalOutput(Path fsOutputFile,
    Path tmpLocalFile) throws IOException