|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.filecache.TrackerDistributedCacheManager
public class TrackerDistributedCacheManager
Manages a single machine's instance of a cross-job cache. This class would typically be instantiated by a TaskTracker (or something that emulates it, like LocalJobRunner). This class is internal to Hadoop, and should not be treated as a public interface.
Constructor Summary | |
---|---|
TrackerDistributedCacheManager(Configuration conf,
TaskController taskController)
|
|
TrackerDistributedCacheManager(Configuration conf,
TaskController taskController,
MRAsyncDiskService asyncDiskService)
Creates a TrackerDistributedCacheManager with a MRAsyncDiskService. |
Method Summary | |
---|---|
static void |
createAllSymlink(Configuration conf,
File jobCacheDir,
File workDir)
This method create symlinks for all files in a given dir in another directory. |
static void |
determineCacheVisibilities(Configuration job)
Determines the visibilities of the distributed cache files and archives. |
static void |
determineTimestamps(Configuration job)
Determines timestamps of files to be cached, and stores those in the configuration. |
static void |
getDelegationTokens(Configuration job,
Credentials credentials)
For each archive or cache file - get the corresponding delegation token |
TaskDistributedCacheManager |
newTaskDistributedCacheManager(Configuration taskConf)
|
void |
purgeCache()
Clear the entire contents of the cache and delete the backing files. |
static void |
validate(Configuration conf)
This is part of the framework API. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public TrackerDistributedCacheManager(Configuration conf, TaskController taskController) throws IOException
IOException
public TrackerDistributedCacheManager(Configuration conf, TaskController taskController, MRAsyncDiskService asyncDiskService) throws IOException
asyncDiskService
- Provides a set of ThreadPools for async disk
operations.
IOException
Method Detail |
---|
public static void createAllSymlink(Configuration conf, File jobCacheDir, File workDir) throws IOException
conf
- the configurationjobCacheDir
- the target directory for creating symlinksworkDir
- the directory in which the symlinks are created
IOException
public void purgeCache()
public TaskDistributedCacheManager newTaskDistributedCacheManager(Configuration taskConf) throws IOException
IOException
public static void determineTimestamps(Configuration job) throws IOException
job
- Configuration of a job.
IOException
public static void determineCacheVisibilities(Configuration job) throws IOException
job
-
IOException
public static void getDelegationTokens(Configuration job, Credentials credentials) throws IOException
job
- credentials
-
IOException
public static void validate(Configuration conf) throws InvalidJobConfException
conf
- a Configuration
to be cheked for duplication
in cached URIs
InvalidJobConfException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |