|
Spring for Apache Hadoop | ||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||
java.lang.Objectorg.springframework.data.hadoop.test.junit.AbstractHadoopClusterTests
org.springframework.data.hadoop.test.junit.AbstractMapReduceTests
public class AbstractMapReduceTests
Abstract base class providing default functionality for running map reduce tests.
| Field Summary |
|---|
| Fields inherited from class org.springframework.data.hadoop.test.junit.AbstractHadoopClusterTests |
|---|
applicationContext, configuration, hadoopCluster |
| Constructor Summary | |
|---|---|
AbstractMapReduceTests()
|
|
| Method Summary | |
|---|---|
protected JobUtils.JobStatus |
findStatus(org.apache.hadoop.mapreduce.Job job)
Find job status. |
protected org.apache.hadoop.fs.Path[] |
getOutputFilePaths(org.apache.hadoop.fs.Path outputDirectory)
Finds an array of output file Paths resulted as
mapreduce job run. |
protected org.apache.hadoop.fs.Path[] |
getOutputFilePaths(java.lang.String outputDirectory)
Finds an array of output file Paths resulted as
mapreduce job run. |
protected JobUtils.JobStatus |
waitFinishedStatus(org.apache.hadoop.mapreduce.Job job,
long timeout,
java.util.concurrent.TimeUnit unit)
Wait finished status. |
protected JobUtils.JobStatus |
waitStatus(org.apache.hadoop.mapreduce.Job job,
long timeout,
java.util.concurrent.TimeUnit unit,
JobUtils.JobStatus... jobStatuses)
Waits state. |
| Methods inherited from class org.springframework.data.hadoop.test.junit.AbstractHadoopClusterTests |
|---|
getApplicationContext, getConfiguration, getFileSystem, getHadoopCluster, setApplicationContext, setConfiguration, setHadoopCluster |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public AbstractMapReduceTests()
| Method Detail |
|---|
protected org.apache.hadoop.fs.Path[] getOutputFilePaths(java.lang.String outputDirectory)
throws java.io.FileNotFoundException,
java.io.IOException
Paths resulted as
mapreduce job run.
outputDirectory - the path to jobs output directory
java.io.FileNotFoundException - if given path was not found
java.io.IOException - if general access error occuredgetOutputFilePaths(Path)
protected org.apache.hadoop.fs.Path[] getOutputFilePaths(org.apache.hadoop.fs.Path outputDirectory)
throws java.io.FileNotFoundException,
java.io.IOException
Paths resulted as
mapreduce job run.
outputDirectory - the path to jobs output directory
java.io.FileNotFoundException - if given path was not found
java.io.IOException - if general access error occured
protected JobUtils.JobStatus waitFinishedStatus(org.apache.hadoop.mapreduce.Job job,
long timeout,
java.util.concurrent.TimeUnit unit)
throws java.lang.Exception
JobStatus.SUCCEEDED, JobStatus.FAILED or JobStatus.KILLED.
job - the jobtimeout - the timeout for waitunit - the unit for timeout
java.lang.Exception - if exception occurred
protected JobUtils.JobStatus waitStatus(org.apache.hadoop.mapreduce.Job job,
long timeout,
java.util.concurrent.TimeUnit unit,
JobUtils.JobStatus... jobStatuses)
throws java.lang.Exception
NULL
if something failed or final known state after the wait/poll operations.
Array of job statuses can be used to return immediately from wait
loop if state is matched.
job - the jobtimeout - the timeout for waitunit - the unit for timeoutjobStatuses - the job statuses to wait
java.lang.Exception - if exception occurredprotected JobUtils.JobStatus findStatus(org.apache.hadoop.mapreduce.Job job)
job - the job
|
Spring for Apache Hadoop | ||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||