|
Spring for Apache Hadoop | ||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||
java.lang.Objectorg.springframework.yarn.batch.partition.AbstractPartitionHandler
org.springframework.yarn.batch.partition.StaticPartitionHandler
public class StaticPartitionHandler
Implementation of Spring Batch PartitionHandler which does
partitioning based on static grid size.
| Constructor Summary | |
|---|---|
StaticPartitionHandler()
Instantiates a new static partition handler. |
|
StaticPartitionHandler(BatchYarnAppmaster batchAppmaster)
Instantiates a new static partition handler. |
|
StaticPartitionHandler(BatchYarnAppmaster batchAppmaster,
int gridSize)
Instantiates a new static partition handler. |
|
| Method Summary | |
|---|---|
protected java.util.Set<org.springframework.batch.core.StepExecution> |
createSplits(org.springframework.batch.core.partition.StepExecutionSplitter stepSplitter,
org.springframework.batch.core.StepExecution stepExecution)
Creates the splits. |
void |
setGridSize(int gridSize)
Passed to the StepExecutionSplitter in the
AbstractPartitionHandler.handle(StepExecutionSplitter, StepExecution) method, instructing
it how many StepExecution instances are required, ideally. |
| Methods inherited from class org.springframework.yarn.batch.partition.AbstractPartitionHandler |
|---|
createRequestData, getKeySplitLocations, getStepName, handle, setBatchAppmaster, setKeySplitLocations, setStepName, setYarnAppmaster, waitCompleteState |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public StaticPartitionHandler()
public StaticPartitionHandler(BatchYarnAppmaster batchAppmaster)
batchAppmaster - the batch appmaster
public StaticPartitionHandler(BatchYarnAppmaster batchAppmaster,
int gridSize)
batchAppmaster - the batch appmastergridSize - the grid size| Method Detail |
|---|
protected java.util.Set<org.springframework.batch.core.StepExecution> createSplits(org.springframework.batch.core.partition.StepExecutionSplitter stepSplitter,
org.springframework.batch.core.StepExecution stepExecution)
throws java.lang.Exception
AbstractPartitionHandler
createSplits in class AbstractPartitionHandlerstepSplitter - the step splitterstepExecution - the step execution
java.lang.Exception - the exceptionpublic void setGridSize(int gridSize)
StepExecutionSplitter in the
AbstractPartitionHandler.handle(StepExecutionSplitter, StepExecution) method, instructing
it how many StepExecution instances are required, ideally. The
StepExecutionSplitter is allowed to ignore the grid size in the
case of a restart, since the input data partitions must be preserved.
gridSize - the number of step executions that will be created
|
Spring for Apache Hadoop | ||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | ||||||||