public final class YarnEnvironmentBuilder extends org.springframework.data.hadoop.config.common.annotation.AbstractConfiguredAnnotationBuilder<java.util.Map<java.lang.String,java.util.Map<java.lang.String,java.lang.String>>,YarnEnvironmentConfigurer,YarnEnvironmentBuilder> implements org.springframework.data.hadoop.config.common.annotation.configurers.PropertiesConfigurerAware, YarnEnvironmentConfigurer
AnnotationBuilder for Yarn environment.| Constructor and Description |
|---|
YarnEnvironmentBuilder()
Instantiates a new yarn environment builder.
|
| Modifier and Type | Method and Description |
|---|---|
void |
addClasspathEntries(java.lang.String id,
java.util.ArrayList<java.lang.String> classpathEntries)
Adds the classpath entries.
|
void |
configuration(Configuration configuration)
Sets the yarn configuration.
|
void |
configureProperties(java.util.Properties properties) |
YarnEnvironmentConfigurer |
entry(java.lang.String key,
java.lang.String value)
Specify an environment variable.
|
YarnEnvironmentConfigurer |
entry(java.lang.String id,
java.lang.String key,
java.lang.String value)
Specify an environment variable using an identifier.
|
YarnEnvironmentConfigurer |
includeLocalSystemEnv(boolean includeLocalSystemEnv)
Specify if existing system environment variables should
be included automatically.
|
YarnEnvironmentConfigurer |
includeLocalSystemEnv(java.lang.String id,
boolean includeLocalSystemEnv)
Specify if existing system environment variables should
be included automatically with an identifier.
|
protected java.util.Map<java.lang.String,java.util.Map<java.lang.String,java.lang.String>> |
performBuild() |
YarnEnvironmentConfigurer |
propertiesLocation(java.lang.String... locations)
Specify properties locations.
|
YarnEnvironmentConfigurer |
propertiesLocationId(java.lang.String id,
java.lang.String[] locations)
Specify properties locations with an identifier.
|
void |
setDefaultMapreduceAppClasspath(java.lang.String id,
java.lang.String defaultMapreduceAppClasspath)
Sets the default mr app classpath.
|
void |
setDefaultYarnAppClasspath(java.lang.String id,
java.lang.String defaultYarnAppClasspath)
Sets the default yarn app classpath.
|
void |
setDelimiter(java.lang.String id,
java.lang.String delimiter)
Sets the delimiter.
|
void |
setIncludeBaseDirectory(java.lang.String id,
boolean includeBaseDirectory)
Sets the include base directory.
|
void |
setUseDefaultMapreduceClasspath(java.lang.String id,
boolean useDefaultClasspath)
Sets the default classpath.
|
void |
setUseDefaultYarnClasspath(java.lang.String id,
boolean useDefaultClasspath)
Sets the default classpath.
|
EnvironmentClasspathConfigurer |
withClasspath()
Specify a classpath environment variable.
|
EnvironmentClasspathConfigurer |
withClasspath(java.lang.String id)
Specify a classpath environment variable using an identifier.
|
org.springframework.data.hadoop.config.common.annotation.configurers.PropertiesConfigurer<YarnEnvironmentConfigurer> |
withProperties()
Specify properties with a
PropertiesConfigurer. |
org.springframework.data.hadoop.config.common.annotation.configurers.PropertiesConfigurer<YarnEnvironmentConfigurer> |
withProperties(java.lang.String id)
Specify properties with a
PropertiesConfigurer
with an identifier. |
apply, apply, beforeConfigureMains, beforeConfigurePosts, beforeInit, doBuild, getConfigurer, getConfigurers, getOrApply, getOrBuild, getSharedObject, getSharedObjects, objectPostProcessor, postProcess, removeConfigurer, removeConfigurers, setSharedObjectpublic YarnEnvironmentBuilder()
protected java.util.Map<java.lang.String,java.util.Map<java.lang.String,java.lang.String>> performBuild()
throws java.lang.Exception
performBuild in class org.springframework.data.hadoop.config.common.annotation.AbstractConfiguredAnnotationBuilder<java.util.Map<java.lang.String,java.util.Map<java.lang.String,java.lang.String>>,YarnEnvironmentConfigurer,YarnEnvironmentBuilder>java.lang.Exceptionpublic void configureProperties(java.util.Properties properties)
configureProperties in interface org.springframework.data.hadoop.config.common.annotation.configurers.PropertiesConfigurerAwarepublic EnvironmentClasspathConfigurer withClasspath() throws java.lang.Exception
YarnEnvironmentConfigurer
Applies a new DefaultEnvironmentClasspathConfigurer into current
builder. Equivalents between JavaConfig and XML are shown below.
JavaConfig:
public void configure(YarnEnvironmentBuilder environment) throws Exception {
environment
.withClasspath()
.entry("cpEntry1")
.entry("cpEntry2")
.useDefaultYarnClasspath(true);
}
<yarn:environment>
<yarn:classpath use-yarn-app-classpath="true" delimiter=":">
cpEntry1
cpEntry2
</yarn:classpath>
</yarn:environment>
withClasspath in interface YarnEnvironmentConfigurerEnvironmentClasspathConfigurer for classpathjava.lang.Exception - if error occurredpublic EnvironmentClasspathConfigurer withClasspath(java.lang.String id) throws java.lang.Exception
YarnEnvironmentConfigurerwithClasspath in interface YarnEnvironmentConfigurerid - the identifierEnvironmentClasspathConfigurer for classpathjava.lang.Exception - if error occurredYarnEnvironmentConfigurer.withClasspath()public YarnEnvironmentConfigurer entry(java.lang.String key, java.lang.String value)
YarnEnvironmentConfigurer
public void configure(YarnEnvironmentConfigure environment) throws Exception {
environment
.entry("myKey1","myValue1")
.entry("myKey2","myValue2");
}
<yarn:environment> myKey1=myValue1 myKey2=myValue2 </yarn:environment>
entry in interface YarnEnvironmentConfigurerkey - The environment keyvalue - The environment valueYarnEnvironmentConfigurer for chainingpublic YarnEnvironmentConfigurer entry(java.lang.String id, java.lang.String key, java.lang.String value)
YarnEnvironmentConfigurerentry in interface YarnEnvironmentConfigurerid - the identifierkey - The environment keyvalue - The environment valueYarnEnvironmentConfigurer for chainingYarnEnvironmentConfigurer.entry(String, String)public YarnEnvironmentConfigurer propertiesLocation(java.lang.String... locations) throws java.io.IOException
YarnEnvironmentConfigurer
public void configure(YarnEnvironmentConfigure environment) throws Exception {
environment
.entry("myKey1","myValue1")
.entry("myKey2","myValue2")
.propertiesLocation("cfg-1.properties", "cfg-2.properties");
}
<yarn:environment properties-location="cfg-1.properties, cfg-2.properties"> myKey1=myValue1 myKey2=myValue2 </yarn:environment>
propertiesLocation in interface YarnEnvironmentConfigurerlocations - The properties file locationsYarnEnvironmentConfigurer for chainingjava.io.IOException - if error occurredpublic YarnEnvironmentConfigurer propertiesLocationId(java.lang.String id, java.lang.String[] locations) throws java.io.IOException
YarnEnvironmentConfigurerpropertiesLocationId in interface YarnEnvironmentConfigurerid - the identifierlocations - the properties file locationsYarnEnvironmentConfigurer for chainingjava.io.IOExceptionYarnEnvironmentConfigurer.propertiesLocation(String...)public YarnEnvironmentConfigurer includeLocalSystemEnv(boolean includeLocalSystemEnv)
YarnEnvironmentConfigurer
public void configure(YarnEnvironmentConfigure environment) throws Exception {
environment
.includeLocalSystemEnv(false);
}
<yarn:environment include-local-system-env="false"/>
includeLocalSystemEnv in interface YarnEnvironmentConfigurerincludeLocalSystemEnv - if system env variables should be includedYarnEnvironmentConfigurer for chainingpublic YarnEnvironmentConfigurer includeLocalSystemEnv(java.lang.String id, boolean includeLocalSystemEnv)
YarnEnvironmentConfigurerincludeLocalSystemEnv in interface YarnEnvironmentConfigurerid - the identifierincludeLocalSystemEnv - if system env variables should be includedYarnEnvironmentConfigurer for chainingYarnEnvironmentConfigurer.includeLocalSystemEnv(boolean)public org.springframework.data.hadoop.config.common.annotation.configurers.PropertiesConfigurer<YarnEnvironmentConfigurer> withProperties() throws java.lang.Exception
YarnEnvironmentConfigurerPropertiesConfigurer.
public void configure(YarnEnvironmentConfigure environment) throws Exception {
Properties props = new Properties();
environment
.withProperties()
.properties(props)
.property("myKey1", ",myValue1")
.and();
}
<util:properties id="props" location="props.properties"/> <prop key="myKey1">myValue1</prop> </util:properties> <yarn:environment properties-ref="props"/>
withProperties in interface YarnEnvironmentConfigurerPropertiesConfigurer for chainingjava.lang.Exception - if error occurredpublic org.springframework.data.hadoop.config.common.annotation.configurers.PropertiesConfigurer<YarnEnvironmentConfigurer> withProperties(java.lang.String id) throws java.lang.Exception
YarnEnvironmentConfigurerPropertiesConfigurer
with an identifier.withProperties in interface YarnEnvironmentConfigurerid - the identifierPropertiesConfigurer for chainingjava.lang.Exception - if error occurredYarnEnvironmentConfigurer.withProperties()public void addClasspathEntries(java.lang.String id,
java.util.ArrayList<java.lang.String> classpathEntries)
classpathEntries - the classpath entriespublic void configuration(Configuration configuration)
configuration - the yarn configurationpublic void setUseDefaultYarnClasspath(java.lang.String id,
boolean useDefaultClasspath)
useDefaultClasspath - the new default classpathpublic void setUseDefaultMapreduceClasspath(java.lang.String id,
boolean useDefaultClasspath)
useDefaultClasspath - the new default classpathpublic void setIncludeBaseDirectory(java.lang.String id,
boolean includeBaseDirectory)
includeBaseDirectory - the new include base directorypublic void setDelimiter(java.lang.String id,
java.lang.String delimiter)
delimiter - the new delimiterpublic void setDefaultYarnAppClasspath(java.lang.String id,
java.lang.String defaultYarnAppClasspath)
defaultYarnAppClasspath - the new default yarn app classpathpublic void setDefaultMapreduceAppClasspath(java.lang.String id,
java.lang.String defaultMapreduceAppClasspath)
defaultMapreduceAppClasspath - the new default mr app classpath