CrawlFilter


public final class CrawlFilter

TODO : configurable

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description
`public class`	`CrawlFilter.Companion`

Field Summary

Fields
Modifier and Type	Field	Description
`private final PageCategory`	`pageType`
`private String`	`urlFilter`
`private TextFilter`	`textFilter`
`private BlockFilter`	`blockFilter`
`private String`	`startKey`
`private String`	`endKey`
`private String`	`reversedStartKey`
`private String`	`reversedEndKey`
`private final ImmutableConfig`	`conf`

Constructor Summary

Constructors
Constructor	Description
`CrawlFilter(ImmutableConfig conf)`

Method Summary

Modifier and Type	Method	Description
`final PageCategory`	`getPageType()`
`final String`	`getUrlFilter()`
`final Unit`	`setUrlFilter(String urlFilter)`
`final TextFilter`	`getTextFilter()`
`final Unit`	`setTextFilter(TextFilter textFilter)`
`final BlockFilter`	`getBlockFilter()`
`final Unit`	`setBlockFilter(BlockFilter blockFilter)`
`final String`	`getStartKey()`
`final Unit`	`setStartKey(String startKey)`
`final String`	`getEndKey()`
`final Unit`	`setEndKey(String endKey)`
`final String`	`getReversedStartKey()`
`final Unit`	`setReversedStartKey(String reversedStartKey)`
`final String`	`getReversedEndKey()`
`final Unit`	`setReversedEndKey(String reversedEndKey)`
`final ImmutableConfig`	`getConf()`
`final WebPage`	`filter(WebPage page)`
`final Boolean`	`testUrlSatisfied(String url)`
`final Boolean`	`testKeyRangeSatisfied(String reversedUrl)`
`final Boolean`	`testTextSatisfied(String text)`
`final Boolean`	`isAllowed(Node node)`
`final Boolean`	`isDisallowed(Node node)`
`final Boolean`	`isDetailUrl(String url)`
`final Boolean`	`isSearchUrl(String url)`
`final Boolean`	`isMediaUrl(String url)`
`final Boolean`	`isIndexUrl(String url)`
`String`	`toString()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail
- CrawlFilter
```
CrawlFilter(ImmutableConfig conf)
```

Method Detail

getPageType
```
 final PageCategory getPageType()
```

getUrlFilter
```
 final String getUrlFilter()
```

setUrlFilter

 final Unit setUrlFilter(String urlFilter)

getTextFilter
```
 final TextFilter getTextFilter()
```

setTextFilter

 final Unit setTextFilter(TextFilter textFilter)

getBlockFilter
```
 final BlockFilter getBlockFilter()
```

setBlockFilter

 final Unit setBlockFilter(BlockFilter blockFilter)

getStartKey
```
 final String getStartKey()
```

setStartKey

 final Unit setStartKey(String startKey)

getEndKey
```
 final String getEndKey()
```

setEndKey
```
 final Unit setEndKey(String endKey)
```

getReversedStartKey
```
 final String getReversedStartKey()
```

setReversedStartKey

 final Unit setReversedStartKey(String reversedStartKey)

getReversedEndKey
```
 final String getReversedEndKey()
```

setReversedEndKey

 final Unit setReversedEndKey(String reversedEndKey)

getConf
```
 final ImmutableConfig getConf()
```

filter
```
 final WebPage filter(WebPage page)
```

testUrlSatisfied

 final Boolean testUrlSatisfied(String url)

testKeyRangeSatisfied

 final Boolean testKeyRangeSatisfied(String reversedUrl)

testTextSatisfied

 final Boolean testTextSatisfied(String text)

isAllowed
```
 final Boolean isAllowed(Node node)
```

isDisallowed
```
 final Boolean isDisallowed(Node node)
```

isDetailUrl
```
 final Boolean isDetailUrl(String url)
```

isSearchUrl
```
 final Boolean isSearchUrl(String url)
```

isMediaUrl
```
 final Boolean isMediaUrl(String url)
```

isIndexUrl
```
 final Boolean isIndexUrl(String url)
```

toString
```
 String toString()
```

Class CrawlFilter

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

CrawlFilter

Method Detail

getPageType

getUrlFilter

setUrlFilter

getTextFilter

setTextFilter

getBlockFilter

setBlockFilter

getStartKey

setStartKey

getEndKey

setEndKey

getReversedStartKey

setReversedStartKey

getReversedEndKey

setReversedEndKey

getConf

filter

testUrlSatisfied

testKeyRangeSatisfied

testTextSatisfied

isAllowed

isDisallowed

isDetailUrl

isSearchUrl

isMediaUrl

isIndexUrl

toString