AbstractCrawlLoop

All Implemented Interfaces:: ai.platon.pulsar.common.StartStopRunnable , ai.platon.pulsar.crawl.CrawlLoop


public abstract class AbstractCrawlLoop
 implements CrawlLoop

Nested Classes
Modifier and Type	Class	Description
`public class`	`AbstractCrawlLoop.Companion`

Fields
Modifier and Type	Field	Description
`private final Integer`	`id`
`private LoadOptions`	`defaultOptions`
`private final UrlFeeder`	`urlFeeder`
`private final List<PriorityDataCollector<UrlAware>>`	`collectors`
`private final AbstractCrawler`	`crawler`
`private final String`	`abstract`
`private final String`	`report`
`private final String`	`name`
`private final ImmutableConfig`	`config`

Constructors
Constructor	Description
`AbstractCrawlLoop(String name, ImmutableConfig config)`

Modifier and Type	Method	Description
`Integer`	`getId()`
`LoadOptions`	`getDefaultOptions()`	Data collector lower capacity
`Unit`	`setDefaultOptions(LoadOptions defaultOptions)`	Data collector lower capacity
`abstract UrlFeeder`	`getUrlFeeder()`	The fetch iterable from which all fetch tasks are taken
`List<PriorityDataCollector<UrlAware>>`	`getCollectors()`
`abstract AbstractCrawler`	`getCrawler()`
`String`	`getAbstract()`
`String`	`getReport()`
`String`	`getName()`
`ImmutableConfig`	`getConfig()`

Methods inherited from class ai.platon.pulsar.crawl.CrawlLoop
await, restart, start, stop
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

AbstractCrawlLoop(String name, ImmutableConfig config)

getDefaultOptions
```
 LoadOptions getDefaultOptions()
```
Data collector lower capacity

 Unit setDefaultOptions(LoadOptions defaultOptions)

Data collector lower capacity

getUrlFeeder
```
 abstract UrlFeeder getUrlFeeder()
```
The fetch iterable from which all fetch tasks are taken

 List<PriorityDataCollector<UrlAware>> getCollectors()

Class AbstractCrawlLoop