Constructor Detail

• StreamingCrawlLoop

  StreamingCrawlLoop(GlobalCacheFactory globalCacheFactory, ImmutableConfig unmodifiedConfig, String name)

Method Detail

• getGlobalCache

   final GlobalCache getGlobalCache()

• getIsRunning

   final Boolean getIsRunning()

• getCrawlEventHandler

   final DefaultCrawlEventHandler getCrawlEventHandler()

• setCrawlEventHandler

   final Unit setCrawlEventHandler(DefaultCrawlEventHandler crawlEventHandler)

• getUrlFeeder

   UrlFeeder getUrlFeeder()

  The fetch iterable from which all fetch tasks are taken

• getCrawler

   StreamingCrawler<UrlAware> getCrawler()

• setCrawler

   Unit setCrawler(StreamingCrawler<UrlAware> crawler)

• getGlobalCacheFactory

   final GlobalCacheFactory getGlobalCacheFactory()

  The global cache

• getId

   Integer getId()

• getDefaultOptions

   LoadOptions getDefaultOptions()

  Data collector lower capacity

• setDefaultOptions

   Unit setDefaultOptions(LoadOptions defaultOptions)

  Data collector lower capacity

• getCollectors

   List<PriorityDataCollector<UrlAware>> getCollectors()

• getAbstract

   String getAbstract()

• getReport

   String getReport()

• getName

   String getName()

• getConfig

   ImmutableConfig getConfig()

• start

  @Synchronized() Unit start()

• stop

  @Synchronized() Unit stop()

• await

   Unit await()