A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  _ 

F

failed(Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult
 
failed(FetchTask,Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion
 
failed(Integer,String) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
 
failed(Throwable) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
 
failed(Integer,String) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
 
failed(Throwable) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
 
failed(WebPage,Throwable) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion
 
FAST_CONTEXT_LEAK - enum entry in ai.platon.pulsar.crawl.CriticalWarning
 
FatalPrivacyContextException - class in ai.platon.pulsar.crawl.fetch.privacy
 
FatLinkExtractor - class in ai.platon.pulsar.common.collect
 
FatLinkExtractor.Companion - class in ai.platon.pulsar.common.collect.FatLinkExtractor
 
FatLinkExtractor.Companion.Counters - class in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion
 
FeedLoop - class in ai.platon.pulsar.crawl.fetch.batch
This class feeds the fetchMonitor with input items, and re-fills them as items are consumed by FetcherThread-s.
FeedLoop.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FeedLoop
 
fetch(String) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
Fetch an url
fetch(String,LoadOptions) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
Fetch an url
fetch(String) - function in ai.platon.pulsar.crawl.component.FetchComponent
Fetch an url
fetch(String,LoadOptions) - function in ai.platon.pulsar.crawl.component.FetchComponent
Fetch an url
fetchAll(Iterable,LoadOptions) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
Fetch all the urls, config property 'fetch.concurrency' controls the concurrency level.
FetchComponent - class in ai.platon.pulsar.crawl.component
Created by vincent on 17-5-1.
FetchComponent.Companion - class in ai.platon.pulsar.crawl.component.FetchComponent
 
fetchContent(WebPage) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
Fetch a page
fetchContent(FetchEntry) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
Fetch a page
fetchContent(WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent
Fetch a page
fetchContent(FetchEntry) - function in ai.platon.pulsar.crawl.component.FetchComponent
Fetch a page
fetchContentDeferred(WebPage) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
Fetch a page
fetchContentDeferred(WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent
Fetch a page
FetchEntry - class in ai.platon.pulsar.crawl.common
 
FetchEntry.Companion - class in ai.platon.pulsar.crawl.common.FetchEntry
 
FetchingCache - class in ai.platon.pulsar.crawl.common
 
FetchLoop - class in ai.platon.pulsar.crawl.fetch.batch
This class picks items from queues and fetches the pages
FetchLoop.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FetchLoop
 
FetchModeConverter - class in ai.platon.pulsar.common.options
 
FetchMonitor - class in ai.platon.pulsar.crawl.fetch.batch
Created by vincent on 16-9-24.
FetchMonitor.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
 
FetchOptions - class in ai.platon.pulsar.common.options
 
FetchOptions.Companion - class in ai.platon.pulsar.common.options.FetchOptions
 
FetchResult - class in ai.platon.pulsar.crawl.fetch
 
FetchResult.Companion - class in ai.platon.pulsar.crawl.fetch.FetchResult
 
FetchResultBatchHandler - class in ai.platon.pulsar.crawl
 
FetchResultHandler - class in ai.platon.pulsar.crawl
 
FetchSchedule - class in ai.platon.pulsar.crawl.schedule
This interface defines the contract for implementations that manipulate fetch times and re-fetch intervals.
FetchSchedule.Companion - class in ai.platon.pulsar.crawl.schedule.FetchSchedule
 
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.PulsarContext
 
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
Check the fetch state of a page
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.BasicPulsarContext
Check the fetch state of a page
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext
Check the fetch state of a page
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.StaticPulsarContext
Check the fetch state of a page
FetchState - class in ai.platon.pulsar.crawl.common
 
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.crawl.component.LoadComponent
 
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.session.AbstractPulsarSession
Return the fetch state of the page
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.session.BasicPulsarSession
Return the fetch state of the page
fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.session.PulsarSession
Return the fetch state of the page
FetchTask - class in ai.platon.pulsar.crawl.fetch
 
FetchTask.Companion - class in ai.platon.pulsar.crawl.fetch.FetchTask
 
FetchTask.State - class in ai.platon.pulsar.crawl.fetch.FetchTask
 
fillInStackTrace() - function in kotlin.IllegalBusinessPreconditionException
 
fillInStackTrace() - function in kotlin.IllegalApplicationContextStateException
 
fillInStackTrace() - function in kotlin.BlockedException
 
fillInStackTrace() - function in kotlin.HttpException
 
fillInStackTrace() - function in kotlin.PrivacyContextException
 
fillInStackTrace() - function in kotlin.FatalPrivacyContextException
 
fillInStackTrace() - function in kotlin.UrlFilterException
 
fillInStackTrace() - function in kotlin.IndexingException
 
fillInStackTrace() - function in kotlin.ParseException
 
fillInStackTrace() - function in kotlin.ParserNotFound
 
fillInStackTrace() - function in kotlin.ProtocolException
 
fillInStackTrace() - function in kotlin.ProtocolNotFound
 
fillInStackTrace() - function in kotlin.ScoringFilterException
 
filter(MetricFilter) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder
Only report metrics which match the given filter.
filter(HyperlinkPersistable) - function in ai.platon.pulsar.common.options.LinkOptions
 
filter(String,String) - function in ai.platon.pulsar.common.options.LinkOptions
 
filter(String) - function in ai.platon.pulsar.common.options.LinkOptions
 
filter(WebPage) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
 
filter(String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilter
 
filter(String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters
Run all defined urlFilters.
filter(IndexDocument,String,WebPage) - function in ai.platon.pulsar.crawl.index.IndexingFilter
Adds fields or otherwise modifies the document that will be indexed for a parse.
filter(IndexDocument,String,WebPage) - function in ai.platon.pulsar.crawl.index.IndexingFilters
Run all defined filters.
filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
 
filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter
 
filter(HyperlinkPersistable) - function in ai.platon.pulsar.crawl.parse.LinkFilter
 
filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.ParseFilter
 
filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.ParseFilters
Run all defined filters
FilterResult - class in ai.platon.pulsar.crawl.parse
 
FilterResult.Companion - class in ai.platon.pulsar.crawl.parse.FilterResult
 
find(PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
 
findByClassName(String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlNormalizers
 
findExtend(PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
 
findPendingTask(Integer,URL,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
 
findPendingTask(PoolId,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
Get a pending task, the task can be in working pools or in detached pools
finish(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
 
finish(Integer,Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
 
finish(JobFetchTask,Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
Note : We have set response time for each page, @see {HttpBase#getProtocolOutput}
finish(PoolId,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
Finished downloading the web pageMultiple threaded, non-synchronized class member variables are not allowed inside this method.
finishAsap(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
 
finishUnchecked(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
Finish the fetch item anyway, even if it's failed to download the target page
first() - function in ai.platon.pulsar.crawl.CrawlLoops
 
firstAttr(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
 
firstAttr(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
 
firstIsInstance() - function in ai.platon.pulsar.crawl.CrawlLoops
 
firstText(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
 
firstText(String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
 
flush() - function in ai.platon.pulsar.context.PulsarContext
 
flush() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
Flush the storage
flush() - function in ai.platon.pulsar.context.support.BasicPulsarContext
Flush the storage
flush() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext
Flush the storage
flush() - function in ai.platon.pulsar.context.support.StaticPulsarContext
Flush the storage
flush() - function in ai.platon.pulsar.crawl.component.LoadComponent
 
flush() - function in ai.platon.pulsar.crawl.component.WebDbComponent
 
flush() - function in ai.platon.pulsar.session.AbstractPulsarSession
 
flush() - function in ai.platon.pulsar.session.BasicPulsarSession
 
flush() - function in ai.platon.pulsar.session.PulsarSession
 
forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule
This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule
This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule
This method resets fetchTime, fetchInterval, modifiedTime and page text, so that it forces refetching.
forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule
This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
forEach(Consumer) - function in kotlin.collections.LoadingDelayQueue
 
forEach(Consumer) - function in kotlin.collections.PoolQueue
 
formatAsLine() - function in ai.platon.pulsar.crawl.index.IndexDocument
 
formatAsTable(Collection) - function in ai.platon.pulsar.common.collect.DataCollectorFormatterKt
 
formatStatus() - function in ai.platon.pulsar.crawl.CoreMetrics
 
forName(String) - function in ai.platon.pulsar.common.MimeTypeResolver
A facade interface to Tika's underlying forName method.
forRegistry(MetricRegistry) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Companion
Returns a new Builder for Slf4jReporter.
ForwardingResponse - class in ai.platon.pulsar.crawl.protocol
Forward a response.
ForwardingResponse.Companion - class in ai.platon.pulsar.crawl.protocol.ForwardingResponse
 
free() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
 
FREE - enum entry in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver.Status
 
free() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
 
fromConfig(String,PulsarSession,Priority13) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector.Companion
 
fromString(String) - function in ai.platon.pulsar.common.options.ItemExtractor.Companion
 
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  _