A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
_
F
- failed(Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult
- failed(FetchTask,Throwable) - function in ai.platon.pulsar.crawl.fetch.FetchResult.Companion
- failed(Integer,String) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
- failed(Throwable) - function in ai.platon.pulsar.crawl.parse.FilterResult.Companion
- failed(Integer,String) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
- failed(Throwable) - function in ai.platon.pulsar.crawl.parse.ParseResult.Companion
- failed(WebPage,Throwable) - function in ai.platon.pulsar.crawl.protocol.ForwardingResponse.Companion
- FAST_CONTEXT_LEAK - enum entry in ai.platon.pulsar.crawl.CriticalWarning
- FatalPrivacyContextException - class in ai.platon.pulsar.crawl.fetch.privacy
- FatLinkExtractor - class in ai.platon.pulsar.common.collect
- FatLinkExtractor.Companion - class in ai.platon.pulsar.common.collect.FatLinkExtractor
- FatLinkExtractor.Companion.Counters - class in ai.platon.pulsar.common.collect.FatLinkExtractor.Companion
- FeedLoop - class in ai.platon.pulsar.crawl.fetch.batch
- This class feeds the fetchMonitor with input items, and re-fills them as items are consumed by FetcherThread-s.
- FeedLoop.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FeedLoop
- fetch(String) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- Fetch an url
- fetch(String,LoadOptions) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- Fetch an url
- fetch(String) - function in ai.platon.pulsar.crawl.component.FetchComponent
- Fetch an url
- fetch(String,LoadOptions) - function in ai.platon.pulsar.crawl.component.FetchComponent
- Fetch an url
- fetchAll(Iterable,LoadOptions) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- Fetch all the urls, config property 'fetch.concurrency' controls the concurrency level.
- FetchComponent - class in ai.platon.pulsar.crawl.component
- Created by vincent on 17-5-1.
- FetchComponent.Companion - class in ai.platon.pulsar.crawl.component.FetchComponent
- fetchContent(WebPage) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- Fetch a page
- fetchContent(FetchEntry) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- Fetch a page
- fetchContent(WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent
- Fetch a page
- fetchContent(FetchEntry) - function in ai.platon.pulsar.crawl.component.FetchComponent
- Fetch a page
- fetchContentDeferred(WebPage) - function in ai.platon.pulsar.crawl.component.BatchFetchComponent
- Fetch a page
- fetchContentDeferred(WebPage) - function in ai.platon.pulsar.crawl.component.FetchComponent
- Fetch a page
- FetchEntry - class in ai.platon.pulsar.crawl.common
- FetchEntry.Companion - class in ai.platon.pulsar.crawl.common.FetchEntry
- FetchingCache - class in ai.platon.pulsar.crawl.common
- FetchLoop - class in ai.platon.pulsar.crawl.fetch.batch
- This class picks items from queues and fetches the pages
- FetchLoop.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FetchLoop
- FetchModeConverter - class in ai.platon.pulsar.common.options
- FetchMonitor - class in ai.platon.pulsar.crawl.fetch.batch
- Created by vincent on 16-9-24.
- FetchMonitor.Companion - class in ai.platon.pulsar.crawl.fetch.batch.FetchMonitor
- FetchOptions - class in ai.platon.pulsar.common.options
- FetchOptions.Companion - class in ai.platon.pulsar.common.options.FetchOptions
- FetchResult - class in ai.platon.pulsar.crawl.fetch
- FetchResult.Companion - class in ai.platon.pulsar.crawl.fetch.FetchResult
- FetchResultBatchHandler - class in ai.platon.pulsar.crawl
- FetchResultHandler - class in ai.platon.pulsar.crawl
- FetchSchedule - class in ai.platon.pulsar.crawl.schedule
- This interface defines the contract for implementations that manipulate fetch times and re-fetch intervals.
- FetchSchedule.Companion - class in ai.platon.pulsar.crawl.schedule.FetchSchedule
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.PulsarContext
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Check the fetch state of a page
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.BasicPulsarContext
- Check the fetch state of a page
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext
- Check the fetch state of a page
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.context.support.StaticPulsarContext
- Check the fetch state of a page
- FetchState - class in ai.platon.pulsar.crawl.common
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.crawl.component.LoadComponent
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.session.AbstractPulsarSession
- Return the fetch state of the page
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.session.BasicPulsarSession
- Return the fetch state of the page
- fetchState(WebPage,LoadOptions) - function in ai.platon.pulsar.session.PulsarSession
- Return the fetch state of the page
- FetchTask - class in ai.platon.pulsar.crawl.fetch
- FetchTask.Companion - class in ai.platon.pulsar.crawl.fetch.FetchTask
- FetchTask.State - class in ai.platon.pulsar.crawl.fetch.FetchTask
- fillInStackTrace() - function in kotlin.IllegalBusinessPreconditionException
- fillInStackTrace() - function in kotlin.IllegalApplicationContextStateException
- fillInStackTrace() - function in kotlin.BlockedException
- fillInStackTrace() - function in kotlin.HttpException
- fillInStackTrace() - function in kotlin.PrivacyContextException
- fillInStackTrace() - function in kotlin.FatalPrivacyContextException
- fillInStackTrace() - function in kotlin.UrlFilterException
- fillInStackTrace() - function in kotlin.IndexingException
- fillInStackTrace() - function in kotlin.ParseException
- fillInStackTrace() - function in kotlin.ParserNotFound
- fillInStackTrace() - function in kotlin.ProtocolException
- fillInStackTrace() - function in kotlin.ProtocolNotFound
- fillInStackTrace() - function in kotlin.ScoringFilterException
- filter(MetricFilter) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Builder
- Only report metrics which match the given filter.
- filter(HyperlinkPersistable) - function in ai.platon.pulsar.common.options.LinkOptions
- filter(String,String) - function in ai.platon.pulsar.common.options.LinkOptions
- filter(String) - function in ai.platon.pulsar.common.options.LinkOptions
- filter(WebPage) - function in ai.platon.pulsar.crawl.filter.CrawlFilter
- filter(String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilter
- filter(String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlFilters
- Run all defined urlFilters.
- filter(IndexDocument,String,WebPage) - function in ai.platon.pulsar.crawl.index.IndexingFilter
- Adds fields or otherwise modifies the document that will be indexed for a parse.
- filter(IndexDocument,String,WebPage) - function in ai.platon.pulsar.crawl.index.IndexingFilters
- Run all defined filters.
- filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.AbstractParseFilter
- filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.EmptyParseFilter
- filter(HyperlinkPersistable) - function in ai.platon.pulsar.crawl.parse.LinkFilter
- filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.ParseFilter
- filter(ParseContext) - function in ai.platon.pulsar.crawl.parse.ParseFilters
- Run all defined filters
- FilterResult - class in ai.platon.pulsar.crawl.parse
- FilterResult.Companion - class in ai.platon.pulsar.crawl.parse.FilterResult
- find(PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
- findByClassName(String) - function in ai.platon.pulsar.crawl.filter.CrawlUrlNormalizers
- findExtend(PoolId) - function in ai.platon.pulsar.crawl.fetch.batch.data.PoolQueue
- findPendingTask(Integer,URL,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- findPendingTask(PoolId,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- Get a pending task, the task can be in working pools or in detached pools
- finish(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- finish(Integer,Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- finish(JobFetchTask,Boolean) - function in ai.platon.pulsar.crawl.fetch.batch.TaskPool
- Note : We have set response time for each page, @see {HttpBase#getProtocolOutput}
- finish(PoolId,Integer) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- Finished downloading the web pageMultiple threaded, non-synchronized class member variables are not allowed inside this method.
- finishAsap(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskMonitor
- finishUnchecked(JobFetchTask) - function in ai.platon.pulsar.crawl.fetch.batch.TaskScheduler
- Finish the fetch item anyway, even if it's failed to download the target page
- first() - function in ai.platon.pulsar.crawl.CrawlLoops
- firstAttr(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- firstAttr(String,String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- firstIsInstance() - function in ai.platon.pulsar.crawl.CrawlLoops
- firstText(String) - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- firstText(String) - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- flush() - function in ai.platon.pulsar.context.PulsarContext
- flush() - function in ai.platon.pulsar.context.support.AbstractPulsarContext
- Flush the storage
- flush() - function in ai.platon.pulsar.context.support.BasicPulsarContext
- Flush the storage
- flush() - function in ai.platon.pulsar.context.support.ClassPathXmlPulsarContext
- Flush the storage
- flush() - function in ai.platon.pulsar.context.support.StaticPulsarContext
- Flush the storage
- flush() - function in ai.platon.pulsar.crawl.component.LoadComponent
- flush() - function in ai.platon.pulsar.crawl.component.WebDbComponent
- flush() - function in ai.platon.pulsar.session.AbstractPulsarSession
- flush() - function in ai.platon.pulsar.session.BasicPulsarSession
- flush() - function in ai.platon.pulsar.session.PulsarSession
- forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.AbstractFetchSchedule
- This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
- forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.AdaptiveFetchSchedule
- This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
- forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule
- This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
- forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.FetchSchedule
- This method resets fetchTime, fetchInterval, modifiedTime and page text, so that it forces refetching.
- forceRefetch(WebPage,Instant,Boolean) - function in ai.platon.pulsar.crawl.schedule.NewsFetchSchedule
- This method resets fetchTime, fetchInterval, modifiedTime, retriesSinceFetch and page text, so that it forces refetching.
- forEach(Consumer) - function in kotlin.collections.LoadingDelayQueue
- forEach(Consumer) - function in kotlin.collections.PoolQueue
- formatAsLine() - function in ai.platon.pulsar.crawl.index.IndexDocument
- formatAsTable(Collection) - function in ai.platon.pulsar.common.collect.DataCollectorFormatterKt
- formatStatus() - function in ai.platon.pulsar.crawl.CoreMetrics
- forName(String) - function in ai.platon.pulsar.common.MimeTypeResolver
- A facade interface to Tika's underlying forName method.
- forRegistry(MetricRegistry) - function in ai.platon.pulsar.common.metrics.CodahaleSlf4jReporter.Companion
- Returns a new Builder for Slf4jReporter.
- ForwardingResponse - class in ai.platon.pulsar.crawl.protocol
- Forward a response.
- ForwardingResponse.Companion - class in ai.platon.pulsar.crawl.protocol.ForwardingResponse
- free() - function in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver
- FREE - enum entry in ai.platon.pulsar.crawl.fetch.driver.AbstractWebDriver.Status
- free() - function in ai.platon.pulsar.crawl.fetch.driver.WebDriver
- fromConfig(String,PulsarSession,Priority13) - function in ai.platon.pulsar.common.collect.PeriodicalHyperlinkCollector.Companion
- fromString(String) - function in ai.platon.pulsar.common.options.ItemExtractor.Companion