-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.config.Parameterized,ai.platon.pulsar.crawl.schedule.FetchSchedule
public final class DefaultFetchSchedule extends AbstractFetchSchedule
This class implements the default re-fetch schedule. That is, no matter if the page was changed or not, the
fetchIntervalremains unchanged, and the updated page fetchTime will always be set tofetchTime + fetchInterval * 1000.
-
-
Field Summary
Fields Modifier and Type Field Description private final DurationmaxFetchIntervalprivate final ImmutableConfigconfprivate final MiscMessageWritermessageWriter
-
Constructor Summary
Constructors Constructor Description DefaultFetchSchedule(ImmutableConfig conf, MiscMessageWriter messageWriter)
-
Method Summary
Modifier and Type Method Description DurationgetMaxFetchInterval()final ImmutableConfiggetConf()final MiscMessageWritergetMessageWriter()-
Methods inherited from class ai.platon.pulsar.crawl.schedule.DefaultFetchSchedule
estimatePrevFetchTime, forceRefetch, getParams, initializeSchedule, setFetchSchedule, setPageGoneSchedule, setPageRetrySchedule, shouldFetch -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Constructor Detail
-
DefaultFetchSchedule
DefaultFetchSchedule(ImmutableConfig conf, MiscMessageWriter messageWriter)
-
-
Method Detail
-
getMaxFetchInterval
Duration getMaxFetchInterval()
-
getConf
final ImmutableConfig getConf()
-
getMessageWriter
final MiscMessageWriter getMessageWriter()
-
-
-
-