PeriodicalLocalFileHyperlinkCollector

All Implemented Interfaces:

ai.platon.pulsar.common.collect.collector.DataCollector , ai.platon.pulsar.common.collect.collector.PriorityDataCollector , kotlin.Comparable
```
public class PeriodicalLocalFileHyperlinkCollector
extends CircularLocalFileHyperlinkCollector
                    
```

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description
`public class`	`PeriodicalLocalFileHyperlinkCollector.Companion`

Field Summary

Fields
Modifier and Type	Field	Description
`private String`	`name`
`private final UUID`	`uuid`
`private final PeriodicalLocalFileHyperlinkCollector.Companion.Counters`	`counters`
`private Integer`	`batchSize`
`private final Map<Integer, Instant>`	`startTimes`
`private final Map<Integer, Instant>`	`finishTimes`
`private final Integer`	`round`
`private Integer`	`roundCollected`
`private final Instant`	`startTime`
`private final Instant`	`finishTime`
`private final Duration`	`expires`
`private final Boolean`	`isStarted`
`private final Boolean`	`isExpired`
`private final Boolean`	`isFinished`
`private final LoadOptions`	`options`
`private final Integer`	`capacity`
`private final String`	`fileName`
`private String`	`loadArgs`
`private final List<Hyperlink>`	`hyperlinks`
`private final Integer`	`size`
`private final Path`	`path`
`private Integer`	`collectCount`
`private final Duration`	`collectTime`
`private Integer`	`collectedCount`
`private String`	`country`
`private final Instant`	`createTime`
`private Instant`	`deadTime`
`private String`	`district`
`private final Integer`	`estimatedExternalSize`
`private final Integer`	`estimatedSize`
`private final Integer`	`externalSize`
`private Instant`	`firstCollectTime`
`private final Integer`	`id`
`private final Boolean`	`isDead`
`private final Set<String>`	`labels`
`private String`	`lang`
`private Instant`	`lastCollectedTime`
`private final Integer`	`priority`

Constructor Summary

Constructors
Constructor	Description
`PeriodicalLocalFileHyperlinkCollector(Path path, LoadOptions options, Priority13 priority)`

Method Summary

Modifier and Type	Method	Description
`String`	`getName()`	The collector name
`Unit`	`setName(String name)`	The collector name
`final UUID`	`getUuid()`
`final PeriodicalLocalFileHyperlinkCollector.Companion.Counters`	`getCounters()`
`final Integer`	`getBatchSize()`
`final Unit`	`setBatchSize(Integer batchSize)`
`final Map<Integer, Instant>`	`getStartTimes()`
`final Map<Integer, Instant>`	`getFinishTimes()`
`final Integer`	`getRound()`
`final Integer`	`getRoundCollected()`
`final Unit`	`setRoundCollected(Integer roundCollected)`
`final Instant`	`getStartTime()`
`final Instant`	`getFinishTime()`
`final Duration`	`getExpires()`
`final Boolean`	`getIsStarted()`
`final Boolean`	`getIsExpired()`
`final Boolean`	`getIsFinished()`
`final LoadOptions`	`getOptions()`
`Integer`	`getCapacity()`	The cache capacity, we assume that all items in the file are loaded into the cache
`final String`	`getFileName()`
`final String`	`getLoadArgs()`
`final Unit`	`setLoadArgs(String loadArgs)`
`final List<Hyperlink>`	`getHyperlinks()`
`Integer`	`getSize()`
`final Path`	`getPath()`	The path of the file source
`Integer`	`getCollectCount()`
`Unit`	`setCollectCount(Integer collectCount)`
`Duration`	`getCollectTime()`
`Integer`	`getCollectedCount()`
`Unit`	`setCollectedCount(Integer collectedCount)`
`String`	`getCountry()`
`Unit`	`setCountry(String country)`
`Instant`	`getCreateTime()`
`Instant`	`getDeadTime()`
`Unit`	`setDeadTime(Instant deadTime)`
`String`	`getDistrict()`
`Unit`	`setDistrict(String district)`
`Integer`	`getEstimatedExternalSize()`
`Integer`	`getEstimatedSize()`
`Integer`	`getExternalSize()`
`Instant`	`getFirstCollectTime()`
`Unit`	`setFirstCollectTime(Instant firstCollectTime)`
`Integer`	`getId()`
`Boolean`	`getIsDead()`
`Set<String>`	`getLabels()`
`String`	`getLang()`
`Unit`	`setLang(String lang)`
`Instant`	`getLastCollectedTime()`
`Unit`	`setLastCollectedTime(Instant lastCollectedTime)`
`Integer`	`getPriority()`
`Boolean`	`hasMore()`
`Integer`	`collectTo(List<UrlAware> sink)`
`String`	`toString()`

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
clear, collectTo, collectTo, collectTo, compareTo
Methods inherited from class ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector
dump
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector
deepClear
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PeriodicalLocalFileHyperlinkCollector

PeriodicalLocalFileHyperlinkCollector(Path path, LoadOptions options, Priority13 priority)

Method Detail

getName
```
 String getName()
```
The collector name

setName
```
 Unit setName(String name)
```
The collector name

getUuid
```
 final UUID getUuid()
```

getCounters

 final PeriodicalLocalFileHyperlinkCollector.Companion.Counters getCounters()

getBatchSize
```
 final Integer getBatchSize()
```

setBatchSize

 final Unit setBatchSize(Integer batchSize)

getStartTimes

 final Map<Integer, Instant> getStartTimes()

getFinishTimes

 final Map<Integer, Instant> getFinishTimes()

getRound
```
 final Integer getRound()
```

getRoundCollected
```
 final Integer getRoundCollected()
```

setRoundCollected

 final Unit setRoundCollected(Integer roundCollected)

getStartTime
```
 final Instant getStartTime()
```

getFinishTime
```
 final Instant getFinishTime()
```

getExpires
```
 final Duration getExpires()
```

getIsStarted
```
 final Boolean getIsStarted()
```

getIsExpired
```
 final Boolean getIsExpired()
```

getIsFinished
```
 final Boolean getIsFinished()
```

getOptions
```
 final LoadOptions getOptions()
```

getCapacity
```
 Integer getCapacity()
```
The cache capacity, we assume that all items in the file are loaded into the cache

getFileName
```
 final String getFileName()
```

getLoadArgs
```
 final String getLoadArgs()
```

setLoadArgs

 final Unit setLoadArgs(String loadArgs)

getHyperlinks
```
 final List<Hyperlink> getHyperlinks()
```

getSize
```
 Integer getSize()
```

getPath
```
 final Path getPath()
```
The path of the file source

getCollectCount
```
 Integer getCollectCount()
```

setCollectCount

 Unit setCollectCount(Integer collectCount)

getCollectTime
```
 Duration getCollectTime()
```

getCollectedCount
```
 Integer getCollectedCount()
```

setCollectedCount

 Unit setCollectedCount(Integer collectedCount)

getCountry
```
 String getCountry()
```

setCountry
```
 Unit setCountry(String country)
```

getCreateTime
```
 Instant getCreateTime()
```

getDeadTime
```
 Instant getDeadTime()
```

setDeadTime
```
 Unit setDeadTime(Instant deadTime)
```

getDistrict
```
 String getDistrict()
```

setDistrict
```
 Unit setDistrict(String district)
```

getEstimatedExternalSize
```
 Integer getEstimatedExternalSize()
```

getEstimatedSize
```
 Integer getEstimatedSize()
```

getExternalSize
```
 Integer getExternalSize()
```

getFirstCollectTime
```
 Instant getFirstCollectTime()
```

setFirstCollectTime

 Unit setFirstCollectTime(Instant firstCollectTime)

getId
```
 Integer getId()
```

getIsDead
```
 Boolean getIsDead()
```

getLabels
```
 Set<String> getLabels()
```

getLang
```
 String getLang()
```

setLang
```
 Unit setLang(String lang)
```

getLastCollectedTime
```
 Instant getLastCollectedTime()
```

setLastCollectedTime

 Unit setLastCollectedTime(Instant lastCollectedTime)

getPriority
```
 Integer getPriority()
```

hasMore
```
 Boolean hasMore()
```

collectTo

 Integer collectTo(List<UrlAware> sink)

toString
```
 String toString()
```

Class PeriodicalLocalFileHyperlinkCollector

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector

Methods inherited from class ai.platon.pulsar.common.collect.CircularLocalFileHyperlinkCollector

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector

Methods inherited from class java.lang.Object

Constructor Detail

PeriodicalLocalFileHyperlinkCollector

Method Detail

getName

setName

getUuid

getCounters

getBatchSize

setBatchSize

getStartTimes

getFinishTimes

getRound

getRoundCollected

setRoundCollected

getStartTime

getFinishTime

getExpires

getIsStarted

getIsExpired

getIsFinished

getOptions

getCapacity

getFileName

getLoadArgs

setLoadArgs

getHyperlinks

getSize

getPath

getCollectCount

setCollectCount

getCollectTime

getCollectedCount

setCollectedCount

getCountry

setCountry

getCreateTime

getDeadTime

setDeadTime

getDistrict

setDistrict

getEstimatedExternalSize

getEstimatedSize

getExternalSize

getFirstCollectTime

setFirstCollectTime

getId

getIsDead

getLabels

getLang

setLang

getLastCollectedTime

setLastCollectedTime

getPriority

hasMore

collectTo

toString