LocalFileHyperlinkCollector

All Implemented Interfaces:

ai.platon.pulsar.common.collect.collector.DataCollector , ai.platon.pulsar.common.collect.collector.PriorityDataCollector , kotlin.Comparable
```
public class LocalFileHyperlinkCollector
extends AbstractPriorityDataCollector<UrlAware>
                    
```

Field Summary

Fields
Modifier and Type	Field	Description
`private final Integer`	`capacity`
`private String`	`name`
`private final String`	`fileName`
`private String`	`loadArgs`
`private final List<Hyperlink>`	`hyperlinks`
`private final Integer`	`size`
`private final Path`	`path`
`private Integer`	`collectCount`
`private final Duration`	`collectTime`
`private Integer`	`collectedCount`
`private String`	`country`
`private final Instant`	`createTime`
`private Instant`	`deadTime`
`private String`	`district`
`private final Integer`	`estimatedExternalSize`
`private final Integer`	`estimatedSize`
`private final Integer`	`externalSize`
`private Instant`	`firstCollectTime`
`private final Integer`	`id`
`private final Boolean`	`isDead`
`private final Set<String>`	`labels`
`private String`	`lang`
`private Instant`	`lastCollectedTime`
`private final Integer`	`priority`

Constructor Summary

Constructors
Constructor	Description
`LocalFileHyperlinkCollector(Path path, Priority13 priority)`
`LocalFileHyperlinkCollector(Path path, Integer priority)`

Method Summary

Modifier and Type	Method	Description
`Integer`	`getCapacity()`	The cache capacity, we assume that all items in the file are loaded into the cache
`String`	`getName()`	The collector name
`Unit`	`setName(String name)`	The collector name
`final String`	`getFileName()`
`final String`	`getLoadArgs()`
`final Unit`	`setLoadArgs(String loadArgs)`
`final List<Hyperlink>`	`getHyperlinks()`
`Integer`	`getSize()`
`final Path`	`getPath()`	The path of the file source
`Integer`	`getCollectCount()`
`Unit`	`setCollectCount(Integer collectCount)`
`Duration`	`getCollectTime()`
`Integer`	`getCollectedCount()`
`Unit`	`setCollectedCount(Integer collectedCount)`
`String`	`getCountry()`
`Unit`	`setCountry(String country)`
`Instant`	`getCreateTime()`
`Instant`	`getDeadTime()`
`Unit`	`setDeadTime(Instant deadTime)`
`String`	`getDistrict()`
`Unit`	`setDistrict(String district)`
`Integer`	`getEstimatedExternalSize()`
`Integer`	`getEstimatedSize()`
`Integer`	`getExternalSize()`
`Instant`	`getFirstCollectTime()`
`Unit`	`setFirstCollectTime(Instant firstCollectTime)`
`Integer`	`getId()`
`Boolean`	`getIsDead()`
`Set<String>`	`getLabels()`
`String`	`getLang()`
`Unit`	`setLang(String lang)`
`Instant`	`getLastCollectedTime()`
`Unit`	`setLastCollectedTime(Instant lastCollectedTime)`
`Integer`	`getPriority()`
`Boolean`	`hasMore()`
`Integer`	`collectTo(List<UrlAware> sink)`
`List<String>`	`dump()`

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector
clear, collectTo, collectTo, collectTo, compareTo
Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector
deepClear
Methods inherited from class ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector
toString
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalFileHyperlinkCollector

LocalFileHyperlinkCollector(Path path, Priority13 priority)

LocalFileHyperlinkCollector

LocalFileHyperlinkCollector(Path path, Integer priority)

Method Detail

getCapacity
```
 Integer getCapacity()
```
The cache capacity, we assume that all items in the file are loaded into the cache

getName
```
 String getName()
```
The collector name

setName
```
 Unit setName(String name)
```
The collector name

getFileName
```
 final String getFileName()
```

getLoadArgs
```
 final String getLoadArgs()
```

setLoadArgs

 final Unit setLoadArgs(String loadArgs)

getHyperlinks
```
 final List<Hyperlink> getHyperlinks()
```

getSize
```
 Integer getSize()
```

getPath
```
 final Path getPath()
```
The path of the file source

getCollectCount
```
 Integer getCollectCount()
```

setCollectCount

 Unit setCollectCount(Integer collectCount)

getCollectTime
```
 Duration getCollectTime()
```

getCollectedCount
```
 Integer getCollectedCount()
```

setCollectedCount

 Unit setCollectedCount(Integer collectedCount)

getCountry
```
 String getCountry()
```

setCountry
```
 Unit setCountry(String country)
```

getCreateTime
```
 Instant getCreateTime()
```

getDeadTime
```
 Instant getDeadTime()
```

setDeadTime
```
 Unit setDeadTime(Instant deadTime)
```

getDistrict
```
 String getDistrict()
```

setDistrict
```
 Unit setDistrict(String district)
```

getEstimatedExternalSize
```
 Integer getEstimatedExternalSize()
```

getEstimatedSize
```
 Integer getEstimatedSize()
```

getExternalSize
```
 Integer getExternalSize()
```

getFirstCollectTime
```
 Instant getFirstCollectTime()
```

setFirstCollectTime

 Unit setFirstCollectTime(Instant firstCollectTime)

getId
```
 Integer getId()
```

getIsDead
```
 Boolean getIsDead()
```

getLabels
```
 Set<String> getLabels()
```

getLang
```
 String getLang()
```

setLang
```
 Unit setLang(String lang)
```

getLastCollectedTime
```
 Instant getLastCollectedTime()
```

setLastCollectedTime

 Unit setLastCollectedTime(Instant lastCollectedTime)

getPriority
```
 Integer getPriority()
```

hasMore
```
 Boolean hasMore()
```

collectTo

 Integer collectTo(List<UrlAware> sink)

dump
```
@Synchronized() List<String> dump()
```

Class LocalFileHyperlinkCollector

Field Summary

Constructor Summary

Method Summary

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractPriorityDataCollector

Methods inherited from class ai.platon.pulsar.common.collect.collector.AbstractDataCollector

Methods inherited from class ai.platon.pulsar.common.collect.LocalFileHyperlinkCollector

Methods inherited from class java.lang.Object

Constructor Detail

LocalFileHyperlinkCollector

LocalFileHyperlinkCollector

Method Detail

getCapacity

getName

setName

getFileName

getLoadArgs

setLoadArgs

getHyperlinks

getSize

getPath

getCollectCount

setCollectCount

getCollectTime

getCollectedCount

setCollectedCount

getCountry

setCountry

getCreateTime

getDeadTime

setDeadTime

getDistrict

setDistrict

getEstimatedExternalSize

getEstimatedSize

getExternalSize

getFirstCollectTime

setFirstCollectTime

getId

getIsDead

getLabels

getLang

setLang

getLastCollectedTime

setLastCollectedTime

getPriority

hasMore

collectTo

dump