-
- All Implemented Interfaces:
-
ai.platon.pulsar.common.config.Configurable,ai.platon.pulsar.crawl.protocol.Protocol,java.lang.AutoCloseable
public abstract class AbstractNativeHttpProtocol extends AbstractHttpProtocol
-
-
Field Summary
Fields Modifier and Type Field Description public final static intBUFFER_SIZE
-
Constructor Summary
Constructors Constructor Description AbstractNativeHttpProtocol()Creates a new instance of HttpBase
-
Method Summary
Modifier and Type Method Description voidsetConf(ImmutableConfig jobConf)Array<byte>processGzipEncoded(Array<byte> compressed, URL url)Array<byte>processDeflateEncoded(Array<byte> compressed, URL url)abstract ResponsegetResponse(@NotNull() String url, @NotNull() WebPage page, boolean followRedirects)-
Methods inherited from class ai.platon.pulsar.crawl.protocol.http.AbstractHttpProtocol
close, getConf, getProtocolOutput, getProtocolOutputDeferred, getResponse, getResponseDeferred, getResponses, getRobotRules, getSupportParallel, isActive, reset, setConf, toString -
Methods inherited from class ai.platon.pulsar.crawl.protocol.Protocol
cancel, cancelAll, getProtocolOutput, getResponses, getRobotRules, getSupportParallel, setResponse -
Methods inherited from class ai.platon.pulsar.common.config.Configurable
getConf, setConf -
Methods inherited from class java.lang.AutoCloseable
close -
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
-
Method Detail
-
setConf
void setConf(ImmutableConfig jobConf)
-
processGzipEncoded
Array<byte> processGzipEncoded(Array<byte> compressed, URL url)
-
processDeflateEncoded
Array<byte> processDeflateEncoded(Array<byte> compressed, URL url)
-
getResponse
abstract Response getResponse(@NotNull() String url, @NotNull() WebPage page, boolean followRedirects)
-
-
-
-