Module io.annot8.components.opennlp

Package io.annot8.components.opennlp.processors

Class Tokenizer

java.lang.Object

io.annot8.common.components.AbstractComponentDescriptor<T,S>

io.annot8.common.components.AbstractProcessorDescriptor<Tokenizer.Processor,io.annot8.api.settings.NoSettings>

io.annot8.components.opennlp.processors.Tokenizer

All Implemented Interfaces:

io.annot8.api.components.Annot8ComponentDescriptor<Tokenizer.Processor,io.annot8.api.settings.NoSettings>, io.annot8.api.components.ProcessorDescriptor<Tokenizer.Processor,io.annot8.api.settings.NoSettings>

@ComponentName("OpenNLP Tokenizer")
@ComponentDescription("Tokenizes words and sentences using OpenNLP tokenization models")
public class Tokenizer
extends io.annot8.common.components.AbstractProcessorDescriptor<Tokenizer.Processor,io.annot8.api.settings.NoSettings>

Tokenizes words and sentences using OpenNLP tokenization models

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	Tokenizer.Processor

Constructor Summary

Constructors

Constructor	Description
Tokenizer()

Method Summary

Modifier and Type	Method	Description
io.annot8.api.capabilities.Capabilities	capabilities()
protected Tokenizer.Processor	createComponent(io.annot8.api.context.Context context, io.annot8.api.settings.NoSettings settings)

Methods inherited from class io.annot8.common.components.AbstractComponentDescriptor

create, getName, getSettings, setName, setSettings

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.annot8.api.components.Annot8ComponentDescriptor

create, getName, getSettings, setName, setSettings

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

createComponent

protected Tokenizer.Processor createComponent(io.annot8.api.context.Context context,
                                              io.annot8.api.settings.NoSettings settings)

Specified by:

createComponent in class io.annot8.common.components.AbstractComponentDescriptor<Tokenizer.Processor,io.annot8.api.settings.NoSettings>

capabilities

public io.annot8.api.capabilities.Capabilities capabilities()