cz.o2.proxima.beam.storage

Class TestStreamStorage

java.lang.Object

cz.o2.proxima.beam.storage.TestStreamStorage

All Implemented Interfaces:

DataAccessorFactory, cz.o2.proxima.storage.internal.AbstractDataAccessorFactory<BeamDataOperator,DataAccessor>, java.io.Serializable

@AutoService(value=cz.o2.proxima.beam.core.DataAccessorFactory.class)
public class TestStreamStorage
extends java.lang.Object
implements DataAccessorFactory

Storage with URI scheme test-stream://. This storage is backed by TestStream and enables fine tuning with regard to watermark and other stream aspects.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	TestStreamStorage.StreamProviders

Nested classes/interfaces inherited from interface cz.o2.proxima.storage.internal.AbstractDataAccessorFactory

cz.o2.proxima.storage.internal.AbstractDataAccessorFactory.Accept

Field Summary

Fields

Modifier and Type	Field and Description
private cz.o2.proxima.repository.Repository	repo
private static java.util.Map<cz.o2.proxima.repository.Repository,TestStreamStorage.StreamProviders>	storages

Constructor Summary

Constructors

Constructor and Description
TestStreamStorage()

Method Summary

Modifier and Type	Method and Description
cz.o2.proxima.storage.internal.AbstractDataAccessorFactory.Accept	accepts(java.net.URI uri)
DataAccessor	createAccessor(BeamDataOperator operator, cz.o2.proxima.repository.AttributeFamilyDescriptor familyDescriptor)
private TestStreamStorage.StreamProviders	providers()
static void	putStream(cz.o2.proxima.repository.Repository repo, cz.o2.proxima.repository.AttributeFamilyDescriptor family, org.apache.beam.sdk.testing.TestStream<cz.o2.proxima.storage.StreamElement> stream) Put given TestStream for given AttributeFamilyDescriptor.
static com.typesafe.config.Config	replaceStorages(com.typesafe.config.Config config) Replace all storages in all attribute families in given config with test-stream.
static com.typesafe.config.Config	replaceStorages(com.typesafe.config.Config config, cz.o2.proxima.functional.UnaryPredicate<java.lang.String> familyFilter) Replace all storages in all attribute families in given config with test-stream.
void	setup(cz.o2.proxima.repository.Repository repo)
private org.apache.beam.sdk.values.PCollection<cz.o2.proxima.storage.StreamElement>	streamFor(org.apache.beam.sdk.Pipeline pipeline, java.net.URI uri)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

storages

private static final java.util.Map<cz.o2.proxima.repository.Repository,TestStreamStorage.StreamProviders> storages

repo

private cz.o2.proxima.repository.Repository repo

Constructor Detail

TestStreamStorage

public TestStreamStorage()

Method Detail

replaceStorages

public static com.typesafe.config.Config replaceStorages(com.typesafe.config.Config config)

Replace all storages in all attribute families in given config with test-stream.

Parameters:

config - the configuration to replace

Returns:

replaced config

replaceStorages

public static com.typesafe.config.Config replaceStorages(com.typesafe.config.Config config,
                                                         cz.o2.proxima.functional.UnaryPredicate<java.lang.String> familyFilter)

Replace all storages in all attribute families in given config with test-stream.

Parameters:

config - the configuration to replace

familyFilter - filter for families to replace storage in

Returns:

replaced config

putStream

public static void putStream(cz.o2.proxima.repository.Repository repo,
                             cz.o2.proxima.repository.AttributeFamilyDescriptor family,
                             org.apache.beam.sdk.testing.TestStream<cz.o2.proxima.storage.StreamElement> stream)

Put given TestStream for given AttributeFamilyDescriptor.

Parameters:

repo - repository

family - attribute family descriptor

stream - the stream to use as data source

setup

public void setup(cz.o2.proxima.repository.Repository repo)

Specified by:

setup in interface cz.o2.proxima.storage.internal.AbstractDataAccessorFactory<BeamDataOperator,DataAccessor>

accepts

public cz.o2.proxima.storage.internal.AbstractDataAccessorFactory.Accept accepts(java.net.URI uri)

Specified by:

accepts in interface cz.o2.proxima.storage.internal.AbstractDataAccessorFactory<BeamDataOperator,DataAccessor>

createAccessor

public DataAccessor createAccessor(BeamDataOperator operator,
                                   cz.o2.proxima.repository.AttributeFamilyDescriptor familyDescriptor)

Specified by:

createAccessor in interface cz.o2.proxima.storage.internal.AbstractDataAccessorFactory<BeamDataOperator,DataAccessor>

streamFor

private org.apache.beam.sdk.values.PCollection<cz.o2.proxima.storage.StreamElement> streamFor(org.apache.beam.sdk.Pipeline pipeline,
                                                                                              java.net.URI uri)

providers

private TestStreamStorage.StreamProviders providers()