com.cloudera.oryx.lambda.speed

Class ScalaSpeedModelManagerAdapter<K,M,U>

java.lang.Object

com.cloudera.oryx.lambda.speed.ScalaSpeedModelManagerAdapter<K,M,U>

Type Parameters:

K - type of key read from input topic

M - type of message read from input topic

U - type of update message read/written

All Implemented Interfaces:

SpeedModelManager<K,M,U>, Closeable, AutoCloseable

public final class ScalaSpeedModelManagerAdapter<K,M,U>
extends Object
implements SpeedModelManager<K,M,U>

Adapts a ScalaSpeedModelManager to be a Java SpeedModelManager.

Constructor Summary

Constructors

Constructor and Description
ScalaSpeedModelManagerAdapter(com.cloudera.oryx.api.speed.ScalaSpeedModelManager<K,M,U> scalaManager)

Method Summary

Modifier and Type	Method and Description
Iterable<U>	buildUpdates(org.apache.spark.api.java.JavaPairRDD<K,M> newData)
void	close()
void	consume(Iterator<KeyMessage<String,U>> updateIterator, org.apache.hadoop.conf.Configuration hadoopConf) Called by the framework to initiate a continuous process of reading models, and reading from the input topic and updating model state in memory, and issuing updates to the update topic.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ScalaSpeedModelManagerAdapter

public ScalaSpeedModelManagerAdapter(com.cloudera.oryx.api.speed.ScalaSpeedModelManager<K,M,U> scalaManager)

Method Detail

consume

public void consume(Iterator<KeyMessage<String,U>> updateIterator,
                    org.apache.hadoop.conf.Configuration hadoopConf)

Description copied from interface: SpeedModelManager

Called by the framework to initiate a continuous process of reading models, and reading from the input topic and updating model state in memory, and issuing updates to the update topic. This will be executed asynchronously and may block. Note that an exception or error thrown from this method is fatal and shuts down processing.

Specified by:

consume in interface SpeedModelManager<K,M,U>

Parameters:

updateIterator - iterator to read models from

hadoopConf - Hadoop context, which may be required for reading from HDFS

buildUpdates

public Iterable<U> buildUpdates(org.apache.spark.api.java.JavaPairRDD<K,M> newData)

Specified by:

buildUpdates in interface SpeedModelManager<K,M,U>

Parameters:

newData - RDD of raw new data from the topic

Returns:

updates to publish on the update topic

close

public void close()

Specified by:

close in interface SpeedModelManager<K,M,U>

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable