com.cloudera.oryx.lambda

Class UpdateOffsetsFn<T>

java.lang.Object

com.cloudera.oryx.lambda.UpdateOffsetsFn<T>

Type Parameters:

T - unused

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.VoidFunction<org.apache.spark.api.java.JavaRDD<T>>

public final class UpdateOffsetsFn<T>
extends Object
implements org.apache.spark.api.java.function.VoidFunction<org.apache.spark.api.java.JavaRDD<T>>

Function that reads offset range from latest RDD in a streaming job, and updates Zookeeper/Kafka with the latest offset consumed.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
UpdateOffsetsFn(String group, String inputTopicLockMaster)

Method Summary

Modifier and Type	Method and Description
void	call(org.apache.spark.api.java.JavaRDD<T> javaRDD)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UpdateOffsetsFn

public UpdateOffsetsFn(String group,
                       String inputTopicLockMaster)

Method Detail

call

public void call(org.apache.spark.api.java.JavaRDD<T> javaRDD)

Specified by:

call in interface org.apache.spark.api.java.function.VoidFunction<org.apache.spark.api.java.JavaRDD<T>>

Parameters:

javaRDD - RDD whose underlying RDD must be an instance of HasOffsetRanges, such as KafkaRDD