Package | Description |
---|---|
com.cloudera.oryx.api.batch |
Application API interface classes for the Batch Layer.
|
com.cloudera.oryx.api.serving |
Application API interface classes for the Serving Layer.
|
com.cloudera.oryx.app.batch.mllib.als |
Contains an app tier implementation of a Batch Layer, for ALS recommendations, using Spark MLlib.
|
com.cloudera.oryx.example.batch |
Contains a minimal example of what a user application would create to implement a
Batch Layer.
|
com.cloudera.oryx.lambda |
Code used across the Lambda tier.
|
com.cloudera.oryx.lambda.batch |
Contains the core support for the Lambda tier of the Batch Layers.
|
com.cloudera.oryx.ml |
Contains the core support for the ML tier of the Batch and Speed layers.
|
Modifier and Type | Method and Description |
---|---|
void |
BatchLayerUpdate.runUpdate(org.apache.spark.api.java.JavaSparkContext sparkContext,
long timestamp,
org.apache.spark.api.java.JavaPairRDD<K,M> newData,
org.apache.spark.api.java.JavaPairRDD<K,M> pastData,
String modelDirString,
TopicProducer<String,U> modelUpdateTopic) |
Modifier and Type | Method and Description |
---|---|
protected TopicProducer<?,?> |
OryxResource.getInputProducer() |
Modifier and Type | Method and Description |
---|---|
void |
ALSUpdate.publishAdditionalModelData(org.apache.spark.api.java.JavaSparkContext sparkContext,
org.dmg.pmml.PMML pmml,
org.apache.spark.api.java.JavaRDD<String> newData,
org.apache.spark.api.java.JavaRDD<String> pastData,
org.apache.hadoop.fs.Path modelParentPath,
TopicProducer<String,String> modelUpdateTopic) |
Modifier and Type | Method and Description |
---|---|
void |
ExampleBatchLayerUpdate.runUpdate(org.apache.spark.api.java.JavaSparkContext sparkContext,
long timestamp,
org.apache.spark.api.java.JavaPairRDD<String,String> newData,
org.apache.spark.api.java.JavaPairRDD<String,String> pastData,
String modelDirString,
TopicProducer<String,String> modelUpdateTopic) |
Modifier and Type | Class and Description |
---|---|
class |
TopicProducerImpl<K,M>
Wraps access to a Kafka message topic
Producer . |
Modifier and Type | Method and Description |
---|---|
void |
ScalaBatchLayerUpdateAdapter.runUpdate(org.apache.spark.api.java.JavaSparkContext sparkContext,
long timestamp,
org.apache.spark.api.java.JavaPairRDD<K,M> newData,
org.apache.spark.api.java.JavaPairRDD<K,M> pastData,
String modelDirString,
TopicProducer<String,U> modelUpdateTopic) |
Modifier and Type | Method and Description |
---|---|
void |
MLUpdate.publishAdditionalModelData(org.apache.spark.api.java.JavaSparkContext sparkContext,
org.dmg.pmml.PMML pmml,
org.apache.spark.api.java.JavaRDD<M> newData,
org.apache.spark.api.java.JavaRDD<M> pastData,
org.apache.hadoop.fs.Path modelParentPath,
TopicProducer<String,String> modelUpdateTopic)
Optionally, publish additional model-related information to the update topic,
after the model has been written.
|
void |
MLUpdate.runUpdate(org.apache.spark.api.java.JavaSparkContext sparkContext,
long timestamp,
org.apache.spark.api.java.JavaPairRDD<Object,M> newKeyMessageData,
org.apache.spark.api.java.JavaPairRDD<Object,M> pastKeyMessageData,
String modelDirString,
TopicProducer<String,String> modelUpdateTopic) |
Copyright © 2014–2018. All rights reserved.