com.cloudera.oryx.app.common.fn

Class MLFunctions

java.lang.Object

com.cloudera.oryx.app.common.fn.MLFunctions

public final class MLFunctions
extends Object

Contains some reusable functions that are useful for ML-related apps from this project itself, and based on MLlib too.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.spark.api.java.function.Function<String,String[]>	PARSE_FN Parses a CSV or JSON array to String[]
static org.apache.spark.api.java.function.Function<Iterable<Double>,Double>	SUM_WITH_NAN
static org.apache.spark.api.java.function.Function<String,Long>	TO_TIMESTAMP_FN Parses as if with PARSE_FN and returns fourth field as timestamp

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARSE_FN

public static final org.apache.spark.api.java.function.Function<String,String[]> PARSE_FN

Parses a CSV or JSON array to String[]

TO_TIMESTAMP_FN

public static final org.apache.spark.api.java.function.Function<String,Long> TO_TIMESTAMP_FN

Parses as if with PARSE_FN and returns fourth field as timestamp

SUM_WITH_NAN

public static final org.apache.spark.api.java.function.Function<Iterable<Double>,Double> SUM_WITH_NAN