com.cloudera.oryx.common.lang

Class ExecUtils

java.lang.Object

com.cloudera.oryx.common.lang.ExecUtils

public final class ExecUtils
extends Object

Utility methods for executing tasks in parallel, possibly returning a result and possibly using a private pool, using Java 8 abstractions.

Method Summary

Modifier and Type	Method and Description
static <T,R> R	collectInParallel(int numTasks, int parallelism, boolean privatePool, Function<Integer,T> task, Collector<T,?,R> collector)
static void	doInParallel(int numTasks, Consumer<Integer> task)
static void	doInParallel(int numTasks, int parallelism, boolean privatePool, Consumer<Integer> task)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

doInParallel

public static void doInParallel(int numTasks,
                                Consumer<Integer> task)

Parameters:

numTasks - how many copies of task to run; all may be run simultaneously, and a shared thread pool is used

task - task to execute; takes an Integer argument that is the index of the task that has been executed in [0, numTasks)

doInParallel

public static void doInParallel(int numTasks,
                                int parallelism,
                                boolean privatePool,
                                Consumer<Integer> task)

Parameters:

numTasks - how many copies of task to run

parallelism - maximum how many tasks to run simultaneously

privatePool - whether to create and use a new private thread pool; otherwise a shared pool is used. No parallelism or pool is used if parallelism is 1

task - task to execute; takes an Integer argument that is the index of the task that has been executed in [0, numTasks)

collectInParallel

public static <T,R> R collectInParallel(int numTasks,
                                        int parallelism,
                                        boolean privatePool,
                                        Function<Integer,T> task,
                                        Collector<T,?,R> collector)

Type Parameters:

T - type produced by each task

R - type produced by collector from task results

Parameters:

numTasks - how many copies of task to run

parallelism - maximum how many tasks to run simultaneously

privatePool - whether to create and use a new private thread pool; otherwise a shared pool is used. No parallelism or pool is used if parallelism is 1

task - task to execute; takes an Integer argument that is the index of the task that has been executed in [0, numTasks) and returns some value

collector - instance used to collect results into the return value

Returns:

result of collecting individual task results