MapReduce.MapEmitter<K,V>, MapReduce.NullObject, MapReduce.ReduceEmitter<OK,OV>, MapReduce.StageMAP_REDUCE| Constructor and Description |
|---|
MapReduceB() |
| Modifier and Type | Method and Description |
|---|---|
boolean |
doStage(MapReduce.Stage stage)
A MapReduce job can be map-only, map-reduce-only, or map-combine-reduce.
|
List<Integer> |
generateFinalResult(Iterator<KeyValue<Integer,Integer>> keyValues)
The key/value pairs emitted by reduce() (or map() in a map-only job) can be iterated to generate a local JVM Java object.
|
String |
getMemoryKey()
The results of the MapReduce job are associated with a memory-key to ultimately be stored in
Memory. |
Optional<Comparator<Integer>> |
getReduceKeySort()
If a
Comparator is provided, then all pairs leaving the MapReduce.ReduceEmitter are sorted. |
void |
map(Vertex vertex,
MapReduce.MapEmitter<Integer,Integer> emitter)
The map() method is logically executed at all vertices in the graph in parallel.
|
void |
reduce(Integer key,
Iterator<Integer> values,
MapReduce.ReduceEmitter<Integer,Integer> emitter)
The reduce() method is logically on the "machine" the respective key hashes to.
|
clone, equals, hashCode, storeState, toStringfinalize, getClass, notify, notifyAll, wait, wait, waitaddResultToMemory, combine, createMapReduce, getMapKeySort, loadState, workerEnd, workerStartpublic boolean doStage(MapReduce.Stage stage)
MapReducestage - the stage to check for definition.public void map(Vertex vertex, MapReduce.MapEmitter<Integer,Integer> emitter)
MapReduceMapReduce classes must at least provide an implementation of MapReduce#map(Vertex, MapEmitter).vertex - the current vertex being map() processed.emitter - the component that allows for key/value pairs to be emitted to the next stage.public void reduce(Integer key, Iterator<Integer> values, MapReduce.ReduceEmitter<Integer,Integer> emitter)
MapReducekey - the key that has aggregated valuesvalues - the aggregated values associated with the keyemitter - the component that allows for key/value pairs to be emitted as the final result.public Optional<Comparator<Integer>> getReduceKeySort()
MapReduceComparator is provided, then all pairs leaving the MapReduce.ReduceEmitter are sorted.
If sorting is not required, then Optional.empty() should be returned as sorting is computationally expensive.
The default implementation returns Optional.empty().Optional of a comparator for sorting the reduce output.public String getMemoryKey()
MapReduceMemory.public List<Integer> generateFinalResult(Iterator<KeyValue<Integer,Integer>> keyValues)
MapReducekeyValues - the key/value pairs that were emitted from reduce() (or map() in a map-only job)Copyright © 2013–2019 Apache Software Foundation. All rights reserved.