public final class TraverserMapReduce extends StaticMapReduce<Comparable,Object,Comparable,Object,Iterator<Object>>
MapReduce.MapEmitter<K,V>, MapReduce.NullObject, MapReduce.ReduceEmitter<OK,OV>, MapReduce.Stage
Modifier and Type | Field and Description |
---|---|
static String |
TRAVERSERS |
MAP_REDUCE
Constructor and Description |
---|
TraverserMapReduce(Step traversalEndStep) |
Modifier and Type | Method and Description |
---|---|
boolean |
doStage(MapReduce.Stage stage)
A MapReduce job can be map-only, map-reduce-only, or map-combine-reduce.
|
boolean |
equals(Object object) |
Iterator<Object> |
generateFinalResult(Iterator<KeyValue<Comparable,Object>> keyValues)
The key/value pairs emitted by reduce() (or map() in a map-only job) can be iterated to generate a local JVM Java object.
|
Optional<Comparator<Comparable>> |
getMapKeySort()
If a
Comparator is provided, then all pairs leaving the MapReduce.MapEmitter are sorted. |
String |
getMemoryKey()
The results of the MapReduce job are associated with a memory-key to ultimately be stored in
Memory . |
int |
hashCode() |
void |
loadState(Configuration configuration)
When it is necessary to load the state of a MapReduce job, this method is called.
|
void |
map(Vertex vertex,
MapReduce.MapEmitter<Comparable,Object> emitter)
The map() method is logically executed at all vertices in the graph in parallel.
|
String |
toString() |
clone, storeState
finalize, getClass, notify, notifyAll, wait, wait, wait
addResultToMemory, combine, createMapReduce, getReduceKeySort, reduce, workerEnd, workerStart
public static final String TRAVERSERS
public TraverserMapReduce(Step traversalEndStep)
public void loadState(Configuration configuration)
MapReduce
configuration
- the configuration to load the state of the MapReduce job from.public boolean doStage(MapReduce.Stage stage)
MapReduce
stage
- the stage to check for definition.public void map(Vertex vertex, MapReduce.MapEmitter<Comparable,Object> emitter)
MapReduce
vertex
- the current vertex being map() processed.emitter
- the component that allows for key/value pairs to be emitted to the next stage.public Optional<Comparator<Comparable>> getMapKeySort()
MapReduce
Comparator
is provided, then all pairs leaving the MapReduce.MapEmitter
are sorted.
The sorted results are either fed sorted to the combine/reduce-stage or as the final output.
If sorting is not required, then Optional.empty()
should be returned as sorting is computationally expensive.
The default implementation returns Optional.empty()
.Optional
of a comparator for sorting the map output.public Iterator<Object> generateFinalResult(Iterator<KeyValue<Comparable,Object>> keyValues)
MapReduce
keyValues
- the key/value pairs that were emitted from reduce() (or map() in a map-only job)public String getMemoryKey()
MapReduce
Memory
.public int hashCode()
hashCode
in class StaticMapReduce<Comparable,Object,Comparable,Object,Iterator<Object>>
public boolean equals(Object object)
equals
in class StaticMapReduce<Comparable,Object,Comparable,Object,Iterator<Object>>
public String toString()
toString
in class StaticMapReduce<Comparable,Object,Comparable,Object,Iterator<Object>>
Copyright © 2013–2015 Apache Software Foundation. All rights reserved.