edu.umn.cs.spatialHadoop.mapred

Class GridRecordWriter2<S extends Shape>

java.lang.Object

edu.umn.cs.spatialHadoop.core.GridRecordWriter<S>

edu.umn.cs.spatialHadoop.mapred.GridRecordWriter2<S>

Type Parameters:

S -

All Implemented Interfaces:

ShapeRecordWriter<S>

public class GridRecordWriter2<S extends Shape>
extends GridRecordWriter<S>

A record writer that can be used in MapReduce programs. It writes pairs where the key is NullWritable(i.e., not provided) and the value is a shape. The given shape is replicated to every cell it overlaps with.

Author:

Ahmed Eldawy

Field Summary

Fields inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

blockSize, cells, cellsMbr, closingThreads, ExpandedIndexes, fileSystem, intermediateCellPath, intermediateCellRecordCount, intermediateCellSize, intermediateCellStreams, jobConf, LOG, masterFile, NEW_LINE, outDir, pack, PackedIndexes, prefix, ReplicatedIndexes, stockObject, text

Constructor Summary

Constructors

Constructor and Description
GridRecordWriter2(JobConf job, java.lang.String name, CellInfo[] cells)

Method Summary

Methods

Modifier and Type	Method and Description
void	close(Reporter reporter) Close the whole writer.
void	write(NullWritable key, S value) Writes the given shape to the file to all cells it overlaps with

Methods inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

closeCell, closeCellBackground, createFinalCellStream, flushAllEntries, getFilePath, getFinalCellPath, getIntermediateCellStream, getMasterFilePath, setStockObject, writeInternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridRecordWriter2

public GridRecordWriter2(JobConf job,
                 java.lang.String name,
                 CellInfo[] cells)
                  throws java.io.IOException

Throws:

java.io.IOException

Method Detail

write

public void write(NullWritable key,
         S value)
           throws java.io.IOException

Description copied from interface: ShapeRecordWriter

Writes the given shape to the file to all cells it overlaps with

Specified by:

write in interface ShapeRecordWriter<S extends Shape>

Overrides:

write in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException

close

public void close(Reporter reporter)
           throws java.io.IOException

Description copied from class: GridRecordWriter

Close the whole writer. Finalize all cell files and concatenate them into the output file.

Specified by:

close in interface ShapeRecordWriter<S extends Shape>

Overrides:

close in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException