edu.umn.cs.spatialHadoop.mapred

Class GridRecordWriter<S extends Shape>

java.lang.Object

edu.umn.cs.spatialHadoop.core.GridRecordWriter<S>

edu.umn.cs.spatialHadoop.mapred.GridRecordWriter<S>

Type Parameters:

S -

All Implemented Interfaces:

ShapeRecordWriter<S>

public class GridRecordWriter<S extends Shape>
extends GridRecordWriter<S>

A record writer that can be used in MapReduce programs to write an index file where the key is the cell ID and the value is the shape to write to that cell. A given shape is not implicitly replicated to any other cells other than the one provided.

Author:

Ahmed Eldawy

Field Summary

Fields inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

blockSize, cells, cellsMbr, closingThreads, ExpandedIndexes, fileSystem, intermediateCellPath, intermediateCellRecordCount, intermediateCellSize, intermediateCellStreams, jobConf, LOG, masterFile, NEW_LINE, outDir, pack, PackedIndexes, prefix, ReplicatedIndexes, stockObject, text

Constructor Summary

Constructors

Constructor and Description
GridRecordWriter(JobConf job, java.lang.String name, CellInfo[] cells)

Method Summary

Methods

Modifier and Type	Method and Description
void	close(Reporter reporter) Close the whole writer.
void	write(IntWritable key, S value) Writes the given shape to the file to all cells it overlaps with

Methods inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

closeCell, closeCellBackground, createFinalCellStream, flushAllEntries, getFilePath, getFinalCellPath, getIntermediateCellStream, getMasterFilePath, setStockObject, writeInternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridRecordWriter

public GridRecordWriter(JobConf job,
                java.lang.String name,
                CellInfo[] cells)
                 throws java.io.IOException

Throws:

java.io.IOException

Method Detail

write

public void write(IntWritable key,
         S value)
           throws java.io.IOException

Description copied from interface: ShapeRecordWriter

Writes the given shape to the file to all cells it overlaps with

Specified by:

write in interface ShapeRecordWriter<S extends Shape>

Overrides:

write in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException

close

public void close(Reporter reporter)
           throws java.io.IOException

Description copied from class: GridRecordWriter

Close the whole writer. Finalize all cell files and concatenate them into the output file.

Specified by:

close in interface ShapeRecordWriter<S extends Shape>

Overrides:

close in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException