edu.umn.cs.spatialHadoop.mapred

Class GridRecordWriter3<S extends Shape>

java.lang.Object

edu.umn.cs.spatialHadoop.core.GridRecordWriter<S>

edu.umn.cs.spatialHadoop.mapred.GridRecordWriter3<S>

Type Parameters:

S -

All Implemented Interfaces:

ShapeRecordWriter<S>

public class GridRecordWriter3<S extends Shape>
extends GridRecordWriter<S>

A record writer to be used to write the output of MapReduce programs to a spatial index. The key is a rectangle which indicates the MBR of the partition and value is a shape. This record writer does not replicate the given shape to partition (i.e., write it only to the given partition). If the provided rectangle (key) does not match any of the existing partitions, a new partition is created with the given boundaries.

Author:

Ahmed Eldawy

Field Summary

Fields inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

blockSize, cells, cellsMbr, closingThreads, ExpandedIndexes, fileSystem, intermediateCellPath, intermediateCellRecordCount, intermediateCellSize, intermediateCellStreams, jobConf, LOG, masterFile, NEW_LINE, outDir, pack, PackedIndexes, prefix, ReplicatedIndexes, stockObject, text

Constructor Summary

Constructors

Constructor and Description
GridRecordWriter3(JobConf job, java.lang.String name, CellInfo[] cells)

Method Summary

Methods

Modifier and Type	Method and Description
void	close(Reporter reporter) Close the whole writer.
void	write(Rectangle key, S value) Writes the given shape to the file to all cells it overlaps with

Methods inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

closeCell, closeCellBackground, createFinalCellStream, flushAllEntries, getFilePath, getFinalCellPath, getIntermediateCellStream, getMasterFilePath, setStockObject, writeInternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GridRecordWriter3

public GridRecordWriter3(JobConf job,
                 java.lang.String name,
                 CellInfo[] cells)
                  throws java.io.IOException

Throws:

java.io.IOException

Method Detail

write

public void write(Rectangle key,
         S value)
           throws java.io.IOException

Description copied from interface: ShapeRecordWriter

Writes the given shape to the file to all cells it overlaps with

Specified by:

write in interface ShapeRecordWriter<S extends Shape>

Overrides:

write in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException

close

public void close(Reporter reporter)
           throws java.io.IOException

Description copied from class: GridRecordWriter

Close the whole writer. Finalize all cell files and concatenate them into the output file.

Specified by:

close in interface ShapeRecordWriter<S extends Shape>

Overrides:

close in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException