edu.umn.cs.spatialHadoop.core

Class RTreeGridRecordWriter<S extends Shape>

java.lang.Object

edu.umn.cs.spatialHadoop.core.GridRecordWriter<S>

edu.umn.cs.spatialHadoop.core.RTreeGridRecordWriter<S>

All Implemented Interfaces:

ShapeRecordWriter<S>

Direct Known Subclasses:

RTreeGridRecordWriter

public class RTreeGridRecordWriter<S extends Shape>
extends GridRecordWriter<S>

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	fastRTree Whether to use the fast mode for building RTree or not.
static Log	LOG
protected int	maximumStorageOverhead The maximum storage (in bytes) that can be accepted by the user

Fields inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

blockSize, cells, cellsMbr, closingThreads, ExpandedIndexes, fileSystem, intermediateCellPath, intermediateCellRecordCount, intermediateCellSize, intermediateCellStreams, jobConf, masterFile, NEW_LINE, outDir, pack, PackedIndexes, prefix, ReplicatedIndexes, stockObject, text

Constructor Summary

Constructors

Constructor and Description
RTreeGridRecordWriter(Path outDir, JobConf job, java.lang.String prefix, CellInfo[] cells) Initializes a new RTreeGridRecordWriter.

Method Summary

Methods

Modifier and Type	Method and Description
protected Path	flushAllEntries(Path intermediateCellPath, java.io.OutputStream intermediateCellStream, Path finalCellPath) Closes a cell by writing all outstanding objects and closing current file.
protected java.io.OutputStream	getIntermediateCellStream(int cellIndex) Returns an output stream in which records are written as they come before they are finally flushed to the cell file.
protected void	writeInternal(int cellIndex, S shape) Write the given shape to the cellIndex indicated.

Methods inherited from class edu.umn.cs.spatialHadoop.core.GridRecordWriter

close, closeCell, closeCellBackground, createFinalCellStream, getFilePath, getFinalCellPath, getMasterFilePath, setStockObject, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final Log LOG

fastRTree

protected boolean fastRTree

Whether to use the fast mode for building RTree or not.

See Also:

RTree.bulkLoadWrite(byte[], int, int, int, java.io.DataOutput, boolean)

maximumStorageOverhead

protected int maximumStorageOverhead

The maximum storage (in bytes) that can be accepted by the user

Constructor Detail

RTreeGridRecordWriter

public RTreeGridRecordWriter(Path outDir,
                     JobConf job,
                     java.lang.String prefix,
                     CellInfo[] cells)
                      throws java.io.IOException

Initializes a new RTreeGridRecordWriter.

Parameters:

fileSystem - - of output file

outDir - - output file path

cells - - the cells used to partition the input

overwrite - - whether to overwrite existing files or not

Throws:

java.io.IOException

Method Detail

writeInternal

protected void writeInternal(int cellIndex,
                 S shape)
                      throws java.io.IOException

Description copied from class: GridRecordWriter

Write the given shape to the cellIndex indicated.

Overrides:

writeInternal in class GridRecordWriter<S extends Shape>

Throws:

java.io.IOException

flushAllEntries

protected Path flushAllEntries(Path intermediateCellPath,
                   java.io.OutputStream intermediateCellStream,
                   Path finalCellPath)
                        throws java.io.IOException

Closes a cell by writing all outstanding objects and closing current file. Then, the file is read again, an RTree is built on top of it and, finally, the file is written again with the RTree built.

Overrides:

flushAllEntries in class GridRecordWriter<S extends Shape>

Returns:

Throws:

java.io.IOException

getIntermediateCellStream

protected java.io.OutputStream getIntermediateCellStream(int cellIndex)
                                                  throws java.io.IOException

Description copied from class: GridRecordWriter

Returns an output stream in which records are written as they come before they are finally flushed to the cell file.

Overrides:

getIntermediateCellStream in class GridRecordWriter<S extends Shape>

Returns:

Throws:

java.io.IOException