edu.umn.cs.spatialHadoop.mapred

Class BinaryRecordReader<K extends Writable,V extends Writable>

java.lang.Object

edu.umn.cs.spatialHadoop.mapred.BinaryRecordReader<K,V>

Type Parameters:

K -

V -

Direct Known Subclasses:

DistributedJoin.DJInputFormatArray.DJRecordReader, DistributedJoin.DJInputFormatRTree.DJRecordReader, FarthestPair.FPInputFormatArray.FPRecordReader

public abstract class BinaryRecordReader<K extends Writable,V extends Writable>
extends java.lang.Object

Reads every possible pair of values from two underlying record readers. In other words, it makes a Cartesian product from the records stored in the two splits given to this reader.

Author:

eldawy

Field Summary

Fields

Modifier and Type	Field and Description
protected Configuration	conf Configuration of the current job
protected boolean	firstTime A flag that is set before the first record is read
protected []	internalReaders The internal readers that actually do the parsing
protected float	progress1Before Progress of file 1 before reading the current record.
protected CombineFileSplit	split The two splits parsed by this record reader

Constructor Summary

Constructors

Constructor and Description
BinaryRecordReader(Configuration conf, CombineFileSplit split)

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
PairWritable<K>	createKey()
protected abstract	createRecordReader(Configuration conf, CombineFileSplit split, int index) Creates a record reader for one of the two splits parsed by this reader.
PairWritable<V>	createValue()
long	getPos()
float	getProgress()
boolean	next(PairWritable<K> key, PairWritable<V> value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

firstTime

protected boolean firstTime

A flag that is set before the first record is read

internalReaders

protected [] internalReaders

The internal readers that actually do the parsing

split

protected CombineFileSplit split

The two splits parsed by this record reader

conf

protected Configuration conf

Configuration of the current job

progress1Before

protected float progress1Before

Progress of file 1 before reading the current record. Used for progress.

Constructor Detail

BinaryRecordReader

public BinaryRecordReader(Configuration conf,
                  CombineFileSplit split)
                   throws java.io.IOException

Throws:

java.io.IOException

Method Detail

createRecordReader

protected abstract  createRecordReader(Configuration conf,
                       CombineFileSplit split,
                       int index)
                                     throws java.io.IOException

Creates a record reader for one of the two splits parsed by this reader.

Parameters:

split -

Returns:

Throws:

java.io.IOException

next

public boolean next(PairWritable<K> key,
           PairWritable<V> value)
             throws java.io.IOException

Throws:

java.io.IOException

createKey

public PairWritable<K> createKey()

createValue

public PairWritable<V> createValue()

getPos

public long getPos()
            throws java.io.IOException

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Throws:

java.io.IOException

getProgress

public float getProgress()
                  throws java.io.IOException

Throws:

java.io.IOException