edu.umn.cs.spatialHadoop.operations

Class Sampler

java.lang.Object

edu.umn.cs.spatialHadoop.operations.Sampler

public class Sampler
extends java.lang.Object

Reads a random sample of a file.

Author:

Ahmed Eldawy

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Sampler.Map
static class	Sampler.Reduce The job of the reduce function is to change the key from NullWritableRnd to NullWritable.

Field Summary

Fields

Modifier and Type	Field and Description
static long	sizeOfLastProcessedFile Keeps track of the (uncompressed) size of the last processed file or directory.

Constructor Summary

Constructors

Constructor and Description
Sampler()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)
static void	sample(Path[] inputFiles, ResultCollector<? extends TextSerializable> output, OperationsParams params)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sizeOfLastProcessedFile

public static long sizeOfLastProcessedFile

Keeps track of the (uncompressed) size of the last processed file or directory.

Constructor Detail

Sampler

public Sampler()

Method Detail

sample

public static void sample(Path[] inputFiles,
          ResultCollector<? extends TextSerializable> output,
          OperationsParams params)
                   throws java.io.IOException

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Throws:

java.io.IOException