Criterion.Measurement

criterion-1.2.1.0: Robust, reliable performance measurement and analysis

Copyright | (c) 2009-2014 Bryan O'Sullivan
License | BSD-style
Maintainer | bos@serpentine.com
Stability | experimental
Portability | GHC
Safe Haskell | Trustworthy
Language | Haskell2010

Criterion.Measurement

Contents

- Deprecated

Description

Benchmark measurement code.

Synopsis

- initializeTime :: IO ()
- getTime :: IO Double
- getCPUTime :: IO Double
- getCycles :: IO Word64
- getGCStatistics :: IO (Maybe GCStatistics)
- data GCStatistics = GCStatistics {
  - gcStatsBytesAllocated :: !Int64
  - gcStatsNumGcs :: !Int64
  - gcStatsMaxBytesUsed :: !Int64
  - gcStatsNumByteUsageSamples :: !Int64
  - gcStatsCumulativeBytesUsed :: !Int64
  - gcStatsBytesCopied :: !Int64
  - gcStatsCurrentBytesUsed :: !Int64
  - gcStatsCurrentBytesSlop :: !Int64
  - gcStatsMaxBytesSlop :: !Int64
  - gcStatsPeakMegabytesAllocated :: !Int64
  - gcStatsMutatorCpuSeconds :: !Double
  - gcStatsMutatorWallSeconds :: !Double
  - gcStatsGcCpuSeconds :: !Double
  - gcStatsGcWallSeconds :: !Double
  - gcStatsCpuSeconds :: !Double
  - gcStatsWallSeconds :: !Double
  }
- secs :: Double -> String
- measure :: Benchmarkable -> Int64 -> IO (Measured, Double)
- runBenchmark :: Benchmarkable -> Double -> IO (Vector Measured, Double)
- runBenchmarkable :: Benchmarkable -> Int64 -> (a -> a -> a) -> (IO () -> IO a) -> IO a
- runBenchmarkable_ :: Benchmarkable -> Int64 -> IO ()
- measured :: Measured
- applyGCStatistics :: Maybe GCStatistics -> Maybe GCStatistics -> Measured -> Measured
- threshold :: Double
- getGCStats :: IO (Maybe GCStats)
- applyGCStats :: Maybe GCStats -> Maybe GCStats -> Measured -> Measured

# Documentation

initializeTime :: IO () #

Set up time measurement.

getTime :: IO Double #

Return the current wallclock time, in seconds since some arbitrary time.

You must call `initializeTime` once before calling this function!

getCPUTime :: IO Double #

Return the amount of elapsed CPU time, combining user and kernel (system) time into a single measure.

getCycles :: IO Word64 #

Read the CPU cycle counter.

getGCStatistics :: IO (Maybe GCStatistics) #

Try to get GC statistics, bearing in mind that the GHC runtime will throw an exception if statistics collection was not enabled using "`+RTS -T`".

data GCStatistics #

Statistics about memory usage and the garbage collector. Apart from `gcStatsCurrentBytesUsed` and `gcStatsCurrentBytesSlop` all are cumulative values since the program started.

`GCStatistics` is cargo-culted from the `GCStats` data type that GHC.Stats has. Since `GCStats` was marked as deprecated and will be removed in GHC 8.4, we use `GCStatistics` to provide a backwards-compatible view of GC statistics.

Constructors

GCStatistics |
Fields gcStatsBytesAllocated :: !Int64 Total number of bytes allocated gcStatsNumGcs :: !Int64 Number of garbage collections performed (any generation, major and minor) gcStatsMaxBytesUsed :: !Int64 Maximum number of live bytes seen so far gcStatsNumByteUsageSamples :: !Int64 Number of byte usage samples taken, or equivalently the number of major GCs performed. gcStatsCumulativeBytesUsed :: !Int64 Sum of all byte usage samples, can be used with `gcStatsNumByteUsageSamples` to calculate averages with arbitrary weighting (if you are sampling this record multiple times). gcStatsBytesCopied :: !Int64 Number of bytes copied during GC gcStatsCurrentBytesUsed :: !Int64 Number of live bytes at the end of the last major GC gcStatsCurrentBytesSlop :: !Int64 Current number of bytes lost to slop gcStatsMaxBytesSlop :: !Int64 Maximum number of bytes lost to slop at any one time so far gcStatsPeakMegabytesAllocated :: !Int64 Maximum number of megabytes allocated gcStatsMutatorCpuSeconds :: !Double CPU time spent running mutator threads. This does not include any profiling overhead or initialization. gcStatsMutatorWallSeconds :: !Double Wall clock time spent running mutator threads. This does not include initialization. gcStatsGcCpuSeconds :: !Double CPU time spent running GC gcStatsGcWallSeconds :: !Double Wall clock time spent running GC gcStatsCpuSeconds :: !Double Total CPU time elapsed since program start gcStatsWallSeconds :: !Double Total wall clock time elapsed since start

Instances

Eq GCStatistics # |
Methods (==) :: GCStatistics -> GCStatistics -> Bool # (/=) :: GCStatistics -> GCStatistics -> Bool #
Data GCStatistics # |
Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> GCStatistics -> c GCStatistics # gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c GCStatistics # toConstr :: GCStatistics -> Constr # dataTypeOf :: GCStatistics -> DataType # dataCast1 :: Typeable (* -> *) t => (forall d. Data d => c (t d)) -> Maybe (c GCStatistics) # dataCast2 :: Typeable (* -> * -> *) t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c GCStatistics) # gmapT :: (forall b. Data b => b -> b) -> GCStatistics -> GCStatistics # gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> GCStatistics -> r # gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> GCStatistics -> r # gmapQ :: (forall d. Data d => d -> u) -> GCStatistics -> [u] # gmapQi :: Int -> (forall d. Data d => d -> u) -> GCStatistics -> u # gmapM :: Monad m => (forall d. Data d => d -> m d) -> GCStatistics -> m GCStatistics # gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> GCStatistics -> m GCStatistics # gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> GCStatistics -> m GCStatistics #
Read GCStatistics # |
Methods readsPrec :: Int -> ReadS GCStatistics # readList :: ReadS [GCStatistics] # readPrec :: ReadPrec GCStatistics # readListPrec :: ReadPrec [GCStatistics] #
Show GCStatistics # |
Methods showsPrec :: Int -> GCStatistics -> ShowS # show :: GCStatistics -> String # showList :: [GCStatistics] -> ShowS #
Generic GCStatistics # |
Associated Types type Rep GCStatistics :: * -> * # Methods from :: GCStatistics -> Rep GCStatistics x # to :: Rep GCStatistics x -> GCStatistics #
type Rep GCStatistics # |
type Rep GCStatistics = D1 (MetaData "GCStatistics" "Criterion.Measurement" "criterion-1.2.1.0-drG9X4sMg93XFqukoQr0r" False) (C1 (MetaCons "GCStatistics" PrefixI True) ((:*:) ((:*:) ((:*:) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsBytesAllocated") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64)) (S1 (MetaSel (Just Symbol "gcStatsNumGcs") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64))) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsMaxBytesUsed") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64)) (S1 (MetaSel (Just Symbol "gcStatsNumByteUsageSamples") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64)))) ((:*:) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsCumulativeBytesUsed") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64)) (S1 (MetaSel (Just Symbol "gcStatsBytesCopied") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64))) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsCurrentBytesUsed") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64)) (S1 (MetaSel (Just Symbol "gcStatsCurrentBytesSlop") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64))))) ((:*:) ((:*:) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsMaxBytesSlop") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64)) (S1 (MetaSel (Just Symbol "gcStatsPeakMegabytesAllocated") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Int64))) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsMutatorCpuSeconds") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Double)) (S1 (MetaSel (Just Symbol "gcStatsMutatorWallSeconds") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Double)))) ((:*:) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsGcCpuSeconds") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Double)) (S1 (MetaSel (Just Symbol "gcStatsGcWallSeconds") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Double))) ((:*:) (S1 (MetaSel (Just Symbol "gcStatsCpuSeconds") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Double)) (S1 (MetaSel (Just Symbol "gcStatsWallSeconds") NoSourceUnpackedness SourceStrict DecidedUnpack) (Rec0 Double)))))))

secs :: Double -> String #

Convert a number of seconds to a string. The string will consist of four decimal places, followed by a short description of the time units.

measure #

Arguments

:: Benchmarkable | Operation to benchmark.
-> Int64 | Number of iterations.
-> IO (Measured, Double) |

Measure the execution of a benchmark a given number of times.

runBenchmark #

Arguments

:: Benchmarkable |
-> Double | Lower bound on how long the benchmarking process should take. In practice, this time limit may be exceeded in order to generate enough data to perform meaningful statistical analyses.
-> IO (Vector Measured, Double) |

Run a single benchmark, and return measurements collected while executing it, along with the amount of time the measurement process took.

runBenchmarkable :: Benchmarkable -> Int64 -> (a -> a -> a) -> (IO () -> IO a) -> IO a #

runBenchmarkable_ :: Benchmarkable -> Int64 -> IO () #

measured :: Measured #

An empty structure.

applyGCStatistics #

Arguments

:: Maybe GCStatistics | Statistics gathered at the end of a run.
-> Maybe GCStatistics | Statistics gathered at the beginning of a run.
-> Measured | Value to "modify".
-> Measured |

Apply the difference between two sets of GC statistics to a measurement.

threshold :: Double #

The amount of time a benchmark must run for in order for us to have some trust in the raw measurement.

We set this threshold so that we can generate enough data to later perform meaningful statistical analyses.

The threshold is 30 milliseconds. One use of `runBenchmark` must accumulate more than 300 milliseconds of total measurements above this threshold before it will finish.

# Deprecated

getGCStats :: IO (Maybe GCStats) #

Deprecated: GCStats has been deprecated in GHC 8.2. As a consequence,getGCStats has also been deprecated in favor of getGCStatistics.getGCStats will be removed in the next major criterion release.

Try to get GC statistics, bearing in mind that the GHC runtime will throw an exception if statistics collection was not enabled using "`+RTS -T`".

applyGCStats #

Arguments

:: Maybe GCStats | Statistics gathered at the end of a run.
-> Maybe GCStats | Statistics gathered at the beginning of a run.
-> Measured | Value to "modify".
-> Measured |

Deprecated: GCStats has been deprecated in GHC 8.2. As a consequence,applyGCStats has also been deprecated in favor of applyGCStatistics.applyGCStats will be removed in the next major criterion release.

Apply the difference between two sets of GC statistics to a measurement.