NAME¶

Data::Stream::Bulk::Chunked - combine streams into larger chunks

VERSION¶

version 0.11

SYNOPSIS¶

  use Data::Stream::Bulk::Chunked;
  Data::Stream::Bulk::Chunked->new(
      stream     => $s,
      chunk_size => 10000,
  );

DESCRIPTION¶

This is a stream which wraps an existing stream to give more items in a single block. This can simplify application code which does its own processing one block at a time, and where processing larger blocks is more efficient.

ATTRIBUTES¶

stream

The stream to chunk. Required.

chunk_size

The minimum number of items to return in a block. Defaults to 1 (which does nothing).

METHODS¶

get_more

See Data::Stream::Bulk::DoneFlag.

Returns at least "chunk_size" items. Note that this isn't guaranteed to return exactly "chunk_size" items - it just returns multiple full blocks from the backend. Also, the final block returned may have less than "chunk_size" items.

AUTHOR¶

Yuval Kogman <nothingmuch@woobling.org>

COPYRIGHT AND LICENSE¶

This software is copyright (c) 2012 by Yuval Kogman.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.