Scroll to navigation

Data::Stream::Bulk::Chunked(3pm) User Contributed Perl Documentation Data::Stream::Bulk::Chunked(3pm)

NAME

Data::Stream::Bulk::Chunked - combine streams into larger chunks

VERSION

version 0.11

SYNOPSIS

  use Data::Stream::Bulk::Chunked;
  Data::Stream::Bulk::Chunked->new(
      stream     => $s,
      chunk_size => 10000,
  );

DESCRIPTION

This is a stream which wraps an existing stream to give more items in a single block. This can simplify application code which does its own processing one block at a time, and where processing larger blocks is more efficient.

ATTRIBUTES

stream
The stream to chunk. Required.
chunk_size
The minimum number of items to return in a block. Defaults to 1 (which does nothing).

METHODS

get_more
See Data::Stream::Bulk::DoneFlag.
 
Returns at least "chunk_size" items. Note that this isn't guaranteed to return exactly "chunk_size" items - it just returns multiple full blocks from the backend. Also, the final block returned may have less than "chunk_size" items.

AUTHOR

Yuval Kogman <nothingmuch@woobling.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2012 by Yuval Kogman.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
2012-02-14 perl v5.14.2