Expand description

This module defines three traits Destination, DestinationPartition, and Consume to define a destination. This module also contains destination implementations for various dataframes.

Modules§

  • Destination implementation for Arrow and Polars.
  • Destination implementation for Arrow2.
  • Destination implementation for Arrow and Polars.

Traits§

  • A type implemented Consume<T> means that it can consume a value T by adding it to it’s own buffer.
  • A Destination is associated with a TypeSystem and a PartitionDestination. PartitionDestination allows multiple threads write data into the buffer owned by Destination.
  • PartitionDestination writes values to its own region. PartitionDestination is parameterized on lifetime 'a, which is the lifetime of the parent Destination. Usually, a PartitionDestination can never live longer than the parent.