iceberg::WriterProperties Class Reference

Inheritance diagram for iceberg::WriterProperties:

Public Types
template<typename T >
using	Entry = const ConfigBase< WriterProperties >::Entry< T >

Static Public Member Functions
static WriterProperties	FromMap (const std::unordered_map< std::string, std::string > &properties)
	TODO(gangwu): add table properties with write.avro|parquet|orc.*.

Static Public Attributes
static Entry< std::string >	kAvroSchemaName {"write.avro.schema-name", ""}
	The name of the Avro root node schema to write.
static Entry< int64_t >	kAvroBufferSize {"write.avro.buffer-size", 1024 * 1024}
	The buffer size used by Avro output stream.
static Entry< int64_t >	kAvroSyncInterval {"write.avro.sync-interval", 16 * 1024}
	The sync interval used by Avro writer.
static Entry< bool >	kAvroSkipDatum {"write.avro.skip-datum", true}
	Whether to skip GenericDatum and use direct encoder for Avro writing. When true, uses direct encoder (faster). When false, uses GenericDatum.
static Entry< std::string >	kAvroCompression
static Entry< std::string >	kAvroCompressionLevel
static Entry< std::string >	kParquetCompression
static Entry< std::string >	kParquetCompressionLevel

Additional Inherited Members
Public Member Functions inherited from iceberg::ConfigBase< WriterProperties >
ConfigBase &	Set (const Entry< T > &entry, const T &val)
ConfigBase &	Unset (const Entry< T > &entry)
ConfigBase &	Reset ()
T	Get (const Entry< T > &entry) const
const std::unordered_map< std::string, std::string > &	configs () const
std::unordered_map< std::string, std::string > &	mutable_configs ()
std::unordered_map< std::string, std::string >	Extract (std::string_view prefix) const
	Extracts the prefix from the configuration.
Protected Attributes inherited from iceberg::ConfigBase< WriterProperties >
std::unordered_map< std::string, std::string >	configs_

Member Function Documentation

FromMap()

WriterProperties iceberg::WriterProperties::FromMap ( const std::unordered_map< std::string, std::string > &  properties )

static

TODO(gangwu): add table properties with write.avro|parquet|orc.*.

Create a WriterProperties instance from a map of key-value pairs.

Member Data Documentation

kAvroCompression

Entry<std::string> iceberg::WriterProperties::kAvroCompression

inlinestatic

Initial value:

{"write.avro.compression-codec",
                                                    "gzip"}

kAvroCompressionLevel

Entry<std::string> iceberg::WriterProperties::kAvroCompressionLevel

inlinestatic

Initial value:

{"write.avro.compression-level",
                                                         ""}

kParquetCompression

Entry<std::string> iceberg::WriterProperties::kParquetCompression

inlinestatic

Initial value:

{"write.parquet.compression-codec",
                                                       "zstd"}

kParquetCompressionLevel

Entry<std::string> iceberg::WriterProperties::kParquetCompressionLevel

inlinestatic

Initial value:

{
      "write.parquet.compression-level", ""}

---

The documentation for this class was generated from the following files:

• iceberg/file_writer.h
• iceberg/file_writer.cc