|
iceberg-cpp
|
Utility class for computing metrics from Parquet files. More...
#include <parquet_metrics_internal.h>
Static Public Member Functions | |
| static Result< Metrics > | GetMetrics (const Schema &schema, const ::parquet::SchemaDescriptor &parquet_schema, const MetricsConfig &metrics_config, const ::parquet::FileMetaData &metadata, const std::unordered_map< int32_t, FieldMetrics > &field_metrics={}) |
| Compute file-level metrics from Parquet file metadata. | |
Utility class for computing metrics from Parquet files.
|
static |
Compute file-level metrics from Parquet file metadata.
This function extracts metrics including row count, column sizes, value counts, null value counts, and lower/upper bounds from Parquet file metadata. NaN value counts are not currently collected from Parquet metadata. The metrics are computed according to the provided MetricsConfig, which determines which columns to collect metrics for and at what granularity (counts only, truncated bounds, or full bounds).
| schema | The Iceberg schema for the table. |
| parquet_schema | The Parquet schema descriptor. |
| metrics_config | The configuration specifying how to collect metrics. |
| metadata | The Parquet file metadata containing row group statistics. |
| field_metrics | Optional per-field metrics computed during write. If provided, these take precedence over footer statistics. |