apache-iceberg-1.11.0

What's Changed

• Revert "[SPEC] Add implementation note about schema evolution (#13936)" by @emkornfield in #14002
• Fixing AssertJ assertions in TestS3FileIOProperties by @AnatolyPopov in #14005
• Build: Bump io.netty:netty-buffer from 4.2.4.Final to 4.2.5.Final by @dependabot[bot] in #14008
• Build: Bump com.azure:azure-sdk-bom from 1.2.37 to 1.2.38 by @dependabot[bot] in #14010
• Build: Bump com.google.cloud:libraries-bom from 26.66.0 to 26.67.0 by @dependabot[bot] in #13952
• Build: Bump software.amazon.awssdk:bom from 2.33.0 to 2.33.4 by @dependabot[bot] in #14009
• bump Spark version to 4.0.1 by @drexler-sky in #14019
• Site: Bump up mkdocs-monorepo-plugin to 1.1.2 by @manuzhang in #14015
• [docs] Move third-party integrations to root level of left-hand nav, add more catalogs by @rmoff in #13753
• Core: Extended header support for RESTClient implementations by @gaborkaszab in #12194
• Revert "Site: Bump up mkdocs-monorepo-plugin to 1.1.2" by @manuzhang in #14022
• Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.14.0 to 7.15.0 by @dependabot[bot] in #14011
• Spark 4.0: Add Support for PartitionStatistics Files in RewriteTablePath. by @slfan1989 in #13956
• docs: flink: Fix updated link by @Fokko in #14024
• Build: Add Docs Build CI by @manuzhang in #14025
• Spark: Support Trigger AvailableNow in SS by @alexprosak in #13824
• Test: Avoid running redundant tests by @ebyhr in #14036
• Spark 4.0, 3.4: Backport #13824 to Support Trigger AvailableNow in SS by @alexprosak in #14026
• Remove BladePipe due to broken links by @Fokko in #14033
• Flink: Fix flaky tests for Iceberg sink by @mxm in #14044
• Flink: Backport #14044: Fix flaky tests for Iceberg sink by @mxm in #14050
• Core: Refactor: Rename resp to response in RESTCatalogAdapter by @gaborkaszab in #14051
• Site, Build: finalize 1.10.0 release with notes and update revapi and links by @stevenzwu in #13996
• Compulsorily close coordinator if task is stopped by the connect framework. by @kumarpritam863 in #13756
• Docs: Fix style of row-level deletes in spec by @JeonDaehong in #13851
• docs: Add link to BladePipe by @Fokko in #14047
• Site: fix up 1.10.0 release notes by @stevenzwu in #14055
• Docs: Remove extra \ in Kafka Connect Configuration docs by @raveendra11 in #13240
• Docs: Update supported Flink versions by @mxm in #13611
• fix: Make TableMetadataV3ValidMinimal actually v3 by @c-thiel in #14061
• Build: Bump io.netty:netty-buffer from 4.2.5.Final to 4.2.6.Final by @dependabot[bot] in #14075
• Build: Bump software.amazon.awssdk:bom from 2.33.4 to 2.33.9 by @dependabot[bot] in #14073
• Build: Bump mkdocs-material from 9.6.18 to 9.6.19 by @dependabot[bot] in #14074
• Arrow: delete outdated comment by @nandorKollar in #14068
• Core: Don't copy stats of delete files in DeleteFileIndex by @ebyhr in #13161
• Core: Refactor: Move properties of REST catalog into RESTCatalogProperties by @gaborkaszab in #13991
• Spec: Deprecate Position delete files with row data by @pvary in #14045
• Azure: Don't fetch credential from endpoint if properties contain a valid credential by @smaheshwar-pltr in #13966
• API: Follow up on adding Variant data type to implement sanitizing for Variant #11479 by @manirajv06 in #13137
• docs: use * for path expansion instead of hardcoding version by @kevinjqliu in #13989
• Infra: update how-to-release doc and site scripts on releasing versioned doc and javadoc based on learnings from 1.10.0 release by @stevenzwu in #14066
• Site: change default remote name back to origin. otherwise, site CI could fail by @stevenzwu in #14086
• Infra: add .sdkmanrc to .gitignore file by @stevenzwu in #14085
• Spark 3.4: Backport: Add procedure and action to compute partition stats. by @slfan1989 in #14034
• Docs: Update Spark Structured Streaming docs for Rate Limiting & Triggers by @alexprosak in #14030
• Update vendors.md adding Fivetran by @fivetran-caseykarst in #14088
• Backport Parquet encoding tests for Spark 3.5 by @eric-maynard in #13859
• Core: Add CountNull Aggregation Support by @jackylee-ch in #13981
• Core: Allow reading metadata table when scanning table with dropped partition source field by @gabeiglio in #14089
• Spark 3.4, 3.5: Backport Add Support for PartitionStatistics Files in RewriteTablePath. by @slfan1989 in #14032
• Add StreamNative to the vendor list by @hangc0276 in #14097
• Spec: bring back added-rows in snapshot fields by @stevenzwu in #14048
• AWS, Core, Data, Spark: Remove deprecations for 1.11.0 by @dogukancagatay in #14059
• API: required nested fields within optional structs can produce null by @dejangvozdenac in #13804
• Core: Make deprecated method package-private in PartitionStats by @ebyhr in #14119
• Doc: Add Spark v4.0 to lifecycle status by @ronkapoor86 in #14116
• Flink: Add support for Flink 2.1.0 by @mxm in #13714
• Add "stop signs" for sensitive information/issues to all issue templates by @snazy in #14103
• BigQuery: Add table validity check for BigQueryMetastoreCatalog by @thomaschow in #14113
• [Core] Add mergeAppendTest to ensure consist distribution of data files in manifests by @dramaticlly in #14111
• Core: Fix Scan Plan API resource paths by @singhpk234 in #14120
• Build: Bump hadoop from 3.4.1 to 3.4.2. by @slfan1989 in #14125
• Fix variant type filtering in ParquetMetricsRowGroupFilter by @geruh in #14081
• Build: Bump software.amazon.awssdk:bom from 2.33.9 to 2.34.0 by @dependabot[bot] in #14133
• Build: Bump mkdocs-material from 9.6.19 to 9.6.20 by @dependabot[bot] in #14131
• Build: Bump org.assertj:assertj-core from 3.27.4 to 3.27.5 by @dependabot[bot] in #14130
• Manifest list encryption by @ggershinsky in #7770
• Flink: Add support for Flink 2.1.0 follow-up by @manuzhang in #14156
• Build: Bump guava from 33.4.8-jre to 33.5.0-jre by @dependabot[bot] in #14128
• Flink: add _row_id and _last_updated_sequence_number readers by @Guosmilesmile in #14148
• Spark 4.0: Pass format-version when creating a snapshot in table migration actions by @Fokko in #14163
• Flink: Backport add _row_id and _last_updated_sequence_number readers to 2.1 and 1.20 by @Guosmilesmile in #14168
• Spark 3.5: Pass format-version when creating a snapshot by @Fokko in #14169
• Spark 3.4: Pass format-version when creating a snapshot by @Fokko in #14170
• Build: Bump com.google.errorprone:error_prone_annotations from 2.41.0 to 2.42.0 by @dependabot[bot] in #14132
• API, Spark 4.0: Add create_file_list option to RewriteTablePathProcedure. by @slfan1989 in #13837
• Spark 4.0: Refactor Spark procedures to consistently use ProcedureInput for parameter handling. by @slfan1989 in #13913
• Docs: Add REST catalog authentication properties (addresses - #13209) by @piyushdubey in #14065
• Doc: Enhance RewriteTablePath procedure documentation with parameter details. by @slfan1989 in #14181
• Spark 3.5: Backport: Refactor Spark procedures to consistently use ProcedureInput for paramete...

apache-iceberg-1.10.2

What's Changed

• Core, Spark: Fix equality deletes non-deterministic schema ordering (#13873)(Backports #15514) by @RussellSpitzer in #15605
• Build: Bump org.apache.avro:avro from 1.12.0 to 1.12.1 (#14369) by @steveloughran in #15607
• [1.10.x] Core: Load snapshot after it has been committed to prevent accidental cleanup of files (#15511) by @nastra in #15650
• [1.10] Backport always merge DVs on commit path (#15006) to 1.10.x by @amogh-jahagirdar in #15654
• [1.10.x] Core: Do not cleanup when CREATE transactions fail with 503 (#15051) by @ebyhr in #15662
• [1.10.x] Flink: Fix non-deterministic operator UIDs in DynamicIceberg Sink (#15687) by @mxm in #15738
• [1.10.x] Fix CVE-2025-67721 in io.airlift:aircompressor by @kevinjqliu in #15829
• [1.10.x] Bump jackson from 2.19.2 to 2.21.2 to fix GHSA-72hv-8253-57qq by @manuzhang in #15847
• [1.10.x] Backport (#14295) Closes #15908 - Hive : Fixing the trailing slash issue for the database paths in HMS … by @aalopatin in #16010
• [1.10.x] Flink: Add LICENSE entries for bundled flink-metrics-dropwizard by @mxm in #16130
• Spark: Backport LICENSE and NOTICE changes to 1.10.x (#16142) by @amogh-jahagirdar in #16162
• [1.10x] Core: Validate v2 deletes against concurrent format upgrade (#16146) by @dramaticlly in #16161
• Open API: Backport 1.10 Remove runtime Jar from build and deploy (#16163) by @amogh-jahagirdar in #16188
• AWS: Backport License/Notice fixes (#16196) by @amogh-jahagirdar in #16236
• Azure: Backport License/Notice fix from #16181 to 1.10.x and include Nimbus/ASM in License by @amogh-jahagirdar in #16242
• GCP: Backport License/Notice fix from #16182 to 1.10.x, excluding woodstox/gcs-analytics and JSR by @amogh-jahagirdar in #16244
• Spark: Backport LICENSE and NOTICE fixes to 1.10.x (#16215) by @amogh-jahagirdar in #16255
• Flink: Backport License/Notice to 1.10.x (#16159) by @amogh-jahagirdar in #16175
• Azure: [1.10.x] Add missing LICENSE entry for Gson shaded by Nimbus JOSE+JWT by @kevinjqliu in #16260
• Core: Backport Fix row ID assignment for EXISTING entry during a manifest merge to 1.10.x by @amogh-jahagirdar in #16304

New Contributors

• @aalopatin made their first contribution in #16010

Full Changelog: apache-iceberg-1.10.1...apache-iceberg-1.10.2

apache-iceberg-1.10.1

• API
  • required nested fields within optional structs can produce null by @dejangvozdenac in (#13804)
  • Detect whether required fields nested within optionals can produce nulls by @nastra in (#14270)
• Core
  • Prevent dropping a namespace when it contains views by @nastra in (#14456)
  • Fix overflow due to default value on timestamp nanos by @ebyhr in (#14359)
  • Fix the unpartitioned check in replace partitions by @yuboxx in (#14186)
  • Fix for respecting custom location providers in SerializableTable and actions by @przemekd in (#14280)
  • Fix NAN_VALUE_COUNTS serialization for ContentFile by @huaxingao in (#14721)
  • Handle unknown type during deletes by @nastra in (#14356)
  • REST: Fix validation of PlanTableScanRequest by @nastra in (#14561)
  • REST: Fix validation of PlanTableScanResponse by @nastra in (#14562)
  • REST: Fix RESTFileScanTaskParser to handle empty delete file references list by @ajreid21 in (#14568)
  • REST: Fix serde of tasks with multiple deletes by @singhpk234 in (#14573)
  • REST: Align PlanTableScanRequest filter with the OpenAPI spec by @geruh in (#14658)
  • REST: Make plan status consistent with the REST spec by @singhpk234 in (#14643)
• Parquet
  • Fix NameMapping loss in ParquetUtil.footerMetrics by @tmater in (#14617)
  • Add variant type support to ParquetTypeVisitor by @tmater in (#14588)
  • Fix variant type filtering in ParquetMetricsRowGroupFilter by @geruh in (#14081)
  • handle NPE for VariantLogicalType in TypeWithSchemaVisitor by @aihuaxu in (#14261)
  • Fix UUID ClassCastException when reading Parquet files with UUIDs by @ndrluis in (#14027)
• Flink
  • Ensure DynamicCommitter idempotence in the presence of failures by @mxm in (#14182)
  • Backport Ensure DynamicCommitter idempotence in the presence of failures by @mxm in (#14213)
  • Prevent recreation of ManifestOutputFileFactory during flushing by @mxm in (#14358)
  • Backport Prevent recreation of ManifestOutputFileFactory during flushing by @mxm in (#14385)
  • Fix cache refreshing in DynamicIcebergSink by @aiborodin in (#14406)
  • Port fix cache refreshing in DynamicIcebergSink by @aiborodin in (#14765)
• Spark
  • 3.4: Pass format-version when creating a snapshot by @Fokko in (#14170)
  • 3.5: Pass format-version when creating a snapshot by @Fokko in (#14169)
  • 4.0: Pass format-version when creating a snapshot in table migration actions by @Fokko in (#14163)
  • Fix Z-order UDF to correctly handle DateType by @ronkapoor86 in (#14108)
• Kafka Connect
  • Merge control topic and last persisted offsets by @danielcweeks in (#14525)
• Vendor integrations
  • AWS: Configure builder for reuse of HTTP connection pool in SDK v2 by @anuragmantri in (#14161)
  • AWS: Fix leaked credentials when contacting multiple catalogs by @adutra in (#14178)
  • AWS: Exclude logging dependencies from the bundle by @danielcweeks in (#14225)

Full Changelog: apache-iceberg-1.10.0...apache-iceberg-1.10.1

apache-iceberg-1.10.0

What's Changed

• Add format/ to site-ci by @Fokko in #12869
• update links to daft docs by @ccmao1130 in #12860
• Spark3.4: BackPort Add Parallelism Parameter Validation to AddFilesProcedure. by @slfan1989 in #12872
• Core: Add test when listing namespaces with a non-existing namespace by @nastra in #12873
• Flink: Add support for Flink 2.0 by @mxm in #12527
• Core: Fix Kryo ser/de with StorageCredential config by @nastra in #12882
• Add timestamp_ns, time and UUID types for Variant by @aihuaxu in #12682
• Spec: Avoid struct field conflicts in default values by @rdblue in #12841
• Core: Ensure reactivated view version uses correct timestamp by @lliangyu-lin in #12821
• Parquet: Add variant array reader in Parquet by @aihuaxu in #12512
• Build: Bump nessie from 0.103.3 to 0.103.5 by @dependabot[bot] in #12902
• Build: Bump testcontainers from 1.20.6 to 1.21.0 by @dependabot[bot] in #12904
• Build: Bump mkdocs-material from 9.6.11 to 9.6.12 by @dependabot[bot] in #12848
• Build: upgrade to Gradle 8.14 by @jbonofre in #12898
• Spark: Use newArrayListWithExpectedSize instead of newArrayList for NDVSketchUtil by @jackylee-ch in #12907
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.3 to 5.4.4 by @dependabot[bot] in #12906
• Docs: Release notes for 1.9.0 by @ajantha-bhat in #12911
• Infra: Add 1.9.0 to issue template by @ajantha-bhat in #12913
• Infra: Update doap.rdf file by @ajantha-bhat in #12918
• Core: Increase wait time of flaky test by @manuzhang in #12714
• Flink: Backport add StreamingStartingStrategy.INCREMENTAL_FROM_LATEST_SNAPSHOT_EXCLUSIVE to Flink 1.19 by @morhidi in #12899
• Docs: Site updates for 1.9.0 by @ajantha-bhat in #12921
• Spark 3.5: Update MERGE and UPDATE for row lineage by @amogh-jahagirdar in #12736
• Flink: Add lockFactory open in LockRemover for table maintenance by @Guosmilesmile in #12900
• Docs: Fix version doc release step by @ajantha-bhat in #12922
• Parquet variant array write by @aihuaxu in #12847
• Build: Bump software.amazon.awssdk:bom from 2.29.52 to 2.31.30 by @dependabot[bot] in #12905
• Build: Bump jackson-bom from 2.18.3 to 2.19.0 by @dependabot[bot] in #12903
• Spark 3.4: Migrate tests in sql by @tomtongue in #12934
• Flink: Backport Add lockFactory open in LockRemover for table maintenance to Flink 1.20 and 1.19 by @Guosmilesmile in #12929
• Docs: Add DuckDB by @szarnyasg in #12932
• Spark 3.4: Migrate Spark Partition Transform tests by @tomtongue in #12941
• Flink: Fix typo in JdbcLockFactory by @Guosmilesmile in #12940
• Spark: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs by @pvary in #12692
• Flink: Change Preconditions import from flink util to guava by @Guosmilesmile in #12939
• Update Spark Parquet vectorized read tests to uses Iceberg Record instead of Avro GenericRecord by @amogh-jahagirdar in #12925
• Follow up to address comments in variant array writer by @aihuaxu in #12933
• OpenAPI: Use more clear language in recommending error responses by @sungwy in #12376
• Core: Broaden exception handling in writer clean up logic by @xiaoxuandev in #12863
• Spec: Remove misleading statement about source-ids by @wypoon in #12948
• API, Build: Explicitly pass version into Git Properties Plugin by @RussellSpitzer in #12949
• Build: Bump parquet from 1.15.1 to 1.15.2 by @dependabot[bot] in #12964
• Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.12.0 to 7.13.0 by @dependabot[bot] in #12966
• Build: Bump software.amazon.awssdk:bom from 2.31.30 to 2.31.35 by @dependabot[bot] in #12967
• Build: Bump nessie from 0.103.5 to 0.103.6 by @dependabot[bot] in #12963
• Spark 3.4: Migrate other sql tests by @tomtongue in #12945
• Build: Bump datamodel-code-generator from 0.28.5 to 0.30.1 by @dependabot[bot] in #12961
• Docs: Incorrect property in CREATE CATALOG for Flink by @mrsubhash in #12894
• Spark: Add flag to handle missing files for importSparkTable by @jshmchenxi in #12212
• Spec additions for encryption by @ggershinsky in #12162
• Spec: Update partition stats for V3 by @aokolnychyi in #12098
• AWS, GCP: Deprecate passing FileIO properties through constructor by @nastra in #12972
• Flink: Maintenance - RewriteDataFiles by @pvary in #11497
• Build: Bump net.snowflake:snowflake-jdbc from 3.23.2 to 3.24.0 by @dependabot[bot] in #12965
• API, Core: Add deleteFile to RowDelta API by @RussellSpitzer in #12861
• API, Core: Add table metadata keys for encryption by @rdblue in #12927
• Enable HTTP proxy support for the client used by REST Catalog by @akhilputhiry in #12406
• Flink: Backport Maintenance - RewriteDataFiles to Flink 1.19, 1.20 by @gyfora in #12991
• Build: Bump Comet from 0.5.0 to 0.8.1 by @huaxingao in #12974
• Core: Disallow creation of invalid PartitionSpec by @devinrsmith in #12887
• REST spec: Remove update to enable row lineage by @rdblue in #12986
• Spec: Update v3 summary, add row lineage by @rdblue in #12982
• Docs: Mark Spark 3.3 as End-of-Life since 1.9 by @manuzhang in #12989
• Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs by @gaborkaszab in #12980
• Build, Core: Let RevAPI compare against 1.9.0 / Fix API breakage around StorageCredential by @nastra in #12930
• GCP: Support multiple storage credential prefixes by @nastra in #12881
• AWS, Core, Flink, Parquet: Remove deprecations for 1.10.0 by @manuzhang in #12909
• Spark 4.0 integration by @huaxingao in #12494
• Spark 3.4: Migrate source and spark tests by @tomtongue in #12998
• ORC: Upgrade ORC to 1.9.6 by @dongjoon-hyun in #13003
• Spark 3.4: Migrate the remaining SparkCatalogTestBase related tests and remove SparkCatalogTestBase by @tomtongue in #13007
• Core: Refactor and use InternalData for partition stats by @ajantha-bhat in #12946
• Add databend & iceberg docuement url by @sundy-li in #13002
• Revert "Spark 4.0 integration" by @huaxingao in #13006
• Update ADLS implementation status by @mrcnc in #13020
• Spec: Clarify behavior of special geo objects for lower/upper bounds by @szehon-ho in #12956
• Spark: Migrate Spark 3.4 SparkTestBaseWithCatalog related tests including refactoring Spark 3.5 tests by @tomtongue in #13015
• Spark: Migrate Spark 3.4 SparkTestBase related tests including refactoring Spark 3.5 tests by @tomtongue in #13031
• Docs: Add Spark SQL Configurations by @guykhazma in #12931
• Parquet: Fix to ensure that last updated sequence numbers for V2 and earlier tables are null by @amogh-jahagirdar in #13001
• Build: Bump mkdocs-material from 9.6.12 to 9.6.13 by @dependabot[bot] in #13029
• REST spec: Add encryption keys by @rdblue in #12987
• Add table property to disable/enable parquet column statistics #12770 by @huaxiangsun in #12771
• Docs: Fix ...

Apache Iceberg 1.9.2

What's Changed

• Stop retrying on 502 / 504 by @singhpk234 in #13461

Full Changelog: apache-iceberg-1.9.1...apache-iceberg-1.9.2

Apache Iceberg 1.9.1

What's Changed

• Core: Ensure reactivated view version uses correct timestamp by @lliangyu-lin in #12821
• API, Build: Explicitly pass version into Git Properties Plugin by @RussellSpitzer in #12949
• Bump Apache Parquet to 1.15.2 by @Fokko
• Core: Revert #12670 to Temporarily Restore Sending Single Snapshot Changes Rather than in Bulk by @aihuaxu in #13100

Full Changelog: apache-iceberg-1.9.0...apache-iceberg-1.9.1

Apache Iceberg 1.9.0

What's Changed

• Build: Bump software.amazon.awssdk:bom from 2.30.11 to 2.30.16 by @dependabot in #12208
• Build: Bump com.google.cloud:libraries-bom from 26.53.0 to 26.54.0 by @dependabot in #12207
• Build: Bump org.xerial:sqlite-jdbc from 3.48.0.0 to 3.49.0.0 by @dependabot in #12206
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.1 to 5.4.2 by @dependabot in #12209
• Docs: Fix expire_snapshots output by @manuzhang in #12213
• Update LICENSE/NOTICE files with last dependency updates by @jbonofre in #12214
• Doc: update note about notebook in spark-quickstart by @xxchan in #11996
• Spec: Support geo type by @szehon-ho in #10981
• Build: skip scheduled docker image publish workflows on forks by @dramaticlly in #12218
• Docs: Add missing types to the spec v3 summary by @wgtmac in #12219
• Spec: Typo - missing be by @RussellSpitzer in #12229
• Docs: Site update for 1.8.0 release by @amogh-jahagirdar in #12242
• spec: Remove source-ids for V{1,2} tables by @Fokko in #12161
• Build: Update revAPI to compare against 1.8.0 by @amogh-jahagirdar in #12244
• Update release version to 1.8.0 in doap.rdf by @amogh-jahagirdar in #12247
• Infra: Update Iceberg bug report template for 1.8.0 by @amogh-jahagirdar in #12248
• Docs: Fix formatting of 1.8.0 release notes by @amogh-jahagirdar in #12249
• Core: Adjust Jackson settings to handle large metadata json by @bryanck in #12224
• Build: Bump Hive to 2.3.10 by @nastra in #12253
• Build: Clean up dependencies by @nastra in #12252
• Core: Add InternalData read and write builders by @rdblue in #12060
• API, Core: Support default values in UpdateSchema by @rdblue in #12211
• update site to include iceberg summit link by @danicafine in #12256
• Core: Fix divide by zero when adjust split size by @hantangwangd in #12201
• Spark: Remove unused PruneColumnsWithReordering class by @rdblue in #12258
• Spark: Fix assertion checks by @nastra in #12255
• API: Deprecate NestedType.of in favor of builder by @rdblue in #12227
• Docker: Pin QEMU version temporarily by @ebyhr in #12262
• OpenAPI: Add RemoveSchemas REST update type by @gaborkaszab in #12022
• Minor: update Learn More to point to spark quickstart by @danicafine in #12272
• Build: Bump datamodel-code-generator from 0.27.2 to 0.28.1 by @manuzhang in #12290
• Spark 3.5: Fix job description of RewriteTablePathSparkAction by @ebyhr in #12282
• Build: Bump io.netty:netty-buffer from 4.1.117.Final to 4.1.118.Final by @dependabot in #12287
• Build: Bump software.amazon.awssdk:bom from 2.30.16 to 2.30.21 by @dependabot in #12286
• OpenAPI: Add overwrite option when registering an iceberg table by @dramaticlly in #12239
• Build: Bump mkdocs-material from 9.6.3 to 9.6.4 by @dependabot in #12284
• Core: Fix non-setting row-lineage from table properties on initial table creation by @tomtongue in #12307
• API: Reject unknown type for required fields and validate defaults by @rdblue in #12302
• API: Fix TestInclusiveMetricsEvaluator notStartsWith tests by @rdblue in #12303
• Core: add variant type support by @aihuaxu in #11831
• Fix CI: Update tests with UnknownType from Required to Optional by @Fokko in #12316
• Docs: Refactor site navigation bar by @manuzhang in #12289
• Parquet: Implement Variant readers by @rdblue in #12139
• Docs: Add rewrite-table-path in spark procedure by @dramaticlly in #12115
• Parquet: Fix errorprone warning by @ebyhr in #12324
• Docs: add apache amoro(incubating) with iceberg (#11965) by @czy006 in #11966
• Parquet: Fix performance regression in reader init by @bryanck in #12305
• Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12314
• Fix: fix apache amoro ams doc pic ref by @czy006 in #12332
• Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12312
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12329
• Checkstyle: Apply the same generic type naming rules to interfaces and classes by @pvary in #12333
• Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12340
• Docs: Fix link of catalog in terms.md by @wangyinsheng in #12326
• Docs: Add documentation for Rate limiting in Spark Structured Streaming by @singhpk234 in #12217
• Spark 3.5: Fix Incorrect Spec Used With AddFiles Procedure by @RussellSpitzer in #12319
• Parquet: Remove deprecated VectorizedReader.setRowGroupInfo and ParquetValueReader.setPageSource by @ebyhr in #12321
• Bump versions in {LICENSE,NOTICE} by @Fokko in #12337
• Spark: Remove Spark 3.3 support by @manuzhang in #12279
• Core: Remove deprecated Util.blockLocations method and StructCopy class by @ebyhr in #12320
• Core: Handle partition evolution case in PartitionStatsUtil#computeStats by @deniskuzZ in #12137
• Core, Spark: Remove deprecated code for 1.9.0 by @nastra in #12336
• API: Move variant to API and add extract expression by @rdblue in #12304
• Core: Remove namespace/table/view HEAD endpoints from defaults by @nastra in #12351
• Nit: Remove additional 'Iceberg' in Puffin footer payload by @tomtongue in #12369
• API: Move Variant interfaces and serialized implementations to API by @rdblue in #12374
• Flink: Fix the comment error in SketchDataStatistics by @Guosmilesmile in #12375
• Core: Don't remove trailing slash from absolute paths by @adutra in #12389
• Build: Bump mkdocs-material from 9.6.4 to 9.6.5 by @dependabot in #12386
• Build: Bump org.xerial:sqlite-jdbc from 3.49.0.0 to 3.49.1.0 by @dependabot in #12385
• Build: Bump org.awaitility:awaitility from 4.2.2 to 4.3.0 by @dependabot in #12384
• Build: Bump nessie from 0.102.5 to 0.103.0 by @dependabot in #12383
• Build: Bump com.google.cloud:libraries-bom from 26.54.0 to 26.55.0 by @dependabot in #12382
• Build: Bump testcontainers from 1.20.4 to 1.20.5 by @dependabot in #12380
• Build: Bump software.amazon.awssdk:bom from 2.30.21 to 2.30.26 by @dependabot in #12379
• Spec: Allow Equality Deletes with Row Lineage and Define Behavior by @RussellSpitzer in #12230
• Core: Add "volatile" to HadoopFileIO#hadoopConf by @okumin in #12388
• Arrow, Parquet, Spark 3.5, Flink 1.20: Avoid deprecated method by @ebyhr in #11874
• Docs: Add Stackable to the Vendors page by @lfrancke in #12344
• Build: Upgrade to Gradle 8.13 by @jbonofre in #12398
• Kafka Connect: Add SMTs for Debezium and AWS DMS by @ismailsimsek in #11936
• API, Core: Update inclusive metrics evaluator for extract and transforms by @rdblue in #12311
• Build: remove Hadoop 2 dependency by @Kontinuation in #12348
• View Spec: Fix typo by @ajantha-bhat in #12405
• Fix grammar issues in descriptions about Hive environment in hive-quickstart.md by @wenxin-cn in #12402
• ...

apache-iceberg-1.7.2

What's Changed

• 1.7.x cherry pick #11526 by @bryanck in #11629
• [1.7] Revert "Support WASB scheme in ADLSFileIO" by @mrcnc in #11817
• Core, Spark, Flink, Hive: Remove unused failsafe dependency from core and add Failsafe to runtime LICENSE(s) by @amogh-jahagirdar in #11828
• [1.7.x] AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 token to credential provider by @nastra in #11971
• Spark: Fix empty scan issue when start timestamp retrieves root snapshot and end timestamp is missing (#11967) by @Fokko in #11983
• Remove slf4j-api reference in LICENSE (#12052) by @Fokko in #12068
• [1.7.x] Core: Retain current view version during expiration (#12067) by @nastra in #12084
• Bump the versions of site/mkdocs.yml by @Fokko in #12175
• [1.7.x] Kafka: Pin Kafka-Connect version to fix integration tests by @Fokko in #12354
• [1.7.x] Bump Nessie to 0.120.5 to include updated License/Notice by @Fokko in #12356
• [1.7.x] Fix {LICENSE,NOTICE} for Kafka Connect Runtime by @Fokko in #12353
• [1.7.x] Fix {LICENSE,NOTICE} for Flink Runtime by @Fokko in #12358
• [1.7.x] Fix {LICENSE,NOTICE} for GCP Bundle by @Fokko in #12359
• [1.7.x] Fix {LICENSE,NOTICE} for AWS Bundle by @Fokko in #12360
• [1.7.x] Fix {LICENSE,NOTICE} for Azure Bundle by @Fokko in #12361
• [1.7.x] Fix {LICENSE,NOTICE} for Spark Runtime by @Fokko in #12355
• [1.7.x] Align azure-storage-blob version in azure-bundle LICENSE by @jbonofre in #12445
• [1.7.x] Fix Kafka-connect LICENSE and NOTICE by @Fokko in #12400
• [1.7.x] AWS: Don't fetch credential from endpoint if properties contain a valid credential (#12504) by @nastra in #12515

Full Changelog: apache-iceberg-1.7.1...apache-iceberg-1.7.2

apache-iceberg-1.8.1

What's Changed

• [1.8.x] Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12313
• [1.8.x] Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12328
• [1.8.x] Core: Adjust Jackson settings to handle large metadata json (#12224) by @nastra in #12330
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12338
• [1.8.x] Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12341
• [1.8.x] Build: Revert AWS SDK from 2.30.11 to 2.29.52 by @nastra in #12339
• [1.8.x] Core: Remove namespace/table/view HEAD endpoints from defaults (#12351) by @nastra in #12368
• [1.8.x] Core: Don't remove trailing slash from absolute paths by @adutra in #12390
• [1.8.x] Fix versions in LICENSE/NOTICE by @jbonofre in #12365

Full Changelog: apache-iceberg-1.8.0...apache-iceberg-1.8.1

apache-iceberg-1.8.0

What's Changed

• Doc: Update rewrite data files spark procedure by @dramaticlly in #11396
• Docs: warn parallelism > 1 doesn't work for migration procedures by @manuzhang in #11417
• Core: log retry sleep time by @sullis in #11413
• Core: Use RoaringPositionBitmap in position index by @aokolnychyi in #11441
• Core: Add validation for table commit properties by @dramaticlly in #11437
• Core: Add cardinality to PositionDeleteIndex by @aokolnychyi in #11442
• Puffin: Add delete-vector-v1 blob type by @rdblue in #11238
• Spec v3: Add deletion vectors to the table spec by @rdblue in #11240
• API, Core: Add data file reference to DeleteFile by @aokolnychyi in #11443
• Build: Bump software.amazon.awssdk:bom from 2.29.1 to 2.29.6 by @dependabot in #11454
• Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.3 to 8.3.5 by @dependabot in #11452
• Build: Bump com.google.cloud:libraries-bom from 26.49.0 to 26.50.0 by @dependabot in #11451
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4 to 5.4.1 by @dependabot in #11450
• Build: Bump com.azure:azure-sdk-bom from 1.2.28 to 1.2.29 by @dependabot in #11453
• Flink: Maintenance - TableManager + ExpireSnapshots by @pvary in #11144
• Build: Bump mkdocs-material from 9.5.42 to 9.5.43 by @dependabot in #11455
• Build: Bump net.snowflake:snowflake-jdbc from 3.19.1 to 3.20.0 by @dependabot in #11447
• Build: Bump kafka from 3.8.0 to 3.8.1 by @dependabot in #11449
• Build: Bump jackson-bom from 2.18.0 to 2.18.1 by @dependabot in #11448
• Core: Fix generated position delete file spec by @aokolnychyi in #11458
• API, Core: Add content offset and size to DeleteFile by @aokolnychyi in #11446
• Build: Revert Parquet to 1.13.1 by @RussellSpitzer in #11462
• Spark 3.5: Preserve data file reference during manifest rewrites by @aokolnychyi in #11457
• Core: Make PositionDeleteIndex serializable by @aokolnychyi in #11463
• Spark 3.5: Preserve content offset and size during manifest rewrites by @aokolnychyi in #11469
• Spark 3.5: Fix flaky test due to temp directory not empty during delete by @manuzhang in #11470
• Core, Data, Flink, Spark: Improve tableDir initialization for tests by @nastra in #11460
• Core: Support DVs in DeleteFileIndex by @aokolnychyi in #11467
• Core: Adapt commit, scan, and snapshot stats for DVs by @aokolnychyi in #11464
• Spark: Merge new position deletes with old deletes during writing by @amogh-jahagirdar in #11273
• Fix ADLSLocation file parsing by @mrcnc in #11395
• open-api: Build runtime jar for test fixture by @ajantha-bhat in #11279
• Core, Puffin: Add DV file writer by @aokolnychyi in #11476
• Flink: Fix config key typo in error message of SplitComparators by @liuml07 in #11482
• API: Removes Explicit Parameterization of Schema Tests by @RussellSpitzer in #11444
• Docs: Fix verifying release candidate with Spark and Flink by @manuzhang in #11461
• Flink: Port #11144 to v1.19 by @pvary in #11473
• Docs: Fix format of verifying release candidate with Flink by @manuzhang in #11487
• Core: Support DVs in DeleteLoader by @aokolnychyi in #11481
• Infra: Update DOAP.RDF for Apache Iceberg 1.7.0 by @RussellSpitzer in #11492
• Docs: Site Update for 1.7.0 Release by @RussellSpitzer in #11494
• Infra: Add 1.7.0 to issue template by @RussellSpitzer in #11491
• Build: Let revapi compare against 1.7.0 by @RussellSpitzer in #11490
• Docs: Adds Release notes for 1.6.1 by @RussellSpitzer in #11500
• Docs: Fixes Release Formatting for 1.7.0 Release Notes by @RussellSpitzer in #11499
• Spec: Explicitly specify operation as a required field of Snapshot's summary field by @sungwy in #11355
• Exclude reading _pos column if it's not in the scan list by @huaxingao in #11390
• Build: Bump mkdocs-redirects from 1.2.1 to 1.2.2 by @dependabot in #11511
• Build: Bump mkdocs-material from 9.5.43 to 9.5.44 by @dependabot in #11510
• Build: Bump software.amazon.awssdk:bom from 2.29.6 to 2.29.9 by @dependabot in #11509
• Docs: Update multi-engine support after 1.7.0 release by @manuzhang in #11503
• Spark: Fix typo in spark ddl document by @hantangwangd in #11517
• Core: Support commits with DVs by @aokolnychyi in #11495
• Kafka Connect: fix Hadoop dependency exclusion by @bryanck in #11516
• Upgrade to Gradle 8.11.0 by @jbonofre in #11521
• Spark 3.5: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11480
• use dist/release KEYS by @kevinjqliu in #11526
• Remove iceberg-pig by @jbonofre in #11380
• Core, Flink, Spark: Verify maintenance actions with DVs by @nastra in #11485
• Spark: Use assumeThat(format).isEqualTo(FileFormat.PARQUET) instead of assumeThat(format).isEqualTo(parquet) by @huaxingao in #11540
• Spark 3.4: Support Spark Column Stats by @saitharun15 in #11532
• Docs: Fix rendering lists by @manuzhang in #11546
• Build: Bump kafka from 3.8.1 to 3.9.0 by @dependabot in #11508
• Support WASB scheme in ADLSFileIO by @mrcnc in #11504
• Docs: 4 Spaces are Required for Sublists by @RussellSpitzer in #11549
• API, Core, Spark: Ignore schema merge updates from long -> int by @rocco408 in #11419
• Docs: Fix level of Deletion Vectors by @manuzhang in #11547
• API, Core: Replace deprecated ContentFile#path usage with location by @amogh-jahagirdar in #11550
• API: Add Variant data type by @aihuaxu in #11324
• Spark 3.5: Adapt DeleteFileIndexBenchmark for DVs by @aokolnychyi in #11529
• Spark 3.5: Adapt PlanningBenchmark for DVs by @aokolnychyi in #11531
• Spark 3.5: Add DVReaderBenchmark by @aokolnychyi in #11537
• Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 by @dependabot in #11572
• Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 by @dependabot in #11568
• Build: Bump io.netty:netty-buffer from 4.1.114.Final to 4.1.115.Final by @dependabot in #11569
• Data, Flink, Spark: Test deletes with format-version=3 by @nastra in #11538
• Build: Bump nessie from 0.99.0 to 0.100.0 by @dependabot in #11567
• Build: Bump orc from 1.9.4 to 1.9.5 by @dependabot in #11571
• API, Arrow, Core, Data, Spark: Replace usage of deprecated ContentFile#path API with location API by @amogh-jahagirdar in #11563
• Core: Serialize null when there is no current snapshot by @Fokko in #11560
• Spark 3.4: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11579
• Spark 3.3: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11580
• Core: Inherited classes from SnapshotProducer has TableOperations red… by @gaborkaszab in #11578
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" by @nastra in #11574
• Core: delete temp metadata file when version already exists by @leesf in https://github.com/apache...