Styxis
Company
Knowledge

After copying an Iceberg DeleteFile, verify equalityFieldIds survive

A copied path and successful commit do not establish that the metadata defining deletion semantics was retained.

Copy the deletion meaning as well as the path

Copying a delete file must preserve the mandatory metadata defining its meaning. A Truthound check needs delete kind and equality-field identities, not merely file existence. A file present at the copied path does not establish a valid deletion plan. [1, 2, 3]

A commit succeeds before planFiles fails

The public Iceberg report reproduces DeleteFile builder copy omitting equalityFieldIds. The copy commits successfully, but a subsequent planFiles call fails. It also describes explicitly setting the equality IDs again after copying. The case separates write acceptance from readiness to plan a scan. [1]

Compare the lists before and after copying

Compare delete kind and equality-field ID lists across the copy. Hold catalog registration for an equality delete lacking its required key list. If an illustrative source file has 1 approved key field, the copy must retain 1; a count of 0 fails. Equal counts can still conceal different IDs, so compare the complete list as well. [1, 3]

A conditional Truthound check

Truthound Core's ConditionalExpressionValidator can inspect a prepared metadata table for the requirement that an equality delete has a valid key list. Separate tooling extracts metadata and preserves the original list. Truthound does not call or repair the builder. Even an explicit-ID workaround needs post-commit planFiles and actual deletion-scope checks. [1, 2, 3]

Application conditions

Extract delete_kind, equality_field_count, original_field_ids and copied_field_ids for the same copy operation, preserving the original list independently.

Alternatives

Validate the reported path that explicitly resets equality field IDs after copy.

Limitations

  • Truthound neither invokes nor repairs the Iceberg DeleteFile builder. Extract inspection metadata separately.

Evidence

Event checked
Subject checked
Modified