After copying an Iceberg DeleteFile, verify equalityFieldIds survive
A copied path and successful commit do not establish that the metadata defining deletion semantics was retained.
Copy the deletion meaning as well as the path
Copying a delete file must preserve the mandatory metadata defining its meaning. A Truthound check needs delete kind and equality-field identities, not merely file existence. A file present at the copied path does not establish a valid deletion plan. [1, 2, 3]
A commit succeeds before planFiles fails
The public Iceberg report reproduces DeleteFile builder copy omitting equalityFieldIds. The copy commits successfully, but a subsequent planFiles call fails. It also describes explicitly setting the equality IDs again after copying. The case separates write acceptance from readiness to plan a scan. [1]
Compare the lists before and after copying
Compare delete kind and equality-field ID lists across the copy. Hold catalog registration for an equality delete lacking its required key list. If an illustrative source file has 1 approved key field, the copy must retain 1; a count of 0 fails. Equal counts can still conceal different IDs, so compare the complete list as well. [1, 3]
A conditional Truthound check
Truthound Core's ConditionalExpressionValidator can inspect a prepared metadata table for the requirement that an equality delete has a valid key list. Separate tooling extracts metadata and preserves the original list. Truthound does not call or repair the builder. Even an explicit-ID workaround needs post-commit planFiles and actual deletion-scope checks. [1, 2, 3]
Application conditions
Extract delete_kind, equality_field_count, original_field_ids and copied_field_ids for the same copy operation, preserving the original list independently.
Alternatives
Validate the reported path that explicitly resets equality field IDs after copy.
Limitations
Truthound neither invokes nor repairs the Iceberg DeleteFile builder. Extract inspection metadata separately.
Evidence
- Event checked
- Subject checked
- Modified
