Truthound · All articles · 24/24
Evidence-led Truthound Core guidance on data contracts, check inputs and operational limits.
480 articles
Checking R list-element names across an Arrow and Parquet round trip
Preserved table metadata does not establish preservation of the names that identify list elements.
Checking Arrow offsets when ASCII conversion shortens the data buffer
The array offset and the first value offset describe different boundaries.
Check quantile probabilities before interpreting Arrow tdigest NaN
Invalid probability requests and approximation error on valid requests require different checks.
Checking Arrow rounding grids separately from tie-breaking
Verify both membership of the rounding grid and the policy used to choose a neighboring multiple.
Checking required children only where their parent struct exists
Physical NULL slots beneath an absent parent are different from missing children under a present parent.
Checking Parquet root nodes before using StreamReader
Format-level support for nesting does not imply that every reader API supports nested schemas.
Checking for unread data after an empty Parquet page
A page with no values is not necessarily the end of its column chunk.
Checking list-element support before converting Arrow data to pandas
A successful top-level conversion does not establish support at a nested list position.
Validating literal dotted names separately from nested ORC paths
Preserve field identity before comparing a top-level a.b column with a child b inside struct a.
Validate requested rows before calling Arrow Dataset.head(-1)
Do not import pandas negative-head semantics into a different scanning API.
Checking value parity for V4 Arrow IPC union subset reads
Bind full-read and subset-read controls to the same file, metadata version, union kind and row identity.
Validating original dates before Emscripten timestamp normalization
A valid output timestamp can hide an impossible date in the original input.
Checking the int64 minimum before negating Arrow durations
The smallest signed duration has no positive counterpart in the same storage type.
Validating logical slice alignment in Arrow dense unions
An in-range offset can still select the wrong child value after two input windows become misaligned.
Aligning date32 contracts across Python lists and NumPy arrays
Record the date unit and the supported conversion path alongside the integer values.
Checking complete dictionary types before Arrow coalesce
Value types alone omit index widths and ordered flags that can determine execution compatibility.
Airbyte Postgres Xmin bookmarks: retain rows that commit late
The largest issued transaction number differs from the boundary imposed by older transactions that are not visible yet.
Airbyte MariaDB CDC restart failures: inspect the TableMap context behind the offset
A restart offset must identify a decodable event boundary, not merely an increasing number.
Airbyte MySQL composite-key snapshots: inspect the first key group
An exclusive first partition boundary can omit the minimum-key group even when synchronization succeeds.
Airbyte MySQL-to-ClickHouse type errors: start with the corrected CDC selectedFields diagnosis
Before changing a date conversion, check whether CDC system fields match the transmitted schema.
