Skip to content

Add flat vs. struct field projection benchmarks#21257

Merged
adriangb merged 1 commit intoapache:mainfrom
pydantic:friendlymatthew/more-bench-struct-field
Mar 30, 2026
Merged

Add flat vs. struct field projection benchmarks#21257
adriangb merged 1 commit intoapache:mainfrom
pydantic:friendlymatthew/more-bench-struct-field

Conversation

@friendlymatthew
Copy link
Copy Markdown
Contributor

Rationale for this change

This PR adds a benchmark comparing top-level column access against struct field access for the same logical data

#20925 introduced leaf level projection masking so that projecting a single struct field skips decoding its siblings. #21180 added benchmarks measuring that improvement across different strcut shapes. But neither benchmark answers how struct field access compare to reading the same column at the top level. Without that baseline, it's hard to know how much overhead the struct access path itself adds

@github-actions github-actions bot added the core Core DataFusion crate label Mar 30, 2026
@adriangb adriangb added this pull request to the merge queue Mar 30, 2026
Merged via the queue into apache:main with commit ccaf802 Mar 30, 2026
30 checks passed
@adriangb adriangb deleted the friendlymatthew/more-bench-struct-field branch March 30, 2026 20:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants