Add Quickwit entry#865
Open
alexey-milovidov wants to merge 2 commits intomainfrom
Open
Conversation
Quickwit (Rust, Tantivy-based) exposes an Elasticsearch-compatible REST API but no SQL endpoint, so each ClickBench query is hand-translated to ES DSL in queries.json. Loading goes through /api/v1/_elastic/hits/_bulk; querying through /_search. 19 of the 43 queries are not expressible in Quickwit's ES API (COUNT(DISTINCT), substring LIKE, scripted/runtime fields, REGEXP_REPLACE, ORDER BY on text fields) and are recorded as null. The remaining 24 queries were validated against a 1M-row sample on a single node. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Ubuntu 24.04 (the noble image used by run-benchmark.sh) refuses "pip3 install --user requests" under PEP 668's externally-managed environment, which aborted benchmark.sh after ~28s on c7a.metal-48xl. The python3-requests apt package is available and sufficient. Also drop the symlink "quickwit -> quickwit-v0.8.2" since the source directory is itself named "quickwit", and reference the versioned dir directly via $QW_DIR. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a benchmark entry for Quickwit, a Rust-based search engine for log analytics built on Tantivy. Modeled on the existing Elasticsearch entry.
Quickwit exposes an Elasticsearch-compatible REST API but no SQL endpoint, so each ClickBench query is hand-translated to ES DSL in `queries.json`. Loading goes through `/api/v1/_elastic/hits/_bulk`; querying through `/_search`.
19 of the 43 queries are not expressible in Quickwit's ES API and are recorded as `null`:
The remaining 24 queries were validated against a 1M-row sample on a single c6a-class node (aarch64). The full 100M-row run was not executed in this PR; `results/` is empty pending a full benchmark run.
Test plan