SYSTEM Cited by 1 source
GitHub Blackbird¶
Definition¶
Blackbird is GitHub's code search engine, responsible for indexing over 180 million repositories — more than 480 TB of source code. It extracts ngrams from every byte of source code after case-folding, building the search index that powers GitHub's code search product.
Architecture (known)¶
- Indexing pipeline: Every byte of source code is case-folded before ngram extraction. This makes the speed of case-folding a critical infrastructure cost driver at 480 TB scale.
- Query path: For every potential query result, another (implicit or explicit) case-folding operation locates matches.
- Language: At least the case-folding component is implemented in Rust (the casefold crate is open-sourced from this work).
Scale¶
- 180 million repositories indexed
- 480 TB of source code
- Case-folding runs on every byte at index time
(Source: sources/2026-07-31-github-dont-stop-early-case-folding-source-code-at-memory-speed)
Seen in¶
- sources/2026-07-31-github-dont-stop-early-case-folding-source-code-at-memory-speed — describes the performance-critical case-folding operation optimized for Blackbird's scale
Related¶
- systems/casefold-crate — the Rust crate open-sourced from Blackbird's case-folding optimization
- companies/github — operator