A practical research investigation into what has already been built for analyzing the Torah, Prophets, and Writings in their original Hebrew and Aramaic, and a feasible blueprint for a next-generation system.
All source data is Hebrew-native. The proposed interface and outputs are English. Compiled July 2026.
Summary: the foundational data problem is largely solved. A verified Hebrew text with hand-checked lemma and morphology already exists under open licenses (OSHB, MACULA, STEPBible, ETCBC). The realistic work is not building linguistic data from scratch but assembling existing verified datasets into a queryable index with a clean English interface, using deterministic methods for anything linguistic and restricting generative AI to explanation. What follows maps the landscape and gives a build plan grounded in that reality.
Indexing the Hebrew Bible is one of the oldest information-retrieval projects in Western scholarship. The lineage runs from hand concordances to morphological databases long before any neural model.
Takeaway for system design: the concordance/lemma/root/Strong's model is not legacy baggage. It is the exact data shape a modern index needs, and open datasets already encode it.
public domainconsonants + vowels + cantillation
Contains: the full pointed Hebrew/Aramaic text of the Leningrad Codex, including qere/ketiv (read vs written) variants and accent marks. Structure: plain text and XML transcriptions keyed by book/chapter/verse. Supports: exact-text display, verse citation, and the base layer every other dataset annotates. It is text only; morphology is added by downstream projects.
morphhb)CC BY 4.0 (annotations)OSIS XMLmost accessible
Contains: the WLC text plus, for each word, a lemma (an augmentation of Strong's numbers) and a morphology code (for example HVqp3ms = Hebrew, Verb, Qal, perfect, 3rd person, masculine, singular). Structure: OSIS XML with per-word <w> elements carrying lemma and morph attributes; prefixes and suffixes are segmented. Supports: lemma search, morphological filtering, interlinear display. This is the single most practical starting dataset for an open build. Morphology is hand-curated, not machine-guessed.
research-gradegraph formatdeepest syntax
Contains: roughly 426,000 words with the richest linguistic annotation available: part of speech, person/number/gender, verbal stem (binyan) and tense, plus phrase, clause, and sentence segmentation with phrase functions and clause types. Structure: a graph of typed nodes (word, subphrase, phrase, phrase_atom, clause, clause_atom, sentence, verse, chapter, book) and features on them, distributed in the Text-Fabric format. Supports: genuine syntactic and grammatical queries. Two front doors: SHEBANQ (web, MQL queries, saveable) and Text-Fabric (offline Python). Fixed versions exist for 2011 through 2021 and 2025, plus a continuous c version.
CC BY 4.0TSVTyndale House
TAHOT (Translators Amalgamated Hebrew OT): the Leningrad text via OpenScriptures, corrected against colour scans, with full morphology and disambiguated extended Strong's tags for every word, prefix, and suffix. TBESH (Translators Brief lexicon of Extended Strongs for Hebrew): an abridged BDB keyed to those extended Strong's numbers. Structure: tab-separated text files, easy to ingest. Supports: word-to-lexicon joins, glossing, and a clean Strong's spine that is backward-compatible with legacy Strong's.
open licenseTSV + syntax treesrichest open stack
Contains: the WLC text, OSHB morphology, syntax trees (developed with the Groves Center), SDBH semantic domains, glosses, referents, and quotation markup. Word senses draw on the UBS MARBLE project. Structure: both a flat WLC/tsv word table (no tree, easy to load) and a graph/tree form for syntactic work. Supports: everything OSHB does, plus syntax and semantic-domain queries, in one coherent open package. For a new build, MACULA is the strongest single backbone because it consolidates several sources.
Uncertainty flag: exact word counts, version numbers, and license details drift between releases. Treat the figures here as close and pin a specific dataset version at ingestion time.
A key finding: for the Masoretic Text specifically, hand-verified morphology already exists, so machine morphological parsing is mostly unnecessary for the MT itself. ML earns its place on harder tasks: reconstruction of damaged inscriptions, semantic search, stylistic classification, and candidate intertextual detection. The tasks below are ordered by how reliable and ready they are.
| Task | Best current approach | Method / model | Availability | Reliability |
|---|---|---|---|---|
| Morphological tagging | OSHB / MACULA gold morphology (hand-curated); Dicta DictaBERT-morph for unlabeled text |
Curated database; fine-tuned BERT for the ML route | OSHB, MACULA: open. Dicta: open/free | High — MT is already fully tagged |
| Syntactic analysis | ETCBC clause/phrase database; MACULA syntax trees; Andersen–Forbes & Cascadia (Logos) | Rule-based + hand-corrected linguistic annotation | ETCBC, MACULA: open. Andersen–Forbes, Cascadia: commercial (Logos) | High for the annotated MT |
| Semantic search / embeddings | Dicta BEREL / DictaBERT family; NeoDictaBERT (2025) |
BERT-style PLM pretrained on rabbinic/modern Hebrew | Open (Dicta / HuggingFace) | Medium — trained mostly on rabbinic/modern, not biblical, so use with care |
| Named-entity recognition | Derived from proper-noun tags (OSHB/STEP) + gazetteer; MACULA referents | Lexical tag lookup, not a dedicated neural NER | Open (data-derived) | Medium — no robust biblical-Hebrew NER model; entity resolution is the gap |
| Intertextual / parallel detection | Sefaria traditional links (deterministic); transformer benchmark (arXiv 2025) for candidate discovery | Curated cross-references + embedding-similarity ranking | Sefaria links: open. Benchmark: research code | Medium — good for candidates, needs human confirmation |
| Text reconstruction | Embible (Fono et al. 2024) for damaged Hebrew/Aramaic | Ensemble of masked word + character transformers | Research (ACL Findings) | Medium — niche, for epigraphy not the intact MT |
Caution on general LLMs: peer commentary (e.g., HIPHIL Novum, 2024) documents that large language models hallucinate morphology, invent citations, and misparse biblical Hebrew. They are unsafe as a source of linguistic truth and should be confined to explanation over retrieved, verified data.
The dividing line is whether a tool keys its analysis to the Hebrew token or to an English gloss.
Design implication: build on a Hebrew-native dataset (OSHB or MACULA), store lemma and root as distinct fields, and never let an English gloss become the primary key.
Keep the core graph small and fully derivable from existing verified data. Every node and edge below can be populated from OSHB or MACULA on day one, except the two marked optional.
| Node | Holds | Source |
|---|---|---|
Book / Chapter / Verse | reference, canonical order, versification scheme | WLC |
Word (token) | surface form, position in verse, pointing | WLC / OSHB |
Lemma | dictionary form, Strong's / extended Strong's id, gloss | OSHB / TBESH |
Root | tri-consonantal root | lemma→root map (ETCBC lexeme data helps) |
Morphology | POS, stem, tense, person, gender, number, state | OSHB / MACULA |
Entity | person, place, group; canonical id | proper-noun tags + gazetteer |
Sense (optional) | semantic domain | MACULA / SDBH |
This is deliberately shallow. It answers the questions that matter (where does this root occur, in which stems, near which entities, with what parallels) without trying to encode every interpretive layer at once. Deeper syntax (the ETCBC/MACULA trees) attaches later as an additional edge set, not a rewrite.
Jewish and Christian reading traditions matter for data modeling only where they change annotation. Model them as separate, provenance-tagged layers over the same core text, never merged into it.
Each layer is a toggle. The core index stays neutral and verifiable; interpretation is clearly attributed to its tradition and source.
Equidistant-letter sequences, gematria patterns, and "hidden design" claims lack methodological support: they are sensitive to text edition, spacing, and multiple-comparisons problems, and published statistical support has not withstood scrutiny. They are deprioritized and must never sit in the core. If ever included, they belong in a clearly labeled, opt-in computed layer, presented as pattern output rather than fact, and kept separate from the verified linguistic data.
A verified text, morphology, and basic linguistic annotation, made queryable two ways, with every answer traceable to the token and dataset it came from.
Every response carries the verse reference, the exact Hebrew token(s), the morphology, and the source dataset plus version. If it cannot be traced, it is not shown.
Minimum components: a reliable Hebrew text, morphological tagging, a searchable database, a basic interface.
WLC/tsv) into a Postgres schema: book → chapter → verse → word, with lemma and morph on each word.| Tool | Hebrew support | Data depth | Usability | Extensibility | Fit for a new build |
|---|---|---|---|---|---|
| Logos | Excellent — reverse interlinears, Andersen–Forbes + Cascadia syntax | Deepest commercial; huge licensed library | Polished, English UI, heavy | Closed; extend only via its own tools | Low — reference, not a data source |
| Accordance | Excellent — fast tagged-MT original-language search | Strong, some syntax | Fast, English UI | Closed | Low — reference |
| STEP Bible | Very good — solid Hebrew tagging | Good; lighter analysis | Free, simple, English UI | Open data (CC BY 4.0) | High — usable data + model |
| ETCBC (SHEBANQ / Text-Fabric) | Deepest open linguistic annotation | Highest for syntax/grammar | Research-grade; steep; Python/MQL | Fully open + programmable | High — the syntax backbone |
| MACULA (Clear-Bible) | Excellent — WLC + morph + trees + senses | Richest open consolidated stack | Data files, not an app | Open license | Highest — best single backbone |
Reading: Logos and Accordance are references to consult, not foundations to build on (closed data). MACULA, ETCBC, OSHB, and STEPBible are the buildable foundation — open, documented, and Hebrew-native, with an English presentation layer that is entirely your own to design.
Bottom line: the verified linguistic foundation already exists and is open. The realistic, high-value work is integration and interface, using deterministic methods for everything linguistic and confining generative AI to explanation over cited data.
Confidence: high on the identity, structure, and openness of the core datasets (verified against their live repositories, July 2026). Medium on fast-moving ML details (model names, accuracy figures, latest releases) — verify the specific version before relying on it in a build.