# World data lake · collect first · then present

**Status:** direction locked · scaffolding live · full ingest multi-phase  
**Doctrine hard lines (never break):**
- **No** OUP / Turner *Dictionary of Ancient Deities* text (or any modern closed encyclopedia scrape)
- **No** sacred-texts.com full-text scrape (category map inspiration only)
- **No** pirate comics / commercial lyrics  
- **Yes** Gutenberg · Wikidata CC0 · Open Library · Internet Archive PD · Getty open metadata · honor gates

**Your photos (IMG_6520–6523):** structure reference only — dual-column A–Z deity dictionary with *Also known as* · *See also* · culture tags · cross-culture correspondences. Rebuild that **shape** on open sources; never OCR/import Turner pages.

---

## Phase order (honest)

| Phase | Name | Goal | When collab |
|-------|------|------|-------------|
| **D0** | Spine (done) | Labs · path · zoom · 286 living books · 5958 deities · open-names | — |
| **D1** | Placeholders | Every Gutenberg id + open title stub · doctrine source map · viewer layouts | not yet |
| **D2** | Catalog fill | Resolve stubs → real metadata (title/author/lang) from Gutenberg RDF / Open Library | not yet |
| **D3** | Viewer fidelity | newspaper · archive slides · side-by-side · A4 · comic · poster · widescreen · eink · glyph-broadcast | demo-ready |
| **D4** | Deity graph | World deities + human given names · alt names · story links · culture · seeAlso (open only) | demo-ready |
| **D5** | Small data lake | AI-assisted normalize · embeddings optional · lake tables under `data/lake/` | after D2–D4 solid |
| **D6** | Present + collab | One story · Track C outreach | **you** reach out |

Until D3–D4 feel good, collab is still small talk. That’s correct.

---

## Lakes / corpora (open only)

### 1 · Books (living + visual)
| Source | Use | Loader |
|--------|-----|--------|
| Project Gutenberg catalog | **Every** ebook id as catalog row | `data/living-books/gutenberg-catalog-meta.json` + future RDF pull |
| Gutenberg HTML/txt | Read-through when opened | `/api/gutenberg` · `living-book-reader.js` |
| Open Library | Covers · alternate titles · works | links on stub |
| Internet Archive PD | Facsimile plates · deep-zoom | `visual-projects` + IIIF later |
| Codex Regius sibling | Facsimile pattern | already wired |

**Today:** ~286 catalogue entries (277 with Gutenberg).  
**Target D1:** placeholder row for **all** Gutenberg ebooks (~70k+) as slim stubs (id · title · author · lang · status=stub). Full text **never** bulk-mirrored — load on demand.

### 2 · Doctrine / sacred / wisdom (beyond sacred-texts map)
| Source class | Role |
|--------------|------|
| Gutenberg scripture/PD wisdom | Full text |
| Wikidata religion/mythology items | Labels · cultures · same-as |
| µeee lens sources (mueee.qbitos.ai) | Discovery index under ugrad shell (U1) — not a rights free-for-all |
| Archive.org PD collections | Facsimile when PD |
| Getty open / museum open metadata | Culture / iconography links |

Category map may mirror sacred-texts **topics**; full text only PD.

### 3 · Deities (Turner-shape, open body)
| Field (target) | Open source |
|----------------|-------------|
| name · spelling | Wikidata label |
| culture / pantheon | Wikidata P2596 / culture claims |
| description (short) | Wikidata description (CC0) |
| alsoKnownAs[] | Wikidata aliases + sitelinks |
| seeAlso[] | Wikidata “said to be the same as” / related + our graph |
| stories[] | **Links** to Gutenberg myth PD + Wikipedia (read offsite) — not closed encyclopedia prose |
| correspondences | e.g. Ma-Bellona ↔ Athina (from open sources only) |

**Today:** 5958 deities (open-wikidata).  
**D4:** enrich with `alsoKnownAs` · `seeAlso` · `culture` fill · story links · dual-column dictionary chrome (your photo layout).

### 4 · Human names (world)
| Source | Use |
|--------|-----|
| open-names given/family/history | Live packs |
| Wikidata human names / given name items | Expand |
| Frequency / open baby-name datasets (license-checked) | Optional growth — **no** closed babyname site scrapes without license |

**Today:** thousands of given/family/history rows + names-glance ~17k.

---

## Viewer layouts (D3) — placeholders live

See `data/living-books/viewer-layouts.json`. Modes:

| id | Intent |
|----|--------|
| `newspaper` | multi-column dense text |
| `archive-slides` | plate-first · caption bar |
| `side-by-side` | verso \| recto (your open-book photos) |
| `a4` | portrait page frame |
| `comic` | panel gutter · page turns |
| `poster` | single plate · max zoom |
| `widescreen` | 16:9 stage |
| `eink` | greyscale · high-contrast · kindle-like |
| `glyph-broadcast` | GrokYtalkY row blocks `::` `.:` `:.` `::` · pixel/glyph strip |

Zoom already good (deep-zoom maxScale 64). Layouts change **frame + chrome**, not the zoom engine.

---

## Small data lake (D5) — shape only for now

```
data/lake/
  manifest.json          # corpora list · rights · row counts
  books/catalog.parquet|jsonl   # stubs → resolved
  deities/graph.jsonl
  names/given.jsonl
  doctrine/sources.jsonl
  derived/               # AI normalize outputs (never closed text)
```

**AI role:** normalize, dedupe, link entities, suggest seeAlso — **not** invent licensed prose or scrape Turner.

---

## What we do **not** do with your book photos

- OCR Turner pages into the lake  
- Store Dictionary of Ancient Deities full text  
- Cite Turner as a data source  

We **do** use them as UX/layout + field-shape inspiration for the open deity dictionary.

---

## Near-term build order (code)

1. Gutenberg catalog placeholder pipeline (slim stubs)  
2. Viewer layout mode switch on living-books / deep-zoom  
3. Deity cross-ref enrichment schema + Wikidata alias pass  
4. Doctrine source registry (µeee lens + open lists)  
5. `data/lake/manifest.json` + first jsonl exports  
6. Only then: presentation deck + Track C outreach  

---

## Commands (as they land)

```bash
# planned
npm run books:gutenberg-catalog   # stub all PG ids
npm run lake:export               # snapshot open tables
npm run deities:enrich-aliases    # Wikidata aliases → alsoKnownAs
```

Live today:

```bash
npm run books:pd
npm run books:sacred
# visual deep-zoom projects already in visual-projects.json
```