Skip to content

Introduction

The Project

The Pruzhany Chronicles transforms the archived pages of two historical Yiddish newspapers into a vivid portrait of a community on the eve of its destruction. Using generative AI to read the surviving editions from Pruzhany, Poland, the project extracts local entities—individuals, businesses, life events—and weaves them with Holocaust databases, library collections, and yizkor books to reassemble a data-driven record of the town's final years.

This Guide

This guide walks through one edition—December 16, 1938—to document how a newspaper scan becomes a structured database. Each section details one layer of the data model, from physical text extraction through semantic event mapping, with every value drawn from the live edition bundle. Work is ongoing to process the approximately 500 remaining editions of the Pruzaner Sztyme and Pruzaner Lebn spanning 1934–1939, preserved by the Historical Jewish Press.

Three-Layer Architecture

The data model separates the newspaper content into three increasingly semantic layers, plus a cross-cutting enrichment layer. This separation reflects a fundamental insight: the physical layout of a newspaper page, the editorial structure of its content, and the real-world events it describes are three distinct things that happen to share the same physical medium.

blocks reference content units
content units grouped into events
Click a layer to see examples

Edition at a Glance

This guide explores the 1938-12-16 edition of the Pruzhaner Shtime — 4 pages containing 7,873 words across 170 text blocks, organized into 77 content units. The enrichment layer adds 163 named individuals, 61 locations, and 3 documented events.

Entity Counts

0 Pages
0 Text Blocks
0 Content Units
0 Events
0 People
0 Locations
0 Organizations
0 Topics

Pages & Blocks (Layer 1)

The physical layer represents the newspaper as the OCR pipeline sees it. Each of the 4 pages is divided into text blocks — contiguous regions of text identified by their bounding box coordinates on the page image. These coordinates allow the digital edition to link every piece of transcribed text back to its precise location on the original newspaper.

Page Summary

Block IDBbox [x, y, w, h] TranscriptionConf. Content Unit
blk-1938-12-16-p1-r001[918, 140, 1479, 102]אקציע פון קק"ל! שטיצט די חנוּכה—
blk-1938-12-16-p1-r002[2295, 282, 686, 64]PRUŻANER SZTYME—
blk-1938-12-16-p1-r003[1739, 301, 373, 54]פרייז 10 גר.—

Content Units (Layer 2)

Content Units represent the editorial structure of the newspaper. Each unit is a coherent editorial object — an article, a notice, an advertisement, a congratulatory message, or an obituary. A single Content Unit may span multiple physical blocks (for example, an article that flows across two columns).

Showing 57 ad units. Select a type above to browse.

57 of 57
ID Printed title · Supplied title People Locs
cu-1938-12-16-i0101Headline: JNF Hanukkah Campaign00
Page location
Page 1 1 block

Yiddish Text

אקציע פון קק"ל! שטיצט די חנוּכה

English Translation

Support the Hanukkah campaign of the JNF!
Ad · Commercial advertisement Subjects: Zionism
Physical location:  
Cross-references: (references, 80%)  (references, 100%)  (references, 100%) 
cu-1938-12-16-i0103אקדמית חנוכה נהדרתA splendid Hanukkah academy22
cu-1938-12-16-i0104א פייערלעכע חנוכה אקאדעמיעA festive Hanukkah academy02
cu-1938-12-16-i0105רחל פאמעראניעץ חיים שור חתונה געהאטMain Wedding Announcement: Rachel Pomeranietz & Chaim Shor married in Buenos Aires, Dec 10, 193823
cu-1938-12-16-i0106צו דער חתונה פון אונזער ליבער טאכטער און שוועסטער רחל מיט ה' חיים שור פאטער דוד פאמעראניעץ, כייקע, זעליק, לאה'לע שאפירא (הי), יצחק פאמעראניעץ (ארגענטינעWedding greetings to Rachel Pomerantz from her family72
cu-1938-12-16-i0107למחותננו ר' דוד פומרניץ (פה), בנו יצחק (ארגנטינה) ולבננו זליק, חייקה ולאה שאפירא יחזקאל שאפירא ומשפחתו (פה) דוד (ירושליםWedding greetings from Yechezkel Shapiro and family93
cu-1938-12-16-i0108אונזער פלימעניק און קוזין דוד פאמעראניעץ בערל קאפלאן און פאמיליעFrom Avraham-Yitzchak and Berl Kaplan50
cu-1938-12-16-i0109אונזערע פריינט פאמיליעס פאמעראניעץ־שאפירא איטקע, משה טשערעטשעווסקי און קינדערFrom Itke and Moshe Cherechevsky40
cu-1938-12-16-i0110אונזערע פריינט פאמיליעס פאמעראניעץ־שאפירא צירל, בנימין עלמאן און קינדערGreetings from Tzirl and Binyamin Elman40
cu-1938-12-16-i0111אונזער קוזין דוד פאמעראניעץ ריבטשע, משה יודעוויטשFrom Kaplan and Judewicz families80
cu-1938-12-16-i0112אונוער קוזין דוד פאמעראניעץ לייבל (פיעסקFrom Shimon Birnbaum and Leibel53
cu-1938-12-16-i0113אונזער קוזין דוד פאמעראניעץ העניע, לייב שו"ב פרוזשאנסקי און קינדערFrom Henye and Leib Pruzhanski60
cu-1938-12-16-i0114אונזערע פריינט פאמיליעס פאמעראניעץ־שאפירא יעקב פערלשטיין און פאמיליעHearty Mazel Tov from Jacob Perlstein30
cu-1938-12-16-i0115אונזער פריינט דוד פאמעראניעץ בעלטשע, אליהו פאמעראניעץWedding greetings from Belche and Eliyahu Pomerantz60
cu-1938-12-16-i0116ר חל! צו דיין חתונה מיט ה' חיים שור אסתר זאוועלעווסקי (קאמעניעץGreetings from Teigl, Dare, Lashe, and Esther73
cu-1938-12-16-i0117אונזער פריינט דוד פאמעראניעץ פאמיליעס ליפשיץ־פאמעראניעץ סגלFrom Lifshitz-Pomerantz families30
cu-1938-12-16-i0118אונזערע גוטע פריינט פאמיליעס פאמעראניעץ שיינדל, אהרן סופר, פריידקע, וואלפקע עלמאןFrom Spector and Elman families80
cu-1938-12-16-i0119חברטע רחל! דבורה, לייבל שאפירא און טעכטערלFrom Dvora and Leibl Shapiro40
cu-1938-12-16-i0120די פאמיליעס פאמעראניעץ שאפירא אפרים־מיכל פרוזשאנסקי שו"ב און פאמיליעFrom Ephraim Michel Pruzshansky30
cu-1938-12-16-i0121מזל־טוב! די פאמיליעס פאמעראניעץ שאפירא יוסף קליינערמאן און קינדערFrom Yosef Kleinerman and children30

Life Events (Layer 3)

Life Events represent the semantic layer — real-world occurrences that generated newspaper coverage. The Pomerantz–Shor wedding, for instance, produced 27 Content Units: a formal announcement from the bride's father plus 26 congratulatory messages. The event groups these Content Units together and records each unit's role (primary announcement, congratulation, or mention).

This edition contains 3 events with associated Content Units. Each event links to the shared record of the same happening across issues.

3 of 3
Event Name Type Source Main people Units
Death of Chaim FeldmanDeathedition12
Birth to Rivka Kaplan-Judewicz and Moshe JudewiczBirthedition323
Wedding of Rachel Shor (née Pomeraniec) and Chaim ShorWeddingedition227

Community Connections Made Visible

The table above shows individual events in isolation. But the real power of the semantic layer emerges when events are cross-referenced — revealing how the same people appear across different life events, their relationships reconstructed from the newspaper's own pages.

The same edition also announces the birth of a daughter to Rivtche and Moshe Judewicz, generating a formal birth announcement and 22 congratulatory messages. Strikingly, 19 individuals sent congratulations to both events — among them Rivtche Judewicz herself, the new mother, who joins the Kaplan and Judewicz families in congratulating the Pomerantz–Shor wedding ().
WeddingPomerantz–ShorBirthJudewicz36only wedding37only birth22both events
Wedding Only 36
Shared 22
Birth Only 37

Social overlap between two life events in the 1938-12-16 edition

The Enrichment Layer

The three layers above capture what is in the newspaper — its physical form, editorial structure, and the events it describes. The enrichment layer goes further: it adds structured knowledge drawn from external research, transforming brief textual mentions into richly annotated records. Every named person, place, organization, and topic becomes a node in a growing knowledge graph.

This enrichment accumulates gradually. The current edition represents a snapshot of ongoing research — some entities have extensive biographical data and verified Holocaust fates, while others remain skeletal entries awaiting further investigation. The Data Quality section quantifies these gaps.

Five Entity Types

The sections that follow explore each entity type in detail. Here is what the enrichment layer captures for this edition:

163 People Biographical data, family relationships, Holocaust fate
61 Locations Hierarchical geography with coordinates and historical context
3 Events Edition events and historical events with main_people
0 Topics Thematic tags grouping related content units
44 Organizations Named institutions, businesses, and communal bodies

References are maintained in both directions — a person lists all content units where they appear, and each content unit lists all people mentioned in it — supporting different access patterns depending on whether you're exploring an entity or reading an article.

People

The enrichment layer identifies 163 individuals mentioned in this edition. Each person entity includes biographical data and, where possible, research into their fate during the Holocaust. This research draws on databases from Yad Vashem, the Arolsen Archives, memorial books, and other sources.

For most individuals in this edition, their Holocaust fate remains unknown — a common challenge in Holocaust research. The fate classifications range from definitive ("Perished," "Survived") to probabilistic ("Likely Perished," "Likely Survived" based on their known location and circumstances).

22 people connected by 182 family relationships across 1 family groups

Kaplan–Judewicz
Fate Perished Likely Perished Survived Unknown Died Before
Relationship Spouse Parent–Child Sibling In-Law Other

Locations

The enrichment layer includes 61 geographic locations, organized in a hierarchical tree reflecting administrative containment: streets sit within towns, towns within districts, districts within regions, and regions within countries.

Each location is linked to external geographic databases (Wikidata and GeoNames) for interoperability with the European Holocaust Research Infrastructure (EHRI). Locations of Holocaust significance include structured metadata about ghettos, camps, and massacre sites.

The map below shows how this single newspaper edition connected readers across four continents — from the Pruzhany heartland to the Argentine diaspora, from Eretz Israel to Newfoundland. Dot size reflects the number of content units mentioning each location. Click any dot to see its details in the tree below.

Click any location in the tree to see its details. Use Expand All to see the full hierarchy.

country Belarus 0
region Brest Region 0
town Pruzhany 14
country Canada 0
country Israel 0
country Lithuania 0
country Poland 2

Pruzhany

Type
town
Coordinates
52.5567, 24.4567
Content Units
              

Topics & Organizations

Topics (0)

Topics categorize Content Units by theme, grouping related editorial content regardless of physical position in the newspaper.

Organizations (44)

Organizations mentioned in the newspaper include local businesses, community institutions, and cultural organizations, linked to the Content Units where they appear.

Other

Data Quality & Coverage

Where is the data complete, and where are the gaps? This section examines field coverage across the edition's entities and visualizes the Holocaust fate research that underpins the biographical data. These metrics help assess readiness for using this edition as ground truth when processing future editions.

Field Coverage

Percentage of entities where key fields have been filled in (excluding “unknown” values for Holocaust fate).

Content Units with English translation 77/77
100%
Blocks assigned to Content Units 166/170
98%
People with determined Holocaust fate 44/163
27%
People with family relationships 22/163
13%
People with Yiddish name 155/163
95%
Locations with coordinates 35/61
57%

Holocaust Fate Distribution

Each square represents approximately 1% of the 163 named individuals.

Unknown 119 73%
Perished 29 18%
N/A 5 3%
Likely Perished 4 2%
Survived 3 2%
Died Before 3 2%

Timeline

Birth and death years of named individuals, relative to the newspaper's publication

1880189019001910192019301940195016 Kislev 5699PUBLICATION DATE
Birth year
Death (perished)
Death (survived)
Death (died before war)
Publication date

Technical Reference

This section documents key design decisions in the data model — the choices that aren't obvious from the data itself but matter for reviewing correctness and extending the model for future editions.

Why String IDs?

All entity identifiers are semantic strings like person-rachel-pomerantz or cu-ball-announcement rather than auto-incrementing integers. This choice offers several advantages:

  • Self-documenting: You can read the data without looking up IDs in a separate table
  • Prefix-based polymorphism: The UI can determine entity type from the prefix (person-, cu-, location-), enabling a single selection variable to hold any entity
  • Stability: IDs don't change when the database is rebuilt (unlike auto-increment)
  • Debuggability: Log messages and JSON output are human-readable

ID Prefix Reference

PrefixEntity TypeExample
page-Pagepage-1938-12-16-4
blk-Blockblk-5746
cu-Content Unitcu-13685
event-Eventevent-pomerantz-shor-wedding
person-Personperson-rachel-pomerantz
location-Locationlocation-pruzhany
topic-Topictopic-lifecycle-events
org-Organizationorg-kehillah-pruzhany

Why snake_case?

All field names use snake_case (e.g., holocaust_fate, unit_ids) for consistency with the SQLite database layer. Earlier versions used camelCase, but the migration to a relational database standardized on snake_case throughout the stack.

Why Separate Files?

Each data layer is stored in its own JSON file because each has a different authoring cadence:

  • Pages/Blocks: Change when OCR is re-run or corrected
  • Content Units: Change during editorial curation
  • Enrichment: Accumulates gradually through research
  • Life Events: Curated as editorial understanding deepens

Separation allows independent updates without merge conflicts. The Edition Bundle (1938-12-16-edition.json) contains the five projected issue documents. Repeated source text is stored once in its text table; the accompanying JSON Schema describes those references. Each person's detail_path links to their public facts and sources across issues. People share a fixed set of shards. Both the issue and those shards come from the same privacy projection.

Event Source Classification

Events carry a source field distinguishing their provenance:

  • edition — Events documented in the newspaper itself (weddings, bar mitzvahs, community news)
  • historical — Events added from external Holocaust research (ghetto establishment, deportations, massacres)

Events of type holocaust_event always have source: 'historical'. This classification ensures that the newspaper's own voice is never confused with retrospective knowledge.

רייזטשע און משה יודעוויטש מעלדן וועגן געבורט פון זייער טעכטערל

Rivtche and Moshe Judewicz announce the birth of their little daughter

— for Tzvia

Generated from the Pruzhany Digital Archive edition bundle. Schema version: 1.0.0.

A project of DS Media LLC