OpenKB
Open LLM Knowledge Base β an open-source CLI (VectifyAI) that compiles raw documents into a structured, interlinked wiki-style knowledge base using LLMs. It is a direct, packaged implementation of the Karpathy LLM Wiki pattern: instead of re-deriving knowledge on every query (traditional RAG), it compiles knowledge once into a persistent wiki and keeps it current. Apache-2.0.
This is the same architecture this vault runs by hand β a relevant reference for Brain and Building an AI Second Brain.
Links
Description
Two layers:
- Wiki foundation β compiles and maintains the knowledge. On
add, the LLM generates a summary page, reads existing concept/entity pages, synthesizes cross-document concepts, creates/updates entity pages (people, orgs, places, products β auto-extracted, kept in sync), and updates the index + log. One source can touch 10β15 wiki pages; knowledge accumulates rather than sitting isolated. - Generators β turn the wiki into output:
query/chat(grounded, cited answers),visualize(self-contained 3D/mind-map/radial knowledge graph HTML), and the Skill Factory.
Retrieval is vectorless β powered by PageIndex, which builds a hierarchical tree index over long PDFs (β₯20 pages) and lets the LLM reason over the tree instead of chunk-and-embed. No vector DB. Short docs are read in full via markitdown.
Wiki pages follow Googleβs Open Knowledge Format spec and are plain .md with [[wikilinks]] β opens directly in Obsidian for graph view.
Download or use
pip install openkb- GitHub: https://github.com/VectifyAI/OpenKB
- Site: https://openkb.ai/
- Multi-provider via LiteLLM β set
provider/model(e.g.anthropic/claude-sonnet-4-6,gpt-5.4,gemini/gemini-3.1-pro-preview) in.openkb/config.yaml.
Reasoning for
This vault is a hand-built version of exactly what OpenKB automates: a compiled, cross-linked wiki maintained by an LLM agent (CLAUDE.md schema, progressive-disclosure indexes, entity-style notes). OpenKB is the closest packaged tool β worth tracking for (a) its vectorless PageIndex retrieval as an alternative to embedding-based Graphify/LightRAG/CocoIndex, (b) the Skill Factory (openkb skill new) which distills redistributable Agent Skills from the wiki, mirroring the skills this repo ships, and (c) its OKF compliance.
π§© Skill Factory
openkb skill new <name> "<intent>" distills an installable agent skill from any subset of the wiki β a SKILL.md + references/ + optional scripts/, plus an auto-updated marketplace.json for one-line install. Quality gates: structural validate, trigger-accuracy eval (does the description: actually fire?), and history/rollback versioning. Iterate inside openkb chat without re-running the pipeline.
Alternatives considered
- Karpathyβs manual workflow β web clipper β
.md, LLM compiles; OpenKB adds long-doc PageIndex, automatic entity extraction, broad format support, and CLI agent integration. - Graphify / LightRAG / CocoIndex β embedding- or graph-based RAG/indexing; OpenKB is the vectorless, persistent-wiki approach.
- Open Notebook β NotebookLM-style chat-with-sources, not a compiled wiki.
- OpenWiki β langchain-aiβs code-specific counterpart: compiles a wiki of your codebase for agents, kept fresh by a daily-PR GitHub Action.
Resources
- The Stack: PageIndex, markitdown, OpenAI Agents SDK, LiteLLM, Click, watchdog.
- Ecosystem: PageIndex, ChatIndex, ConDB, PageIndex MCP.
- Concept origin: Karpathy on the LLM wiki pattern β see LLM Knowledge Bases.
Template: tool