Axiomatic Reasoning for LLMs

Interesting Similarity of Obsidian graphview and LLM

Abstract

Obsidian, a personal knowledge management tool, structures information as a graph composed of nodes (Markdown notes), edges (bidirectional wikilinks), and hubs (Maps of Content). Large Language Models based on the Transformer architecture internally represent token relationships via attention matrices that function as weighted adjacency matrices in a fully connected graph. This report examines structural and functional homologies between these two systems across static architecture and dynamic behavior. Key findings indicate that both systems organize knowledge via node-edge-hub triads, support dynamic reconfiguration through query-like operations, and exhibit convergent evolution toward hybrid internal-external knowledge architectures. Residual differences include symbolic versus subsymbolic representation, static versus dynamic persistence, and user-controllable versus emergent formation of hubs.

1. Structural Overview of Obsidian Knowledge Graph

Obsidian represents a vault of plain-text Markdown files as an interactive graph. Each file constitutes a node, and internal links using [[wikilink]] syntax form edges between nodes. The graph view provides visual navigation of the entire vault or local neighborhoods around a selected note.

Node Characteristics

Edge Characteristics

Hub Formation

Graph Dimensions

2. Transformer Internal Architecture as Implicit Graph

Transformer-based LLMs process token sequences by computing self-attention across all positions. The resulting attention matrix can be interpreted as a dynamically weighted adjacency matrix of a complete directed graph over tokens.

Node Correspondence

Edge Correspondence

Hub Correspondence

Dimensional Scale

3. Homology Analysis: Static Structural Comparison

The following table aligns corresponding components across both systems.

Structural Component Obsidian Implementation Transformer Implementation Functional Homology
Node Markdown note file Token embedding / Knowledge neuron group Information-bearing discrete unit
Edge [[wikilink]] (binary, symbolic) Attention score (continuous, subsymbolic) Relational connection between units
Hub Map of Content (MOC) Attention sink / Semantic hub Central aggregator of connections
Graph Type Sparse, undirected (effectively) Dense, directed per layer Network of relationships
Persistence Permanent file system storage Ephemeral, recomputed per context Knowledge retention mechanism

Mathematical Isomorphism
Both systems can be modeled as graphs G = (V, E) with weighted adjacency matrices. For Obsidian, A_ij ∈ {0,1} indicates existence of a wikilink. For Transformer layer l, A_ij^(l) = Attention(Q^(l), K^(l))_ij ∈ [0,1] provides continuous edge weights.

Divergence Points

4. Dynamic Behavior and Temporal Evolution

Introducing dynamic operations narrows the behavioral gap between the two systems.

Query Execution

Continuous Node Addition

External System Integration

Impact on Homology
Introducing time and execution elements increases structural homology across all axes: node addition processes become comparable, query mechanisms exhibit functional equivalence, and external integration patterns converge on hybrid knowledge architectures. The primary remaining divergence lies in transparency: Obsidian graphs remain fully inspectable and editable, while attention graphs remain latent and inaccessible for direct modification.

5. Emergent Phenomena Supporting Structural Convergence

Several independently observed phenomena reinforce the convergent nature of these systems.

Knowledge Neurons and Relation-Specific Neurons
Factual knowledge in LLMs localizes to small subsets of feed-forward neurons. Relation-specific neurons encode edge-like relational information, suggesting that explicit knowledge graph triples are implicitly encoded in weight space.

Semantic Hub in LLM Representations
Even models trained predominantly on English develop an internal semantic hub that aligns representations across languages and modalities. This mirrors the MOC pattern where diverse notes converge on a central organizing note.

Graph-Aware Attention Reformulations
Research explicitly recasts Transformer attention as a graph operation, demonstrating that injecting graph neural network inductive biases improves relational reasoning. This confirms that attention matrices inherently serve as latent graph structures.

6. Synthesis: Convergent Evolution of Knowledge Networks

The structural parallels between Obsidian graphs and Transformer attention networks arise from a shared functional imperative: efficient representation and retrieval of relational knowledge. Both systems evolved under different constraints:

Constraint Obsidian Transformer LLM
Interpretability Full human readability Opaque vector representations
Scalability Limited by manual curation Massive automated scaling
Persistence Non-volatile file storage Volatile, recomputed per inference
Control User-directed link creation Data-driven, emergent connections

Despite these differences, the underlying node-edge-hub triadic structure persists. The addition of query languages and external memory integration further aligns their operational dynamics.

7. Practical Implications

Augmented Knowledge Workflows
Integrating Obsidian with LLM via MCP creates a system where AI agents read and write to a human-curated knowledge graph. The vault becomes a persistent, inspectable memory layer for the LLM, mitigating hallucination risks through grounded retrieval.

Interpretability Proxies
The graph view in Obsidian provides a tangible metaphor for the latent structures inside Transformer models. Analyzing attention graphs as if they were Obsidian graphs aids mental modeling of LLM behavior for researchers and developers.

Hybrid Architectures
The convergence pattern supports the design of neuro-symbolic systems where symbolic knowledge graphs (Obsidian-style) complement subsymbolic neural inference. This dual approach leverages the strengths of both paradigms: explicitness and control from graphs, flexibility and generalization from neural models.

8. Conclusion

The Obsidian graph view and Transformer internal attention mechanism exhibit a robust structural homology characterized by node-edge-hub triads, dynamic reconfiguration capabilities, and hybrid integration with external knowledge sources. Dimensional scale and implementation substrates differ, but the underlying organizational logic converges on a network-based knowledge representation. This similarity informs both practical tooling for augmented cognition and theoretical understanding of knowledge emergence in artificial neural systems.