A semantic substrate for developmental learning

Bithkuil is an experimental representation and training research program exploring whether a learner can acquire relational and compositional competence more efficiently when important semantic distinctions are made explicit before they must be reconstructed from ordinary language.

The project draws selectively from the unusually rich grammatical architecture of New Ithkuil, treating parts of that architecture as a source of candidate semantic factors rather than as a language that a neural network must simply learn to speak.

The central question is empirical: can structured semantic representations reduce the data, parameter, compute, or developmental cost required to acquire reusable cognitive operations?

What Bithkuil tests

Bithkuil investigates several connected hypotheses:

  • Explicit semantic factors: whether making distinctions such as configuration, relation, purpose, composition, evidence, scope, and other structured properties directly observable can improve learning efficiency.
  • Compositional reuse: whether previously acquired semantic primitives lower the marginal cost of learning later concepts that depend on them.
  • Developmental ordering: whether measurable prerequisite relationships can be used to construct curricula that outperform flat or arbitrarily ordered training.
  • Representation efficiency: whether two lossless encodings of the same underlying world can differ substantially in how easily a bounded learner can recover useful functions from them.
  • Transfer: whether semantic structure learned in one representation remains useful when later tasks, surface forms, generators, or domains change.
  • Low-precision interaction: whether explicitly structured representations interact favorably with ternary or other aggressively quantized neural architectures.

These hypotheses are separable. Evidence for generic factorized representation would not by itself establish that Bithkuil is uniquely advantageous, and a negative result for one training architecture would not invalidate the broader representation-learning question.

Why Ithkuil?

New Ithkuil was designed to encode semantic distinctions with a degree of explicitness, regularity, and compositional structure unusual among natural languages. That makes it scientifically interesting as a donor system for representation design.

Bithkuil does not assume that Ithkuil’s linguistic categories are automatically optimal for machine learning.

Instead, the project asks which distinctions can be transformed into useful computational primitives, which should be decomposed or normalized, which should remain surface-language phenomena, and which should not be adopted at all.

Grammar therefore precedes lexicon in the research program. The first objective is to identify reusable semantic machinery and dependency structure before attempting broad lexical coverage.

The semantic reconstruction hypothesis

Two representations can preserve the same information while imposing very different learning problems.

An unrestricted optimal decision rule can recover equivalent information from any lossless invertible encoding. Real neural learners, however, operate under finite parameters, finite data, finite optimization budgets, architectural biases, and limited developmental histories.

Bithkuil tests whether some representations effectively prepay part of the cost of semantic reconstruction by exposing factors that would otherwise need to be inferred indirectly and repeatedly.

The project calls this possible difference the semantic reconstruction tax.

It is not assumed to exist as a literal hidden component inside a model. It is measured through controlled contrasts: how much training resource is required to reach matched competence under different representations?

From system effect to attribution

The initial Bithkuil research program deliberately begins with an integrated systems experiment rather than requiring every component to prove itself independently first.

The experimental system combines:

  • a small ternary-weight neural learner,
  • Bithkuil-derived semantic representations,
  • deterministic synthetic worlds and independent truth oracles,
  • prerequisite-ordered developmental curricula,
  • an adaptive but truth-bounded developmental teacher,
  • retention and transfer probes,
  • sealed evaluation families,
  • reproducible checkpoints and execution lineage.

If the integrated system produces a meaningful effect, subsequent experiments progressively remove, scramble, replace, or isolate its components.

Controls include token renaming, nonseparable factor mixing, matched-example replay, compute matching, generic typed representations, curriculum interventions, generator-family holdouts, precision comparisons, and scale changes.

The goal is not merely to obtain a positive result. It is to discover why a result occurs and which parts survive hostile controls.

A deliberately falsifiable program

Bithkuil is designed so that interesting hypotheses can fail independently.

A generic structured representation may equal or outperform Bithkuil. Developmental ordering may provide no measurable benefit. Ternary training may contribute nothing. Explicit factors may help only on narrow synthetic tasks. Effects may disappear under compute matching, transfer, scale, or unfamiliar generators.

Those outcomes remain scientifically useful.

Conversely, a result becomes progressively more interesting if an advantage survives controls that preserve information while destroying convenient factor alignment, survives matched resource budgets, transfers to new compositions or representations, and persists beyond the original finite-world task family.

The project therefore treats negative controls and result gradients as part of the research object rather than as post hoc qualifications.

Current state

The current Stage 2 package includes a revised scientific manuscript, preregistered experiment designs, deterministic world and oracle specifications, a reference training implementation, developmental-teacher machinery, checkpoint and recovery controls, reproducibility requirements, and an initial set of engineering validation tests.

The reference implementation is intentionally small. It is designed to make the first mechanistic experiments cheap, inspectable, repeatable, and difficult to explain away through hidden complexity.

No confirmatory Bithkuil training result is claimed by the current publication package.

The next scientific milestone is empirical: execute the integrated trial, preserve the complete result lineage, and allow the observed result to determine which attribution experiments deserve to run next.

Research publication

The current research paper, Prepaying Semantics: Bithkuil as a Developmental Substrate for Representation-Efficient Relational and Compositional Learning, develops the scientific rationale, falsification program, first systems experiment, and training architecture in detail.

Its purpose is not to report that Bithkuil works.

It is to make the proposition precise enough that reality can answer.