GPU · active compute
Keeps active experts and the shared model computation near the processor. The GPU is the fast working set, not the entire model warehouse.
Large-model intelligence. Local execution. A path to models that learn.
Astra runs large open-weight models on hardware you control. It coordinates GPU, CPU, RAM, and SSD to make 125-billion-parameter-class inference practical on a workstation. Liquid Weights is the next research frontier: selectively adapting actual model parameters from verified experience.
Intelligence for a brighter tomorrowAstra's runtime keeps the fast path on the GPU while using system memory and sparse storage for the much larger model footprint.
Keeps active experts and the shared model computation near the processor. The GPU is the fast working set, not the entire model warehouse.
Holds the model’s expert weights in system memory. CPU execution handles experts outside the GPU working set concurrently.
Serves the large lookup table through sparse reads rather than requiring it to live entirely in accelerator memory.
The numbers above are internal results for a particular quantized Qwen model and a workstation with approximately 125 GB of RAM, not a claim that 125B parameters fit entirely in 24 GB VRAM. At the 2M context setting, retrieval passed 4/4 and aggregation passed 1/1; a three-hop reasoning test failed at both short and long contexts. Initial 2M prefill took roughly 32 minutes. Throughput figures above were measured at 128K.
Today's deployed models usually keep their trained parameters fixed. Astra Liquid Weights investigates persistent, reversible parameter updates selected from independently verified knowledge and evaluated before promotion. This is numerical model adaptation—not a retrieval index, a prompt shortcut, or a claim of unrestricted autonomous learning.
Identify a stable, attributable claim or rule. Unsupported output never becomes training truth.
Train an isolated numerical parameter overlay without mutating the original model checkpoint.
Test unseen paraphrases, counterexamples, interference, forgetting, and unrelated capability.
Persist accepted edits across restart. Disable, re-enable, or reject them independently.
A genuinely new fact learned into numerical parameters must survive process restart without retrieval or prompt injection; isolated edits must be disableable and recoverable. The experiments also measure forgetting, leakage into nearby answers, generalization, and runtime cost. Until that evidence exists, Liquid Weights remains a research program.
From local development to privately operated enterprise intelligence, Astra is designed around control over the runtime and the evidence behind its performance.
Run capable open-weight intelligence locally where data control and operational independence matter.
Work across large codebases and document collections with an evidence-backed context envelope.
Serve local applications and coding agents through existing OpenAI- and Anthropic-compatible interfaces.
Explore whether verified operational experience can become durable, reversible model capability.
Interested in high-performance private inference, commercial deployments, technical validation, or backing the research? Talk directly with Algodyne Corporation. Benchmark evidence and experimental findings can be shared with qualified technical collaborators.
ASTRA / ALGODYNE CORPORATION — BUILD SYSTEMS. LAUNCH VENTURES. COMPOUND IMPACT.