Open Source · 2026 - Present

Orkhon

An auditable, from-scratch PyTorch LLM stack covering the tokenizer, decoder-only Transformer, pretraining and alignment, evaluation, RAG and tools, OpenAI-compatible serving, and safetensors export.

  • 260 Documented Tests
  • 22M Model Run
View Source (opens in a new tab) Visit Site (opens in a new tab)
Orkhon project site: 'A hand-written transformer stack that learns Turkic', next to Göktürk inscription art

Tech Stack

  • Python
  • PyTorch
  • LLM
  • Transformers
  • Open Source
  • Apache-2.0

Written about it

  • 4 min read

    Publishing the Orkhon Model Family

    The June Orkhon updates published the project as a model family: a from-scratch PyTorch LLM stack with CI, demo, prompt-routing, and public-site wiring.

    • Orkhon
    • LLM
    • PyTorch

More in Open Source

  • 2026 - Present

    Re-Shell

    An open-source full-stack development platform that unites microservices and microfrontends under a single CLI. Ships Docker-aware service scaffolds, Kubernetes/Helm/GitOps manifest generation, Kafka/Redis Streams async transport scaffolds, and Elasticsearch/ELK observability templates across .NET, Java, Rust, Python, and Node.js generators.

  • 2026 - Present

    Quorate

    An open-source CLI that runs multiple AI reviewers in parallel, then applies deterministic PASS, WARN, or FAIL merge gates. Provider output and verdict artifacts stay inspectable.

  • 2026 - Present

    KAPiTaN OS

    An open-source Linux distribution with a Turkish-language command layer — making the terminal accessible to Turkish-speaking users through native-language commands on top of a familiar Linux base.

All Projects