Skip to content

Debian package with systemd socket activation (bitnet-server) #557

@123Satyajeet123

Description

@123Satyajeet123

Built a Debian package that runs BitNet b1.58 2B4T as a systemd service on Ubuntu 24.04.

What it does:

  • sudo apt install bitnet-server from PPA
  • OpenAI-compatible API on localhost:11435
  • Socket activation: 112KB idle, starts on first request
  • Auto-downloads model from HuggingFace
  • Sandboxed (unprivileged user, systemd protections)

PPA: ppa:satyajeet1827/bitnet-server
Source: https://github.com/123Satyajeet123/bitnet-server

Sharing in case it's useful for the community or worth linking from the README. Happy to answer questions about the packaging approach.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions