Instructions to use Soofi-Project/Soofi-S-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Soofi-Project/Soofi-S-Base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Soofi-Project/Soofi-S-Base")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Soofi-Project/Soofi-S-Base", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Soofi-Project/Soofi-S-Base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Soofi-Project/Soofi-S-Base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Soofi-Project/Soofi-S-Base",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Soofi-Project/Soofi-S-Base

SGLang

How to use Soofi-Project/Soofi-S-Base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Soofi-Project/Soofi-S-Base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Soofi-Project/Soofi-S-Base",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Soofi-Project/Soofi-S-Base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Soofi-Project/Soofi-S-Base",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Soofi-Project/Soofi-S-Base with Docker Model Runner:
```
docker model run hf.co/Soofi-Project/Soofi-S-Base
```

'This year' on the homepage, no date on the release page. Which is current?

by M-vdBerg - opened Aug 15

Discussion

M-vdBerg

Aug 15

Great work on Soofi-S-Base, the technical report and public training/eval code are genuinely valuable.

But the release messaging doesn't add up. The soofi.info homepage says the open-source release is planned "this year," while the linked detail page ("Mehr erfahren") already softens that to "later in the project," timeline "to be announced."

The beta is also closed to new applicants, and the HF checkpoints remain gated closed-beta previews under a still-unfinished license.

For comparison, Switzerland's Apertus (ETH/EPFL) went from announcement to a fully open, Apache-2.0, publicly accessible release. A proof this is achievable, not a structural constraint of sovereign AI projects.

Could you commit to something firmer than "this year"? A target month/quarter, or the concrete milestones still outstanding (licensing, safety sign-off, trial results)? I'm holding off on a proper evaluation until this is settled, so even a tentative update would help a lot.

Thanks for the work so far, looking forward to something concrete.

Best,
Michael

M-vdBerg

6 days ago

Friendly bump — three and a half weeks on, still no reply here.

I want to be fair about the wider picture: this isn't only about my thread. In #2, @mfromm (Soofi-Project) wrote about a month ago that "our target is an open release within the next weeks and will share access details as soon as the model is ready." Those weeks have now passed without an update. Meanwhile #4, #5 and #7 are open with the same question, and #7 reports an access request pending since 16 July. So the pattern isn't a single unanswered post — it's that the Discussions tab, which is the one public channel you've opened for this model, is currently a one-way street.

That matters more than the delay itself. Delays in a project of this scale are normal and nobody here would hold a slipped date against you. Silence is what turns a normal delay into a credibility problem, because from the outside it's indistinguishable from a release that isn't coming.

So, narrowing my original question to what should be cheap to answer:

1.	Which statement is current — the "this year" on the soofi.info homepage, or the "to be announced" on the linked detail page? Right now they contradict each other, and one of them is misleading readers.
2.	Is the "within the next weeks" target from #2 still standing, or has it moved? A target month or quarter would be enough.
3.	Which milestones are actually outstanding — license text, safety sign-off, trial results, something else? Naming the blocker is more informative than naming a date.
4.	Is anyone triaging the access queue? Several people report requests sitting since July without a decision either way.

If the honest answer is "we can't commit to a date yet, and here's why" — that would be a genuinely useful reply, and far better received than continued silence. An open project doesn't owe the community a date, but it does owe it an answer.

Still looking forward to evaluating the model properly once it's out. Thanks for taking the time.

Best,
Michael

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment