7B
DarrenLabs-7B · Live
The small one, for notes and first drafts.
Turn a rough site note into a readable checklist, or a messy drawing note into a first draft you can edit. Based on Qwen2.5-7B-Instruct.
- Size
- 4.7 GB
- Speed, 32GB VRAM avg
- 169 tokens / sec
- On our CPU VM
- 8.8 tokens / sec
- Tokens
- 54
“I am DarrenLabs-7B, an assistant running on the DarrenLabs AI Lab VM. I am based on Qwen2.5-7B, an open-source model from Alibaba Qwen, used under the Apache 2.0 license.”
Use it for a first draft, then review it. On 32GB VRAM, the 54-token test answer generates in about 0.3 seconds on average, about 19 times faster than our CPU. On CPU, the test took 16.0 seconds in total.
32B
DarrenLabs-32B · Live, slow on CPU
The bigger one, for longer documents.
For a full drawing quality note, a checklist with reasons, or a second pass over a long document. Based on Qwen3-32B. Fast on a 32GB GPU, slow on CPU, and the slow time is on this page.
- Size
- 20 GB
- Speed, 32GB VRAM avg
- 54 tokens / sec
- On our CPU VM
- 1.89 tokens / sec
- Tokens
- 292, incl. thinking
“I am DarrenLabs-32B, an AI assistant deployed on the DarrenLabs AI Lab VM (Oracle Cloud). I am based on Qwen3-32B, an open-source model from Alibaba Qwen, licensed under Apache 2.0.”
Use it for longer work, then review it. On 32GB VRAM, the 292-token test answer generates in about 5.4 seconds on average, about 29 times faster than our CPU. On CPU, the same answer took 413.9 seconds, about seven minutes. CPU is measured. GPU is an average from published benchmarks, not yet our own run.