[PLUG] Self Host LLM, what models can I run?

Will via plug on 13 Mar 2026 09:36:35 -0700

[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

[PLUG] Self Host LLM, what models can I run?

From: Will via plug <plug@lists.phillylinux.org>
To: "Philadelphia Linux User's Group Discussion List" <plug@lists.phillylinux.org>
Subject: [PLUG] Self Host LLM, what models can I run?
Date: Fri, 13 Mar 2026 12:36:19 -0400
Arc-authentication-results: i=1; mx.google.com; arc=none
Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=to:subject:message-id:date:from:mime-version:dkim-signature; bh=uJ3doGuN+bB2Wy9ZU1MPGx4OiisHugYdRUgNYS6vBjc=; fh=BoeuUYbUeMDFJCmhFS8RPLNDT/YhQPHvpy2DpYvqiTY=; b=e6nIYTglXCCePm43HhAgOeUUziBqNP4sd/OHXKR2J+icPulZ5wuSJzGGg9f+uEUonM /2bA/3Yd09KeqSuO+4SsMs3sJIBM816Ql+EcPggeGQL9VzLRjZt77bjpxCXGLdhdAbtE tj1b2ZU7e/9a7yxqYao+g+eG4grba6QzTGoej290Y6Tbm72dquAgP0CZCEg2Tq3FaS4L teCaoiJk1U831AH3kArZA5bA2c08cBSIkqG7j0QEQ/SAKj92lmZUz4y8VADcZtCdlDJ/ 8lSF7wCETJYEvLffl1+/JFubK+QIeB/pkz2WtBngY7wfHwvF7TLx0aiiNFSYtQcO+3vk W0Kg==; darn=lists.phillylinux.org
Arc-seal: i=1; a=rsa-sha256; t=1773419790; cv=none; d=google.com; s=arc-20240605; b=PMtjWQMcW+JzE9yPPpux1wMAJWyTpccge9EXD4lxdBP7t3rR35G099U+x7oJw3ALJ8 iPRmp6+UnEJ3UoYrMMONREFbiordRL+4Q5Ns5aVlHLi8EGxNQwZF6uXS9Vm3IKxhX+G6 ZkPYLlOlVagSgTz28ssJ+jjgJajKfqcQnr+17wL3Yn3PGLFJZdHt3StQamCq5VbckRki DOEn1OOwAwuzHukK0ThElOWhmwEdNaIbMKfUZ9j2DC8sx4LTX/BWGm+CfeTh0nhUUJ05 i3FfJm7W+AJJTX2HobPO0Let7NGhxhDkf+YO6IeUeCmqKNAspGoQ0ezHrx4jc5HwreRk WouQ==
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1773419790; x=1774024590; darn=lists.phillylinux.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=uJ3doGuN+bB2Wy9ZU1MPGx4OiisHugYdRUgNYS6vBjc=; b=dKd+E3ThkOUIdSRNokBM6ExiNo1r1c6O3wC+SyCKI2zvGwylc5taIzDkTutoujdfcq pEHAvNFSXD+WrRb31PCgqaHsZkTHOX2pJfd2LhRBxSDLouny3cHU+HmKunI+bacTwNAJ X4ao3uP6hQU4Xr+Sko7ddnIM3SqCNLhX2CQYgEskhqpXp1AqVJyCay+ANPRYgq9V1vVW +Pj0+frOWYzh7usrVuA1WlxoaUcF9S5DSL74JgNFQAn122aQLyR9jGbfg9WQZWxZpqSz w1WzwoaiRH9qR+g+YFZor+yvvDXIuABHK5b6aPV0gt8QbL0Zhh+UTZlNO/jbjwLJ1o+9 CqZg==
Reply-to: Will <staticphantom@gmail.com>
Sender: "plug" <plug-bounces@lists.phillylinux.org>

I found this pop up on my Hacker News feed... I wish I had this for my talk on Tuesday on Open Claw.

https://www.canirun.ai/

This little website also manages to see your GPU and some website information to pre-populate.... things you forget you share when you use the internet.

-Will C

___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug

Follow-Ups:
- Re: [PLUG] Self Host LLM, what models can I run?
  - From: Rich Freeman via plug <plug@lists.phillylinux.org>

Prev by Date: [PLUG] Nine CrackArmor Flaws in Linux AppArmor Enable Root Escalation,
Next by Date: [PLUG] open source copper ethernet tester
Previous by thread: [PLUG] Nine CrackArmor Flaws in Linux AppArmor Enable Root Escalation,
Next by thread: Re: [PLUG] Self Host LLM, what models can I run?
Index(es):
- Date
- Thread