Frank's avatar
Frank
npub1x3n9...00qs
Frank's avatar
Frank 1 month ago
#cloudflare A Cloudflare spokesperson said the company observed a “spike in unusual traffic” at apx 6:20 ET, right before the outage. Some say hackers want monero as payment to restore services.
Frank's avatar
Frank 1 month ago
#ram #nostr Ram is freaking expensive, especially server DDR5 ECC Ram!! And it is only going to get worse I think. Damn! You want one stick of Samsung DDR5 ECC at 64gb 6400MHZ RDIMM on ebay, open box. $950.00 for one stick! And you need 8 to 12 typically! image
Frank's avatar
Frank 1 month ago
#llm #localllm Get your own GPU or two and run your own AI models. Anthropic and others are trying to crush this. Do not let them. image
Frank's avatar
Frank 1 month ago
#apple #digitalid Apple introduces digital ID today. Bitcoin is tracked also. The Government says “Hi” image
Frank's avatar
Frank 1 month ago
#ai #localllm #selfhostedai #quantization 7+ main precision formats used in AI ▪️ FP32 ▪️ FP16 ▪️ BF16 ▪️ FP8 (E4M3 / E5M2) ▪️ FP4 ▪️ INT8/INT4 ▪️ 2-bit (ternary/binary quantization) General trend: higher precision for training, lower precision for inference. Save the list and learn more about these formats here: huggingface.co/posts/Kseniase… image
Frank's avatar
Frank 1 month ago
China saved opensource LLMs and not only that, it made the FRONTIER opensource between July 16th and today, these are the major releases: > Kimi-K2-Thinking (1T-A32B) > MiniMax M2 > DeepSeek V3.2 > GLM-4.6 (335B-A32B) > Qwen3-VL-30B-A3B (Instruct & Thinking) > Qwen3-VL-235B-A22B (Instruct & Thinking) > Qwen3-Next 80B-A3B (Instruct & Thinking) > GLM-4.5V (VLM, 106B-A12B) > DeepSeek V3.1 > Doubao 1.6-Vision (multimodal, tool-calling) > Doubao Translation 1.5 (ByteDance, 28 Languages) > ERNIE X1.1 (Baidu, Reasoning) > Hunyuan-MT-7B & Chimera-7B (Tencent Translation Specialists) > MiniCPM-V 4.5 (8B), Tiny but GPT-4o-level VLM > InternVL 3.5 (MASSIVE Multimodal Family of Models, 1B to 241B Sizes) > Step-3 (VLM, 321B/38B) > SenseNova V6.5 (SenseTime, Multimodal) > GLM-4.5 Air (Base & Instruct, 106B-A12B) > GLM-4.5 (Base & Instruct, 335B-A32B) > Qwen 3-Coder-30B-A3B (Instruct & Thinking) > Qwen3-Coder-480B-A35B (Instruct & Thinking) > Qwen3-30B-A3B-2507 (Instruct & Thinking) > Qwen3-235B-A22B-2507 (Instruct & Thinking) > Kimi K2 (1T-A32B) US & EU need to do better image
Frank's avatar
Frank 1 month ago
#ai #llm #localllama #localllm #grownostr #nostr #gfy Not your own locally hosted LLM? You are giving away your thoughts and ideas to corporations/governments, who pay for what and how you think.
Frank's avatar
Frank 1 month ago
More power #nostr #llm #ai #gfy image