Sign in Subscribe
Topic

ollama

A collection of 2 issues

๐Ÿ–ฅ๏ธUnraid + ๐Ÿฆ€OpenClaw(๐Ÿ‹Docker) + ๐Ÿฆ™Ollama(๐Ÿค–Local Model)

Unraid ์‹œ์Šคํ…œ์—์„œ Ollama์˜ Locam LLM ์„œ๋น„์Šค๋ฅผ ์ด์šฉํ•˜์—ฌ OpenClaw๋ฅผ ๋™์ž‘์‹œ์ผœ๋ด…์‹œ๋‹ค. * Ollama๋Š” ์ด๋ฏธ ์„ค์น˜๋˜์–ด ์„œ๋น„์Šค ์ค‘์ธ ๊ฒƒ์„ ์ „์ œ๋กœ ํ•ฉ๋‹ˆ๋‹ค. * ์™ธ๋ถ€ ์ ‘๊ทผ(์—ญ๋ฐฉํ–ฅ ํ”„๋ก์‹œ ๋“ฑ)์— ๋Œ€ํ•œ ์„ค๋ช…์€ ์ƒ๋žตํ•ฉ๋‹ˆ๋‹ค. OpenClaw ์ปจํ…Œ์ด๋„ˆ ์„ค์น˜ํ•˜๊ธฐ Apps์—์„œ OpenClaw๋ฅผ ๊ฒ€์ƒ‰ํ•˜์—ฌ Official ์ปจํ…Œ์ด๋„ˆ๋ฅผ ๋‹ค์šด๋กœ๋“œ ํ•ฉ๋‹ˆ๋‹ค. ๋„์ปค ์„ค์ •์€ ๊ธฐ๋ณธ๊ฐ’์—์„œ ๋ช‡๊ฐ€์ง€ ๊ฑด๋“œ๋ ค์•ผ ํ•ฉ๋‹ˆ๋‹ค. ํ•ด๋‹น ๋ ˆํฌ์ง€ํ† ๋ฆฌ ๋ฒ„์ „์€ ๊ธฐ๋ณธ๊ฐ’์ด latest ์ตœ์‹ ๋ฒ„์ „์œผ๋กœ ์„ค์ •๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.
15 min read

์‹œ๋†€๋กœ์ง€ + Ollama + lfm2.5 + Chatbot-Ollama ์„ค์น˜ ๊ฐ€์ด๋“œ

on-device ํ™˜๊ฒฝ์—์„œ ๊ฐ€๋ณ๊ฒŒ ๋Œ๋ฆด ์ˆ˜ ์žˆ๋Š” LLM์ธ lfm๋ชจ๋ธ๊ณผ ์‹œ๋†€๋กœ์ง€ DS225+๋ฅผ ํ™œ์šฉํ•ด ์™ธ๋ถ€ ํด๋ผ์šฐ๋“œ ์—ฐ๊ฒฐ ์—†์ด ๋‚ด NAS ์•ˆ์—์„œ๋งŒ ๋™์ž‘ํ•˜๋Š” ๋กœ์ปฌ AI ์ฑ—๋ด‡ ํ™˜๊ฒฝ์„ ๊ตฌ์ถ•ํ•ด ๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ์ผ๋ฐ˜์ ์ธ Local LLM์€ ๊ณ ์„ฑ๋Šฅ์˜ GPU์™€ ๋ฉ”๋ชจ๋ฆฌ๊ฐ€ ํ•„์ˆ˜์ ์ž…๋‹ˆ๋‹ค. (ex. llama, qwen, glm ... .etc) lfm๋ชจ๋ธ์˜ ๊ฒฝ์šฐ on-device์—์„œ๋„ ๋ง‰๊ฐ•ํ•œ(?) ํผํฌ๋จผ์Šค๋ฅผ ๋ณด์—ฌ์ฃผ๋Š” ์†Œํ˜•๋ชจ๋ธ๋กœ ์Šค๋งˆํŠธํฐ์ด๋‚˜ ๋ชจ๋ฐ”์ผcpu์—์„œ๋„ ๋น ๋ฅด๊ฒŒ ์‹คํ–‰ํ•  ์ˆ˜
7 min read
root@cyberpunk:~#