'ejDo' (AI, artificial intelligence) computerlIj neH vum. Internet lo'be'. DIvI' Huch (subscription) lo'be'. QIH lo'wI' lujDaq pagh. QIn rur, 'ach DaH wa' teh.
Meta chu'ta'Muse Glimmer 'e' vItlhutlh. 30 milyan parameter (numbers vum 'ejDo') ghajbogh 'ejDo', Apache 2.0 chutmey bIng poH neH, "agentic" vum lulIj: qatlh vay' chenmoHmeH, jan lo'meH, poH nI' vumtaHvIS — ghobe' Hoch jatlhtaHvIS neH.
nuq Muse Glimmer chu'?
'ejDo' tIn law' Daq tIn (data center) vumtaH, computerlIj bIQ'a' ram law'. Muse Glimmer wov chu': computerlIj neH lo'meH chenmoHlu'pu'. Meta 'ejDo' quantize ta'pu' (mIw: computer mI' HochHom veS chu'wI') 'ej 55 gigabyte-vo' 18 joq 20 gigabyte-Daq nIH.
'ach 'ejDo' data neH bIH. ja'chuqmey vumtaHbogh memory je DachelDI', nom 24 gigabyte GPU memory DaSuq — Meta 24 joq 32 gigabyte 'e' jatlh. mughmeH: wa' GPU, HIja', 'ach GPU nIv. Daq tIn ghobe'. 'ach yaH computer je ghobe'.
Context window (mu'mey qawmoHlaHbogh 'ejDo') 120,000 token nIvchoHtaH — 'ejDo' computerlIj-lIj neH vaj pIj. nagh beQ (images) je yaj: 30 milyan parameter tera'Daq mIllogh laDwI' mach tu'lu', vaj mIllogh Daq DaHevmoH 'ej yu'meH DaneH. 'ej Hoch Internetvo' pagh vumtaH. Data pagh Meta Daq ghoS, server pagh nuHmey qaw.
nuq lI' vaHbe' — nuq DIvI' Huch poQ?
'ejDo' Daq: lI' Hoch. bIng poH (weights) Hugging Face Daq jang, Hoch chaw'be'. DIvI' Huch pagh, API bIQtIq pagh, credit card pagh.
'ach: computer maSHwI' (hardware) poQ, 'ej "computerlIj Daq vum" jatlhbogh law' poQ. 24 gigabyte GPU memory laptop vulgar Daq Datu'be' — GPU wagh Daq Datu'. tlhoy' GPU pupbe' pu' HoS puS, 'ach nob ghobe'. Ollama joq OpenWebUI DalI'DI', reH ghoStaH. pagh-vo' bIchuHchugh, GPU wagh 'ej DIvI' Huch DIS law' yInoH — "lI' Hoch" jatlhpa'.
DaH vItlhutlh laH'a'?
HIja', GPU-lIj lo'lu'chugh. Ollama, LM Studio je Muse Glimmer lulI'chu'; bIQeqqu'chugh, llama.cpp, MLX (Apple qonwI'), ExecuTorch (jom jan) je lo'laH. Ollama qonwI' maH DaqawlI'chugh, 'ejDo' chu' bIng poH neH DalI' poQ — Hoch latlh chaw'pu'.
Nvidia laDbogh: 20,000 token wa' second-Daq. mI'vam yIlIj — Daq tIn-vo' ghoS, pa' vaghvatlh yu'meH wa' poH vumlu'. computerlIj teH Daq: 84 token wa' second-Daq GPU Nvidia chu' Daq, 24 token AMD laptop chip Daq, 26 vaj 50 Mac chu' Daq. mI'vammey je chenmoHwI'pu' juvta', 'ejDo' nIHbogh lo'taHvIS — mI'lIj GPU, context tIq, nIH 'ar je Dogh. 'ach 'ar 'oH 'e' DaSovmeH lI'.
yajmeH: wa' token wa' syllable rur. 24 token wa' second-Daq: mu'mey nom cha'lu', nuv law' qonlaHbogh nom law'. 'ach cloud nom law' puS. laDmeH yap. 'ejDo' tup law' mob vumtaHvIS, Qatlh.
'ejDo' agent-mey DalI'chugh, yIqIm: OpenClaw Da lo'lu' Muse Glimmer. OpenClaw wIlo' — Do' 'oH, 'ach token mI'wI' jach reH. 'ejDo' computerlIj Daq vumDI', Qagh vam nat: token DaDIlbe', HoS DaDIl. OpenClaw ghItlh wIneHtaH ret. 'ach ghItlh wIrIn'a'? Sovbe'. jarmey law' loSlI' 'ej maH qab legh.
jIH SoH? pagh chaq programmer neH?
vay' loQ: peritos technicos Hutlh, computerlIj wov poQ. Ollama joq OpenWebUI qaSpu'be'chugh, HeghmoHwI' machtaH — bIng poH Hutlh nom, 'ej Muse Glimmer rap jan lo'lu' reH. 'ach 'ejDo' chu' Muse Glimmer DalI'chugh, chaq nom 'ejDo' laHlIj chIm 'ejDo' patlh law' vaj chu'chugh.
'ej HIja': naDev poH wa'DIch 'ej "Linux 'ejDo' computerlIj hosting-Daq mIw tIqDaj" paq. Docker, llama.cpp, Ollama Da DalI'pu'chugh, nuq vIjatlh DaSov.
nuq chaw'
Muse Glimmer ChatGPT joq Claude teq neH, 'ej cloud vay' Do' law'lu'taH. 'ach "computerlIj neH, chIm, HoS" 'e' cha'chugh, jaSchoHmoHmeH Do'-tam ghaH. 'ejDo' ghommeymey Daq neH chu'be'taH — computerlIj-lIj DungDaj wa'Hom vumlI'. GPU-lIj tu'lu'chugh, yInIS 'e' vItlhutlh.