OpenWeights: Edge Inference

Alpha Romer Coma

Mayelana nalolu hlelo lokusebenza

I-OpenWeights isebenzisa amamodeli olimi oluvulekile ngqo efonini yakho. Akukho akhawunti ongayakha, akukho seva ongakhuluma nayo, futhi akukho okulinganiselwe ngawe.

Sesha Ubuso Obugobile ngaphakathi kohlelo lokusebenza, thola ukuthi imodeli izosebenza ngempela kudivayisi yakho ngaphambi kokuthi uyilande, futhi uxoxe nayo. Ithokheni ngayinye ikhiqizwa yihadiwe yakho.

NOMA YILUPHI IMODELI, HHAYI IKHATHALOGU

Ezinye izinhlelo zokusebenza ezikudivayisi zikunikeza uhlu olufushane olukhethwe omunye umuntu. I-OpenWeights ikunikeza iHub. Uma othile eshicilele i-GGUF ehoreni eledlule, ungayisebenzisa.

THEMBEKA NGEDIVAYISI YAKHO

Ngaphambi kokuthi uchithe ama-gigabytes, uhlelo lokusebenza lufunda isihloko semodeli kunethiwekhi futhi lukutshele ukuthi ludingani ngobude bomongo obukhethile, cishe ukuthi luzoshesha kangakanani, nokuthi luzosebenza nhlobo efonini yakho.

IZINOMBOLO ZANGEQINISO, PHAMBI KWAKHO

Amathokheni ngomzuzwana, isikhathi sethokheni yokuqala, nokuthi iwindi lomongo ligcwele kangakanani, liboniswa ngenkathi uxoxa kunokuba lifihliwe.

OKUFANELE UKULUNGISE

Izinga lokushisa, i-top-p, i-top-k, isijeziso esiphindaphindayo, ubude bomongo, isixwayiso sesistimu kanye nalokho imodeli etshelwa kona ngamathuluzi ayo, konke kugcinwe ngemodeli ngayinye. Lapho imodeli ingacabanga ngaphambi kokuba iphendule lokho kuyiswishi futhi, futhi ocingweni olune-GPU esebenzayo ungasho ukuthi iyiphi iprosesa ephethe izendlalelo.

OKUNGAPHEZU KOKUBHALA

Izithombe nomsindo wamamodeli athumela iphrojektha yawo, abhala phansi noma yimuphi imodeli engafunda, abize nge-recognizer yefoni yakho kudivayisi, futhi afunde ngokuzwakalayo.

UMSIZO ONGASEBENZA

Imodeli ingasesha iwebhu, ifunde ikhasi, futhi isebenze nefolda okhetha ukuyabelana ngayo. Unquma ukuthi ithola intambo engakanani: vumela isinyathelo ngasinye, uyivumele isebenze, noma uyicele ukuthi ihlele kuqala bese isho ukuthi izokwenzenjani ngaphambi kokuba kwenzeke noma yini. Ingakubuza umbuzo ocacisayo bese ilandela uhlu lokuhlola ongaziphawula lona. Wonke amathuluzi angacinywa.

I-PRIVATE NGOKWAKHA

Izingxoxo zakho, amamodeli akho kanye nokusetshenziswa kwakho kuhlala kudivayisi. Akukho i-SDK yokuhlaziya, akukho ntatheli yokuphahlazeka, futhi akukho sisekelo sethu. Ukusekela ngokuzenzakalelayo kanye nokudluliselwa kwedivayisi kuvaliwe, ngakho ifoni entsha ayizuzi izingxoxo zakho. Ukukhipha kususa konke.

Amathuluzi amabili afinyelela ku-inthanethi, ngoba kufanele: usesho lwewebhu kanye nokulanda amakhasi. Womabili abhalwe ngaphansi kwesihloko esithi ashiya idivayisi, womabili angacinywa, futhi yonke ikholi umuntu ayenzayo ingumugqa empendulweni ebiza igama layo nokuthi inikezwe ini. Ithokheni yakho ye-Hugging Face, uma uyibeka, ibethelwe ngokhiye obanjwe ku-Android Keystore futhi ithunyelwa kuphela ku-Hugging Face.

OKUDINGAYO

I-Android 12 noma entsha, idivayisi ye-ARM engu-64-bit, kanye nenkumbulo eyanele yemodeli oyikhethayo. Uhlelo lokusebenza luzokutshela ngaphambi kokuthi ulande.

Amamodeli avela kubantu besithathu. Ukhetha ukuthi iyiphi ozoyisebenzisa, futhi lokho ekushoyo umsebenzi womshicileli wayo kunokuba owethu. Umthombo ovulekile, ku-github.com/alpharomercoma/openweights.

Yini entsha

Compiled models for everyone, a search that listens, and a shortcut from "Ready to use"

- Every install now runs both engines, so ExecuTorch models download on any phone
- Typing in Discover searches all of Hugging Face, not just the recommended shelf
- Recommended compiled models now follow our five-phone benchmarks: Qwen3 1.7B, LFM2.5 1.2B and Llama 3.2 3B
- Tapping the download-finished notification opens a fresh chat on that model