Uburyo bwo Gukoresha Moderi za AI

Uburyo bwo Gukoresha Moderi za AI

Igisubizo kigufi: Gukoresha moderi ya AI bivuze guhitamo imiterere yo gutanga (igihe nyacyo, itsinda, inzira yo gucukumbura, cyangwa impande), hanyuma bigatuma inzira yose ibasha gusubirwamo, kugaragara, gutekana, no gusubizwa inyuma. Iyo uhinduye byose kandi upima igihe p95/p99 igarukira ku musaruro nk'uw'umusaruro, uba wirinda amakosa menshi ya "kazi kuri mudasobwa yanjye igendanwa".

Ibintu by'ingenzi byakunzwe:

Imiterere yo gushyiraho porogaramu: Hitamo porogaramu iboneka mu gihe nyacyo, ikoreshwa mu itsinda, uburyo bwo kuyikoresha, cyangwa uburyo bwo kuyikoresha mbere yo kwiyemeza gukoresha ibikoresho.

Kongera gukosorwa: Hindura moderi, imiterere, kode, n'ibidukikije kugira ngo hirindwe ko ibintu bihinduka.

Uburyo bwo Kureba: Gukurikirana buri gihe uko amakuru asubirwamo, amakosa, ubwinshi bw'amakuru, n'uburyo amakuru cyangwa umusaruro bikwirakwizwa.

Gukoresha uburyo bwo gupima ikirere mu buryo bwizewe: Koresha uburyo bwo gupima ikirere mu buryo bwikora, ubururu n'icyatsi kibisi, cyangwa igicucu.

Umutekano n'ubuzima bwite: Shyira mu bikorwa uburenganzira, imipaka y'ibiciro, n'imicungire y'amabanga, kandi ugabanye PII mu nyandiko.

Nigute wakoresha moderi za AI? Infographic

Ingingo ushobora gukunda gusoma nyuma y'iyi: 

🔗 Uburyo bwo gupima imikorere ya AI
Menya ibipimo, ibipimo ngenderwaho, n'igenzura ry'ubuzima busanzwe kugira ngo umenye ibisubizo byizewe bya AI.

🔗 Uburyo bwo gukora imirimo hifashishijwe ubuhanga bwa AI
Hindura akazi gasubiramo mo inzira z'imikorere ukoresheje amabwiriza, ibikoresho, n'uburyo bwo guhuza.

🔗 Uburyo bwo kugerageza moderi za AI
Gushushanya isuzumabumenyi, amakuru, n'amanota kugira ngo ugereranye ingero mu buryo buboneye.

🔗 Uburyo bwo kuvugana n'ubutasi (AI)
Baza ibibazo byiza, shyiraho imiterere y'ikibazo, kandi ubone ibisubizo byumvikana vuba.

1) Icyo "gushyira mu bikorwa" bivuze mu by'ukuri (n'impamvu atari API gusa) 🧩

Iyo abantu bavuze ngo “shyiraho icyitegererezo,” bashobora kuba bashaka kuvuga kimwe muri ibi:

Bityo rero, gushyiraho porogaramu bituma "icyitegererezo kiboneka" gito, ahubwo ni nk'ibi bikurikira:

  • gupakira + gutanga + kwagura + gukurikirana + imiyoborere + gusubiza inyuma ( Ubururu-Icyatsi )

Ni nko gufungura resitora. Guteka ibiryo byiza ni ingenzi, yego. Ariko uracyakeneye inyubako, abakozi, firigo, menu, uruhererekane rw'ibicuruzwa, n'uburyo bwo guhangana n'ifunguro rya nimugoroba udatakaje muri firigo. Ntabwo ari ikigereranyo cyiza… ariko urabyumva. 🍝

2) Ni iki gituma verisiyo ya "Uburyo bwo Gukoresha Moderi za AI" iba nziza ✅

"Gukoresha neza" birambirana mu buryo bwiza. Bitwara neza iyo umuntu ashyizwe mu gitutu, kandi iyo bitagenze bityo, ushobora kubisuzuma vuba.

Dore uko "byiza" bikunze kugaragara:

  • Ibyubaka byoroshye (Reproducible)
    Kode imwe + ibintu bimwe = imyitwarire imwe. Nta miterere iteye ubwoba y'uko "ikora kuri mudasobwa yanjye igendanwa" 👻 ( Docker: Kontineri ni iki? )

  • Amasezerano asobanutse yo gukoresha interineti.
    Ibyinjizwa, ibisohoka, imiterere, n'ibice by'inkombe birasobanuwe. Nta bwoko butunguranye saa mbiri za mu gitondo. ( OpenAPI: OpenAPI ni iki?, JSON Schema )

  • Imikorere ijyanye n'ukuri
    Gutinda no kubyaza umusaruro bipimirwa ku bikoresho nk'ibikorerwa mu musaruro n'imizigo ifatika.

  • Gukurikirana hakoreshejwe amenyo
    Ibipimo, ibiti, ibimenyetso, n'igenzura ry'amazi bitera igikorwa (si ububiko bw'amadirishya gusa nta muntu ufungura). ( Igitabo cya SRE: Gukurikirana Sisitemu Zikwirakwizwa )

  • Ingamba zo gushyira ahagaragara mu mutekano
    Canary cyangwa ubururu-icyatsi, gusimbuza byoroshye, guhindura ibintu bidasaba isengesho. ( Canary Release , Blue-Green Deployment )

  • Kumenya ikiguzi
    "Byihuta" ni byiza kugeza igihe fagitire isa n'inomero ya terefone 📞💸

  • Umutekano n'ubuzima bwite bikubiye mu
    gucunga amabanga, kugenzura uburyo abantu binjira, gucunga PII, no kugenzura amakuru. ( Kubernetes Secrets , NIST SP 800-122 )

Niba ushobora kubikora buri gihe, uba usanzwe urusha amakipe menshi. Reka tuvugishe ukuri.

3) Hitamo uburyo bwiza bwo gushyiramo ibikoresho (mbere yo guhitamo ibikoresho) 🧠

Igipimo cya API mu gihe nyacyo ⚡

Igihe cyiza ni iki:

  • abakoresha bakeneye ibisubizo byihuse (inama, kugenzura uburiganya, kuganira, guhindura ibyabo bwite)

  • ibyemezo bigomba gukorwa mu gihe cyo gusaba

Kwitonda:

Amanota menshi 📦

Igihe cyiza ni iki:

  • Ibyahanuwe bishobora gutinda (gutanga amanota y'ibyago mu ijoro rimwe, guhanura ibyavuye mu bushakashatsi, kongera ETL) ( Amazon SageMaker Batch Transform )

  • ushaka uburyo bwo gukoresha amafaranga neza no koroshya imikorere

Kwitonda:

  • amakuru mashya n'inyuma

  • gukomeza gushyira mu bikorwa imiterere y'ibintu mu buryo bujyanye n'amahugurwa

Igitekerezo cyo kuri interineti 🌊

Igihe cyiza ni iki:

  • ukomeza gutunganya ibikorwa (IoT, clickstreams, sisitemu zo gukurikirana)

  • ushaka ibyemezo bifatwa mu gihe nyacyo nta nyishu ikomeye isaba

Kwitonda:

Gushyira mu bikorwa Edge 📱

Igihe cyiza ni iki:

  • gutinda guke nta kwishingikiriza kuri interineti ( LiteRT kuri mudasobwa )

  • ibibujijwe ku buzima bwite

  • ahantu hatari kuri interineti

Kwitonda:

Hitamo igishushanyo mbonera mbere, hanyuma uhitemo agace. Bitabaye ibyo uzarangiza ukoresheje icyitegererezo cy'impande mu gihe cyo gukora. Cyangwa ikintu nk'icyo. 😬

4) Gupfunyika icyitegererezo kugira ngo kigumeho neza n'umusaruro 📦🧯

Aha niho "gushyira ibintu mu buryo bworoshye" byinshi bipfa bucece.

Verisiyo ya byose (yego, byose)

  • Igikoresho cy'icyitegererezo (ibiremereye, imbonerahamwe, tokenizer, amakarita y'ibirango)

  • Uburyo bwo gushyira ibintu mu buryo (impinduka, guhuza ibintu, imashini zikoresha ikoranabuhanga)

  • Kode y'icyitegererezo (mbere/nyuma yo gutunganya)

  • Ibidukikije (Python, CUDA, porogaramu za sisitemu)

Uburyo bworoshye bukora:

Ibikoresho birafasha, ariko ntukabisenge 🐳

Ibikoresho ni byiza cyane kuko:

Ariko uracyakeneye gucunga:

  • amavugurura y'ishusho y'ibanze

  • Guhuza abashoferi ba GPU

  • gusesengura umutekano

  • Ingano y'ishusho (nta muntu ukunda "isi nziza ya 9GB") ( Uburyo bwiza bwo kubaka Docker )

Guhindura uburyo bwo guhuza imiterere

Hitamo imiterere y'ibyo ushyiramo/bisohoka hakiri kare:

Kandi nyamuneka yemeza ko inyandiko zashyizwemo. Inyandiko zitari zo ni zo mpamvu nyamukuru ituma "tike zisubiza ubusa". ( OpenAPI: OpenAPI ni iki?, JSON Schema )

5) Amahitamo yo gutanga serivisi - kuva kuri "API yoroshye" kugeza kuri seriveri zuzuye 🧰

Hari inzira ebyiri zisanzwe:

Amahitamo A: Seriveri ya porogaramu + kode y'icyitegererezo (uburyo bwa FastAPI) 🧪

Wandika API ishyiramo icyitegererezo hanyuma ikagarura ibyahanuwe. ( FastAPI )

Ibyiza:

  • byoroshye guhindura

  • byiza cyane ku bikoresho byoroshye cyangwa ibicuruzwa byo mu rwego rwo hasi

  • uburenganzira bworoshye, inzira, no guhuza

Ibibi:

  • Ufite uburenganzira bwo gutunganya imikorere (guhuza, guhuza, gukoresha GPU)

  • uzavugurura amapine amwe, wenda mbere na mbere nabi

Amahitamo B: Seriveri y'icyitegererezo (TorchServe / Triton-style approach) 🏎️

Seriveri zihariye zikora:

Ibyiza:

  • imiterere myiza y'imikorere igaragara neza kurusha uko byahoze mbere

  • gutandukanya serivisi n'imitekerereze y'ubucuruzi neza

Ibibi:

  • imikorere igoye cyane

  • imiterere ishobora kumva… idasobanutse neza, nko guhindura ubushyuhe bwo kwiyuhagira

Imiterere y'ubwoko bwa hybrid irakunze kugaragara cyane:

6) Imbonerahamwe yo kugereranya - uburyo buzwi bwo gukoresha (bufite imivugire ikwiye) 📊😌

Hasi hari incamake y'amahitamo abantu bakoresha mu gihe bashaka uburyo bwo gukoresha moderi za AI .

Igikoresho / Uburyo Abareba Igiciro Impamvu bikora
Docker + FastAPI (cyangwa bisa nayo) Amakipe mato, amakipe mashya Ifite ubuntu Byoroshye, byoroshye kandi byihuse kohereza - "uzumva" buri kibazo cyose cyo gupima ( Docker , FastAPI )
Kubernetes (DIY) Amakipe yo kuri platform Ishingiye kuri infrarouge Kugenzura + kwaguka… kandi, hari udupfundo twinshi, bimwe muri byo byaravumwe ( Kubernetes HPA )
Urubuga rwa ML rucungwa (serivisi ya ML yo mu bicu) Amakipe ashaka abakinnyi bake Wishyure uko ugenda Imikorere yubatswemo, uburyo bwo gukurikirana - rimwe na rimwe bihenze ku mikorere ihoraho ( Vertex AI deployment , SageMaker real-time inference )
Imikorere idafite seriveri (ku bijyanye no gusesengura ibintu byoroheje) Porogaramu zishingiye ku birori Kwishyura kuri buri gukoresha Ni nziza ku modoka zigenda zishira - ariko gutangira vuba no kuba ingano ya moderi bishobora kwangiza umunsi wawe 😬 ( AWS Lambda cold starts )
Seriveri y'inyongera ya NVIDIA Triton Amakipe yibanda ku mikorere myiza Porogaramu y'ubuntu, ikiguzi cya infrared Gukoresha neza GPU, guhuza, gukoresha imiterere myinshi - config isaba kwihangana ( Triton: Dynamic batching )
Ishyo ry'urumuri Amakipe akomeye ya PyTorch Porogaramu y'ubuntu Imiterere myiza isanzwe yo gutanga serivisi - ishobora gukenera guhindurwa kugira ngo ikoreshwe ku rwego rwo hejuru ( TorchServe docs )
BentoML (gupakira + gutanga) Injeniyeri za ML Ingufu z'ubuntu, inyongera ziratandukanye Gupakira neza, ubunararibonye bwiza bw'abakora porogaramu - uracyakeneye amahitamo ya infra ( gupakira BentoML kugirango uyishyireho )
Ray Serve Abantu ba sisitemu zikwirakwizwa Ishingiye kuri infrarouge Ibipimo bitambitse, ni byiza ku miyoboro - bisa nkaho ari "binini" ku mishinga mito ( Ray Serve docs )

Imbonerahamwe: "Free-ish" ni imvugo ikoreshwa mu buzima busanzwe. Kuko ntabwo ari ubuntu. Buri gihe hari fagitire ahantu runaka, kabone niyo yaba ari ibitotsi byawe. 😴

7) Imikorere n'uburyo bwo gupima - gutinda, umusaruro, n'ukuri 🏁

Gutunganya imikorere niho gushyiraho ibintu biba ubuhanga. Intego si "yihuse". Intego ihora yihuta bihagije .

Ibipimo by'ingenzi bifite akamaro

Ibikoresho bisanzwe byo gukurura

  • Gusaba Batching
    Combine kugira ngo wongere ikoreshwa rya GPU. Ni byiza cyane ku ikoreshwa rya throughput, bishobora kwangiza igihe cyo gutinda iyo urenze urugero. ( Triton: Dynamic batching )

  • Gupima
    Ubuziranenge buke (nka INT8) bushobora kwihutisha icyerekezo no kugabanya kwibuka. Bishobora kwangiza gato ubuziranenge. Rimwe na rimwe ntibitangaje. ( Gupima nyuma y'amahugurwa )

  • Gukusanya / kunoza
    ONNX yohereza, optimizers za graph, flows zimeze nka TensorRT. Ifite imbaraga, ariko gukosora amakosa bishobora gutera uburibwe 🌶️ ( ONNX , ONNX Runtime model optimizations )

  • Gushyingura.
    Niba amakuru yinjiye asubiramo (cyangwa ushobora kuyashyira mu bubiko), ushobora kuzigama byinshi.

  • gupima kigenga
    ikoreshwa rya CPU/GPU, uburebure bw'umurongo, cyangwa igipimo cyo gusaba. Ubujyakuzimu bw'umurongo buragabanuka. ( Kubernetes HPA )

Inama idasanzwe ariko ifatika: pima ukoresheje ingano y'umuzigo nk'umusaruro. Imizigo mito y'igerageza irakubeshya. Baramwenyura mu kinyabupfura hanyuma bakaguhemukira nyuma.

8) Gukurikirana no kwitegereza - ntugahunge amaso 👀📈

Gukurikirana icyitegererezo si ugukurikirana gusa igihe ntarengwa. Urashaka kumenya niba:

Ibyo ugomba gukurikirana (nibura igihe gishoboka)

Ubuzima bwa serivisi

  • Umubare w'ibisabwa, igipimo cy'amakosa, ikwirakwizwa ry'igihe cyatinze ( SRE Book: Monitoring Distributed Systems )

  • ubwinshi bw'ibikoresho (CPU/GPU/ububiko)

  • uburebure bw'umurongo n'igihe uri ku murongo

Imyitwarire y'icyitegererezo

  • ikwirakwizwa ry'ibiranga byinjizwa (imibare y'ibanze)

  • amahame yo gushyiramo (ku buryo bwo gushyiramo)

  • ikwirakwizwa ry'umusaruro (icyizere, imvange y'ibyiciro, intera y'amanota)

  • Gutahura ibitagenda neza ku bintu byinjizwa mu bikoresho (imyanda yinjira, imyanda isohoka)

Guhindagurika kw'amakuru n'ihindagurika ry'ibitekerezo

Gushyira mu bikorwa inyandiko, ariko ntabwo ari uburyo bwo "gushyira mu bikorwa inyandiko iteka ryose" 🪵

Ikarita:

Witondere ubuzima bwite. Ntushaka ko amakuru yawe ahinduka ikibazo cy'ibura ry'amakuru yawe. ( NIST SP 800-122 )

9) CI/CD n'ingamba zo gushyira ahagaragara - fata moderi nk'izisohoka nyazo 🧱🚦

Niba ushaka uburyo bwizewe bwo gushyiraho ibikoresho, kora umuyoboro. Ndetse n'uworoshye.

Urugendo rukomeye

  • Ibizamini by'ibikoresho byo gutunganya mbere no gutunganya nyuma

  • Ikizamini cyo guhuza hakoreshejwe "itsinda rya zahabu" rizwi cyane ry'ibyinjira n'ibisohoka

  • Ikizamini cyo gupima imizigo (ndetse n'icyoroshye)

  • Kubaka ibihangano (ikonteyineri + icyitegererezo) ( Uburyo bwiza bwo kubaka Docker )

  • Shyira ku rutonde rw'ibitaramo

  • Gusohora Canary ku gice gito cy'urujya n'uruza rw'abantu ( Canary Release )

  • Kuzamuka buhoro buhoro

  • Gusubiza inyuma byihuse ku mpande z'ingenzi ( Ubururu-Icyatsi )

Imiterere yo gushyiramo ibintu igufasha kugarura ubwenge bwawe

  • Canary : shyira ahagaragara kugeza ku kigero cya 1-5% mbere ( Canary Release )

  • Ubururu-icyatsi : koresha verisiyo nshya iruhande rw'iya kera, uhindure hejuru igihe witeguye ( Ubururu-icyatsi cyoroshye )

  • Gupima igicucu : ohereza abantu nyabo kuri moderi nshya ariko ntukoreshe ibisubizo (ni byiza cyane mu isuzuma) ( Microsoft: Gupima igicucu )

Kandi uhindure aho ugarukira cyangwa uhindure inzira ukurikije verisiyo y'icyitegererezo. Uzagushimira mu gihe kizaza. Uzagushimira mu gihe kiri imbere, ariko bucece.

10) Umutekano, ubuzima bwite, na "ndakwinginze ntugatange amakuru" 🔐🙃

Abashinzwe umutekano bakunze kuhagera batinze, nk'umushyitsi utatumiwe. Byaba byiza umutumiye hakiri kare.

Urutonde rw'ibikorwa

  • Kwemeza no kwemerera (ni nde wakwita icyitegererezo?)

  • Kugabanya igipimo (kurindwa ihohoterwa n'inkubi y'umuyaga itunguranye) ( API Gateway throttling )

  • Gucunga amabanga (nta mfunguzo ziri muri kode, nta mfunguzo ziri muri dosiye za config…) ( Umuyobozi w'Amabanga ya AWS , Kubernetes Secrets )

  • Igenzura ry'imiyoboro (imiyoboro y'ibanga, politiki yo gutanga serivisi)

  • Inyandiko z'igenzura (cyane cyane ku byahanuwe by'ingenzi)

  • Kugabanya amakuru (bika gusa ibyo ugomba) ( NIST SP 800-122 )

Niba moderi ikora ku makuru bwite:

  • indangamuntu za redact cyangwa hash

  • irinde kwandika imitwaro y'ubwishyu idakoreshejwe ( NIST SP 800-122 )

  • sobanura amategeko agenga kugumana

  • urujya n'uruza rw'amakuru mu nyandiko (rurambiranye, ariko rurarinda)

Nanone, gukoresha nabi inshinge zihuse n'ibisohoka bishobora kugira akamaro ku buryo bwo kubyara. Ongeraho: ( OWASP Top 10 for LLM Applications , OWASP: Prompt Injection )

  • amategeko agenga isuku yinjiye

  • gushungura umusaruro aho bikwiye

  • inzira zo kurinda ibikoresho cyangwa ibikorwa byo guhamagara ububiko bw'amakuru

Nta sisitemu itunganye, ariko ushobora kuyigabanya intege nke.

11) Imitego isanzwe (izwi nka imitego isanzwe) 🪤

Dore indirimbo za kera:

Niba urimo gusoma ibi kandi utekereza uti “yego dukora bibiri muri ibyo,” ikaze muri iyi club. Iyi club ifite utuntu two kurya, kandi ifite stress nkeya. 🍪

12) Incamake - Uburyo bwo gukoresha moderi za AI udataye umutwe 😄✅

Gukoresha ubuhanga bwa "AI" niho ubuhanga bwa "AI" buhinduka ikintu nyacyo. Ntabwo ari ibintu bishimishije, ahubwo niho icyizere gituruka.

Incamake yihuse

Kandi yego, Uburyo bwo Gukoresha AI Models zishobora kumva nk'aho zirimo gukurura imipira y'urumuri mu ntangiriro. Ariko iyo umuyoboro wawe uhagaze neza, uba ushimishije cyane. Nk'aho warangije gutegura agasanduku k'ibintu byinshi… agasanduku gusa ni ko kaba ari ko kagendwa n'umusaruro. 🔥🎳

Ibibazo Bikunze Kubazwa

Icyo bivuze gushyira mu bikorwa icyitegererezo cya AI

Gukoresha moderi ya AI akenshi bikubiyemo ibirenze kugaragaza API y’ubuhanuzi. Mu by’ukuri, birimo gupakira moderi n’ibiyikomokaho, guhitamo imiterere yo kuyikoresha (igihe nyacyo, itsinda, uburyo bwo kuyikoresha, cyangwa uruziga), gupima neza, gukurikirana ubuzima n’ihindagurika ry’amakuru, no gushyiraho inzira zitekanye zo kuyikoresha no kuyisubiza inyuma. Gukoresha moderi ya AI biguma neza mu gihe umuntu abyiteze kandi bigakomeza gupimwa iyo hari ikintu kitagenda neza.

Uburyo bwo guhitamo hagati yo gukoresha porogaramu mu buryo bwihuse, mu buryo bwihuse, mu buryo bwihuse cyangwa mu buryo bwihuse

Hitamo uburyo bwo gushyiraho amakuru ukurikije igihe hakenewe guhanura n'imbogamizi ukoresha. API zo mu gihe nyacyo zihuye n'uburambe bwo gusabana aho gutinda ari ngombwa. Gutanga amanota ku batch bikora neza iyo gutinda byemewe kandi amafaranga atangwa neza. Gukurikirana amakuru bihuye n'ibikorwa bihoraho, cyane cyane iyo uburyo bwo gutanga amakuru butangiye kuba bubi. Gushyiraho Edge ni byiza cyane ku bijyanye no gukora hanze y'urubuga, ubuzima bwite, cyangwa ibisabwa mu gihe cyo gutinda cyane, nubwo kuvugurura no guhindura ibikoresho bigoye kubicunga.

Icyo wakora kugira ngo wirinde ko "ikora kuri mudasobwa yanjye igendanwa" inanirwa gukoreshwa

Verisiyo irenze uburemere bw'icyitegererezo gusa. Ubusanzwe, uzakenera ikintu cyakozwe muri verisiyo (harimo tokenizers cyangwa label maps), isuzuma ry'ibanze n'imiterere y'ibintu, kode y'icyitegererezo, hamwe n'ahantu hose hakora (Python / CUDA / libraries za system). Fata icyitegererezo nk'ikintu cyakozwe muri verisiyo zifite tagi na metadata yoroheje isobanura ibyo schema yiteze, inyandiko z'isuzuma, n'imbogamizi zizwi.

Niba ari ugukoresha serivisi yoroshye ya FastAPI cyangwa seriveri yihariye

Seriveri yoroshye ya porogaramu (uburyo bwa FastAPI) ikora neza ku bicuruzwa bya mbere cyangwa moderi zoroshye kuko ugumana ububasha ku miyoboro, auth, na integration. Seriveri y'icyitegererezo (TorchServe cyangwa NVIDIA Triton-style) ishobora gutanga uburyo bukomeye bwo guhuza, guhuza, no gukoresha GPU neza. Amakipe menshi akoresha uburyo butandukanye: seriveri y'icyitegererezo kugira ngo amenye neza hamwe n'urwego ruto rwa API rwo kwemeza, gushyiraho ubusabe, n'umupaka w'igipimo.

Uburyo bwo kunoza igihe cyo gutinda no gukoresha neza ibicuruzwa nta kubangamira uburyo bikoreshwa

Tangira upima igihe cyo gutinda kwa p95/p99 ku bikoresho bisa n'umusaruro ukoresheje imitwaro ifatika, kubera ko ibizamini bito bishobora kuyobya. Uburyo busanzwe bwo gukoresha uburyo bwo gupima (gutanga umusaruro mwiza, igihe gishobora kuba kibi kurushaho), gupima (guto kandi vuba, rimwe na rimwe hamwe n'uburyo bwo gusesengura neza), gukusanya no gutunganya (ONNX/TensorRT-like), no kubika amakuru asubirwamo cyangwa gushingwa. Gupima imiterere y'amakuru hakoreshejwe uburyo bwo gupima imiterere y'amakuru bishobora kandi gutuma igihe cyo gutinda kuzamuka.

Ni irihe genzura rikenewe nyuma y'aho "iherezo riri hejuru"

Igihe cyo gukora ntabwo gihagije, kuko serivisi ishobora kugaragara neza mu gihe ireme ry’ibiteganyijwe rigabanuka. Nibura, genzura ingano y’ubusabe, igipimo cy’amakosa, n’ikwirakwizwa ry’igihe cyatinze, hamwe n’ibimenyetso by’ubwinshi nka CPU/GPU/memory n’igihe cyo gutondeka umurongo. Ku bijyanye n’imyitwarire y’icyitegererezo, kurikirana ikwirakwizwa ry’ibisohoka n’ibisohoka hamwe n’ibimenyetso by’ibanze bitameze neza. Ongeraho igenzura ry’uburyo ibintu bihinduka aho kuba imenyesha ry’urusaku, hamwe n’amarangamuntu y’ubusabe bw’inyandiko, verisiyo z’icyitegererezo, n’ibyavuye mu kwemeza schema.

Uburyo bwo gushyira ahagaragara verisiyo nshya mu buryo butekanye kandi ugakira vuba

Fata moderi nk'izisohoka zose, ukoresheje umuyoboro wa CI/CD upima itegurwa rya mbere n'itegurwa rya nyuma, ugakora igenzura ryo guhuza kuri "seti ya zahabu", kandi ugashyiraho umurongo ngenderwaho w'imizigo. Ku isohoka, canary isohora imodoka buhoro buhoro, mu gihe ubururu n'icyatsi kibisi bikomeza verisiyo ishaje kugira ngo igaruke ako kanya. Isuzuma ry'igicucu rifasha gusuzuma moderi nshya ku bantu nyabo badakoze ingaruka ku bakoresha. Rollback igomba kuba uburyo bwo mu rwego rwa mbere, ntabwo ari ikintu cyo gutekerezaho nyuma.

Ingorane zikunze kugaragara mu gihe umuntu yiga uburyo bwo gushyira mu bikorwa moderi za AI

Uburyo bwo gusesengura amahugurwa busanzwe ni bwo busanzwe: gutegura mbere y’amahugurwa bitandukanye hagati y’amahugurwa n’umusaruro, kandi imikorere igabanuka bucece. Ikindi kibazo gikunze kugaragara ni ukubura uburyo bwo kwemeza igishushanyo mbonera, aho impinduka ziyongera zigabanya uburyo bwo kwinjira mu buryo butoroshye. Amakipe kandi agabanya igihe cyo gutinda gukora kandi akibanda cyane ku mpuzandengo, akirengagiza ikiguzi (GPU zidafite icyo zikora ziyongera vuba), kandi agasimbuka gahunda yo gusimbuza. Gukurikirana igihe cyo gukora gusa ni byo biteye akaga cyane, kuko "kugera ku muvuduko ariko bitari byo" bishobora kuba bibi kuruta kumanuka.

Amareferensi

  1. Serivisi za interineti za Amazon (AWS) - Amazon SageMaker: Incamake y'igihe nyacyo - docs.aws.amazon.com

  2. Serivisi za interineti za Amazon (AWS) - Amazon SageMaker Batch Transform - docs.aws.amazon.com

  3. Serivisi za interineti za Amazon (AWS) - Amazon SageMaker Model Monitor - docs.aws.amazon.com

  4. Serivisi za interineti za Amazon (AWS) - Uburyo bwo gusaba gukoresha porogaramu ya API Gateway - docs.aws.amazon.com

  5. Serivisi za interineti za Amazon (AWS) - Umuyobozi w'Amabanga ya AWS: Intangiriro - docs.aws.amazon.com

  6. Serivisi za interineti za Amazon (AWS) - Iherezo ry'ubuzima bw'ibidukikije bya AWS Lambda - docs.aws.amazon.com

  7. Google Cloud - Vertex AI: Shyira moderi ku mpera - docs.cloud.google.com

  8. Incamake y'igenzura rya Vertex AI muri Google Cloud - docs.cloud.google.com

  9. Google Cloud - Vertex AI: Uburyo bwo kugenzura ibintu buhindagurika kandi buhindagurika - docs.cloud.google.com

  10. Google Cloud Blog - Dataflow: uburyo bwo kureba buri kanya ugereranije n'uburyo bwo kureba buri kanya - cloud.google.com

  11. Google Cloud - Uburyo bwo gukwirakwiza amakuru kuri Cloud Dataflow - docs.cloud.google.com

  12. Igitabo cya Google SRE - Uburyo bwo kugenzura imikorere ya sisitemu zikwirakwizwa - sre.google

  13. Ubushakashatsi bwa Google - Umurizo ku rwego rwo hejuru - research.google

  14. LiteRT (Google AI) - Incamake ya LiteRT - ai.google.dev

  15. LiteRT (Google AI) - LiteRT yerekana ibikoresho - ai.google.dev

  16. Docker - Kontineri ni iki? - docs.docker.com

  17. Docker - Uburyo bwiza bwo kubaka Docker - docs.docker.com

  18. Kubernetes - Kubernetes Amabanga - kubernetes.io

  19. Kubernetes - Horizontal Pod Autoscaling - kubernetes.io

  20. Martin Fowler - Irekurwa rya Canary - martinfowler.com

  21. Martin Fowler - Ubururu n'icyatsi kibisi - martinfowler.com

  22. Gahunda ya OpenAPI - OpenAPI ni iki? - openapis.org

  23. Gahunda ya JSON - (urubuga rwarebwe) - json-schema.org

  24. Ibikoresho bya Porotokole - Incamake ya Bikoresho bya Porotokole - protobuf.dev

  25. FastAPI - (urubuga rwavuzweho) - fastapi.tiangolo.com

  26. NVIDIA - Triton: Dynamic Batching & Concurrent Model Exercise - docs.nvidia.com

  27. NVIDIA - Triton: Ishyirwa mu bikorwa ry'icyitegererezo icyarimwe - docs.nvidia.com

  28. NVIDIA - Triton Inference Server - docs.nvidia.com

  29. PyTorch - Inyandiko za TorchServe - docs.pytorch.org

  30. BentoML - Gupakira ibikoresho byo kohereza - docs.bentoml.com

  31. Inyandiko za Ray - Ray Serve - docs.ray.io

  32. TensorFlow - Gupima nyuma y'amahugurwa (TensorFlow Model Optimization) - tensorflow.org

  33. TensorFlow - Kwemeza amakuru ya TensorFlow: kumenya imbogamizi zitangwa n'amahugurwa - tensorflow.org

  34. ONNX - (urubuga rwavuzweho) - onnx.ai

  35. ONNX Runtime - Icyitegererezo cyiza - onnxruntime.ai

  36. NIST (Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga) - NIST SP 800-122 - csrc.nist.gov

  37. arXiv - Amakarita y'icyitegererezo yo gutanga raporo y'icyitegererezo - arxiv.org

  38. Microsoft - Isuzuma ry'igicucu - microsoft.github.io

  39. OWASP - OWASP 10 za mbere kuri porogaramu za LLM - owasp.org

  40. Umushinga w'umutekano wa OWASP GenAI - OWASP: Gutera inshinge vuba - genai.owasp.org

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe

Garuka kuri blog