Uburyo bwo gusuzuma moderi za AI

Uburyo bwo gusuzuma moderi za AI

Igisubizo kigufi: Sobanura uko "ibyiza" bisa ku ikoreshwa ryawe, hanyuma ugerageze ukoresheje amabwiriza ahagarariye, yahinduwe hamwe n'ibimenyetso by'inyongera. Huza ibipimo byikora hamwe n'amanota y'abantu, hamwe n'umutekano w'abahanganye n'igenzura ry'ingufu zihuse. Niba ikiguzi cyangwa igihe cyo gutinda bitangiye kuba ngombwa, gereranya moderi ukurikije intsinzi y'akazi kuri pound yakoreshejwe n'igihe cyo gusubiza p95/p99.

Ibintu by'ingenzi byakunzwe:

Kubazwa : Shyira ba nyir'inyandiko basobanutse, andika verisiyo, hanyuma wongere ukoreshe evals nyuma yo guhindura byihutirwa cyangwa icyitegererezo.

Gukorera mu mucyo : Andika ibipimo ngenderwaho by'intsinzi, imbogamizi, n'ikiguzi cyo gutsindwa mbere yo gutangira gukusanya amanota.

Igenzura : Gukomeza ibizamini bishobora gusubiramo, amakuru yanditseho amazina, n'ibipimo bya p95/p99 byakurikiranwe.

Guhangana : Koresha imbonerahamwe y'isuzuma ry'abantu n'inzira y'ubujurire yagenwe ku bisubizo bishyamiranye.

Ubudakoresha nabi : Gutera inshinge ku buryo bwihuse itsinda rishinzwe kurwanya ihohoterwa, ingingo zikomeye, no kwanga cyane kugira ngo barinde abakoresha.

Niba urimo guhitamo icyitegererezo cy'igicuruzwa, umushinga w'ubushakashatsi, cyangwa igikoresho cy'imbere, ntushobora kuvuga ngo "bisa n'ibigezweho" ngo ubitange (reba ubuyobozi bwa OpenAI evals na NIST AI RMF 1.0 ). Uko ni ko ugera ku ikarita ya chatbot isobanura neza uburyo bwo gukoresha microwave. 😬

Uburyo bwo gusuzuma imiterere ya AI (AI Models Infographic)

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Ahazaza h'ubukorano bushingiye ku ikoranabuhanga: ibipimo bizahindura imyaka icumi iri imbere
Udushya tw'ingenzi, ingaruka ku kazi, n'amahame mbwirizamuco tugomba kwitaho mu gihe kiri imbere.

🔗 Ibyitegererezo by'ibanze mu buhanga bwo gukora imibonano mpuzabitsina ku batangira.
Menya ibyo bahuguwemo, uburyo bahuguwemo, n'impamvu ari ingenzi.

🔗 Uburyo ubuhanga bwo gukora imibonano mpuzabitsina (AI) bugira ingaruka ku bidukikije no ku ikoreshwa ry'ingufu.
Suzuma imyuka ihumanya ikirere, ikoreshwa ry'amashanyarazi, n'uburyo bwo kugabanya ibikorwa byayo.

🔗 Uko kongera ubushobozi bwa AI bikora ku mashusho meza muri iki gihe
Reba uburyo moderi zongeramo utuntu duto, zikuraho urusaku, kandi zikagura neza.

1) Gusobanura "byiza" (biterwa, kandi nta kibazo) 🎯

Mbere yo gukora isuzuma iryo ari ryo ryose, hitamo uko intsinzi isa. Bitabaye ibyo uzapima byose ntugire icyo wiga. Ni nko kuzana kaseti yo gupima kugira ngo uhitemo amarushanwa y'umugati. Yego, uzabona imibare, ariko nta byinshi izakubwira 😅

Sobanura:

  • Intego y'umukoresha : incamake, gushakisha, kwandika, gutekereza, gukuramo ibimenyetso

  • Ikiguzi cyo gutsindwa : inama itari yo kuri filime irasekeje; amabwiriza atari yo kuri muganga… ntabwo asekeje (gushyiraho ingamba zo guhangana n’ingaruka: NIST AI RMF 1.0 ).

  • Ibikoresho bikorerwa mu gihe cyo gukora : kuri mudasobwa, mu gicu, inyuma y'inkuta z'umuriro, mu buryo bugenzurwa

  • Inzitizi z'ibanze : gutinda, ikiguzi kuri buri busabe, ubuzima bwite, gusobanurwa, inkunga mu ndimi nyinshi, kugenzura ijwi

Umudeli "ufite ubuhanga" mu kazi kamwe ashobora guteza akaga akandi. Ibyo si ukuvuguruzanya, ni ukuri. 🙂

2) Uburyo bukomeye bwo gusuzuma icyitegererezo cya AI bumeze 🧰

Yego, iki ni cyo gice abantu basimbuka. Bafata urugero rw'icyitegererezo, bakarukoresha rimwe, hanyuma bakarwita umunsi umwe. Urwego rw'isuzuma ruhamye rufite ibintu bike bihoraho (ingero z'ibikoresho bifatika: OpenAI Evals / OpenAI evals guide ):

  • Ishobora gusubirwamo - ushobora kongera kuyikoresha mu cyumweru gitaha kandi ukizera igereranya

  • Uhagarariye - igaragaza abakoresha bawe n'imirimo yawe nyakuri (atari utuntu duto gusa)

  • Igizwe n'ibipimo byinshi - bihuza ibipimo byikora + isuzuma ry'abantu + ibizamini by'impinduka

  • Ishobora gukorwa - ibisubizo bikubwira icyo ukwiye gukosora, ntabwo ari "amanota yagabanutse" gusa

  • Irinda gutinda - yirinda "kwigisha ikizamini" cyangwa gusohora amazi mu buryo butunguranye

  • ryimbitse ku giciro - ntabwo rigomba kuguhomba (keretse niba ukunda ububabare)

Niba isuzuma ryawe ridashobora kwihanganira mugenzi wawe ushidikanya akavuga ati “Sawa, ariko shyira ibi mu bikorwa,” ntabwo birarangira. Ni cyo kintu cy’ingenzi.

3) Uburyo bwo gusuzuma moderi za AI utangirana n'uduce tw'ikoreshwa 🍰

Dore amayeri agufasha kuzigama igihe kinini: gabanya ikoreshwa ry'ibikoresho mo uduce duto .

Aho "gusuzuma icyitegererezo," kora:

  • Gusobanukirwa intego (ese bigeraho icyo umukoresha ashaka)

  • Gusubiramo cyangwa gukoresha amakuru ajyanye n'aho byabereye (ese bikoresha amakuru yatanzwe neza)

  • Gutekereza / imirimo ikorwa mu ntambwe nyinshi (ese ikomeza kuba ijyanye n'intambwe zose)

  • Imiterere n'imiterere (ese bikurikiza amabwiriza)

  • Kuboneza umutekano n'amahame (ese birinda ibikubiye mu makuru bidafite umutekano; reba NIST AI RMF 1.0 )

  • Ijwi n'ijwi ry'ikirango (ese byumvikana nk'aho ushaka ko byumvikana)

Ibi bituma "Uburyo bwo Gusuzuma Modeli za AI" budasa n'ikizamini kimwe kinini ahubwo bugasa n'ikizamini cyihariye. Ibibazo birababaza, ariko birashoboka. 😄

4) Ibintu by'ibanze byo gusuzuma bitari mu rubuga - ibizamini, ibirango, n'ibisobanuro bidasanzwe by'ingenzi 📦

eval yo hanze niho ukora ibizamini bigenzurwa mbere yuko abakoresha bakora ikintu icyo ari cyo cyose (imiterere y'imikorere: OpenAI Evals ).

Hubaka cyangwa ukusanye itsinda ry'ibizamini rikubereye koko

Itsinda ryiza ry'ibizamini rikunze kuba rikubiyemo:

  • Ingero za zahabu : umusaruro mwiza watanga utewe ishema

  • Ibibazo bya Edge : ubutumwa budasobanutse neza, uburyo bwo kwinjiramo budasobanutse neza, imiterere itunguranye

  • Isuzuma ry’uburyo bwo gutsindwa : ibintu bishobora gutuma umuntu abona ibintu nk’aho atari byo cyangwa ibisubizo bidafite ishingiro (gupima ibyago: NIST AI RMF 1.0 )

  • Ubushakashatsi ku bumenyi butandukanye : urwego rw'ubuhanga butandukanye ku bakoresha, imvugo, indimi, uturere

Iyo ugerageje gusa ku byo "bisobanutse", icyitegererezo kizagaragara neza cyane. Hanyuma abakoresha bawe bazagaragara bafite amakosa yo kwandika, interuro ebyiri, n'imbaraga zo gukanda ku jisho. Murakaza neza muri reality.

Amahitamo yo gushyiramo ibirango (azwi nka: urwego rw'ubukana)

Ushobora kwita ibisohoka nka:

  • Binary : gutsinda/gutsindwa (kwihuta, gukomeye)

  • Isesengura : Amanota 1-5 y'ubuziranenge (ashingiye ku ngingo, ku buryo umuntu yiyumva)

  • Ibiranga byinshi : ukuri, ubuziranenge, ijwi, ikoreshwa ry'inyandiko, nibindi (byiza, buhoro)

Uburyo bwinshi ni ahantu heza ku makipe menshi. Ni nko gusogongera ibiryo no gucira urubanza umunyu utandukanye n'imiterere. Bitabaye ibyo, uvuga gusa uti "ni byiza" hanyuma ugashyira amaboko hejuru.

5) Ibipimo bitabeshya - n'ibipimo by'ukuri 📊😅

Ibipimo ni ingenzi… ariko bishobora no kuba igisasu gishyuha. Birabagirana, ahantu hose, kandi bigoye kubisukura.

Imiryango isanzwe y'ibipimo

  • Uburinganire / guhuza neza : ni byiza cyane mu gukuramo, gushyira mu byiciro, no gukora imirimo iteguye

  • F1 / precision / recall : ifasha iyo umuntu abuze ikintu ni bibi kurusha urusaku rwinshi (ibisobanuro: scikit-learn precision/recall/F-score )

  • Uburyo bwa BLEU / ROUGE buhurirana : ni byiza ku mirimo ijyanye no gusesengura, akenshi iyobya (ibipimo by'umwimerere: BLEU na ROUGE )

  • Gushyiramo isano : bifasha mu guhuza imiterere y'amagambo, bishobora guhemba ibisubizo bitari byo ariko bisa

  • Igipimo cy'intsinzi ku murimo : "ese umukoresha yabonye icyo akeneye" ibipimo ngenderwaho bya zahabu iyo byasobanuwe neza

  • Gukurikiza inzitizi : bikurikiza imiterere, uburebure, agaciro ka JSON, gukurikiza gahunda

Ingingo y'ingenzi

Niba akazi kawe gafunguye (kwandika, gutekereza, kuganira ku buryo bwo gushyigikirana), ibipimo by'umubare umwe bishobora kuba… bihindagurika. Ntabwo ari ubusa, ahubwo bihindagurika gusa. Gupima guhanga udushya ukoresheje urwego birashoboka, ariko uzumva ubaye umuswa kubikora. (Nanone uzakuramo amaso yawe, birashoboka.)

Rero: koresha ibipimo, ariko ubishyire ku isuzuma ry’abantu n’umusaruro nyakuri w’imirimo (urugero rumwe rw’ibiganiro by’isuzuma rishingiye kuri LLM + ibitagenda: G-Eval ).

6) Imbonerahamwe yo Kugereranya - amahitamo meza yo gusuzuma (hamwe n'ibintu bidasanzwe, kuko ubuzima bufite ibintu bidasanzwe) 🧾✨

Dore urutonde rw'uburyo bwo gusuzuma. Vanga uhuze. Amakipe menshi ni yo abikora.

Igikoresho / Uburyo Abareba Igiciro Impamvu bikora
Inzu yo gupimisha imashini yubatswe n'intoki Ibicuruzwa + ikoranabuhanga $ Igamije cyane, ifata gusubira inyuma vuba - ariko ugomba kuyigumana iteka ryose 🙃 (ibikoresho byo gutangira: OpenAI Evals )
Akanama gatanga amanota ku rutonde rw'abantu Amakipe ashobora kureka abasuzuma $$ Byiza cyane ku mvugo, uburyohe, "ese umuntu yakwemera ibi", akajagari gato bitewe n'abasuzuma
LLM-nk'umucamanza (ukoresheje imirongo) Imirongo yihuta yo gusubiramo ibintu $-$$ Birihuse kandi bikwirakwira, ariko bishobora kuragwa urwikekwe ndetse rimwe na rimwe bigatuma umuntu arushaho kugira amanota atari ukuri (ubushakashatsi + ibibazo bizwi byo gutandukana: G-Eval )
Gusiganwa mu maguru mu ikipe y'abanzi batukura Umutekano + kubahiriza amategeko $$ Irashaka uburyo bwo gucika intege buteye cyane, cyane cyane inshinge zoroshye - bisa n'ikizamini cy'umuhangayiko muri siporo (incamake y'ikibazo: OWASP LLM01 Inshinge zoroshye / OWASP 10 za mbere kuri porogaramu za LLM )
Gukora ibizamini bya sintetike Amakipe y'ikoranabuhanga $ Uburyo bwiza bwo gukwirakwiza amakuru, ariko inyandiko zikozwe mu buryo bwa "synthetic" zishobora kuba nziza cyane, zirangwa n'ikinyabupfura cyinshi… abakoresha ntibarangwa n'ikinyabupfura
Gupima A/B hakoreshejwe abakoresha nyabo Ibicuruzwa bikuze $$$ Ikimenyetso gisobanutse neza - kandi gitera stress cyane mu marangamutima iyo ibipimo bihinduka (ubuyobozi busanzwe: Kohavi et al., “Ibizamini bigenzurwa kuri interineti” )
Igenzura rya RAG (Retrieval-grounded eval) Shakisha + porogaramu z'ibisubizo $$ Ibipimo "bikoresha neza imiterere y'ibintu," bigabanya izamuka ry'ibiciro ry'amanota y'ibitekerezo (incamake ya RAG: Isuzuma rya RAG: Ubushakashatsi )
Gukurikirana + kumenya aho ibintu binyura Sisitemu z'umusaruro $$-$$$ Ifata kwangirika uko igihe kigenda - ntihinduka kugeza umunsi igukijije 😬 (incamake y'ihindagurika: Ubushakashatsi ku birebana n'ihindagurika ry'ibitekerezo (PMC) )

Menya ko ibiciro ari bito cyane ku bushake. Biterwa n'ingano, ibikoresho, n'umubare w'inama uhura nazo ku buryo butaziguye.

7) Isuzumabumenyi ry'abantu - intwaro y'ibanga abantu batanga amafaranga make 👀🧑⚖️

Uramutse ukoze isuzuma ryikora gusa, uzabura:

  • Ijwi ritajyanye ("kuki ari ribi cyane")

  • Amakosa y'ukuri asa n'aho ari meza

  • Ingaruka mbi, ibitekerezo bidafite ishingiro, cyangwa imvugo idahwitse (gushyiraho ibyago + uruhande rushingiye ku bidindiza: NIST AI RMF 1.0 )

  • Amakosa akurikira amabwiriza aracyagaragara nk' "ay'ubwenge"

Kora imitako ifatika (cyangwa abasuzuma bazayikoresha mu buryo bw'ubuntu)

Urupapuro rubi: "Ubufasha"
Urupapuro rwiza:

  • Ubuziranenge : ukuri kw'ibintu bitewe n'inkuru irambuye + aho biherereye

  • Ubusembwa : bukubiyemo ingingo zisabwa nta guceceka

  • Gusobanutse neza : bisomeka neza, bifite imiterere, urujijo ruto

  • Politiki / umutekano : yirinda ibikubiye mu nyandiko bibujijwe, ikemura neza ibyangwa (uburyo bw'umutekano: NIST AI RMF 1.0 )

  • Ishusho : ijyanye n'ijwi, ijwi, urwego rwo gusoma

  • Ubwizerwe : ntabwo buhimba amasoko cyangwa ibirego bidashyigikiwe

Nanone, rimwe na rimwe kora igenzura ry’abasuzuma hagati y’abasuzuma. Iyo abasesengura babiri badahuje ibitekerezo buri gihe, ntabwo ari "ikibazo cy’abantu," ahubwo ni ikibazo cy’urutonde rw’ibibazo. Ubusanzwe (iby’ibanze ku bwizerwa hagati y’abasuzuma hagati y’abasuzuma: McHugh kuri kappa ya Cohen ).

8) Uburyo bwo gusuzuma moderi za AI kugira ngo umenye umutekano, imbaraga, n' "uh, abakoresha" 🧯🧪

Iki ni cyo gice ugomba gukora mbere yo gutangira - hanyuma ugakomeza gukora, kuko interineti idasinzira.

Ibizamini by'ubudahangarwa birimo

  • Imyandikire, imvugo isanzwe, ikibonezamvugo cyangiritse

  • Ibitekerezo birebire cyane kandi bigufi cyane

  • Amabwiriza avuguruzanya ("vuga make ariko ushyiremo buri kantu kose")

  • Ibiganiro bihuza abantu benshi aho abakoresha bahindura intego

  • Kugerageza gutera umuti mu buryo bwihuse ("wirengagije amategeko yabanje ...") (ibisobanuro by'iterabwoba: OWASP LLM01 Prompt Injection )

  • Ingingo zikomeye zisaba kwangwa witonze (gusobanura ibyago/umutekano: NIST AI RMF 1.0 )

Isuzuma ry'umutekano si "uko byanze" gusa

Icyitegererezo cyiza kigomba:

  • Kwanga ubusabe butekanye mu buryo bwumvikana kandi butuje (amabwiriza: NIST AI RMF 1.0 )

  • Tanga ubundi buryo butekanye mu gihe bikenewe

  • Irinde kwanga cyane ibibazo bitagize ingaruka mbi (ibitari byo)

  • Gukemura ibyifuzo bidasobanutse neza ukoresheje ibibazo bisobanuka neza (igihe byemewe)

Kwanga cyane ni ikibazo gikomeye cy’ibicuruzwa. Abakoresha ntibakunda gufatwa nk’ibisambo biteye amakenga. 🧌 (Nubwo ari ibisambo biteye amakenga.)

9) Ikiguzi, gutinda, n'ukuri kw'imikorere - isuzuma buri wese yibagirwa 💸⏱️

Moderi ishobora kuba "itangaje" ariko ikaba idafite ishingiro niba igenda buhoro, ihenze, cyangwa idakora neza.

Suzuma:

  • Ikwirakwizwa ry'igihe gito (si impuzandengo gusa - p95 na p99 matter) (impamvu ingero z'ibyiciro by ...

  • Igiciro kuri buri gikorwa cyagenze neza (si ikiguzi kuri buri tokeni ukwayo)

  • Ituze mu gihe cy'umutwaro (igihe cyo guhagarara, imipaka y'igipimo, izamuka ridasanzwe)

  • Kwizerwa mu guhamagara igikoresho (niba gikoresha imikorere, ese kibyitwaramo neza)

  • Ingengabihe y'uburebure bw'umusaruro (imwe mu miterere irahindagurika, kandi ihindagurika ritwara amafaranga)

Imodoka mbi gato kandi yihuta kabiri ishobora gutsinda mu myitozo. Ibyo bisa nkaho bigaragara, nyamara abantu barabyirengagiza. Nk'aho kugura imodoka ya siporo yo kugura ibiribwa, hanyuma bakinubira umwanya wo gutwara imodoka.

10) Uburyo bworoshye bwo gukora kuva ku mpera kugeza ku mpera ushobora gukoporora (no guhindura) 🔁✅

Dore uburyo bwo gusuzuma moderi za AI udafatiwe mu bigeragezo bitagira iherezo:

  1. Sobanura intsinzi : inshingano, imbogamizi, ikiguzi cyo gutsindwa

  2. Kora itsinda rito ry'ibizamini "by'ibanze" : Ingero 50-200 zigaragaza ikoreshwa nyaryo

  3. Ongeraho impande n'impande : kugerageza gutera inshinge, ibintu bidasobanutse neza, imashini zipima umutekano (icyiciro cyo gutera inshinge vuba: OWASP LLM01 )

  4. Kora igenzura ryikora : imiterere, ubuziranenge bwa JSON, ubuziranenge bw'ibanze aho bishoboka

  5. Kora isuzuma ry'abantu : ingero z'ibyavuye mu byiciro, amanota ukoresheje umurongo

  6. Gereranya ibitandukanye : ubuziranenge ugereranije n'ikiguzi ugereranije n'igihe cyo gutinda ugereranije n'umutekano

  7. Igerageza mu irekurwa rito : Ibizamini bya A/B cyangwa ishyirwa mu byiciro (Ubuyobozi bw'igerageza rya A/B: Kohavi et al. )

  8. Igenzura mu ikorwa : guhindagurika, gusubira inyuma, imirongo y'ibitekerezo by'abakoresha (incamake y'ihindagurika: Isuzuma ry'ibitekerezo (PMC) )

  9. Iterate : kuvugurura amabwiriza, kugarura, gutunganya neza, gukingira, hanyuma wongere ukoreshe eval (imiterere ya eval iterate: OpenAI evals guide )

Bika inyandiko zahinduwe. Si ukubera ko ari ibintu bishimishije, ahubwo ni ukubera ejo hazaza - uzagushimira ufashe ikawa kandi uvuga uti "icyahindutse ..." ☕🙂

11) Imitego isanzwe (izwi nka: uburyo abantu bishuka ku bushake) 🪤

  • Kwitoza ikizamini : ukoresha uburyo bwo kunoza ibyo wasabye kugeza igihe ibipimo bishaje neza, ariko abakoresha bakababara

  • Amakuru y'isuzuma yavuye mu kaga : inyandiko z'ibizamini zigaragara mu mahugurwa cyangwa mu gutunganya amakuru neza (wooops)

  • Gusenga mu buryo bumwe : gukurikirana amanota amwe adagaragaza agaciro k'umukoresha

  • Kwirengagiza impinduka mu ikwirakwizwa ry'ibicuruzwa : impinduka mu myitwarire y'abakoresha kandi moderi yawe irangirika bucece (gushyiraho ingaruka z'umusaruro: Ubushakashatsi ku guhindagurika kw'ibitekerezo (PMC) )

  • Gushyira mu gaciro cyane ku "bwenge" : gutekereza neza ntacyo bitwaye niba bihindura imiterere cyangwa bihimba ibintu

  • Kutagerageza ireme ry'ubuziranenge bw'uburangare : "Oya" ishobora kuba ari yo ariko iracyari mbi cyane UX

Nanone, mwirinde ama-demo. Ama-demo ameze nk'amashusho magufi. Yerekana ibintu by'ingenzi, ahisha ibice by'amajwi, kandi rimwe na rimwe aryamye n'umuziki w'ikinamico. 🎬

12) Incamake y'inyongera ku buryo bwo gusuzuma moderi za AI 🧠✨

Gusuzuma uburyo bwo gukora indyo yuzuye (AI models) si amanota amwe, ni indyo yuzuye. Ukeneye poroteyine (uburyo bukwiye), imboga (umutekano), karubohidrati (umuvuduko n'igiciro), kandi yego, rimwe na rimwe deseri (ijwi n'ibyishimo) 🍲🍰 (igenamiterere ry'ibyago: NIST AI RMF 1.0 )

Niba nta kindi wibuka:

  • Sobanura icyo "icyiza" bivuze ku ikoreshwa ryawe

  • Koresha ibizamini by'ibizamini bihagarariye abandi, ntabwo ari ibipimo bizwi gusa

  • Huza ibipimo byikora n'isuzuma ry'abantu

  • Ubuhanga mu isuzuma n'umutekano nk'uko abakoresha babikora ni ibintu bivuguruzanya (kuko rimwe na rimwe… baba ari byo) (icyiciro cyihuse cyo guteramo: OWASP LLM01 )

  • Shyiramo ikiguzi n'igihe cyo gutinda mu isuzuma, ntabwo ari nk'igitekerezo cya nyuma (impamvu ijanisha ry'ibyiciro ari ingenzi: Igitabo cy'akazi cya Google SRE )

  • Igenzura nyuma yo kurishyira ahagaragara - moderi zigenda zihinduka, porogaramu zirahinduka, abantu barushaho guhanga udushya (incamake y'ihindagurika: Ubushakashatsi ku birebana n'ihindagurika (PMC) )

Uko ni ko wasuzuma Modeli za AI mu buryo butuma ibicuruzwa byawe bikomeza gukora neza iyo abantu batangiye gukora ibintu abantu batazi. Ibyo ni ko bigenda buri gihe. 🙂

Ibibazo Bikunze Kubazwa

Ni iyihe ntambwe ya mbere mu gusuzuma moderi za AI ku gicuruzwa nyacyo?

Tangira usobanura icyo "ibyiza" bivuze ku ikoreshwa ryawe ryihariye. Vuga intego y'umukoresha, ibyo wananiwe byagutwaye (ibice bike ugereranije n'ibice byinshi), n'aho moderi izakorera (ibicu, kuri igikoresho, ibidukikije bigenzurwa). Hanyuma andika inzitizi zikomeye nka gutinda, ikiguzi, ubuzima bwite, no kugenzura ijwi. Udafite uru rufatiro, uzapima byinshi ariko ugakomeza gufata icyemezo kibi.

Ni gute nakora ikizamini kigaragaza neza abakoresha banjye?

Hubaka itsinda ry'ibizamini rikubereye koko, atari igipimo rusange gusa. Shyiramo ingero za zahabu wakwishimira gutanga, hamwe n'amakuru asakuza, agaragara mu buryo butunguranye hamwe n'imyandikire y'imyandikire, interuro ebyiri, n'ibisabisho bidasobanutse neza. Ongeraho ibimenyetso by'intege nke n'ibizamini byo gutsindwa bigerageza kubona ibintu mu buryo butari bwo cyangwa ibisubizo bitizewe. Shyiraho ubuhanga butandukanye, imvugo, indimi, n'uturere kugira ngo umusaruro udasenyuka mu musaruro.

Ni ibihe bipimo ngomba gukoresha, kandi ni ibihe bishobora kuyobya?

Huza ibipimo n'ubwoko bw'igikorwa. Guhuza neza n'ubunyangamugayo bikora neza mu gukuramo no gusohora ibintu mu buryo bw'imiterere, mu gihe ubunyangamugayo/kwibuka neza na F1 bifasha iyo hari ikintu kibuze ari bibi kurusha urusaku rwinshi. Ibipimo bihurirana nka BLEU/ROUGE bishobora kuyobya imirimo ifunguye, kandi gushyiramo ibisa bishobora gutanga ibisubizo "bitari byo ariko bisa". Ku bijyanye no kwandika, gushyigikira, cyangwa gutekereza, huza ibipimo n'isuzuma ry'abantu n'igipimo cy'intsinzi ku gikorwa.

Ni gute nakora isuzuma kugira ngo rishobore gusubiramo kandi ribe urwego rw'umusaruro?

Uburyo bukomeye bwo gusuzuma bushobora gusubirwamo, bugaragaza, burimo ibice byinshi, kandi bushobora gukorwa. Huza igenzura ryikora (imiterere, ubuziranenge bwa JSON, ubuziranenge bw'ibanze) hamwe n'amanota y'abantu n'ibizamini by'urugamba. Bikore bidashobora kwangirika wirinze kuvunika no "kwigisha ikizamini." Komeza umenye ikiguzi cy'isuzuma kugira ngo ushobore kugisubiramo kenshi, atari rimwe gusa mbere yo gutangira.

Ni ubuhe buryo bwiza bwo gukora isuzumabumenyi ry'abantu bitabaye akajagari?

Koresha umurongo ngenderwaho kugira ngo abasesengura ntibakore ibintu nk'ibidahuye, byuzuye, byumvikana, uburyo ibintu bifatwa nk'ukuri, uburyo ibintu bihuye n'ukuri, uburyo ibintu bihuzwa n'amagambo, n'uburyo ibintu bihuzwa n'ukuri (si uguhimba ibirego cyangwa amasoko). Jya ugenzura buri gihe amasezerano y'abasesengura; niba abasesengura badahuza buri gihe, umurongo ngenderwaho ushobora gukenera kunozwa. Isuzuma ry'abantu ni ingenzi cyane cyane ku bijyanye n'itandukaniro ry'imvugo, amakosa y'ukuri adasobanutse, n'ibitaragenze neza nyuma y'amabwiriza.

Ni gute nasuzuma umutekano, imbaraga, n'ingaruka zo guterwa inshinge vuba?

Igerageza ukoresheje "ugh, abakoresha": imyandikire y'inyuguti, imvugo isanzwe, amabwiriza avuguruzanya, amabwiriza maremare cyane cyangwa magufi cyane, hamwe n'impinduka mu ntego nyinshi. Shyiramo uburyo bwo kwihutisha gukoresha uburyo bwo kwihutisha nko "kwirengagiza amategeko yabanje" n'ingingo z'ingenzi zisaba kwangwa witonze. Imikorere myiza y'umutekano ntabwo ari ukwanga gusa - ahubwo ni ukwanga neza, gutanga ubundi buryo bwizewe igihe bikenewe, no kwirinda kwanga cyane ibibazo bitagira ingaruka mbi bikomeretsa UX.

Ni gute nasuzuma ikiguzi n'igihe ntarengwa mu buryo buhuye n'ukuri?

Ntupime impuzandengo gusa - kurikirana ikwirakwizwa ry'igihe gito, cyane cyane p95 na p99. Suzuma ikiguzi kuri buri gikorwa cyagenze neza, ntugasuzume ikiguzi kuri buri tokeni ukwayo, kuko kongera kugerageza no gushakisha ibisubizo bishobora gusibanganya amafaranga wabitse. Gerageza uburambe mu gihe cyo gusohora (igihe kidashira, imipaka y'igipimo, ubwiyongere) n'ubwizigirwa bw'ibikoresho/imikorere. Uburyo bubi gato bwihuse kabiri cyangwa buhamye bushobora kuba amahitamo meza y'ibicuruzwa.

Ni iyihe gahunda yoroshye kuva ku mpera kugeza ku mpera y'uburyo bwo gusuzuma moderi za AI?

Sobanura ibipimo ngenderwaho by'intsinzi n'imbogamizi, hanyuma ukore itsinda rito ry'ibizamini by'ibanze (ingero zigera kuri 50-200) bigaragaza ikoreshwa nyaryo. Ongeraho amatsinda y'inyongera n'ay'ingamba zo kwirinda no gutera inshinge. Kora igenzura ryikora, hanyuma utange ingero z'ibisubizo ku manota y'abantu. Gereranya ubuziranenge ugereranije n'ikiguzi ugereranije n'umutekano, gerageza hamwe n'ikizamini cya A/B, hanyuma ukurikirane umusaruro kugira ngo urebe ko hari impinduka zigenda zigaruka.

Ni ubuhe buryo bukunze gukoreshwa cyane mu isuzuma ry'icyitegererezo mu makipe?

Imitego isanzwe irimo kunoza ibyo abantu bashaka kugira ngo bagere ku rugero rwiza mu gihe abakoresha bababara, kuzana ibyo abantu bashaka gusuzuma mu mahugurwa cyangwa mu gutunganya amakuru neza, no gukoresha igipimo kimwe kidagaragaza agaciro k'umukoresha. Amatsinda kandi yirengagiza impinduka mu gukwirakwiza amakuru, gukoresha "ubwenge" mu buryo burenze urugero aho gukoresha uburyo bwo kubahiriza imiterere n'ubudahemuka, no gusimbuka isuzuma ry'ubuziranenge bw'ibyo abantu bashaka kuvuga. Ibitekerezo bishobora guhisha ibi bibazo, bityo rero byishingikiriza ku mabwiriza agena imiterere, aho gukoresha amajwi agaragara.

Amareferensi

  1. OpenAI - OpenAI evals guide - platform.openai.com

  2. Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga (NIST) - Gahunda yo Kugenzura Ingaruka za AI (AI RMF 1.0) - nist.gov

  3. OpenAI - openai/evals (ububiko bwa GitHub) - github.com

  4. scikit-learn - precision_recall_fscore_support - scikit-learn.org

  5. Ishyirahamwe ry'Ubumenyi bw'Indimi mu Kubara (ACL Anthology) - BLEU - aclanthology.org

  6. Ishyirahamwe ry’Ubumenyi bw’Indimi mu Kubara (ACL Anthology) - ROUGE - aclanthology.org

  7. arXiv - G-Eval - arxiv.org

  8. OWASP - LLM01: Gutera inshinge vuba - owasp.org

  9. OWASP - OWASP 10 za mbere ku porogaramu nini z'inyigo z'indimi - owasp.org

  10. Kaminuza ya Stanford - Kohavi n'abandi, “Igerageza ryagenzuwe kuri interineti” - stanford.edu

  11. arXiv - Isuzuma rya RAG: Ubushakashatsi - arxiv.org

  12. PubMed Central (PMC) - Ubushakashatsi ku birebana n'ihindagurika ry'ibitekerezo (PMC) - nih.gov

  13. PubMed Central (PMC) - McHugh kuri kappa ya Cohen - nih.gov

  14. Google - Igitabo cy'akazi cya SRE ku igenzura - google.workbook

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe

Garuka kuri blog