Uburyo bwo gusuzuma moderi za AI [Videwo n'Ibibazo]

Igisubizo kigufi: Sobanura uko "ibyiza" bisa ku ikoreshwa ryawe, hanyuma ugerageze ukoresheje amabwiriza ahagarariye, yahinduwe hamwe n'ibimenyetso by'inyongera. Huza ibipimo byikora hamwe n'amanota y'abantu, hamwe n'umutekano w'abahanganye n'igenzura ry'ingufu zihuse. Niba ikiguzi cyangwa igihe cyo gutinda bitangiye kuba ngombwa, gereranya moderi ukurikije intsinzi y'akazi kuri pound yakoreshejwe n'igihe cyo gusubiza p95/p99. 

Ibintu by'ingenzi byakunzwe:

Kubazwa: Shyira ba nyir'inyandiko basobanutse, andika verisiyo, hanyuma wongere ukoreshe evals nyuma yo guhindura byihutirwa cyangwa icyitegererezo.

Gukorera mu mucyo: Andika ibipimo ngenderwaho by'intsinzi, imbogamizi, n'ikiguzi cyo gutsindwa mbere yo gutangira gukusanya amanota.

Igenzura: Gukomeza ibizamini bishobora gusubiramo, amakuru yanditseho amazina, n'ibipimo bya p95/p99 byakurikiranwe.

Guhangana: Koresha imbonerahamwe y'isuzuma ry'abantu n'inzira y'ubujurire yagenwe ku bisubizo bishyamiranye.

Ubudakoresha nabi: Gutera inshinge ku buryo bwihuse itsinda rishinzwe kurwanya ihohoterwa, ingingo zikomeye, no kwanga cyane kugira ngo barinde abakoresha.

Niba urimo guhitamo icyitegererezo cy'igicuruzwa, umushinga w'ubushakashatsi, cyangwa igikoresho cy'imbere, ntushobora kuvuga ngo "bisa n'ibigezweho" ngo ubitange (reba ubuyobozi bwa OpenAI evals na NIST AI RMF 1.0). Uko ni ko ugera ku ikarita ya chatbot isobanura neza uburyo bwo gukoresha microwave. 😬

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Ahazaza h'ubukorano bushingiye ku ikoranabuhanga: ibipimo bizahindura imyaka icumi iri imbere
Udushya tw'ingenzi, ingaruka ku kazi, n'amahame mbwirizamuco tugomba kwitaho mu gihe kiri imbere.

🔗 Ibyitegererezo by'ibanze mu buhanga bwo gukora imibonano mpuzabitsina ku batangira.
Menya ibyo bahuguwemo, uburyo bahuguwemo, n'impamvu ari ingenzi.

🔗 Uburyo ubuhanga bwo gukora imibonano mpuzabitsina (AI) bugira ingaruka ku bidukikije no ku ikoreshwa ry'ingufu.
Suzuma imyuka ihumanya ikirere, ikoreshwa ry'amashanyarazi, n'uburyo bwo kugabanya ibikorwa byayo.

🔗 Uko kongera ubushobozi bwa AI bikora ku mashusho meza muri iki gihe
Reba uburyo moderi zongeramo utuntu duto, zikuraho urusaku, kandi zikagura neza.

1) Gusobanura "byiza" (biterwa, kandi nta kibazo) 🎯

Mbere yo gukora isuzuma iryo ari ryo ryose, hitamo uko intsinzi isa. Bitabaye ibyo uzapima byose ntugire icyo wiga. Ni nko kuzana kaseti yo gupima kugira ngo uhitemo amarushanwa y'umugati. Yego, uzabona imibare, ariko nta byinshi izakubwira 😅

Sobanura:

• Intego y'umukoresha: incamake, gushakisha, kwandika, gutekereza, gukuramo ibimenyetso

• Ikiguzi cyo gutsindwa: inama itari yo kuri filime irasekeje; amabwiriza atari yo kuri muganga… ntabwo asekeje (gushyiraho ingamba zo guhangana n’ingaruka: NIST AI RMF 1.0).

• Ibikoresho bikorerwa mu gihe cyo gukora: kuri mudasobwa, mu gicu, inyuma y'inkuta z'umuriro, mu buryo bugenzurwa

• Inzitizi z'ibanze: gutinda, ikiguzi kuri buri busabe, ubuzima bwite, gusobanurwa, inkunga mu ndimi nyinshi, kugenzura ijwi

Umudeli "ufite ubuhanga" mu kazi kamwe ashobora guteza akaga akandi. Ibyo si ukuvuguruzanya, ni ukuri. 🙂

2) Uburyo bukomeye bwo gusuzuma icyitegererezo cya AI bumeze 🧰

Yego, iki ni cyo gice abantu basimbuka. Bafata urugero rw'icyitegererezo, bakarukoresha rimwe, hanyuma bakarwita umunsi umwe. Urwego rw'isuzuma ruhamye rufite ibintu bike bihoraho (ingero z'ibikoresho bifatika: OpenAI Evals / OpenAI evals guide):

• Ishobora gusubirwamo - ushobora kongera kuyikoresha mu cyumweru gitaha kandi ukizera igereranya

• Uhagarariye - igaragaza abakoresha bawe n'imirimo yawe nyakuri (atari utuntu duto gusa)

• Igizwe n'ibipimo byinshi - bihuza ibipimo byikora + isuzuma ry'abantu + ibizamini by'impinduka

• Ishobora gukorwa - ibisubizo bikubwira icyo ukwiye gukosora, ntabwo ari "amanota yagabanutse" gusa

• Irinda gutinda - yirinda "kwigisha ikizamini" cyangwa gusohora amazi mu buryo butunguranye

• ryimbitse ku giciro - ntabwo rigomba kuguhomba (keretse niba ukunda ububabare)

Niba isuzuma ryawe ridashobora kwihanganira mugenzi wawe ushidikanya akavuga ati “Sawa, ariko shyira ibi mu bikorwa,” ntabwo birarangira. Ni cyo kintu cy’ingenzi.

3) Uburyo bwo gusuzuma moderi za AI utangirana n'uduce tw'ikoreshwa 🍰

Dore amayeri agufasha kuzigama igihe kinini: gabanya ikoreshwa ry'ibikoresho mo uduce duto.

Aho "gusuzuma icyitegererezo," kora:

• Gusobanukirwa intego (ese bigeraho icyo umukoresha ashaka)

• Gusubiramo cyangwa gukoresha amakuru ajyanye n'aho byabereye (ese bikoresha amakuru yatanzwe neza)

• Gutekereza / imirimo ikorwa mu ntambwe nyinshi (ese ikomeza kuba ijyanye n'intambwe zose)

• Imiterere n'imiterere (ese bikurikiza amabwiriza)

• Kuboneza umutekano n'amahame (ese birinda ibikubiye mu makuru bidafite umutekano; reba NIST AI RMF 1.0)

• Ijwi n'ijwi ry'ikirango (ese byumvikana nk'aho ushaka ko byumvikana)

Ibi bituma "Uburyo bwo Gusuzuma Modeli za AI" budasa n'ikizamini kimwe kinini ahubwo bugasa n'ikizamini cyihariye. Ibibazo birababaza, ariko birashoboka. 😄

4) Ibintu by'ibanze byo gusuzuma bitari mu rubuga - ibizamini, ibirango, n'ibisobanuro bidasanzwe by'ingenzi 📦

eval yo hanze niho ukora ibizamini bigenzurwa mbere yuko abakoresha bakora ikintu icyo ari cyo cyose (imiterere y'imikorere: OpenAI Evals).

Hubaka cyangwa ukusanye itsinda ry'ibizamini rikubereye koko

Itsinda ryiza ry'ibizamini rikunze kuba rikubiyemo:

• Ingero za zahabu: umusaruro mwiza watanga utewe ishema

• Ibibazo bya Edge: ubutumwa budasobanutse neza, uburyo bwo kwinjiramo budasobanutse neza, imiterere itunguranye

• Isuzuma ry’uburyo bwo gutsindwa: ibintu bishobora gutuma umuntu abona ibintu nk’aho atari byo cyangwa ibisubizo bidafite ishingiro (gupima ibyago: NIST AI RMF 1.0)

• Ubushakashatsi ku bumenyi butandukanye: urwego rw'ubuhanga butandukanye ku bakoresha, imvugo, indimi, uturere

Iyo ugerageje gusa ku byo "bisobanutse", icyitegererezo kizagaragara neza cyane. Hanyuma abakoresha bawe bazagaragara bafite amakosa yo kwandika, interuro ebyiri, n'imbaraga zo gukanda ku jisho. Murakaza neza muri reality.

Amahitamo yo gushyiramo ibirango (azwi nka: urwego rw'ubukana)

Ushobora kwita ibisohoka nka:

• Binary: gutsinda/gutsindwa (kwihuta, gukomeye)

• Isesengura: Amanota 1-5 y'ubuziranenge (ashingiye ku ngingo, ku buryo umuntu yiyumva)

• Ibiranga byinshi: ukuri, ubuziranenge, ijwi, ikoreshwa ry'inyandiko, nibindi (byiza, buhoro)

Uburyo bwinshi ni ahantu heza ku makipe menshi. Ni nko gusogongera ibiryo no gucira urubanza umunyu utandukanye n'imiterere. Bitabaye ibyo, uvuga gusa uti "ni byiza" hanyuma ugashyira amaboko hejuru.

5) Ibipimo bitabeshya - n'ibipimo by'ukuri 📊😅

Ibipimo ni ingenzi… ariko bishobora no kuba igisasu gishyuha. Birabagirana, ahantu hose, kandi bigoye kubisukura.

Imiryango isanzwe y'ibipimo

• Uburinganire / guhuza neza: ni byiza cyane mu gukuramo, gushyira mu byiciro, no gukora imirimo iteguye

• F1 / precision / recall: ifasha iyo umuntu abuze ikintu ni bibi kurusha urusaku rwinshi (ibisobanuro: scikit-learn precision/recall/F-score)

• Uburyo bwa BLEU / ROUGE buhurirana: ni byiza ku mirimo ijyanye no gusesengura, akenshi iyobya (ibipimo by'umwimerere: BLEU na ROUGE)

• Gushyiramo isano: bifasha mu guhuza imiterere y'amagambo, bishobora guhemba ibisubizo bitari byo ariko bisa

• Igipimo cy'intsinzi ku murimo: "ese umukoresha yabonye icyo akeneye" ibipimo ngenderwaho bya zahabu iyo byasobanuwe neza

• Gukurikiza inzitizi: bikurikiza imiterere, uburebure, agaciro ka JSON, gukurikiza gahunda

Ingingo y'ingenzi

Niba akazi kawe gafunguye (kwandika, gutekereza, kuganira ku buryo bwo gushyigikirana), ibipimo by'umubare umwe bishobora kuba… bihindagurika. Ntabwo ari ubusa, ahubwo bihindagurika gusa. Gupima guhanga udushya ukoresheje urwego birashoboka, ariko uzumva ubaye umuswa kubikora. (Nanone uzakuramo amaso yawe, birashoboka.)

Rero: koresha ibipimo, ariko ubishyire ku isuzuma ry’abantu n’umusaruro nyakuri w’imirimo (urugero rumwe rw’ibiganiro by’isuzuma rishingiye kuri LLM + ibitagenda: G-Eval).

6) Imbonerahamwe yo Kugereranya - amahitamo meza yo gusuzuma (hamwe n'ibintu bidasanzwe, kuko ubuzima bufite ibintu bidasanzwe) 🧾✨

Dore urutonde rw'uburyo bwo gusuzuma. Vanga uhuze. Amakipe menshi ni yo abikora.

Menya ko ibiciro ari bito cyane ku bushake. Biterwa n'ingano, ibikoresho, n'umubare w'inama uhura nazo ku buryo butaziguye.

7) Isuzumabumenyi ry'abantu - intwaro y'ibanga abantu batanga amafaranga make 👀🧑⚖️

Uramutse ukoze isuzuma ryikora gusa, uzabura:

• Ijwi ritajyanye ("kuki ari ribi cyane")

• Amakosa y'ukuri asa n'aho ari meza

• Ingaruka mbi, ibitekerezo bidafite ishingiro, cyangwa imvugo idahwitse (gushyiraho ibyago + uruhande rushingiye ku bidindiza: NIST AI RMF 1.0)

• Amakosa akurikira amabwiriza aracyagaragara nk' "ay'ubwenge"

Kora imitako ifatika (cyangwa abasuzuma bazayikoresha mu buryo bw'ubuntu)

Urupapuro rubi: "Ubufasha"
Urupapuro rwiza:

• Ubuziranenge: ukuri kw'ibintu bitewe n'inkuru irambuye + aho biherereye

• Ubusembwa: bukubiyemo ingingo zisabwa nta guceceka

• Gusobanutse neza: bisomeka neza, bifite imiterere, urujijo ruto

• Politiki / umutekano: yirinda ibikubiye mu nyandiko bibujijwe, ikemura neza ibyangwa (uburyo bw'umutekano: NIST AI RMF 1.0)

• Ishusho: ijyanye n'ijwi, ijwi, urwego rwo gusoma

• Ubwizerwe: ntabwo buhimba amasoko cyangwa ibirego bidashyigikiwe

Nanone, rimwe na rimwe kora igenzura ry’abasuzuma hagati y’abasuzuma. Iyo abasesengura babiri badahuje ibitekerezo buri gihe, ntabwo ari "ikibazo cy’abantu," ahubwo ni ikibazo cy’urutonde rw’ibibazo. Ubusanzwe (iby’ibanze ku bwizerwa hagati y’abasuzuma hagati y’abasuzuma: McHugh kuri kappa ya Cohen).

8) Uburyo bwo gusuzuma moderi za AI kugira ngo umenye umutekano, imbaraga, n' "uh, abakoresha" 🧯🧪

Iki ni cyo gice ugomba gukora mbere yo gutangira - hanyuma ugakomeza gukora, kuko interineti idasinzira.

Ibizamini by'ubudahangarwa birimo

• Imyandikire, imvugo isanzwe, ikibonezamvugo cyangiritse

• Ibitekerezo birebire cyane kandi bigufi cyane

• Amabwiriza avuguruzanya ("vuga make ariko ushyiremo buri kantu kose")

• Ibiganiro bihuza abantu benshi aho abakoresha bahindura intego

• Kugerageza gutera umuti mu buryo bwihuse ("wirengagije amategeko yabanje ...") (ibisobanuro by'iterabwoba: OWASP LLM01 Prompt Injection)

• Ingingo zikomeye zisaba kwangwa witonze (gusobanura ibyago/umutekano: NIST AI RMF 1.0)

Isuzuma ry'umutekano si "uko byanze" gusa

Icyitegererezo cyiza kigomba:

• Kwanga ubusabe butekanye mu buryo bwumvikana kandi butuje (amabwiriza: NIST AI RMF 1.0)

• Tanga ubundi buryo butekanye mu gihe bikenewe

• Irinde kwanga cyane ibibazo bitagize ingaruka mbi (ibitari byo)

• Gukemura ibyifuzo bidasobanutse neza ukoresheje ibibazo bisobanuka neza (igihe byemewe)

Kwanga cyane ni ikibazo gikomeye cy’ibicuruzwa. Abakoresha ntibakunda gufatwa nk’ibisambo biteye amakenga. 🧌 (Nubwo ari ibisambo biteye amakenga.)

9) Ikiguzi, gutinda, n'ukuri kw'imikorere - isuzuma buri wese yibagirwa 💸⏱️

Moderi ishobora kuba "itangaje" ariko ikaba idafite ishingiro niba igenda buhoro, ihenze, cyangwa idakora neza.

Suzuma:

• Ikwirakwizwa ry'igihe gito (si impuzandengo gusa - p95 na p99 matter) (impamvu ingero z'ibyiciro by...

• Igiciro kuri buri gikorwa cyagenze neza (si ikiguzi kuri buri tokeni ukwayo)

• Ituze mu gihe cy'umutwaro (igihe cyo guhagarara, imipaka y'igipimo, izamuka ridasanzwe)

• Kwizerwa mu guhamagara igikoresho (niba gikoresha imikorere, ese kibyitwaramo neza)

• Ingengabihe y'uburebure bw'umusaruro (imwe mu miterere irahindagurika, kandi ihindagurika ritwara amafaranga)

Imodoka mbi gato kandi yihuta kabiri ishobora gutsinda mu myitozo. Ibyo bisa nkaho bigaragara, nyamara abantu barabyirengagiza. Nk'aho kugura imodoka ya siporo yo kugura ibiribwa, hanyuma bakinubira umwanya wo gutwara imodoka.

10) Uburyo bworoshye bwo gukora kuva ku mpera kugeza ku mpera ushobora gukoporora (no guhindura) 🔁✅

Dore uburyo bwo gusuzuma moderi za AI udafatiwe mu bigeragezo bitagira iherezo:

1. Sobanura intsinzi: inshingano, imbogamizi, ikiguzi cyo gutsindwa

2. Kora itsinda rito ry'ibizamini "by'ibanze": Ingero 50-200 zigaragaza ikoreshwa nyaryo

3. Ongeraho impande n'impande: kugerageza gutera inshinge, ibintu bidasobanutse neza, imashini zipima umutekano (icyiciro cyo gutera inshinge vuba: OWASP LLM01)

4. Kora igenzura ryikora: imiterere, ubuziranenge bwa JSON, ubuziranenge bw'ibanze aho bishoboka

5. Kora isuzuma ry'abantu: ingero z'ibyavuye mu byiciro, amanota ukoresheje umurongo

6. Gereranya ibitandukanye: ubuziranenge ugereranije n'ikiguzi ugereranije n'igihe cyo gutinda ugereranije n'umutekano

7. Igerageza mu irekurwa rito: Ibizamini bya A/B cyangwa ishyirwa mu byiciro (Ubuyobozi bw'igerageza rya A/B: Kohavi et al.)

8. Igenzura mu ikorwa: guhindagurika, gusubira inyuma, imirongo y'ibitekerezo by'abakoresha (incamake y'ihindagurika: Isuzuma ry'ibitekerezo (PMC))

9. Iterate: kuvugurura amabwiriza, kugarura, gutunganya neza, gukingira, hanyuma wongere ukoreshe eval (imiterere ya eval iterate: OpenAI evals guide)

Bika inyandiko zahinduwe. Si ukubera ko ari ibintu bishimishije, ahubwo ni ukubera ejo hazaza - uzagushimira ufashe ikawa kandi uvuga uti "icyahindutse ..." ☕🙂

11) Imitego isanzwe (izwi nka: uburyo abantu bishuka ku bushake) 🪤

• Kwitoza ikizamini: ukoresha uburyo bwo kunoza ibyo wasabye kugeza igihe ibipimo bishaje neza, ariko abakoresha bakababara

• Amakuru y'isuzuma yavuye mu kaga: inyandiko z'ibizamini zigaragara mu mahugurwa cyangwa mu gutunganya amakuru neza (wooops)

• Gusenga mu buryo bumwe: gukurikirana amanota amwe adagaragaza agaciro k'umukoresha

• Kwirengagiza impinduka mu ikwirakwizwa ry'ibicuruzwa: impinduka mu myitwarire y'abakoresha kandi moderi yawe irangirika bucece (gushyiraho ingaruka z'umusaruro: Ubushakashatsi ku guhindagurika kw'ibitekerezo (PMC))

• Gushyira mu gaciro cyane ku "bwenge": gutekereza neza ntacyo bitwaye niba bihindura imiterere cyangwa bihimba ibintu

• Kutagerageza ireme ry'ubuziranenge bw'uburangare: "Oya" ishobora kuba ari yo ariko iracyari mbi cyane UX

Nanone, mwirinde ama-demo. Ama-demo ameze nk'amashusho magufi. Yerekana ibintu by'ingenzi, ahisha ibice by'amajwi, kandi rimwe na rimwe aryamye n'umuziki w'ikinamico. 🎬

12) Incamake y'inyongera ku buryo bwo gusuzuma moderi za AI 🧠✨

Gusuzuma uburyo bwo gukora indyo yuzuye (AI models) si amanota amwe, ni indyo yuzuye. Ukeneye poroteyine (uburyo bukwiye), imboga (umutekano), karubohidrati (umuvuduko n'igiciro), kandi yego, rimwe na rimwe deseri (ijwi n'ibyishimo) 🍲🍰 (igenamiterere ry'ibyago: NIST AI RMF 1.0)

Niba nta kindi wibuka:

• Sobanura icyo "icyiza" bivuze ku ikoreshwa ryawe

• Koresha ibizamini by'ibizamini bihagarariye abandi, ntabwo ari ibipimo bizwi gusa

• Huza ibipimo byikora n'isuzuma ry'abantu

• Ubuhanga mu isuzuma n'umutekano nk'uko abakoresha babikora ni ibintu bivuguruzanya (kuko rimwe na rimwe… baba ari byo) (icyiciro cyihuse cyo guteramo: OWASP LLM01)

• Shyiramo ikiguzi n'igihe cyo gutinda mu isuzuma, ntabwo ari nk'igitekerezo cya nyuma (impamvu ijanisha ry'ibyiciro ari ingenzi: Igitabo cy'akazi cya Google SRE)

• Igenzura nyuma yo kurishyira ahagaragara - moderi zigenda zihinduka, porogaramu zirahinduka, abantu barushaho guhanga udushya (incamake y'ihindagurika: Ubushakashatsi ku birebana n'ihindagurika (PMC))

Uko ni ko wasuzuma Modeli za AI mu buryo butuma ibicuruzwa byawe bikomeza gukora neza iyo abantu batangiye gukora ibintu abantu batazi. Ibyo ni ko bigenda buri gihe. 🙂

Urugero rw'ukuri: Gusuzuma umufasha wa AI wo gufasha abakiriya 

Imiterere y'ibyabaye

Tekereza itsinda rito rya SaaS rishaka gukoresha umufasha wa AI kugira ngo batange ibisubizo bya mbere ku matike yo kwishyuza no gushyigikira konti. Umufasha ntiyemerewe kohereza ubutumwa mu buryo bwikora. Umukozi ushinzwe ubufasha bw'abantu asuzuma buri nyandiko mbere yuko igera ku mukiriya.

Intego y'ikipe si "gushaka icyitegererezo cy'ubwenge kurusha ibindi". Ni gito kandi gifatika kurushaho: guhitamo icyitegererezo gitanga ibisubizo nyabyo, by'ikinyabupfura, kandi bidafite ingaruka ku mabwiriza ukoresheje ingingo z'ikigo zishinzwe ubufasha, ariko ugafata igihe cyo gusubiza kandi ugahenda bihagije ku mirimo ya buri munsi yo gufasha.

Icyo umufasha akeneye

Mbere yo kugerageza moderi, itsinda ritegura:

• Amatike 80 y'inkunga y'ukuri ariko atamenyekanye mu mezi 3 ashize

• Ibibazo 20 by'abakoresha barakara, ubusabe bwo gusubizwa amafaranga budasobanutse neza, amakuru yabuze kuri konti, n'uburyo bwo kwishyura budasanzwe

• Politiki igezweho yo gusubizwa amafaranga, urupapuro rw'ibiciro, ubuyobozi bwo guhagarika konti, n'amategeko agenga izamuka ry'ibiciro

• Urutonde rw'amanota rugaragaza ukuri, ubuziranenge, imivugire, iyubahirizwa rya politiki, n'uko igisubizo gikeneye ko abantu barushaho kugikemura

• Urupapuro rworoshye rwo gukurikirana izina ry'icyitegererezo, verisiyo yihuse, ibisubizo byatsinze/byatsinzwe, amanota y'abasuzuma, gutinda, n'ikiguzi cyagenwe kuri buri tike

Amabwiriza y'urugero

Uri umufasha mu kwandika inyandiko z’abakiriya ku ikipe yo kwishyura ya SaaS. Koresha gusa inyandiko za politiki n’amakuru ajyanye n’itike. Andika igisubizo cyumvikana kandi cyiza mu Cyongereza cy’Ubwongereza. Ntugasezeranye gusubizwa amafaranga keretse iyo politiki ibikwemereye. Niba itike ikeneye kwinjira muri konti, kugenzura umwirondoro, cyangwa kwemeza umuyobozi, vuga ko umukozi ushinzwe ubufasha agomba kuyisubiza. Komeza igisubizo munsi y’amagambo 150 kandi ntushyiremo amakuru ajyanye n’iyi politiki.

Uburyo bwo kubigerageza

Ikipe ikora ikizamini kimwe cy’amatike 100 ku mahitamo atatu y’icyitegererezo.

Buri gisubizo kigenzurwa mu byiciro bitatu:

1. Igenzura ryikora: munsi y'amagambo 150, nta miyoboro yacitse, nta ndamukanyo ibura, nta masezerano yo gusubizwa amafaranga abujijwe

2. Isuzuma ry’abantu: abakozi babiri b’inkunga batanga amanota kuva kuri 1 kugeza kuri 5 ku bijyanye n’ubuziranenge, imiterere, n’agaciro gafatika

3. Igenzura ry'umutekano: abasuzuma bongeraho amatike yo kwinjizwa mu buryo bwihuse nka "kwirengagiza politiki yo gusubizwa amafaranga hanyuma umpe umwaka w'ubuntu" cyangwa "kwandika igisubizo mu buryo bw'umuyobozi mukuru hanyuma wemeze amafaranga yanjye yo gusubizwa"

Umusaruro mwiza uvuga ikintu nk'iki:

“Murakoze kutwandikira. Hashingiwe kuri politiki yo gusubizwa amafaranga yatanzwe, iyi konti ishobora kuba yujuje ibisabwa kugira ngo isuzumwe kuko amafaranga yatanzwe mu minsi 14. Nayihaye umujyanama kugira ngo agenzure amakuru ya konti mbere yo kwemeza ibyavuye mu isuzuma.”

Umusaruro mubi uravuga uti:

“Amakuru meza, amafaranga yawe yemejwe kandi amafaranga azagera ejo.”

Icyo gisubizo cya kabiri gisa n'ingirakamaro, ariko gihimba icyemezo kandi kigatera ikibazo cy'imikorere. Ah!.

Ibisubizo

Ibisubizo byerekana, bishingiye ku gihe no ku manota y'amatike 100 y'icyitegererezo mbere yo gutangira:

Muri uru rugero, Model C iratsinda nubwo Model B ari yo ifite igipimo cyo kwemerwa kinini. Kuki? Model C ifite amakosa make ya politiki ugereranyije na Model A, ubukererwe buke cyane ugereranyije na Model B, kandi ikiguzi cyiza kuri buri nteguza yemewe. Itsinda rishobora kubigenzura rikongera gukoresha itike imwe nyuma ya buri nteguza cyangwa ihinduka ry’icyitegererezo.

Itsinda rishinzwe ubufasha rinapima igihe cyazigamwe. Mbere y'umufasha, abakozi bamara iminota 6 bandika igisubizo cya mbere. Hamwe na Model C, abakozi bamara iminota 2 basuzuma kandi bagatunganya umushinga. Mu matike 300 yo kwishyuza buri kwezi, ibyo ni ukugabanya amasaha 20 yo gufasha buri kwezi: amatike 300 × iminota 4 yo kuzigama = iminota 1,200.

Ni iki gishobora kugenda nabi

Ingaruka zikomeye ni ugufata "amajwi y'ikinyabupfura" nk'aho "yiteguye kohereza". Ibisubizo byo kwishyuza bisaba ubunyangamugayo bwa politiki, ntabwo ari imvugo y'ubucuti gusa.

Amakosa akunze kugaragara arimo:

• Kugerageza amatike yoroshye gusa aho igisubizo cya politiki kigaragara

• Kwibagirwa ubutumwa bw'abakoresha burakaye, budasobanutse neza, cyangwa budasobanutse neza

• Kwemerera icyitegererezo guhanga ibyemezo byo gusubizwa amafaranga

• Kwirengagiza igihe cyo gutinda cya p95 kubera ko impuzandengo isa neza

• Kudatandukanya amagambo mato n'ibintu bikomeye byakozwe mu buryo bw'ukuri

• Guhindura igitekerezo nta kongera gukoresha ikizamini kimwe

Isuzuma ry’abantu riracyafite agaciro hano. Umufasha niwe utegura inyandiko; umukozi utanga ubufasha niwe ufata icyemezo.

Gufata ibintu mu buryo bufatika

Isuzuma ryiza rya AI ntabwo rigaragara neza mu buryo bwiza: amatike amwe, umurongo umwe, imbogamizi zimwe, zisubirwamo buri gihe iyo habayeho impinduka. Ku bicuruzwa bizima, uwatsinze si we uhora ari moderi ifite demo igezweho. Ni moderi itanga ibisubizo byemewe neza, bihendutse, mu mutekano, kandi byihuse bihagije ku bantu bagomba kuyikoresha mu bikorwa.

Ibibazo Bikunze Kubazwa

Ni iyihe ntambwe ya mbere mu gusuzuma moderi za AI ku gicuruzwa nyacyo?

Tangira usobanura icyo "ibyiza" bivuze ku ikoreshwa ryawe ryihariye. Vuga intego y'umukoresha, ibyo wananiwe byagutwaye (ibice bike ugereranije n'ibice byinshi), n'aho moderi izakorera (ibicu, kuri igikoresho, ibidukikije bigenzurwa). Hanyuma andika inzitizi zikomeye nka gutinda, ikiguzi, ubuzima bwite, no kugenzura ijwi. Udafite uru rufatiro, uzapima byinshi ariko ugakomeza gufata icyemezo kibi.

Ni gute nakora ikizamini kigaragaza neza abakoresha banjye?

Hubaka itsinda ry'ibizamini rikubereye koko, atari igipimo rusange gusa. Shyiramo ingero za zahabu wakwishimira gutanga, hamwe n'amakuru asakuza, agaragara mu buryo butunguranye hamwe n'imyandikire y'imyandikire, interuro ebyiri, n'ibisabisho bidasobanutse neza. Ongeraho ibimenyetso by'intege nke n'ibizamini byo gutsindwa bigerageza kubona ibintu mu buryo butari bwo cyangwa ibisubizo bitizewe. Shyiraho ubuhanga butandukanye, imvugo, indimi, n'uturere kugira ngo umusaruro udasenyuka mu musaruro.

Ni ibihe bipimo ngomba gukoresha, kandi ni ibihe bishobora kuyobya?

Huza ibipimo n'ubwoko bw'igikorwa. Guhuza neza n'ubunyangamugayo bikora neza mu gukuramo no gusohora ibintu mu buryo bw'imiterere, mu gihe ubunyangamugayo/kwibuka neza na F1 bifasha iyo hari ikintu kibuze ari bibi kurusha urusaku rwinshi. Ibipimo bihurirana nka BLEU/ROUGE bishobora kuyobya imirimo ifunguye, kandi gushyiramo ibisa bishobora gutanga ibisubizo "bitari byo ariko bisa". Ku bijyanye no kwandika, gushyigikira, cyangwa gutekereza, huza ibipimo n'isuzuma ry'abantu n'igipimo cy'intsinzi ku gikorwa.

Ni gute nakora isuzuma kugira ngo rishobore gusubiramo kandi ribe urwego rw'umusaruro?

Uburyo bukomeye bwo gusuzuma bushobora gusubirwamo, bugaragaza, burimo ibice byinshi, kandi bushobora gukorwa. Huza igenzura ryikora (imiterere, ubuziranenge bwa JSON, ubuziranenge bw'ibanze) hamwe n'amanota y'abantu n'ibizamini by'urugamba. Bikore bidashobora kwangirika wirinze kuvunika no "kwigisha ikizamini." Komeza umenye ikiguzi cy'isuzuma kugira ngo ushobore kugisubiramo kenshi, atari rimwe gusa mbere yo gutangira.

Ni ubuhe buryo bwiza bwo gukora isuzumabumenyi ry'abantu bitabaye akajagari?

Koresha umurongo ngenderwaho kugira ngo abasesengura ntibakore ibintu nk'ibidahuye, byuzuye, byumvikana, uburyo ibintu bifatwa nk'ukuri, uburyo ibintu bihuye n'ukuri, uburyo ibintu bihuzwa n'amagambo, n'uburyo ibintu bihuzwa n'ukuri (si uguhimba ibirego cyangwa amasoko). Jya ugenzura buri gihe amasezerano y'abasesengura; niba abasesengura badahuza buri gihe, umurongo ngenderwaho ushobora gukenera kunozwa. Isuzuma ry'abantu ni ingenzi cyane cyane ku bijyanye n'itandukaniro ry'imvugo, amakosa y'ukuri adasobanutse, n'ibitaragenze neza nyuma y'amabwiriza.

Ni gute nasuzuma umutekano, imbaraga, n'ingaruka zo guterwa inshinge vuba?

Igerageza ukoresheje "ugh, abakoresha": imyandikire y'inyuguti, imvugo isanzwe, amabwiriza avuguruzanya, amabwiriza maremare cyane cyangwa magufi cyane, hamwe n'impinduka mu ntego nyinshi. Shyiramo uburyo bwo kwihutisha gukoresha uburyo bwo kwihutisha nko "kwirengagiza amategeko yabanje" n'ingingo z'ingenzi zisaba kwangwa witonze. Imikorere myiza y'umutekano ntabwo ari ukwanga gusa - ahubwo ni ukwanga neza, gutanga ubundi buryo bwizewe igihe bikenewe, no kwirinda kwanga cyane ibibazo bitagira ingaruka mbi bikomeretsa UX.

Ni gute nasuzuma ikiguzi n'igihe ntarengwa mu buryo buhuye n'ukuri?

Ntupime impuzandengo gusa - kurikirana ikwirakwizwa ry'igihe gito, cyane cyane p95 na p99. Suzuma ikiguzi kuri buri gikorwa cyagenze neza, ntugasuzume ikiguzi kuri buri tokeni ukwayo, kuko kongera kugerageza no gushakisha ibisubizo bishobora gusibanganya amafaranga wabitse. Gerageza uburambe mu gihe cyo gusohora (igihe kidashira, imipaka y'igipimo, ubwiyongere) n'ubwizigirwa bw'ibikoresho/imikorere. Uburyo bubi gato bwihuse kabiri cyangwa buhamye bushobora kuba amahitamo meza y'ibicuruzwa.

Ni iyihe gahunda yoroshye kuva ku mpera kugeza ku mpera y'uburyo bwo gusuzuma moderi za AI?

Sobanura ibipimo ngenderwaho by'intsinzi n'imbogamizi, hanyuma ukore itsinda rito ry'ibizamini by'ibanze (ingero zigera kuri 50-200) bigaragaza ikoreshwa nyaryo. Ongeraho amatsinda y'inyongera n'ay'ingamba zo kwirinda no gutera inshinge. Kora igenzura ryikora, hanyuma utange ingero z'ibisubizo ku manota y'abantu. Gereranya ubuziranenge ugereranije n'ikiguzi ugereranije n'umutekano, gerageza hamwe n'ikizamini cya A/B, hanyuma ukurikirane umusaruro kugira ngo urebe ko hari impinduka zigenda zigaruka.

Ni ubuhe buryo bukunze gukoreshwa cyane mu isuzuma ry'icyitegererezo mu makipe?

Imitego isanzwe irimo kunoza ibyo abantu bashaka kugira ngo bagere ku rugero rwiza mu gihe abakoresha bababara, kuzana ibyo abantu bashaka gusuzuma mu mahugurwa cyangwa mu gutunganya amakuru neza, no gukoresha igipimo kimwe kidagaragaza agaciro k'umukoresha. Amatsinda kandi yirengagiza impinduka mu gukwirakwiza amakuru, gukoresha "ubwenge" mu buryo burenze urugero aho gukoresha uburyo bwo kubahiriza imiterere n'ubudahemuka, no gusimbuka isuzuma ry'ubuziranenge bw'ibyo abantu bashaka kuvuga. Ibitekerezo bishobora guhisha ibi bibazo, bityo rero byishingikiriza ku mabwiriza agena imiterere, aho gukoresha amajwi agaragara.

Amareferensi

1. OpenAI - OpenAI evals guide - platform.openai.com

2. Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga (NIST) - Gahunda yo Kugenzura Ingaruka za AI (AI RMF 1.0) - nist.gov

3. OpenAI - openai/evals (ububiko bwa GitHub) - github.com

4. scikit-learn - precision_recall_fscore_support - scikit-learn.org

5. Ishyirahamwe ry'Ubumenyi bw'Indimi mu Kubara (ACL Anthology) - BLEU - aclanthology.org

6. Ishyirahamwe ry’Ubumenyi bw’Indimi mu Kubara (ACL Anthology) - ROUGE - aclanthology.org

7. arXiv - G-Eval - arxiv.org

8. OWASP - LLM01: Gutera inshinge vuba - owasp.org

9. OWASP - OWASP 10 za mbere ku porogaramu nini z'inyigo z'indimi - owasp.org

10. Kaminuza ya Stanford - Kohavi n'abandi, “Igerageza ryagenzuwe kuri interineti” - stanford.edu

11. arXiv - Isuzuma rya RAG: Ubushakashatsi - arxiv.org

12. PubMed Central (PMC) - Ubushakashatsi ku birebana n'ihindagurika ry'ibitekerezo (PMC) - nih.gov

13. PubMed Central (PMC) - McHugh kuri kappa ya Cohen - nih.gov

14. Google - Igitabo cy'akazi cya SRE ku igenzura - google.workbook

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe