Injeniyeri za AI zikora iki?

Injeniyeri za AI zikora iki?

Wigeze wibaza ikihishe inyuma y'ijambo rizwi cyane "AI Engineer"? Nanjye narabyibajije. Urebye inyuma bisa nkaho ari byiza, ariko mu by'ukuri ni ugushushanya ibice bingana, guhanagura amakuru adasobanutse, guhuza sisitemu, no kugenzura cyane niba ibintu bikora uko byakagombye. Niba ushaka verisiyo y'umurongo umwe: bihindura ibibazo bidasobanutse neza mo sisitemu zikora za AI zidasenyuka iyo abakoresha nyabo bagaragaye. Uko igihe kirekire, kandi gato mu kajagari - ni ko biri hano hasi. Fata kafeyine. ☕

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Ibikoresho bya AI ku bahanga: Kongera imikorere n'udushya
Vumbura ibikoresho bikomeye bya AI byongera umusaruro w'ubuhanga n'ubuhanga mu by'ubuhanga.

🔗 Ese injeniyeri za porogaramu zizasimburwa na AI?
Suzuma ahazaza h'ubuhanga mu bya mudasobwa mu gihe cy'imikorere y'ikoranabuhanga.

🔗 Ikoreshwa ry'ubuhanga mu nganda zihindura ubwenge bw'ubukorano
Menya uburyo ubuhanga mu by'ubukorano (AI) burimo kuvugurura imikorere y'inganda no guteza imbere udushya.

🔗 Uburyo bwo kuba injeniyeri wa AI
Intambwe ku yindi y'ubuyobozi bwo gutangira urugendo rwawe rugana ku mwuga w'ubuhanga mu by'ubuhanga mu by'ubuhanga.

Incamake y'ikibazo: icyo injeniyeri w'umuhanga mu by'ubukorano (AI) mu by'ukuri 💡

Ku rwego rworoshye, injeniyeri w’ubukorano bw’ubukorano bw’ubukorano (AI) ashushanya, yubaka, atwara, kandi agatunganya sisitemu z’ubukorano bw’ubukorano. Imirimo ya buri munsi ikunze kuba ikubiyemo:

  • Guhindura ibicuruzwa cyangwa ibyo ubucuruzi bukeneye mu buryo budasobanutse neza mu buryo runaka bishobora gukora.

  • Gukusanya, gushyira ibirango, gusukura, no - byanze bikunze - kongera kugenzura amakuru iyo atangiye guhindagurika.

  • Gutora no gutoza ingero, kuzisuzuma ukoresheje ibipimo bikwiye, no kwandika aho zizananirana.

  • Gushyira ikintu cyose mu miyoboro ya MLOps kugira ngo kibashe kugeragezwa, gushyirwa mu bikorwa, no kugaragara.

  • Kubireba mu gasozi: kubikora neza, umutekano, ubutabera… no kubikosora mbere yuko bihinduka.

Niba utekereza uti “rero ni ubuhanga bwa porogaramu hamwe n’ubumenyi bw’amakuru hamwe n’ibitekerezo byinshi ku bicuruzwa” - yego, ni uko bimeze.

Ni iki gitandukanya nziza za AI n'izindi ✅

Ushobora kumenya buri nyandiko zose z’ubwubatsi zasohotse kuva mu 2017 ariko ugakomeza kubaka akajagari gakomeye. Abantu batera imbere muri uyu mwanya akenshi:

  • Tekereza muri sisitemu. Babona umurongo wose: amakuru yinjira, ibyemezo bisohoka, byose bikurikiranwa.

  • Ntugakore ubushakashatsi ku magi. Imiterere y'ibanze n'igenzura ryoroheje mbere yo gukusanya ibintu bigoye.

  • Teganya ibitekerezo. Gusubiramo imyitozo no gusubiza inyuma si ibintu by'inyongera, ni bimwe mu bigize igishushanyo mbonera.

  • Andika ibintu. Impinduka, ibitekerezo, inzitizi - birambiranye, ariko nyuma bizagenda neza.

  • Fata ubuhanga mu gukora imibonano mpuzabitsina n’abantu ku giti cyabo. Ingaruka ntizishira bitewe n’icyizere, ziraboneka kandi zigacungwa.

Inkuru nto: Itsinda rimwe ry’abaterankunga ryatangiye rifite amategeko adafite ishingiro + ishingiro ryo kugarura ibintu. Ibyo byabahaye ibizamini byo kwemera neza, bityo ubwo bahinduranyaga icyitegererezo kinini nyuma, bagereranyaga neza - kandi byoroshye gusubira inyuma iyo cyakoraga nabi.

Uruhererekane rw'ubuzima: ukuri guhindagurika vs ibishushanyo mbonera byiza 🔁

  1. Shyira ikibazo mu nyuguti. Sobanura intego, imirimo, n'uko "byiza bihagije" bisa.

  2. Kora ikoranabuhanga ryo gusya amakuru. Sukura, shyiramo ikimenyetso, gabanyamo ibice, verisiyo. Emeza buri gihe kugira ngo umenye uko schema ikora.

  3. Igerageza ry'icyitegererezo. Gerageza byoroshye, gerageza ishingiro, subiramo, andika.

  4. Yohereza. Imiyoboro ya CI/CD/CT, imiyoboro y'amazi itekanye, inyoni zigendanwa, imiyoboro isubira inyuma.

  5. Komeza urebe. Genzura uburyo ibintu bimeze neza, gutinda, guhindagurika, ubutabera, n'umusaruro w'abakoresha. Hanyuma ongera witoze.

Ku gishushanyo mbonera, ibi bisa n'uruziga rwiza. Mu by'ukuri bisa no gukurura spaghetti n'umuhago.

Ufite inshingano zo gukora imibonano mpuzabitsina iyo umupira ugeze mu muhanda 🧭

Ntabwo ari iby’amadirishya meza yo gusimbuka. Injeniyeri zishingikiriza ku miterere y’amadirishya kugira ngo zigaragaze ko ibyago ari ukuri:

  • NIST AI RMF itanga imiterere yo kubona, gupima, no guhangana n'ibyago mu gishushanyo mbonera binyuze mu gushyiraho [1].

  • Amahame ya OECD akora nk'icungamutungo - amabwiriza rusange imiryango myinshi igenderaho [2].

Amakipe menshi kandi akora urutonde rwayo bwite (isuzuma ry’ubuzima bwite, amarembo y’abantu) akurikije izi ngendo z’ubuzima.

Inyandiko zisa n'izidakenewe: Amakarita y'icyitegererezo n'amakuru 📝

Inyandiko ebyiri uzishimira nyuma:

  • Amakarita y'icyitegererezo → garagaza ikoreshwa ryabyo, imiterere yabyo, amabwiriza. Byanditswe kugira ngo ibicuruzwa/amategeko nabyo bishobore gukurikiranwa [3].

  • Impapuro z'amakuru ku makuru → sobanura impamvu amakuru ahari, ibirimo, ibishobora kuba bidafite aho bihuriye, n'ikoreshwa ry'umutekano ugereranyije n'iriteje akaga [4].

Uzaza (n'abo mu itsinda ryacu) muzagushimira bucece kubera ko wabyanditse.

Gushakisha amakuru mu buryo bwimbitse: uburyo bwo gukusanya amakuru, amasezerano, no kuyahindura 🧹📦

Amakuru arahinduka. Injeniyeri za AI zikoresha ubuhanga mu gukora igenzura ry’ikoranabuhanga zishyira mu bikorwa amasezerano, zigashyiraho sheki, kandi zigashyiraho verisiyo zijyanye na kode kugira ngo ubashe gusubira inyuma nyuma.

  • Kwemeza → kode schema, ranges, freshness; gukora docs mu buryo bwikora.

  • Verisiyo → ihuza amakuru n'amamodeli hamwe na Git commits, bityo ukaba ufite logi y'impinduka ushobora kwizera.

Urugero ruto: Umucuruzi umwe yashyize mu bikorwa igenzura ry’amakuru kugira ngo ahagarike ububiko bw’abatanga serivisi zuzuyemo ibintu bitari ngombwa. Iyo tripwire imwe yahagaritse gusubiramo amakuru inshuro nyinshi muri recall@k mbere y’uko abakiriya babibona.

Kwibira mu mazi menshi: kohereza no kwagura ibicuruzwa 🚢

Kubona moderi ikora muri prod si model.fit() . Umukandara w'ibikoresho hano urimo:

  • Docker kugira ngo ipakirwe neza.

  • Kubernetes zo gutunganya, kwagura, no gushyira ahagaragara mu mutekano.

  • Imiterere ya MLOps y'ibicurane, A/B splits, no kumenya ibintu bidasanzwe.

Inyuma y'urukingo hari igenzura ry'ubuzima, gukurikirana, gahunda ya CPU vs GPU, guhindura igihe ntarengwa. Ntabwo ari byiza cyane, ni ngombwa cyane.

Kwibira mu buryo bwimbitse: sisitemu za GenAI na RAG 🧠📚

Sisitemu zitanga umusaruro zizana ikindi kintu gishya - uburyo bwo kugarura amakuru.

  • Gushyiramo + gushakisha vekiteri ku bijyanye no gushakisha ibintu bisa ku muvuduko.

  • yo gukusanya amakuru kugira ngo akurikirane amakuru, akoreshe ibikoresho, kandi akoreshwe nyuma yo kuyatunganya.

Amahitamo mu gukata, kongera gushyira ku rutonde, no kugabanya - izi hamagara nto nizo zigena niba ubona chatbot idakora neza cyangwa co-pilot y'ingirakamaro.

Ubuhanga n'ibikoresho: ibiri mu gice cy'ibicuruzwa 🧰

Ipaki ivanze y'ibikoresho byo kwigiramo byimbitse n'ibikoresho byo kwigisha byimbitse:

  • Imiterere: PyTorch, TensorFlow, scikit-learn.

  • Imiyoboro: Inzira y'umwuka, n'ibindi, ku mirimo yagenwe.

  • Umusaruro: Docker, K8s, serving frameworks.

  • Uburyo bwo kugaragara: kugenzura imihindagurikire y'ikirere, gukurikirana igihe ibintu bitinze, kugenzura ubutabera.

Nta muntu ukoresha byose . Amayeri ni ukumenya bihagije mu buzima bwose kugira ngo utekereze neza.

Imbonerahamwe y'ibikoresho: icyo injeniyeri zigeraho by'ukuri 🧪

Igikoresho Abareba Igiciro Impamvu ari ingirakamaro
PyTorch Abashakashatsi, injeniyeri Isoko ifunguye Inzira yoroshye, ifite Python, umuryango munini, imbuga zihariye.
TensorFlow Amakipe ashingiye ku bicuruzwa Isoko ifunguye Ubujyakuzimu bw'ibidukikije, TF Serving & Lite yo gukoresha.
kwiga Abakoresha ML ba kera Isoko ifunguye Imiterere myiza, API nziza, itegurwa mbere.
MLflow Amakipe afite igerageza ryinshi Isoko ifunguye Ikomeza gukora ibintu, ibishushanyo mbonera, n'ibindi bikoresho biteguye neza.
Ingufu zituruka mu mwuka Abantu ba pipeline Isoko ifunguye DAGs, gahunda, uburyo bwo kuzibona birahagije.
Docker Muri rusange buri wese Ishingiro ry'ubuntu Ahantu hamwe (akenshi). Imirwano mike "ikora kuri mudasobwa yanjye igendanwa gusa".
Kubernetes Amakipe akomeye cyane mu bijyanye n'ikoranabuhanga Isoko ifunguye Gupima, gushyira ahagaragara, imitsi yo mu rwego rwo hejuru rw'ikigo.
Serivisi zo gutanga icyitegererezo kuri K8s Abakoresha moderi za K8s Isoko ifunguye Serivisi isanzwe, imigozi yo gutembera, ishobora kwaguka.
Isomero ry'ishakisha rya vektori Abubatsi ba RAG Isoko ifunguye Kusa vuba, bifasha gukoresha GPU.
Amaduka acunga ibyuma binini Amakipe ya RAG y'ibigo Icyiciro cyishyurwa Ibipimo bidafite seriveri, gushungura, kwizerwa ku rugero.

Yego, imvugo isa n'aho idahuye. Amahitamo y'ibikoresho akenshi ni yo asanzwe.

Gupima intsinzi nta kurohama mu mibare 📏

Ibipimo by'ingenzi biterwa n'aho ibintu biherereye, ariko akenshi uruvange rwa:

  • Ubwiza bw'ibiteganyijwe: ubuziranenge, kwibuka, F1, gupima.

  • Sisitemu + umukoresha: gutinda, p95/p99, kuzamura impinduka, igipimo cyo kurangiza.

  • Ibipimo by'ubutabera: uburinganire, ingaruka zitandukanye - bikoreshejwe neza [1][2].

Ibipimo bihari kugira ngo habeho ihindagurika ry’ibipimo. Niba bitabaye ibyo, bihindure.

Imiterere y'imikoranire: ni siporo y'ikipe 🧑🤝🧑

Injeniyeri za AI zikunze kwicara ku ihuriro ry’imihanda hamwe na:

  • Abantu bashinzwe ibicuruzwa n'urubuga (sobanura intsinzi, inzira zo kurinda).

  • Injeniyeri z'amakuru (amasoko, igishushanyo, SLA).

  • Umutekano/amategeko (ubuzima bwite, kubahiriza amategeko).

  • Igishushanyo/ubushakashatsi (igerageza ry'abakoresha, cyane cyane GenAI).

  • Ops/SRE (igihe cyo gukora imyitozo yo kuzimya umuriro).

Tegereza imbonerahamwe z'amabaraza zivugwa mu nyandiko n'impaka zishyushye rimwe na rimwe - ni byiza.

Ingaruka mbi: ikibazo cy'imyenda ya tekiniki 🧨

Sisitemu za ML zikurura imyenda ihishe: imiterere igoranye, imiterere idakora neza, inyandiko za kole zibagirana. Inzobere zishyiraho uburyo bwo kurinda - ibizamini by'amakuru, imiterere yanditse, révolvers - mbere yuko igishanga gikura. [5]

Ababungabunga isuku: imyitozo ifasha 📚

  • Tangira gato. Garagaza ko imiyoboro ikora mbere yo kugora ibishushanyo mbonera.

  • Imiyoboro ya MLOps. CI ku makuru/imideli, CD ku serivisi, CT yo kongera guhugura.

  • Urutonde rw'igenzura ry'ubuhanga mu bya siyansi. Byashyizwe ku rubuga rwawe, hamwe n'inyandiko nka Model Cards & Datasheets [1][3][4].

Ibibazo Bikunze Kubazwa Vuba: igisubizo cy'interuro imwe 🥡

Abahanga mu bya siyansi bakora porogaramu za AI bakora sisitemu zo kuva ku mpera kugeza ku mpera zifite akamaro, zishobora kugeragezwa, zishobora gukoreshwa, kandi zifite umutekano mu rugero runaka - mu gihe zigaragaza neza ko ibyo zikora nta muntu uri mu mwijima.

TL;DR 🎯

  • Bafata ibibazo bidasobanutse neza → sisitemu zizewe za AI binyuze mu gukora amakuru, gukora ibishushanyo mbonera, MLOps, no gukurikirana.

  • Ibyiza ni uko wabanza ukabikora byoroshye, ugapima udasiba, kandi ukandika ibitekerezo byawe.

  • Umusaruro AI = imiyoboro + amahame (CI/CD/CT, ubutabera aho bikenewe, gutekereza ku byago bikubiye mu bikorwa).

  • Ibikoresho ni ibikoresho gusa. Koresha nibura bigufasha kunyura muri gari ya moshi → inzira → korera → reba.

Amasano y'ifatizo

  1. NIST AI RMF (1.0). Ihuza

  2. Amahame ya OECD AI. Isano

  3. Amakarita y'icyitegererezo (Mitchell et al., 2019). Isano

  4. Impapuro z'amakuru ku makuru (Gebru et al., 2018/2021). Isano

  5. Umwenda wa tekiniki wihishe (Sculley et al., 2015). Isano

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe

Garuka kuri blog