Ikigo cy'amakuru cya AI ni iki? [Videwo n'Ibibazo]

Igisubizo kigufi: Ikigo cy’amakuru cya AI ni hafite ubucucike bwinshi aho ingufu, ubukonje, imyenda, n’ububiko bihurizwa hamwe n’uburyo bwo kwigisha no gutanga serivisi, ntabwo ari icyumba cya seriveri gifite GPU z’inyongera. Uduce duto turamenyekana; inyubako ni yo igena niba bikora. Niba amashusho adashobora kuva, shyiramo akantu gato; amakipe menshi agomba gukodesha.

Ibintu by'ingenzi byakunzwe:

Udupira tw’amashanyarazi ugereranije n’inyubako: Ingufu, gukonjesha, imyenda, n’ububiko ni byo bigena niba imashini zihutisha akazi zikora.

Ahantu hatari ingoro: Subiramo udusanduku tubiri iyo amakuru adashobora gusohoka; ntugure ikigo.

Igipimo cy'ubugari vs igipimo cy'ubugari: Ku nshuro umunani, igipimo cy'ubugari gitangira kongera gukora; koresha igipimo cy'amasaha 18.

Ubudahangarwa mu gukoresha nabi: Ntugatange PUE ku birango bibiri mu cyumba kivanze.

Ibisubizo by'icyitegererezo: Gukoresha inshuro umunani ni ikarita nto, ntabwo ari ukwizigamira 50% by'umusaruro.

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Ese ubuhanga bwo gukora imibonano mpuzabitsina (AI) ni ubwo kwizerwa? Videwo n'ibibazo.
Suzuma uburyo bwo gukora imibonano mpuzabitsina binyuze muri videwo ishishikaje n'ibibazo bihuza abantu.

🔗 Uburyo bwo gukoresha ubuhanga bwo gukora imibonano mpuzabitsina mu buzima bwa buri munsi.
Menya uburyo bufatika ubuhanga bwo gukora imibonano mpuzabitsina bushobora koroshya imirimo n'ibikorwa bya buri munsi.

🔗 Uburyo bwo gukoresha ubuhanga bwo gukora imibonano mpuzabitsina ku kazi
Menya uburyo bufatika bwo gukoresha ubuhanga bwo gukora imibonano mpuzabitsina kugira ngo ubone umusaruro mwiza mu kazi.

🔗 ubuhanga bwo gutekereza ku bwenge bushobora kwitekerezaho?
Sobanukirwa niba ubwenge bw'ubukorano bushobora gutekereza ku giti cyabwo cyangwa gutekereza neza.

Uburyo bitandukanye n'ikigo cy'amakuru "gisanzwe"

Inzu gakondo zikoresha uburyo bwo gukora imirimo itandukanye n'amasaha yo gukora muri serivisi nke. Wita ku gusiba, yego, kandi ukita ku PUE nk'igitekerezo - ingufu z'inyongera inyubako ikoresha kugira ngo itange watt ya mudasobwa. Ubusanzwe, ntushushanya buri nzira ikikije icyuma gishyushya gikoreshwa nk'aho ari ahantu ho gushyushya imodoka.

Imbuga za AI zihindura ibipimo. Ubucucike buriyongera. Umuyoboro uhinduka nk'ikintu akazi k'imyitozo kadashobora gucika intege. Ububiko bugomba gutuma aho bagenzura haguma hameze nabi cyangwa se abakoresha accelerators bakaguma gusa, nk'amafarasi yo mu isiganwa mu muvuduko w'imodoka.

Hari itandukaniro mu muco. Abashinzwe ubucuruzi batekereza mu matike no guhindura amadirishya. Abashinzwe ikoranabuhanga rya gihanga (AI) batekereza mu mirongo y'akazi ndetse n'ibyiyumvo byo kurwara iyo node ipfuye nyuma y'igihe kirekire. Ndatekereza ko ushobora kwita "ibigo by'amakuru" byombi kuko ari byo. Ikirango gihisha gusa amazi.

Ntabwo ari ihame ry'umuco. Imashini zitandukanye, izina ry'umuryango umwe.

GPU, accelerators, na rack ikoresha ingufu nyinshi

Genda hasi gakondo izamutse, aho bashyira ibintu bisa nkaho ari heza cyane. Genda ku murongo w’ubuhanga bwo gukora ibintu bya gihanga (AI) maze basa n’abashaka kumira inyubako.

Ibikoresho bidasanzwe si CPU y'ubwenge. Ni agasanduku k'umuvuduko: GPU cyangwa izindi chips za AI, zipakiye muri seriveri, hanyuma zigashyirwa ku dusanduku, hanyuma imirongo isangiye umwenda munini. GPU ihuza chips mu kintu gishobora kwitwa accelerator imwe nini; umwenda w'itsinda ukora amayeri amwe ku gipimo cy'umurongo. Imyitozo ijyanye n'igihe ikora gusa iyo izo links zikomeje kuba nyinshi kandi zitegerejwe. Bibuze ibyo kandi "cluster" yawe ni umurundo w'ibigo by'akazi bihenze bisangira kode y'iposita.

Ingufu zikurikira utumashini. Ntabwo ari PDU nini cyane yo mu biro. Megawati z'umuzigo wa IT iyo icyumba cyuzuye - sinzahimba umubare. Ubucucike kuri buri kirahuri ni bwo buryo bwo guhindura imiterere y'ibikoresho. Raki nke. Buri kimwe ni itanura rito. Ikintu kidashoboka akenshi ni substation, ntabwo ari urutonde rw'ibyo GPU zifuza. Urabizi uko bimeze: kugura bisaba accelerator nyinshi; ikigo gikeneye ikiganiro kirekire n'isheki nini cyane.

Imvugo imwe y'ubupfapfa sinshobora kunyeganyeza: ikigo ni inyamaswa ishonje. Ushobora korora yihuta. Uracyagomba kuyigaburira, kandi uracyagomba kuyikuraho ubushyuhe. Simbuka kimwe muri byo maze kiba igikoresho cy'impapuro gihenze cyane.

Ingufu, ubushyuhe, n'ikibazo cyo gukonjesha

Amashanyarazi arahari. Ubushyuhe burashira. Iryo ni ryo dini ryose.

Ibikoresho bifite ubushyuhe bwinshi bisohora ubushyuhe mu buryo umwuka utigeze usabwa gufata. Ushobora gusunika umwuka cyane - ibikoresho byo guhererekanya ubushyuhe by'inyuma, inzira zishyushye kurushaho, uburyo bwo kubika amazi neza - kandi ibyo bikora kugeza ku rugero runaka. Hanyuma amazi agaragara:

• Gukonjesha hakoreshejwe imashini ikoresha ikoranabuhanga rigezweho

• Imirongo ikonjesha ituma icyumba cy'ibimera gisa n'aho ari imiti ikoreshwa

• Kwinjira mu bishushanyo mbonera bike, biracyatera ubwoba abantu batekereza ko amazi n'abakoresha badakwiye gusangira interuro imwe

Nta na kimwe muri ibi gishimishije. Byose ni ibicuruzwa, kuko accelerator ikoresha throttles ni imwe wamaze kwishyura kandi udashobora kuyikoresha byuzuye.

PUE iracyafite agaciro. Ni igipimo, si imiterere. Abayikoresha bayikurikirana kuko wati imwe ikoreshwa ku bafana n'amapompo ari wati itagiye kuri GPU. Sinzongera kuvuga ishusho "isanzwe"; ikirere n'uburyo ushushanya umupaka biyimura, kandi ubuziranenge bw'impimbano ni bubi kurusha nta na kimwe. Amazi nayo ari mu nkuru. Hari ibimera binywa. Hari n'ibinyobwa. Gukonjesha amazi birushaho kuba byiza kugeza igihe uruzi cyangwa amapfa biyigize politiki.

Guhuza abantu: impamvu umwenda ufite agaciro nk'uko uduce duto dufata

Abantu bafotora GPU. Bagomba gufotora switch.

Imyitozo ni ikiganiro. Ibihumbi by'ama-accelerator ahinduranya imivuduko, ibipimo, ibice by'icyitegererezo, mu buryo buhuye neza. Iyo imyenda ihutiye, akazi kose gategereza buhoro cyane. Niyo mpamvu AI halls ikunda cyane imiyoboro ya bandwidth nyinshi, gutinda guke, na topolojia zidacikamo kabiri iyo umurongo unaniwe. InfiniBand-ish fabrics, Ethernet mu mwanya umwe, GPU ihuza imbere mu gasanduku, imiyoboro igomba kuba imeze neza bwa mbere.

Igitekerezo ni ikindi kiganiro. Uburyo bwo gutanga ibikoresho bwita ku gutinda kw'umurizo - igisubizo gito, ntabwo ari igisubizo gisanzwe. Itsinda ry'abantu bahatanira umwanya uhagije wo gukora ibintu mu buryo bufatika bigabanya imiterere y'umuntu. Itsinda ry'abakora imyitozo rishaka ingendo nini, rusange, zose. Itsinda ry'abakora rishaka ubusabe bwinshi buto no kwigunga, nta muvuduko w'imodoka ugaragara ku mubare w'abatwara imizigo.

Mushiki wanjye, ubwo ndi hano: abantu bafata umuyoboro w'amazi nk'amazi n'ibiceri nk'iresitora. Muri iyi nyubako, amazi ni resitora. Iyo ubuze icyo ugura igikoni kidashobora kwakira ibyo waguze.

Imyitozo vs inference: inyubako ebyiri, rimwe na rimwe mu buryo bufatika

Amahugurwa ni ubukangurambaga. Uteranya itsinda ry’abantu, ukarya amakuru, ukagenzura mu buryo bw’urwiyerurutso, ukiruka amasaha cyangwa ibyumweru, kandi ugasenga ko ibyo bintu biguma nta kibazo. Ufite imbaraga nyinshi, ukunda gukoresha interineti, wihangana bucece - kugeza igihe urugingo rwananiwe rucitse. Umuvuduko umwe upfuye mu kazi gafatanye neza ushobora guhagarika ikorali yose.

Igitekerezo ni ahantu ho gukorera. Abanyamideli bamaze gutozwa, ubu basubiza ibibazo, bashyira amashusho mu byiciro, bagakora inyandiko. Gutinda ni ingenzi. Imashini ishaje gato iri hafi y'umukiriya ishobora gutsinda iy'akataraboneka iri ku mugabane.

Bityo ubona icyuho. Amashuri makuru akurikirana ingufu, ubutaka, n'ubucucike. Ahantu hashingiwe ku bitekerezo hakurikirana gutinda no kubaho. Ahantu hahurira abantu benshi na ho hari, kuko imari shingiro ntabwo ari ntarengwa. Nibyo - si buri gihe inyubako ebyiri. Hari igihe inzu imwe ifite umugozi wa velvet n'imirongo ibiri yo gukonjesha.

Aha ni naho hakorerwaga colocation, hyperscale campus, na on-prem fork. Hyperscalers bubaka ku bipimo bituma abandi bose basa nkaho turimo gutegura ibikoresho. Colos igurisha ubucucike hafi y'aho irangi rishyirwa. On-prem iracyabaho iyo amakuru adashobora gusohoka.

Uburyo bwo kubika amakuru, aho bagenzura amakuru, n'ibikoresho byo kubika amakuru bishoye

Ntawe ushyira sisitemu y'amadosiye ihwanye ku gifuniko cy'agatabo.

Amakuru y’amahugurwa agomba kugera vuba ku buryo GPU zitakora ku birenge byazo. Aho kugenzura bigomba kugwa kugira ngo impanuka idahita ishira icyumweru. Ibiremereye bya moderi bigomba gupakira mbere yuko kopi itangwa ibaho. Uburyo bwo kubika - atari ubushobozi gusa - ni bwo nzitizi ituje. Ushobora gutakaza amafaranga menshi kuri accelerators hanyuma ukayicisha inzara ukoresheje uburyo bwiza bwagenewe imashini zikoresha ikoranabuhanga.

Imiterere iramenyerewe: itsinda ry'abantu rigaragara, umurongo w'akazi, n'umukozi uhagarariye abandi ategereje inyuma nk'aho ari inyemezabwishyu idahwitse. Gushyira hamwe imibare udashyize hamwe nta gukusanya amakuru ni bwo buryo ubona akazi gahenze cyane. Komeza ufungure uduce tw'amakuru cyangwa wemere ko waguze ishusho.

Porogaramu, uburyo bwo gutunganya ibintu, n'urwego rw'imikorere rudashimishije

Ibikoresho by'ikoranabuhanga ni ibyamamare. Abategura gahunda nibo bakora akazi.

Ikigo cy’amakuru cya AI ntacyo kimaze niba akazi kadashobora kubona GPU, niba amakipe abiri adashobora gusangira itsinda rimwe nta nkota, niba urwego rwananiwe rudashobora gusimburwa, niba firmware igenda kugeza igihe umwenda unaniranye mu gihe gito. Uburyo bwo gukora, kureba, gupima ingufu - urwego rwa ops rudashimishije, ni ko ubizi ko ari ingenzi.

Mfite aho ntaborohera kuri uru rwego. Nanone aho NIC idakozwe neza yigira ikibazo cyo gukonjesha ku gicamunsi cyose ... urabisanga mu buryo bugoye.

Iyo urugingo rupfuye hagati mu gihe cyo gukora

Akadomo karapfa. Amadirishya yo guhinduranya aracyahura n'ibikorwa byo kwitoza bitareba kalendari yawe. Ushyira hamwe gahunda y'imirimo minini, ukazitira ibigega by'isuzuma, wandika ibitabo by'ibizamini bisa nkaho "akazi gahoro" kugeza igihe bisa nkaho "akazi kapfuye." Gukoresha uburyo bwo gukosora ibintu biracyari ingenzi - ingufu, gukonjesha, inzira, kubika - ariko uburyo bwo gutsindwa ntiburimo gahunda nziza nk'iya kera. Igitekerezo: kopi, kuraho akadomo k'indwara, komeza gusubiza. Imyitozo isaba ahantu ho kugenzura, ntabwo ari icyizere.

Aho biherereye, amazi, uruziga rw'amashanyarazi, n'abaturanyi

Ntugaterera kimwe muri ibi iruhande rw'akazu kugira ngo ubone uko ubibona.

Guhuza imiyoboro y'amashanyarazi akenshi ni bwo buryo nyabwo bwo guhitamo aho hantu. Ubutaka bworoshye ugereranije n'ahantu hakoreshwa amashanyarazi hamwe n'ikigo gifite abandi bakiriya. Amazi yo gukonjesha, iyo uyakoresheje, aba ikibazo cy'abaturanyi igihe imvura iguye nabi. Urusaku. Ubushyuhe bugaragara. Ubushyuhe ku ruzitiro rw'umupaka. Komite zishinzwe igenamigambi zivumbura ibitekerezo ku "gicu" igihe cyose zikeneye umurima n'uruzi.

Gutinda biratandukanye. Gutekereza ko umuntu akunda kuba hafi y'abakoresha n'aho bahurira. Amahugurwa ashobora kwihisha mu masoko y'amashanyarazi ahendutse no mu kirere gikonje. Inganda zivuga nk'aho hari urubuga rumwe rutunganye. Ntaho rugeze. Hariho ubwumvikane n'itangazo rigenewe abanyamakuru.

Ubushyuhe busigaye n'itanura ritatumiwe

Udutabo dukunda iki gice. Shyira ubushyuhe bw'imyanda mu mazu, mu bidendezi, mu mazu y'ubusitani; ni interuro nziza cyane. Hari igihe umurongo w'akarere uba ari wo w'ukuri. Hari igihe ikigo kiba kiri ahantu hadakwiye kandi ubushyuhe bugakomeza kujya mu kirere. Ndashidikanya kuri verisiyo y'agatabo; sinshidikanya kuri fiziki.

Ni nde uyikeneye (kandi ni nde ukwiye kuyikodesha)

Abantu benshi ntibakeneye gutunga imwe muri izi nzu.

Urutonde rudasobanutse:

• Abakora ibisasu byinshi, kuko ibicuruzwa ari byo bicuruzwa

• Laboratwari, iyo igihe cyo gutondeka umurongo ari cyo kibangamiye, cyangwa amakuru adashobora gusohoka

• Banki, itsinda ry’ibitaro, leta, cyangwa uruganda rufite amakuru y’ibanga - on-prem cyangwa agasanduku k’ibanga k’ibanga bishobora kuba bifite ishingiro, kabone n’iyo byaba ari faff

Abandi bose bagomba gukodesha. Aho umuntu atuye hafite ubucucike bwa AI. Aho abika ibintu mu bicu. Itsinda ricungwa. Ubona accelerators utarinze no kuba ikigo cy'amashanyarazi. Urukundo rurangira bwa mbere umuntu abaza uwo ari we wese uhamagaye coolant loop saa cyenda za mu gitondo.

Ndemera ko hari ikintu cy'ishema. Kugira itsinda ry'abantu bisa n'aho ari ukugira uburyo bwo guhanura. Hanyuma fagitire y'amashanyarazi iraza, maze pride yicara.

Icyo inyubako igamije

None se, Ikigo cy’Amakuru cya AI ni iki? Ikigo cyihariye, gifite abantu benshi aho ibyuma bihutisha ibintu, ingufu, ubukonje, imyenda, n’ububiko bitegurwa hifashishijwe amahugurwa no gutanga serivisi - ntabwo ari ikoranabuhanga rusange rifite GPU mu mfuruka. Kimeze nk'ububiko. Kimeze nk'ikigo cy'amashanyarazi gikora imibare.

Niba nta kindi wibuka: uduce duto turamenyekana; substation, coolant, na network ni byo bigena niba utwo duce twari igitekerezo cyiza. Guhugura no gusesengura bishobora gusangira igisenge; baracyashaka imico itandukanye. Amashyirahamwe menshi agomba gukodesha. Akeya agomba kubaka. Abaturanyi bazabibona uko biri kose.

Igicu cyahoraga gifite inyubako. Muri iyi minsi inyubako ifite ibitekerezo.

Urugero rw'ibintu nyabyo: Akazu k'imyitozo kagizwe n'ibice bibiri iyo amashusho adashobora kuva

Imiterere y'ibyabaye

Tomos ni umuyobozi w’ibikorwa remezo muri Kestrel Precision, uruganda rukora ibikoresho by’abantu 400 rukorera mu gace ka West Midlands. Basanzwe bafite aho bashyira ibikoresho: ERP, imigabane y’amadosiye, imashini zikoreshwa kuri interineti, n’ahantu havanze iyi nkuru yatangiriyeho. Gukonjesha umwuka. Ethernet isanzwe. SAN irangwa n’ubupfura ku ma disiki yo mu biro.

Itsinda rishinzwe kureba imashini rigomba guhugura icyitegererezo cy’igenzura ku mashusho y’uruganda. Amashusho ntashobora kuva aho aherereye. Agaragaza inzira isosiyete itagomba gushyira kuri disiki y’ibicu, ndetse n’iyo yaba ari iy’umuntu ku giti cye. Igisubizo cy’amasoko ni seriveri enye zifite accelerator ebyiri n’agasanduku kitwa "ikigo cyacu cy’amakuru cya AI". Seriveri zijya mu masanduku abiri asanzweho, kuko hari umwanya, kandi umwanya wasaga n’aho ari wo uri kubangamira.

Si ko biri. Mu byumweru bibiri, GPU zumvikana nk'izikora cyane hanyuma zigahita zikora buhoro buhoro. Akazi karagenda gahita gakubita SAN. Akadomo karapfa saa kumi n'imwe maze akazi karagenda. Tomos ntiyabuze kugura amafiriti. Yaguze ahantu hahenze ho gukorera ibintu hamwe na kode ya posita. Inyubako yari ikiri icyumba cy'ubucuruzi.

Ntabwo bakeneye ikigo, sitasiyo nshya, cyangwa uruzi. Bakeneye akazu gato gakora nk'ikigo cy'amakuru cya AI mu buryo buto: ingufu zishyirwa ku birahuri bishobora gufata, ubushyuhe buvaho hatabanje gutekwa amafiriti, umwenda akazi ko guhugura gashobora kuvugaho, ububiko bushobora gufata igenzura, n'igitabo cyo kugenzura igihe urusobe rupfuye. Kubera ko amashusho adashobora kuvaho, gukodesha ikiraro cy'amabara mu minota mirongo ine si cyo gisubizo. Gushyiramo amabara abiri ni byo.

Icyo selile ikeneye

• Ingengo y'imari yapimwe kuri uwo murongo, iturutse kuri PDU, ntabwo iturutse ku rutonde rw'ibyo GPU yifuza. Niba ubushobozi bw'inyongera budashobora guhaza seriveri enye mu gihe cyo gutoza, ikiganiro kirahagarara aho maze bakareba ibara ryinshi, ntabwo ari igitangaza

• Gukonjesha umwuka ntibyigeze bisabwa gukora kuri ubu bucucike: ibikoresho byo guhererekanya ubushyuhe by’inyuma niba icyumba gishobora kubitwara, cyangwa umuyoboro muto w’amazi niba ushobora kubitwara. Niba nta na kimwe muri ibyo, abashinzwe gutanga serivisi ntibajyamo

• Igitambaro cyagenewe umurambararo munini hagati y'amanode ane, ntabwo ari Ethernet yo mu biro. Niba umucuruzi afite switch ya 10 Gb gusa muri kataloge, ntabwo ari itsinda ry'abantu benshi

• Ububiko bwihuse bwo mu gace k'aho abantu bagenzura ibintu n'aho bategurira amahugurwa, ntabwo ari VM SAN

• Umukozi ugena gahunda, igihe cyo kugenzura, n'inzira yo gutangira bundi bushya yanditse. Ibikoresho by'ikoranabuhanga ni ibyamamare. Uru rwego ni akazi

• Agasanduku k'inyongera gafite uruzitiro ku murongo w'uruganda, gatandukanye n'amagambo yo guhugura, kuko gutanga serivisi bisaba gutinda no kwitandukanya, atari itsinda ry'abantu

• Uruhushya rwo kwandika ingufu z'amashanyarazi, amasaha ya GPU, ibikorwa byo gukurura, n'isaha yo ku rukuta. Niba batabishoboye, bazafotora GPU kandi babure swichi

Amabwiriza y'urugero

Tomos abivuga mu magambo ahinnye y’ibigo, mu mvugo isanzwe:

Ntukabyite ikigo cya AI. Hubaka agace k’amahugurwa k’ibice bibiri mu cyumba gisanzweho kugira ngo ubone seriveri enye z’ibice bibiri. Amashusho y’uruganda aguma aho akorera. Intsinzi ni iyi: utudomo tune twuzuza resept y’amahugurwa y’igenzura ry’ibihe 12 nta mpungenge z’ubushyuhe, wandike aho ugenzura mu minota itari icumi, hanyuma usubire kuri iyo reservation iyo wishe urwego nkana. Gukonjesha bigomba gutuma GPU ziguma ku masaha yazo yo kwitoza. Imiyoboro igomba kuba nk’imyenda utwo dusanduku tune dusangiye, ntabwo ari inzira inyura mu biro. Ububiko bugomba gutanga amafiriti. Niba ibikoresho byo guhererekanya ubushyuhe by’inyuma bitazakwira, vuga ubireke. Ntukavuge PUE ku dusanduku tubiri mu cyumba kivanze. Uwo mubare waba ari ikinamico.

Hanyuma abishyira mu kazi k'amahugurwa ubwako:

Aho bagenzura buri minota 30 ugana kuri pisine yihuta yo hafi aho. Niba urwego rupfuye, ongera utangire uhereye aho bagenzura bwa nyuma. Ntutegereze kuri SAN. Ntukomeze gukora imyitozo mu gihe amasaha yagabanutse kubera ubushyuhe. Hindura hanyuma uhagarare kugira ngo tubone aho babika.

Isaha nziza imeze itya: GPU zose umunani zari ku masaha y'imyitozo, dosiye y'aho bagenzura yageze, akazi karacyari mu mwanya wa locked. Isaha mbi imeze itya: abafana bari ku induru, amasaha yarangiye, aho bagenzura handitse 2% nyuma y'iminota icumi, n'umuntu uri mu biro avuga ati "icyiciro kiri hejuru". Kuzamuka si imyitozo.

Uburyo bwo kubigerageza

Bandika ikizamini mbere yo kugikosora, ari na cyo kintu cy’ingenzi cyo kutizera demo.

• Uburyo bumwe bwo gukora isuzuma bwa 12-epoch, amashusho 120.000 amwe, amanota umunani

• Igihe gikurikizwa ni isaha ikoreshwa ku rukuta kugeza ku ifunguro ryarangiye, harimo no gutangira bundi bushya, bipimirwa kuva ku kazi katanzwe kugeza ku igenzura rya nyuma ryo mu gihe cya 12

• Gukoresha ubushyuhe: Amasaha ya GPU aguma ku ntego yo kwitoza mu gihe cyo kwiruka. Gukoresha throttle birananirana nubwo akazi karangira

• Igihe cyo kubika amakuru: igihe cyo kwandika aho ugenzura, hagati n'igihe kibi kurusha ibindi, uhereye ku rutonde rw'akazi

• Imyenda yo gusimbuza: akazi ntigakorerwa mu gihe itsinda ry’abakiriya rikiri rizima. Iyo batabonye uko gusinzira, ibikoresho ntibirangira

• Babiri muri umunani birukanwa ku ntambwe ihamye, ku bushake, kugira ngo bagerageze inzira yo kongera gutangira

• Igitekerezo ni ikizamini cy’amashusho 200 gitandukanye uhereye ku murongo w’uruganda kugeza ku gasanduku ko gutanga serivisi gafite uruzitiro. Intsinzi mu mahugurwa ntifatwa nk'intsinzi mu gutanga serivisi

• Bafata ingufu za rack zivuye kuri PDU mu minota 15 kugira ngo hatagira uvumbura megawati

Kwemera kwita selile "iteguye gukora imibonano mpuzabitsina": resept 8 kuri 8 zirarangiye; 0 kuri 8 zigaragaza uburyo bwo gushyushya; inzira zombi zapfuye zirakomeza; aho kugenzura haguma mu minota mike. Iyo babuze ibyo, baracyafite icyumba cya seriveri gifite amakarita meza y'amashusho.

Ibisubizo

Ibisubizo byerekana, bivuye mu ikizamini cyakozwe mu byiciro umunani, ntabwo ari igipimo cya Kestrel cyasohotse.

Ibitekerezo: seriveri enye zikora akazi ko kwihutisha inshuro ebyiri mu dusanduku tubiri; icyitegererezo kimwe cyo kugenzura; ibyuma 120.000; uburyo umunani bwo gukora resept ya 12-epoch idahinduka; isaha yo ku rukuta irimo gutangira kugeza resept irangiye; throttle bivuze ko isaha yo kwitoza ivanyweho; igihe cyo kugenzura ni igihe cyo kwandika, ntabwo ari icyifuzo; ingufu za rack ni ingero za PDU, ntabwo ari PUE ya kaminuza.

Mbere yo kongera gukora, GPU ziri mu bikoresho bisanzwe bikonjeshwa n'umwuka kuri Ethernet yo mu biro na VM SAN:

• Amanota 5 kuri 8 yarangiye ku igerageza rya mbere. Isaha yo hagati y'urukuta muri ayo atanu: amasaha 14

• 3 kuri 8 byabaye ngombwa ko bongera gutangira nyuma y’aho bamariye guhagarara ahagana ku isaha ya 11 (ebyiri nyuma y’uko agace gato kapfuye gafite aho kagenzurwa hashaje, kamwe nyuma y’ako kagenzurwaga kuzuye SAN). Ongera ugerageze ako kanya, nta gutegereza amasaha ijoro ryose: amasaha 11 yatakaye wongeyeho amasaha 14 yo kugerageza, cyangwa amasaha 25 kugira ngo umenye neza ibyo bitatu

• Igihe cy'ubushyuhe kigera ku gihe cyo kurangiza muri resept yose uko ari umunani, restart irimo: amasaha 18. (Etanu kuri 14, eshatu kuri 25. Intera y'ibice umunani byose iracyari 14, ibyo bikaba byahisha restart. Niyo mpamvu impuzandengo ari yo shingiro hano.)

• Umuvuduko w'ubushyuhe wakoreshejwe inshuro 7 kuri 8. Igihe cy'ubugari ku isaha yagabanijwe: amasaha 3 mu masaha 14 yo kugerageza

• Inyandiko yo kugenzura: iminota 22 hagati

• Gupfa kw'abantu babiri mu buryo bw'impanuka ntabwo byari ikizamini bashoboraga gutsinda. Ntibari bafite igitabo cy'amateka. Impfu ebyiri z'impanuka ni zo zabonetse

• Umutwaro wa IT wo hejuru ku biraki bibiri mu gihe cy'imyitozo: hafi 18 kW. Umurongo wari ufite watts. Ntabwo wari ufite ubukonje cyangwa umwenda

Nyuma yo gushyiramo ibikoresho byo gushyushya by’inyuma kuri ibyo bikoresho bibiri, umwenda wagenewe hagati y’ibice bine, pisine nto ya NVMe yo kugenzura, kugenzura iminota 30, hamwe n’igitabo cyo gutangira gusubiza ibintu mu buryo:

• 8 kuri 8 yarangiye ku igeragezwa rya mbere. Isaha iri hagati y'urukuta: amasaha 9

• Uburyo bwo gushyushya bukoresha ubushyuhe: 0 kuri 8

• Inyandiko yo kugenzura: hagati y'amasegonda 90. Ikibi kurusha ibindi muri seti: iminota 3

• Ubwicanyi bubiri bwakozwe ku bushake bwombi bwaragarutse kuva aho bari bari mu igenzura ry’iminota 30 ishize. Isaha y’inyongera kuri izo nshuro ebyiri: buri minota 40, harimo n’isuzuma, bityo abo babiri bamaranye amasaha agera kuri 9 n’iminota 40. Hagati aho, mu masaha umunani kugeza ku masaha 9,

• Umutwaro wa ikoranabuhanga uracyari hafi 18 kW. Udupira duto. Imiterere itandukanye y'inyubako

Muri uru rugero, igihe cyo gukora resipi cyagabanutse kuva ku masaha 18 kugera ku masaha 9, cyangwa amasaha 9 buri rimwe, amasaha 72 mu masaha umunani. Abarangije bwa mbere bavuye kuri 5 kuri 8 bagera kuri 8 kuri 8. Abashoferi bavuye kuri 7 kuri 8 bagera kuri 0 kuri 8. Uwo mubare wa nyuma ni wo uvuga niba baraguze accelerators cyangwa paperweights. Ntibazavuga ko impinduka y'igihe ari ukwizigamira 50% mu musaruro. Amasaha umunani ni make kandi yoroshye.

Iyi mibare ni urugero rw'igereranya rishingiye ku ikizamini cyavuzwe, icyitegererezo gito, icyitegererezo kimwe, n'icyumba kimwe cy'imvange. Si PUE, si megawati ya kaminuza, kandi si gihamya y'uko Kestrel igomba kubaka ahantu ho guhugura mu murima. Isuzuma ry'ibiti byari mu masaha 9; ntibabihishe. Ingano ya 18 kW ni ishusho ya PDU yuzuye, si inyemezabwishyu y'ibigo. Ntibahinduye amasaha 72 mo ikiguzi, kuko igiciro cy'amashanyarazi cyavanzwe n'uruganda cyari kuba ikimenyetso cy'ubucuruzi bw'impimbano.

Sheki yo gutanga yari itandukanye kandi nto: amashusho 200 y'umurongo ugana ku gasanduku kari gakingiwe uruzitiro, yose ari aho hantu. Ibyo ni ukumenya, ntabwo ari imyitozo. Kuvanga byombi byari kuba ikosa rya hybrid-hall muri miniature.

Ni iki gishobora kugenda nabi

• Gutanga serivisi bikomeje guhamagara seriveri enye "ikigo cy'amakuru cya AI". Ikirango gihisha amakuru y'amazi, kandi kugura gukurikiraho ni GPU nyinshi kuri icyo gice kimwe cy'uburwayi

• Imashini zihinduranya inzugi z'inyuma zinjira kandi nta muntu ushyira amazi ku ruhande rw'amazi. Abafana baracyavuza induru. Amasaha aracyamanuka

• Igitambaro ni switch imwe nta nzira y'inyongera. Ihuza rimwe ryangiritse kandi "cluster" ni workstation enye nanone

• Aho kugenzura biguma kuri SAN kuko pisine ya NVMe yari "icyiciro cya kabiri". Icyiciro cya kabiri ntikigera mbere y'aho agace kapfuye gakurikira kaba katageze

• Batanga PUE ku birango bibiri biri mu cyumba kivanze. Ikirere, umupaka, n'ibindi bice by'umurongo wa ERP bituma icyo gipimo kiba igikoresho cy'imyambarire

• Guhugura no gutanga bisangira umwenda. Igenzura rimaze kuzura rituma umurongo w'uruganda utegereza. Gutinda ku mubyimba ni umusaruro uhari, ntabwo ari ubucucike

• Node irapfa maze umuntu ayifata nk'itike yo gukora akazi aho kuyisubiza inyuma. Abashinzwe ikoranabuhanga n'abashinzwe gukoresha ikoranabuhanga rya AI baraganira nyuma y'umugoroba wose

• Bashoboraga gukodesha akazu, ariko amashusho ntashobora kuvamo. Kwibagirwa iyo mbogamizi bibashyira mu kiganiro cy'ibicu bazagomba kuruhuka

Gufata ibintu mu buryo bufatika

Ikigo cy’amakuru cya AI, muri ubu buryo, si ububiko kandi si inyemezabwishyu ya GPU. Ni selile ituma accelerators zirangiza urugendo: ingufu zishobora gufata, ubushyuhe buva, umwenda, aho kugenzura, n'umuntu uri ku murongo iyo ipeti ripfuye. Kestrel ntiyari akeneye campus. Bakeneye racks ebyiri kugira ngo bareke kwiyitirira. Amakipe menshi agomba gukodesha iyo myitwarire. Bake, bafite amakuru y'ibanga n'icyumba gishobora gutwara ubushyuhe, bagomba kubaka selile bakanka iyo slide.

Ibibazo Bikunze Kubazwa

Ikigo cy'amakuru cya AI ni iki?

Ahantu ho kubara hafite ubucucike bwinshi aho ingufu, gukonjesha, itumanaho, n'ububiko bihurizwa hamwe mu mahugurwa no gutanga serivisi z'icyitegererezo, atari imirongo myiza ya seriveri zikoreshwa muri rusange. Yakozwe ku buryo umubare munini w'abakoresha accelerator bashobora guhugura no gutanga serivisi z'abakoresha accelerator badashonga, badahagaze kuri network, cyangwa ngo bategereze kuri disiki. Inzu isanzwe y'ubucuruzi ni akarere kavanze. Inzu y'ubuhanga bwo gukora accelerator ni ubuhinzi bumwe bufite agaciro kabwo, nka GPU cyangwa chips zo mu bwoko bwa TPU. Isa n'ububiko kandi ikora nk'imashini ikora imibare.

Ni gute ikigo cy'amakuru cya AI gitandukanye n'ikigo gisanzwe cy'amakuru?

Inzu gakondo zikora neza ku bw'imirimo ivanze n'amasaha yo gukora muri serivisi nyinshi nto. Imbuga za AI zihindura ikigereranyo: ubucucike buriyongera, umuyoboro uhinduka ikintu akazi k'amahugurwa kadashobora gucika, kandi ububiko bugomba gutuma igenzura rikomeza kugenda cyangwa accelerators zikaguma gusa. Abashinzwe ubucuruzi batekereza ku matike no guhindura amadirishya. Abashinzwe ikoranabuhanga batekereza ku murongo w'akazi n'ibyiyumvo byo kubabara iyo node ipfuye nyuma y'igihe kirekire. Ushobora guhamagara ibigo byombi by'amakuru. Ikirango gihisha gusa amazi.

Kuki ibigo by'ikoranabuhanga bya AI bikoresha ingufu nyinshi?

Ibikoresho bidasanzwe si CPU y'ubwenge. Ni agasanduku k'umuvuduko: GPU cyangwa izindi chips za AI, zipakiye muri seriveri, hanyuma racks, hanyuma imirongo isangiye umwenda munini. Ubucucike kuri racks ni bwo buryo bwo guhindura imiterere: racks nke, buri imwe ikaba itanura rito. Megawatts z'umutwaro wa IT zigaragara iyo hall yuzuye, nubwo guhanga ishusho isanzwe atari ngombwa. Ikintu kidashoboka akenshi ni substation, ntabwo ari urutonde rw'ibyo GPU zifuza.

Ni gute ibigo by'amakuru bya AI bikonjeshwa?

Ibikoresho by'amashanyarazi bigabanya ubushyuhe mu buryo umwuka utigeze usabwa gufata. Ushobora gusunika umwuka cyane ukoresheje ibikoresho byo guhererekanya ubushyuhe by'inyuma, inzira zishyushye, n'uburyo bwo kubika amazi neza. Hanyuma amazi agaragara: gukonjesha mu buryo butaziguye, imiyoboro ikora neza, no kwinjizwa mu buryo butandukanye. Ak'a ...

Kuki gukoresha interineti ari ingenzi kimwe na GPU?

Imyitozo ni ikiganiro: ibihumbi by'ibikoresho bihuzwa n'imivuduko, ibipimo, n'uduce tw'icyitegererezo mu buryo buhuye neza. Iyo imyenda ihutiye, akazi kose gategereza buhoro cyane. Niyo mpamvu AI halls ikunda cyane gukoresha bandwidth nyinshi, latency iri hasi, imyenda ya InfiniBand cyangwa Ethernet mu mwanya umwe, hamwe na topolojia zidacikamo kabiri iyo umurongo unaniwe. Inference yita ku latency yo ku mugongo, ubusabe bwinshi buto, no kwitandukanya. Muri iyi nyubako, amazi ni resitora.

Ikigo cy'amakuru cya AI gikoreshwa mu buhe buryo: amahugurwa cyangwa gusesengura?

Amahugurwa ni ubukangurambaga: guteranya itsinda, kuriha amakuru, kugenzura mu buryo bw'ibanga, no gukora amasaha cyangwa ibyumweru. Gusobanura ni ahantu hatandukanye: abashushanya bamaze gutozwa, ubu basubiza ibibazo, hamwe n'igihe gito cy'akazi. Amashuri akurikirana ingufu, ubutaka, n'ubucucike bw'abantu. Ahantu hahurira abantu benshi hakurikirana igihe gito n'igihe cyo kubana. Ahantu hahurira abantu benshi habaho kuko imari shingiro atari umupaka, rimwe na rimwe hari aho hantu hafite imiyoboro ibiri yo gukonjesha. Imashini ishaje gato hafi y'umukiriya ishobora gutsinda iy'akataraboneka iri ku mugabane.

Kuki ububiko ari ingenzi mu kigo cy’amakuru cya AI?

Amakuru y’amahugurwa agomba kugera vuba ku buryo GPU zitakora ku birenge byazo. Aho kugenzura bigomba kugwa kugira ngo impanuka idahita ishira icyumweru. Ibiremereye bya moderi bigomba gupakira mbere yuko kopi itangwa ibaho. Uburyo bwo kubika, atari ubushobozi gusa, ni bwo nzitizi ituje. Ushobora gutakaza amafaranga menshi kuri accelerators hanyuma ukayicisha inzara ukoresheje uburyo bwiza bwagenewe imashini zikoresha ikoranabuhanga.

Bigenda bite iyo urugingo rupfuye hagati mu gihe cyo gukora?

Umuvuduko umwe upfuye mu myitozo ifatanye neza ushobora guhagarika korali yose. Imyitozo isaba ahantu ho kugenzura, ntabwo ari icyizere. Inference igabanya umubare w'abarwaye, igakomeza gusubiza kopi, kandi igakomeza kubaho. Amadirishya yo guhinduranya aracyahura n'uburyo imyitozo itita ku ngengabihe yawe. Gusubiramo biracyari ingenzi ku ngufu, gukonjesha, inzira, no kubika, ariko uburyo bwo gutsindwa ntibumeze neza nk'uburyo bwa kera bwo gusimbuka.

Ni izihe ngaruka Ikigo cy’Itangazamakuru cya AI gikora ku muyoboro w’amashanyarazi, amazi n’abaturanyi?

Guhuza imiyoboro y'amashanyarazi akenshi ni bwo buryo nyabwo bwo guhitamo aho hantu. Ubutaka bworoshye ugereranije n'aho ukoresha amashanyarazi n'ikigo gifite abandi bakiriya. Amazi yo gukonjesha, iyo uyakoresheje, aba ikibazo cy'abaturanyi igihe imvura iguye nabi, hamwe n'urusaku, ubushyuhe bwinshi, n'ubushyuhe ku ruzitiro rw'umupaka. Amahugurwa ashobora kwihisha mu masoko y'amashanyarazi ahendutse no mu kirere gikonje. Inference ikunda kuba hafi y'abakoresha. Nta hantu heza hahari. Hariho ubwumvikane n'itangazo rigenewe abanyamakuru.

Ese ngomba gutunga ikigo cy’amakuru cya AI, cyangwa ngomba gukodesha?

Abantu benshi ntibakeneye gutunga imwe muri izi nzu. Abakora ibikoresho byo mu rwego rwo hejuru bubaka kubera ko ibicuruzwa ari byo bikorerwa mu modoka. Laboratwari zubaka iyo igihe cyo gufatirwa ku murongo ari ikibazo cyangwa amakuru adashobora gusohoka. Banki, ibitaro, leta, cyangwa uruganda rufite amakuru y’ibanga rushobora gutuma ahantu habigenewe haba hakiri kare cyangwa ahantu hihariye ho gukodesha. Abandi bose bagomba gukodesha: ahantu hateguwe na AI, ahantu ho kubika amakuru mu bicu, cyangwa ahantu hacungwa. Ubona accelerators utarinze kuba umukoresha w’ingufu.

Amareferensi

1. IEA - www.iea.org

2. LBNL - ikigo cy'amakuru.lbl.gov

3. Urusobe rw'icyatsi kibisi - www.thegreengrid.org

4. LBNL - ikigo cy'amakuru.lbl.gov

5. LBNL - ikigo cy'amakuru.lbl.gov

6. Ikigo cya Uptime - journal.uptimeinstitute.com

7. NVIDIA - developer.nvidia.com

8. NVIDIA - docs.nvidia.com

9. NVIDIA - docs.nvidia.com

10. NVIDIA - docs.nvidia.com

11. Google Cloud - docs.cloud.google.com

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe