AI绠楀姏鏈嶅姟鍣細鏍稿績鐗圭偣涓庡疄鎴樺簲鐢ㄦ寚鍗?/p>

鍦ㄤ汉宸ユ櫤鑳芥妧鏈垎鍙戠殑鏃朵唬锛孉I绔彛鐨勭畻鍔涙湇鍔″櫒宸叉垚涓洪┍鍔ㄦ繁搴﹀涔犮€佸浘鍍忚瘑鍒€佽嚜鐒惰瑷€澶勭悊绛変换鍔＄殑鏍稿績寮曟搸銆傛湰鏂囧皢绯荤粺瑙ｆ瀽鍏舵牳蹇冪壒鎬э紝骞舵墜鎶婃墜鏁欎綘濡備綍楂樻晥浣跨敤杩欎簺鈥滅畻鍔涙€吔鈥濄€?/p>

馃敡 涓€銆丄I绔彛绠楀姏鏈嶅姟鍣ㄧ殑浜斿ぇ鏍稿績鐗圭偣

鎬吔绾ц绠楄姱鐗?/p>

鎼浇NVIDIA GPU锛堝A100/V100锛夋垨AMD EPYC CPU锛屼笓涓哄苟琛岃绠椾紭鍖栥€備互NVIDIA A100涓轰緥锛屽叾6912涓狢UDA鏍稿績鍜?0GB HBM2鏄惧瓨锛屽彲璁╁鏉傜畻娉曡缁冮€熷害鎻愬崌10鍊嶄互涓娿€侳PGA锛堢幇鍦哄彲缂栫▼闂ㄩ樀鍒楋級鍒欐敮鎸佺‖浠剁骇瀹氬埗鍖栧姞閫燂紝鐏垫椿閫傞厤涓嶅悓AI浠诲姟銆?/p>

娴烽噺瀛樺偍涓庨棯鐢佃鍐?/p>

鏍囬厤1TB浠ヤ笂DDR4鍐呭瓨锛屾惌閰峃VMe SSD鍥烘€佺‖鐩橈紙璇诲彇閫熷害楂樿揪3.5GB/s锛夛紝杞绘澗搴斿鐧句嚎绾у弬鏁版ā鍨嬬殑鍔犺浇闇€姹傘€傚垎甯冨紡瀛樺偍鏂规锛堝HDFS锛夎繘涓€姝ユ墿灞曞閲忥紝纭繚鏁版嵁鍚炲悙鏁堢巼銆?/p>

鏁版嵁鍚炲悙鈥滈珮閫熷叕璺€?/p>

閰嶅100GbE浠ュお缃戞垨InfiniBand缃戠粶鎺ュ彛锛屽欢杩熶綆浜?寰锛汸CIe 4.0/5.0鎬荤嚎甯﹀杈?4GB/s锛屽交搴曟秷闄ゆ暟鎹紶杈撶摱棰堛€傜浉杈冧紶缁熸湇鍔″櫒锛岃缁冩暟鎹姞杞芥椂闂寸缉鐭?0%浠ヤ笂銆?/p>

寮规€ф墿灞曟灦鏋?/p>

鏀寔鐑彃鎷擥PU鍜孭CIe鎵╁睍妲斤紝鍙伒娲诲鍔燗I鍔犻€熷崱锛堝TPU銆丠abana Gaudi锛夈€傚鑺傜偣闆嗙兢鑳藉姏鍏佽妯悜鎵╁睍鑷充笂鍗冨彴鏈嶅姟鍣紝婊¤冻鍗冧嚎鍙傛暟澶фā鍨嬭缁冮渶姹傘€?/p>

鏅鸿兘鑳借€楃鎺?/p>

娑插喎鎶€鏈紙鏁ｇ儹鏁堢巼姣旈鍐烽珮30%锛?鍔ㄦ€佺數鍘嬭皟鑺傦紙DVFS锛夛紝鍔熻€楅檷浣?0%鐨勫悓鏃朵繚鎸?9.9%绋冲畾鎬с€傜數婧愯浆鎹㈡晥鐜囪揪95%浠ヤ笂锛屽勾鐪佺數璐硅秴20涓囧厓锛堜互10鍙版湇鍔″櫒闆嗙兢璁★級銆?/p>

馃洜锔?浜屻€佸叚姝ヤ笂鎵嬶細浠庨儴缃插埌璋冧紭鍏ㄦ祦绋?/p>

Step 1锛氱‖浠堕厤缃笌瀹夎

閫夊瀷寤鸿锛氫腑灏忓瀷浼佷笟鍙€夋埓灏擯owerEdge锛堟敮鎸?-8鍧桮PU锛夛紝绉戠爺鏈烘瀯鎺ㄨ崘NVIDIA DGX A100锛堥泦鎴?棰桝100 GPU锛夈€?/p>

鍏抽敭姝ラ锛?/p>

RAID閰嶇疆锛氳嚦灏?鍧桽AS纭洏缁凴AID 5锛屾彁鍗囨暟鎹畨鍏ㄦ€т笌璇诲啓閫熷害銆?/p>

鏁ｇ儹淇濋殰锛氬畨瑁呮恫鍐锋ā鍧楋紝纭繚GPU娓╁害缁存寔鍦?0鈩冧互涓嬨€?/p>

Step 2锛氳蒋浠剁幆澧冩惌寤?/p>

鎿嶄綔绯荤粺锛歎buntu Server 20.04 LTS锛堝NVIDIA CUDA鍏煎鎬ф渶浣筹級銆?/p>

椹卞姩涓庢鏋讹細

# 瀹夎CUDA 12.1鍙奵uDNN 8.9

sudo apt install nvidia-cuda-toolkit

pip install tensorflow-gpu==2.10 pyTorch==1.12 # 涓绘祦AI妗嗘灦鏀寔[4](@ref)[9](@ref)

瀹瑰櫒鍖栭儴缃诧細閫氳繃Docker+Kubernetes绠＄悊澶氫换鍔★紝璧勬簮鍒╃敤鐜囨彁鍗?0%銆?/p>

Step 3锛氭€ц兘鍘嬫Θ鎶€宸?/p>

妯″瀷浼樺寲锛氶噰鐢ㄩ噺鍖栵紙FP32鈫扞NT8锛変笌鍓灊鎶€鏈紝妯″瀷浣撶Н鍘嬬缉70%锛屾帹鐞嗛€熷害缈诲€嶃€?/p>

璧勬簮璋冨害锛欿ubernetes鑷姩鍒嗛厤GPU璧勬簮锛屼换鍔℃帓闃熷欢杩熶笅闄?0%銆?/p>

鐩戞帶宸ュ叿锛歅rometheus+Grafana瀹炴椂鐩戞祴GPU鍒╃敤鐜囷紙鐩爣锛?5%锛夈€?/p>

Step 4锛氬畨鍏ㄥ姞鍥虹瓥鐣?/p>

闃茬伀澧欒鍒欙細浠呭紑鏀維SH锛堢鍙?2锛夊拰API鏈嶅姟绔彛锛堝8000锛夈€?/p>

鏁版嵁鍔犲瘑锛氬惎鐢═LS 1.3浼犺緭鍔犲瘑锛岀粨鍚堝畾鏈熷浠借嚦寮傚湴瀛樺偍锛堝AWS S3锛夈€?/p>

Step 5锛氭暟鎹鐞嗘祦姘寸嚎

graph TD

A[鏁版嵁閲囬泦] --> B[娓呮礂/鏍囨敞] --> C[鍒嗗竷寮忓瓨鍌╙ --> D[妯″瀷璁粌] --> E[楠岃瘉閮ㄧ讲]

浣跨敤Apache Parquet鏍煎紡瀛樺偍鏁版嵁锛孖/O鏁堢巼鎻愬崌40%銆?/p>

鑷姩鏍囨敞宸ュ叿锛堝CVAT锛夊噺灏戜汉宸ユ爣娉ㄦ垚鏈?0%銆?/p>

Step 6锛氱淮鎶や笌鍗囩骇

纭欢杩唬锛氭瘡2骞村崌绾PU锛堝V100鈫扝100锛夛紝绠楀姏鎻愬崌4鍊嶃€?/p>

杞欢鏇存柊锛氭瘡鏈堟鏌UDA鍜屾鏋剁増鏈紝鍙婃椂淇ˉ婕忔礊銆?/p>

馃拵 缁撹锛欰I绠楀姏鏈嶅姟鍣ㄧ殑浠峰€奸棴鐜?/p>

浠庣‖浠堕€夊瀷鍒版ā鍨嬮儴缃诧紝AI绔彛绠楀姏鏈嶅姟鍣ㄩ€氳繃寮傛瀯璁＄畻鏋舵瀯銆佸脊鎬ф墿灞曡璁″強鏅鸿兘鑳借€楁帶鍒讹紝绯荤粺鎬цВ鍐充簡AI浠诲姟涓殑绠楀姏鐡堕銆傛棤璁烘槸璁粌鐧句嚎鍙傛暟澶фā鍨嬶紝杩樻槸閮ㄧ讲杈圭紭鎺ㄧ悊鑺傜偣锛屽悎鐞嗚繍鐢ㄨ繖浜涒€滅畻鍔涘紩鎿庘€濓紝鍙樉钁楃缉鐭」鐩懆鏈燂紝闄嶄綆璇曢敊鎴愭湰銆傛帉鎻″叾鐗规€т笌鎿嶄綔鏂规硶锛屽凡鎴愪负AI浠庝笟鑰呬笉鍙垨缂虹殑鏍稿績鎶€鑳姐€?/p>