涓€銆佷骇鍝佺畝浠?/span>
tipdm鏁版嵁鎸栨帢寤烘ā骞冲彴鏄敱骞夸笢娉拌开鏅鸿兘绉戞妧鑲′唤鏈夐檺鍏徃鑷富鐮斿彂鎵撻€犵殑鍙鍖栥€佷竴绔欏紡銆侀珮鎬ц兘鐨勬暟鎹寲鎺樹笌浜哄伐鏅鸿兘寤烘ā鏈嶅姟骞冲彴锛?/span>鑷村姏浜?/span>涓轰娇鐢ㄨ€呮墦閫氫粠鏁版嵁鎺ュ叆銆佹暟鎹澶勭悊銆佹ā鍨嬪紑鍙戣缁冦€佹ā鍨嬭瘎浼版瘮杈冦€佹ā鍨嬪簲鐢ㄩ儴缃插埌妯″瀷浠诲姟璋冨害鐨勫叏閾捐矾銆?/span>骞冲彴鍐呯疆涓板瘜鐨勬満鍣ㄥ涔犮€佹繁搴﹀涔犮€佷汉宸ユ櫤鑳界畻娉曪紝鍙鐩栫被鍒垝鍒嗐€佸晢鍝佹帹鑽愩€佽秼鍔块娴嬨€佹枃鏈鐞?/span>銆?/span>鍥惧儚澶勭悊绛夊簲鐢ㄥ満鏅紝蹇€熴€佺簿鍑嗗姪鍔涘ぇ鏁版嵁鍜屼汉宸ユ櫤鑳戒负浜т笟杞瀷鍗囩骇璧嬭兘锛?/span>
浜屻€佷骇鍝佸姛鑳?/span>
1銆佸彲瑙嗗寲寤烘ā锛岄浂缂栫爜浣庨棬妲涜交鏉句笂鎵?/span>
鏀寔閫氳繃鎷栨媺鎷芥柟寮忔嫾鎺ョ畻娉曠粍浠跺揩閫熸惌寤烘暟鎹寲鎺樻垨浜哄伐鏅鸿兘娴佺▼锛屼氦浜掗厤缃畻娉曠粍浠跺弬鏁帮紝浠ラ浂缂栫爜妯″紡瀹炵幇涓氬姟閫昏緫锛屾瀬澶у湴闄嶄綆鏁版嵁鎸栨帢鍜屼汉宸ユ櫤鑳藉簲鐢ㄧ殑鎶€鏈棬妲涖€傜晫闈㈠弸濂斤紝绠€鍗曠洿瑙傦紝杞绘澗涓婃墜銆?/span>
2銆佷竴绔欏紡鏈嶅姟锛屾墦閫氣€滄暟鎹埌妯″瀷锛屾ā鍨嬪埌搴旂敤鈥濆叏閾捐矾
鏀寔crisp-dm鏁版嵁鎸栨帢鏍囧噯娴佺▼锛屽姛鑳戒竴绔欏紡瑕嗙洊鏁版嵁鎺ュ叆銆佹暟鎹澶勭悊銆佺壒寰佸伐绋嬨€佹ā鍨嬭缁冭皟璇曘€佹ā鍨嬭瘎浼版瘮杈冦€佹ā鍨嬪簲鐢ㄩ儴缃茬殑寤烘ā鍏ㄦ祦绋嬶紝瀹炵幇鏁版嵁鍒版ā鍨嬪簲鐢ㄥ悇鐜妭涓暟鎹繛鎺ャ€佹暟鎹簮銆佺畻娉曠粍浠躲€佸伐绋嬨€佹ā鍨嬨€佽皟搴︿换鍔＄粺涓€闆嗕腑绠＄悊锛屾湁鍔╀簬蹇€?/span>鎸栨帢鏁版嵁浠峰€笺€?/span>
3銆佸叏鍦烘櫙绠楁硶锛屽吋澶囨枃鏈浘鍍忓鐞嗚兘鍔?/span>
闄や紶缁熸垚鐔熺殑鏈哄櫒瀛︿範绠楁硶澶栵紝骞冲彴杩樺唴缃赴瀵岀殑鑷劧璇█澶勭悊鍜屽浘鍍忓鐞嗛鍩熺畻娉曪紝word2vec銆佹枃鏈敓鎴愩€佸浘鍍忚瘑鍒瓑婊¤冻鍚勭被缁嗗垎鍦烘櫙涓庡簲鐢ㄦ柟鍚戙€傚悓鏃舵敮鎸佷娇鐢ㄨ€呰嚜瀹氫箟绠楁硶锛屽叿澶囧己澶х殑鐏垫椿鎬у拰鎷撳睍鎬с€?/span>
4銆佸崗鍚屽叡浜紝璧勬簮浜掗€氫簰鐢?/span>
鏀寔澶氱鎴枫€佸瑙掕壊鏉冮檺绠＄悊銆傚浜庝紭绉€鐨勬暟鎹€佸缓妯℃祦绋嬬瓑璧勬簮锛屾敮鎸佷竴閿叡浜嚦鎸囧畾鐢ㄦ埛鎴栧叕鍏辩┖闂达紝渚夸簬鎻愬崌璧勬簮浼樺寲閰嶇疆銆?/span>浼樼璧勬簮鍙竴閿?/span>fork杩涜浼樺寲锛屽姪鎮ㄧ珯鍦ㄥ法浜虹殑鑷傝唨涓娿€?/span>
5銆佸璁＄畻寮曟搸涓庢贩鍚堝紡缂栨帓锛屽疄鐜拌法璇█鐨勬ā鍨嬪紑鍙?/span>
搴曞眰绠楁硶寮€鍙戞敮鎸?/span>r銆?/span>python銆?/span>spark绛夊绉嶈绠楀紩鎿庯紝骞冲彴鐙垱澶氳绠楀紩鎿?/span>娣峰悎缂栨帓锛?/span>鎻愪緵瀹炴椂璁＄畻銆佺绾垮垎鏋愩€佹満鍣ㄥ涔犵畻娉曘€佷汉宸ユ櫤鑳界畻娉曚簰鐩歌皟鐢ㄨ兘鍔?/span>锛屽彲瀹炵幇涓€浣撳寲銆佽法璇█鐨勬ā鍨嬪紑鍙戙€?/span>
6銆佸鍏冩暟鎹氦浜掞紝鎻愬崌搴旂敤浠峰€?/span>
鏀寔澶氭柟寮忓绫诲瀷鐨勬暟鎹緭鍏ヨ緭鍑猴紝鍖呮嫭鍚勭被鏁版嵁搴撱€佹帴鍙ｆ枃浠跺拰鏁版嵁鏂囦欢绛夛紝瀹炵幇浼佷笟鍚勭被鏁版嵁缁熶竴鎺ュ叆涓庣鐞嗭紝涓烘ā鍨嬪紑鍙戝拰搴旂敤濂犲畾鍧氬疄鐨勬暟鎹熀纭€銆?/span>
涓夈€佷骇鍝佷紭鍔?/span>
1銆?/span>寰湇鍔℃灦鏋?/span>锛?/span>鏃犳劅鐭ュ姩鎬佽皟鏁?/span>
鍩轰簬寰湇鍔℃灦鏋勶紝褰撻鐭ユ煇涓湇鍔″疄渚嬪彲鑳戒細鏈夊帇鍔涙椂锛屽彲浠ラ€氳繃澶氬紑鍑犱釜鏈嶅姟瀹炰緥鏉ュ鍔犵郴缁熺殑骞跺彂閲忥紝鍏ㄧ▼鏃犻渶鍋滄湇鍔★紝缁欑敤鎴锋洿濂界殑浣撻獙锛涘噺閰嶅彲閲囩敤鍚屾牱鐨勬搷浣溿€傛湇鍔¤祫婧愬彲鍔ㄦ€佷几缂╋紝涓烘偍鐨勯挶鍖呯簿鎵撶粏绠椼€?/span>
2銆佸ぇ鏁版嵁鏋舵瀯鍜孏pu璁＄畻锛岄珮鎬ц兘绠楀姏
鍩轰簬澶ф暟鎹灦鏋勶紝鏀寔鍒嗗竷寮忓瓨鍌ㄣ€佸垎甯冨紡骞惰璁＄畻銆佸唴瀛樿绠楋紝鏀寔gpu璁＄畻锛屾敮鎸佹湇鍔″櫒璁＄畻鑺傜偣姘村钩鎵╁睍锛屽疄鐜版捣閲忔暟鎹殑楂樻晥鍒嗘瀽澶уぇ鎻愰珮鏈嶅姟鍣ㄧ殑鍙潬鎬у拰骞跺彂鎬ц兘銆?/span>
3銆佺伒娲婚儴缃?/span>鏂瑰紡锛?/span>涓烘偍閲忚韩鎵撻€?/span>
鎮ㄥ彲鏍规嵁涓氬姟闇€瑕?/span>閫夋嫨妯″瀷璋冪敤鏂瑰紡锛屽寘鍚紓姝ャ€佸悓姝ョ瓑锛?/span>骞冲彴鏀寔绉佹湁鍖栥€佸湪绾?/span>銆?/span>绉熺敤绛夊绉?/span>妯″紡锛?/span>涔熷彲涓烘偍閲忚韩鎵撻€?/span>銆?/span>
4銆佸畾鍒跺紑鍙戜笌琛屼笟瑙ｅ喅鏂规锛屽紑鏀惧悎浣滄ā寮?/span>
骞冲彴鎻愪緵浜у搧鍚勫姛鑳芥ā鍧楃殑api浜屾寮€鍙戞帴鍙ｏ紝婊¤冻浜у搧鐨勪簩娆″紑鍙戦渶姹傦紱鍚屾椂鏀寔澶氭牱鍖栥€佸紑鏀剧殑鍚堜綔妯″紡锛屽寘鎷絾涓嶉檺浜庡畾鍒跺寲寮€鍙戙€佹彁渚涗互骞冲彴涓哄熀纭€鐨勪俊璁裤€佺數鍔涖€佸箍鐢点€佷氦閫氳繍杈撶瓑琛屼笟瑙ｅ喅鏂规绛夈€?/span>
鍥涖€佸簲鐢ㄤ环鍊?/span>
1銆佷紒涓氬簲鐢?/span>
骞冲彴鍙綔涓烘暟鎹寲鎺樻ā鍨嬬爺绌跺伐鍏风嫭绔嬩娇鐢紱涔熷彲浠ユ槸浼佷笟澶ф暟鎹簲鐢ㄤ腑鐨勪竴閮ㄥ垎锛屼綔涓哄師濮嬫暟鎹笌鍙鍖栧睍绀虹殑杩炴帴妗ユ锛屽師濮嬫暟鎹粡杩囨湰骞冲彴棰勫鐞嗐€佸缓妯°€侀娴嬪悗锛屽湪搴旂敤绯荤粺涓睍绀猴紱涔熷彲浠ヤ綔涓烘暟鎹寲鎺樼畻娉曞紩鎿庝緵绗笁鏂硅繘琛岃皟搴︿娇鐢ㄣ€?/span>骞冲彴鍐呯疆涓板瘜鏁版嵁鍔犲伐銆佹満鍣ㄥ涔犮€佹繁搴﹀涔犲拰浜哄伐鏅鸿兘绠楁硶锛屾敮鎸佸垎甯冨紡瀛樺偍銆佸垎甯冨紡骞惰銆?/span>gpu璁＄畻锛屽彲涓轰紒涓氫笉鍚屽満鏅簲鐢ㄦ彁渚涢珮鏁堢殑妯″瀷寮€鍙戝拰璁＄畻鑳藉姏锛屽疄鐜颁骇涓氬揩閫熻祴鑳姐€?/span>
搴旂敤琛屼笟涓庡満鏅細鏅烘収淇¤锛堝疄浣撴彁鍙栥€佸唴瀹瑰垎绫汇€佽嚜鍔ㄦ憳瑕?/span>銆?/span>棰勬祴銆佹帹鑽?/span>锛夈€佸箍鐢佃惀閿€锛堜骇鍝佹帹鑽愩€佺敤鎴风敾鍍忋€佸鎴峰垎缇わ級銆佺數鍔涳紙寮傚父璇婃柇銆佹晠闅滃畾浣嶃€佷骇鑳介娴嬶級銆佷氦閫氳繍杈撳畨鍏紙琛屼负璇嗗埆銆佹€ц兘璇勪及銆佽川閲忕洃鎺э級锛堥摼鎺ュ埌鍏徃浼佷笟搴旂敤鐨勭晫闈簡瑙ｈ鎯咃級
瀹㈡埛娓呭崟锛氬寳浜競淇¤鍔炪€佺彔姹熸暟鐮侀泦鍥€佸箍宸炰緵鐢靛眬銆佷氦閫氳繍杈撻儴鍏矾绉戝鐮旂┒闄?/span>
2銆佺鐮?/span>
骞冲彴璁粌鍑虹畻娉曟ā鍨嬶紝鍦ㄦ柊鐨勮绠楅」鐩腑浣跨敤宸茬粡璁粌濂界殑妯″瀷杩涜鏁版嵁棰勬祴锛屽舰鎴愪竴娆¤缁冨娆′娇鐢ㄧ殑绠楁硶瀹炵幇銆傚钩鍙板唴缃簡澶ч噺鐨勮涓氭渚嬪拰鏁版嵁闆嗭紝涔熷彲浠ヨ嚜琛屼笂浼犳暟鎹泦锛屼负绉戠爺宸ヤ綔鎻愪緵浼樿川鐨勬暟鎹祫婧愩€傚钩鍙板唴缃ぇ閲忓彲瑙嗗寲灞曠ず妯″紡锛屽彲鎸変娇鐢ㄨ€呰姹傚睍绀哄ぇ鏁版嵁涔嬬編锛屽苟鍙敓鎴愰珮璐ㄩ噺鍥剧墖鏂囦欢锛屼繚瀛樺埌鏈湴鍚庤鐢ㄤ簬绉戠爺鎶ュ憡鍜岃鏂囩瓑銆?/span>骞冲彴閬垮厤鏋嚗鐨勭畻娉曠紪鐮佽繃绋嬶紝鎻愪緵浜嗘槗涓婃墜鐨勬暟鎹瀛﹁缁冨拰姒傚康鍙鍖栫壒鎬э紝鏀寔绠楁硶鍙傛暟鐏垫椿璋冧紭銆佹ā鍨嬭瘎浼版瘮杈冦€佹祦绋嬭嚜鍔ㄥ寲杩愯锛屾槸鏁版嵁鎸栨帢棰嗗煙鐩稿叧绉戝鐮旂┒鏈烘瀯銆侀珮鏍＄瓑浠庝笟浜哄憳杩涜绉戝鐮旂┒鐨勪竴鎶婂埄鍣ㄣ€?/span>
鍚堜綔鍗曚綅锛?/span>涓浗鐢靛姏绉戝鐮旂┒闄€佸箍涓滅數鍔涚瀛︾爺绌堕櫌銆佸箍瑗跨數鍔涚瀛︾爺绌堕櫌銆佺彔姹熸按浜х爺绌舵墍銆侀粍娴锋按浜х爺绌舵墍銆佸寳浜競绉戝鎶€鏈爺绌堕櫌璧勬簮鐜鐮旂┒鎵€
璇曠敤閾炬帴锛?a href="https://python.tipdm.org" target="_blank">https://python.tipdm.org