{"id":88606,"date":"2024-11-07T16:31:16","date_gmt":"2024-11-07T08:31:16","guid":{"rendered":"https:\/\/www.ioiotimes.com\/?p=88606"},"modified":"2024-11-07T16:31:18","modified_gmt":"2024-11-07T08:31:18","slug":"amd-ryzen-ai-300%e7%b3%bb%e5%88%97%e8%99%95%e7%90%86%e5%99%a8%e9%87%8b%e6%94%be%e6%b6%88%e8%b2%bb%e7%b4%9a%e5%a4%a7%e5%9e%8b%e8%aa%9e%e8%a8%80%e6%a8%a1%e5%9e%8b%e7%9a%84%e5%b7%94%e5%b3%b0","status":"publish","type":"post","link":"https:\/\/www.ioiotimes.com\/?p=88606","title":{"rendered":"AMD Ryzen\u2122 AI 300\u7cfb\u5217\u8655\u7406\u5668\u91cb\u653e\u6d88\u8cbb\u7d1a\u5927\u578b\u8a9e\u8a00\u6a21\u578b\u7684\u5dd4\u5cf0\u6548\u80fd"},"content":{"rendered":"\n<p>\u8a9e\u8a00\u6a21\u578b\u81ea GPT-2 \u4ee5\u4f86\u5df2\u53d6\u5f97\u5927\u5e45\u9032\u6b65\uff0c\u4f7f\u7528\u8005\u73fe\u5728\u53ef\u4ee5\u85c9\u7531 LM Studio \u7b49\u6d88\u8cbb\u7d1a\u61c9\u7528\u7a0b\u5f0f\u5feb\u901f\u4e14\u8f15\u9b06\u5730\u90e8\u7f72\u9ad8\u5ea6\u8907\u96dc\u7684\u5927\u578b\u8a9e\u8a00\u6a21\u578b\uff08LLM\uff09\u3002\u900f\u904e\u8207 AMD \u5408\u4f5c\uff0c\u9019\u4e9b\u5de5\u5177\u8b93\u6bcf\u500b\u4eba\u90fd\u80fd\u4f7f\u7528\u4eba\u5de5\u667a\u6167\uff08AI\uff09\uff0c\u4e14\u7121\u9700\u4efb\u4f55\u7de8\u78bc\u6216\u6280\u8853\u77e5\u8b58\u3002<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>llama.cpp<\/strong><strong>\u548c<\/strong><strong>LM Studio<\/strong><strong>\u6982\u8ff0<\/strong><strong><\/strong><\/h3>\n\n\n\n<p>LM Studio \u57fa\u65bc llama.cpp \u9805\u76ee\uff0c\u662f\u4e00\u500b\u5ee3\u53d7\u6b61\u8fce\u7684\u6846\u67b6\uff0c\u7528\u65bc\u5feb\u901f\u4e14\u8f15\u9b06\u5730\u90e8\u7f72\u8a9e\u8a00\u6a21\u578b\u3002LM Studio \u6c92\u6709\u76f8\u4f9d\u6027\uff08dependencies\uff09\uff0c\u50c5\u4f7f\u7528 CPU \u5373\u53ef\u9032\u884c\u52a0\u901f\uff0c\u4ea6\u652f\u63f4 GPU \u52a0\u901f\u529f\u80fd\u3002LM Studio \u4f7f\u7528 AVX2 \u6307\u4ee4\u96c6\u4f86\u52a0\u901f\u57fa\u65bc x86 CPU \u7684\u73fe\u4ee3 LLM\u3002<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>\u6548\u80fd\u5c0d\u6bd4\uff1a\u541e\u5410\u91cf\u548c\u5ef6\u9072<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd01.png\" alt=\"\" class=\"wp-image-88609\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd01.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd01-300x169.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd01-768x432.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">\u25b2\u63a1\u7528Zen 5\u67b6\u69cb\u7684AMD Ryzen AI 9 HX 375\u5728\u6d88\u8cbb\u7d1aLLM\u61c9\u7528\u7a0b\u5f0f\u4e2d\u5e36\u4f86\u9ad8\u905427%\u7684\u6548\u80fd\u63d0\u5347<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>AMD Ryzen\u2122 AI \u70ba\u9019\u4e9b\u6700\u5148\u9032\u7684\u5de5\u4f5c\u8ca0\u8f09\u9032\u884c\u52a0\u901f\uff0c\u5728 x86 \u7b46\u96fb\u4e0a\u904b\u884c LM Studio \u7b49\u57fa\u65bc llama.cpp \u7684\u61c9\u7528\u7a0b\u5f0f\u63d0\u4f9b\u9818\u5148\u696d\u754c\u7684\u6548\u80fd<sup>\u8a3b1<\/sup>\u3002\u503c\u5f97\u6ce8\u610f\u7684\u662f\uff0cLLM \u901a\u5e38\u5c0d\u8a18\u61b6\u9ad4\u901f\u5ea6\u975e\u5e38\u654f\u611f\u3002<\/p>\n\n\n\n<p>\u5728\u6211\u5011\u7684\u5c0d\u6bd4\u6e2c\u8a66\u4e2d\uff0cIntel \u7b46\u96fb\u7684 RAM \u5be6\u969b\u4e0a\u901f\u5ea6\u8f03\u5feb\uff0c\u9054\u5230 8533 MT\/s\uff0c\u800c AMD \u7b46\u96fb\u7684 RAM \u70ba 7500 MT\/s\u3002\u5118\u7ba1\u5982\u6b64\uff0cAMD Ryzen\u2122 AI 9 HX 375 \u8655\u7406\u5668\u7684\u6bcf\u79d2 token \u751f\u6210\u901f\u5ea6\uff08tokens per second\uff09\u6bd4\u7af6\u722d\u5c0d\u624b\u5feb\u51fa\u9ad8\u9054 27%\u3002\u53c3\u8003\u8cc7\u6599\u986f\u793a tokens per second (tk\/s) \u662f\u6e2c\u91cf LLM \u8f38\u51fa token \u901f\u5ea6\u7684\u6307\u6a19\uff0c\u5927\u7d04\u5c0d\u61c9\u65bc\u6bcf\u79d2\u5728\u87a2\u5e55\u4e0a\u986f\u793a\u7684\u5b57\u6578\u3002<\/p>\n\n\n\n<p>AMD Ryzen\u2122 AI 9 HX 375 \u8655\u7406\u5668\u5728 Meta Llama 3.2 1b Instruct\uff084-bit\u91cf\u5316\uff09\u4e2d\u53ef\u5be6\u73fe\u6bcf\u79d2\u9ad8\u9054 50.7 \u500b token \u7684\u6548\u80fd\u3002<\/p>\n\n\n\n<p>\u5c0d\u5927\u578b\u8a9e\u8a00\u6a21\u578b\u9032\u884c\u57fa\u6e96\u6e2c\u8a66\u7684\u53e6\u4e00\u500b\u6307\u6a19\u662f\u300c\u8f38\u51fa\u9996\u500b token \u7684\u6642\u9593\uff08time to first token\uff09\u300d\uff0c\u6e2c\u91cf\u5f9e\u63d0\u4ea4\u63d0\u793a\uff08prompt\uff09\u81f3\u6a21\u578b\u958b\u59cb\u751f\u6210 token \u4e4b\u9593\u7684\u5ef6\u9072\u6642\u9593\u3002\u5728\u8f03\u5927\u6a21\u578b\u4e2d\uff0c\u57fa\u65bc AMD \u201cZen 5\u201d \u67b6\u69cb\u7684 Ryzen\u2122 AI HX 375 \u8655\u7406\u5668\u7684\u901f\u5ea6\u76f8\u8f03\u7af6\u722d\u5c0d\u624b\u7684\u540c\u7d1a\u8655\u7406\u5668\u5feb\u51fa\u9ad8\u9054 3.5 \u500d<sup>\u8a3b1<\/sup>\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"575\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd02.png\" alt=\"\" class=\"wp-image-88610\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd02.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd02-300x168.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd02-768x431.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">\u25b2\u63a1\u7528Zen 5\u67b6\u69cb\u7684AMD Ryzen AI 9 HX 375\u5728\u6d88\u8cbb\u7d1aLLM\u61c9\u7528\u7a0b\u5f0f\u4e2d\u5ef6\u9072\u964d\u4f4e\u90543.5\u500d<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>\u5728Windows\u4e2d\u4f7f\u7528\u53ef\u8b8a\u986f\u793a\u8a18\u61b6\u9ad4\uff08VGM\uff09\u4f86\u63d0\u9ad8\u6a21\u578b\u541e\u5410\u91cf<\/strong><\/h3>\n\n\n\n<p>AMD Ryzen\u2122 AI CPU \u4e2d\u7684\u4e09\u500b\u52a0\u901f\u5668\u5404\u81ea\u64c1\u6709\u7279\u5b9a\u7684\u5de5\u4f5c\u8ca0\u8f09\u5c08\u696d\u5316\u548c\u64c5\u9577\u7684\u60c5\u5883\u3002\u57fa\u65bc AMD XDNA\u2122 2 \u67b6\u69cb\u7684 NPU \u5728\u57f7\u884c Copilot+ \u5de5\u4f5c\u8ca0\u8f09\u6642\u70ba\u6301\u7e8c\u7684 AI \u529f\u80fd\u63d0\u4f9b\u5353\u8d8a\u7684\u529f\u8017\u6548\u7387\uff0cCPU \u70ba\u5de5\u5177\u548c\u6846\u67b6\u63d0\u4f9b\u5ee3\u6cdb\u7684\u8986\u84cb\u7bc4\u570d\u548c\u76f8\u5bb9\u6027\uff0c\u800c\u5167\u986f\uff08iGPU\uff09\u901a\u5e38\u6839\u64da\u9700\u6c42\u8655\u7406 AI \u4efb\u52d9\u3002<\/p>\n\n\n\n<p>LM Studio \u63d0\u4f9b llama.cpp \u7684\u9023\u63a5\u57e0\uff08port\uff09\uff0c\u53ef\u4f7f\u7528\u8207\u4f9b\u61c9\u5546\u7121\u95dc\uff08vendor-agnostic\uff09\u7684 Vulkan API \u4f86\u52a0\u901f\u6846\u67b6\u3002\u6b64\u52a0\u901f\u901a\u5e38\u53d6\u6c7a\u65bc\u786c\u9ad4\u529f\u80fd\u548c Vulkan API \u7684\u9a45\u52d5\u7a0b\u5f0f\u6700\u4f73\u5316\u7684\u7d44\u5408\u3002\u8207\u50c5\u4f7f\u7528 CPU \u6a21\u5f0f\u76f8\u6bd4\uff0c\u5728LM Studio \u4e2d\u958b\u555f GPU offload \u5f8c Meta Llama 3.2 1b Instruct \u7684\u6548\u80fd\u5e73\u5747\u63d0\u5347 31%\u3002Mistral Nemo 2407 12b Instruct \u7b49\u8f03\u5927\u6a21\u578b\u5728 token \u751f\u6210\u968e\u6bb5\u7531\u65bc\u53d7\u5230\u983b\u5bec\u9650\u5236\uff0c\u5e73\u5747\u6548\u80fd\u63d0\u5347 5.1%\u3002<\/p>\n\n\n\n<p>\u6211\u5011\u89c0\u5bdf\u5230\u5728 LM Studio \u4e2d\u4f7f\u7528\u57fa\u65bc Vulkan \u7684 llama.cpp \u7248\u672c\u4e26\u958b\u555f GPU offload \u6642\uff0c\u8207\u50c5\u4f7f\u7528 CPU \u7684\u6a21\u5f0f\u76f8\u6bd4\uff0c\u7af6\u722d\u5c0d\u624b\u8655\u7406\u5668\u9664\u4e86\u5176\u4e2d\u4e00\u500b\u6a21\u578b\u5916\uff0c\u5176\u9918\u6e2c\u8a66\u6a21\u578b\u7684\u5e73\u5747\u6548\u80fd\u7686\u660e\u986f\u8f03\u4f4e\u3002\u56e0\u6b64\uff0c\u70ba\u4e86\u4fdd\u6301\u5c0d\u6bd4\u6e2c\u8a66\u7684\u516c\u5e73\u6027\uff0c\u6211\u5011\u6c92\u6709\u5c07 Intel Core Ultra 7 258v \u5728 LM Studio \u4e2d\u4f7f\u7528\u57fa\u65bc Vulkan \u4e4b Llama.cpp \u7684 GPU-offload \u6548\u80fd\u7d0d\u5165\u6bd4\u8f03\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd03.png\" alt=\"\" class=\"wp-image-88611\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd03.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd03-300x169.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd03-768x432.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">\u25b2iGPU\u52a0\u901f\u548cVGM\u63d0\u5347\u6d88\u8cbb\u7d1aLLM\u7684\u6548\u80fd<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>AMD Ryzen\u2122 AI 300 \u7cfb\u5217\u8655\u7406\u5668\u9084\u5305\u62ec\u4e00\u9805\u540d\u70ba\u53ef\u8b8a\u986f\u793a\u8a18\u61b6\u9ad4\uff08VGM\uff09\u7684\u529f\u80fd\u3002\u901a\u5e38\u7a0b\u5f0f\u6703\u5229\u7528\u70ba iGPU \u5206\u914d\u7684 512 MB \u5c08\u7528\u8a18\u61b6\u5340\u584a\uff0c\u4ee5\u53ca\u4f4d\u65bc\u7cfb\u7d71 RAM\u300c\u5171\u4eab\u300d\u90e8\u5206\u7684\u7b2c\u4e8c\u500b\u8a18\u61b6\u5340\u584a\u3002VGM \u8b93\u4f7f\u7528\u8005\u5c07 512 MB \u7684\u300c\u5c08\u7528\u300d\u5206\u914d\u64f4\u5c55\u5230\u9ad8\u9054 75% \u7684\u53ef\u7528\u7cfb\u7d71 RAM \u5bb9\u91cf\u3002\u9019\u7a2e\u9023\u7e8c\u8a18\u61b6\u9ad4\u7684\u5206\u914d\u986f\u8457\u63d0\u5347\u4e86\u5c0d\u8a18\u61b6\u9ad4\u654f\u611f\u61c9\u7528\u7a0b\u5f0f\u7684\u541e\u5410\u91cf\u3002<\/p>\n\n\n\n<p>\u5728\u958b\u555f VGM\uff0816GB\uff09\u5f8c\uff0cMeta Llama 3.2 1b Instruct \u7684\u6548\u80fd\u5e73\u5747\u63d0\u5347 22%\uff0c\u8207\u4f7f\u7528 iGPU \u52a0\u901f\u4e26\u7d50\u5408 VGM \u7684 CPU \u6a21\u5f0f\u76f8\u6bd4\uff0c\u5e73\u5747\u901f\u5ea6\u5171\u63d0\u5347 60%\u3002Mistral Nemo 2407 12b Instruct \u7b49\u66f4\u5927\u6a21\u578b\u76f8\u8f03\u50c5\u4f7f\u7528 CPU \u7684\u6a21\u5f0f\uff0c\u5e36\u4f86\u9ad8\u9054 17% \u7684\u6548\u80fd\u63d0\u5347\u3002<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>\u540c\u6b65\u6bd4\u8f03\uff1a<\/strong><strong>Mistral 7b Instruct 0.3<\/strong><\/h3>\n\n\n\n<p>\u5118\u7ba1\u7af6\u722d\u5c0d\u624b\u7684\u7b46\u96fb\u5728 LM Studio \u4e2d\u4f7f\u7528\u57fa\u65bc Vulkan \u7684 Llama.cpp \u7248\u672c\u6c92\u6709\u63d0\u4f9b\u52a0\u901f\uff0c\u6211\u5011\u4ecd\u4f7f\u7528 Intel AI Playground \u61c9\u7528\u7a0b\u5f0f\uff08\u57fa\u65bc IPEX-LLM \u548c LangChain\uff09\u4f86\u6bd4\u8f03 iGPU \u6548\u80fd\uff0c\u529b\u6c42\u5728\u6700\u4f73\u7684\u6d88\u8cbb\u7d1a LLM \u9ad4\u9a57\u4e4b\u9593\u9032\u884c\u516c\u5e73\u7684\u6bd4\u8f03\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd04.png\" alt=\"\" class=\"wp-image-88612\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd04.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd04-300x169.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd04-768x432.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">\u25b2Mistral 7b Instruct 0.3\u6e2c\u8a66<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>\u6211\u5011\u4f7f\u7528 Intel AI Playground \u63d0\u4f9b\u7684\u6a21\u578b\uff0c\u5373 Mistral 7b Instruct v0.3 \u548c Microsoft Phi 3.1 Mini Instruct\u3002\u5728LM Studio \u4e2d\u4f7f\u7528\u53ef\u6bd4\u8f03\u7684\u91cf\u5316\u5f8c\uff0c\u6211\u5011\u767c\u73fe AMD Ryzen\u2122 AI 9 HX 375 \u5728 Phi 3.1 \u7684\u901f\u5ea6\u6bd4\u7af6\u722d\u5c0d\u624b\u5feb 8.7%\uff0c\u5728 Mistral 7b Instruct 0.3 \u7684\u901f\u5ea6\u5247\u5feb 13%\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd05.png\" alt=\"\" class=\"wp-image-88613\" style=\"width:840px;height:auto\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd05.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd05-300x169.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/11\/20241107-amd05-768x432.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">\u25b2AMD Ryzen AI 9 HX 375\u7684iGPU\u52a0\u901f\u6548\u80fd<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>AMD \u81f4\u529b\u65bc\u63a8\u9032 AI \u6280\u8853\u7684\u767c\u5c55\uff0c\u8b93\u6bcf\u500b\u4eba\u7686\u80fd\u4f7f\u7528 AI\u3002\u82e5\u6700\u65b0\u7684 AI \u9032\u5c55\u88ab\u8a2d\u7f6e\u5728\u9ad8\u9580\u6abb\u7684\u6280\u8853\u6216\u7de8\u78bc\u6280\u80fd\uff0c\u9019\u76ee\u6a19\u5c07\u7121\u6cd5\u5be6\u73fe\uff0c\u9019\u5c31\u662f\u70ba\u4f55 LM Studio \u7b49\u61c9\u7528\u5982\u6b64\u91cd\u8981\u3002\u9664\u4e86\u80fd\u5920\u5feb\u901f\u4e14\u8f15\u9b06\u5730\u5728\u672c\u5730\u90e8\u7f72 LLM \u5916\uff0c\u9019\u4e9b\u61c9\u7528\u7a0b\u5f0f\u8b93\u4f7f\u7528\u8005\u5728 llama.cpp \u9805\u76ee\u652f\u63f4\u8a72\u67b6\u69cb\u7684\u60c5\u6cc1\u4e0b\uff0c\u7b2c\u4e00\u6642\u9593\u9ad4\u9a57\u6700\u5148\u9032\u7684\u6a21\u578b\u3002<\/p>\n\n\n\n<p>AMD Ryzen\u2122 AI \u52a0\u901f\u5668\u63d0\u4f9b\u5353\u8d8a\u6548\u80fd\uff0c\u958b\u555f VGM \u7b49\u529f\u80fd\u53ef\u70ba AI \u4f7f\u7528\u6848\u4f8b\u63d0\u4f9b\u66f4\u597d\u7684\u6548\u80fd\u3002\u6240\u6709\u56e0\u7d20\u7d50\u5408\u8d77\u4f86\u5f8c\uff0c\u70ba x86 \u7b46\u96fb\u4e0a\u7684\u8a9e\u8a00\u6a21\u578b\u63d0\u4f9b\u4e86\u4ee4\u4eba\u9a5a\u8c54\u7684\u4f7f\u7528\u8005\u9ad4\u9a57\u3002<\/p>\n\n\n\n<p>\u6b32\u89aa\u81ea\u9ad4\u9a57 LM Studio\uff0c\u8acb\u53c3\u95b1<a href=\"https:\/\/lmstudio.ai\/ryzenai\" target=\"_blank\" rel=\"noreferrer noopener\">\u6b64\u9023\u7d50<\/a>\u3002<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>\u25bcSide by Side Comparison: Mistral 7b Instruct v0.3<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Side by Side Comparison: Mistral 7b Instruct v0.3\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/1v7_cDKyk74?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>\u3000\u3000\u3000<\/p>\n\n\n\n<p><sup>\u8a3b1\uff1a\u5728\u6b64\u6b21\u6bd4\u8f03\u4e2d\uff0c\u6211\u5011\u9078\u64c7\u63a1\u8cfc\u7576\u6642\u5728\u5317\u7f8e\u5e02\u5834\u4e0a\u6700\u597d\u768414\u540b\u7b46\u96fb\u3002<br>\u8a3b2\uff1aSTX-98\uff1a\u622a\u81f32024\u5e7410\u6708\u7531AMD\u9032\u884c\u7684\u6e2c\u8a66\u3002\u5c0d\u65bc\u6a23\u672c\u63d0\u793a\u300c\u7528\u4e94\u884c\u89e3\u91cb\u71b5\u7684\u6982\u5ff5\u300d\u9032\u884c3\u6b21\u57f7\u884c\u7684\u5e73\u5747\u6548\u80fd\u3002\u6240\u6709\u6e2c\u8a66\u5747\u5728LM Studio 0.3.4\u4e0a\u9032\u884c\u3002\u6e2c\u8a66\u7684\u6a21\u578b\u5305\u62ec\uff1aMeta Llama 3.2 1b Instruct\u3001Meta Llama 3.2 3b Instruct\u3001Microsoft Phi 3.1 4k Mini Instruct\u3001Google Gemma 2 9b Instruct\u3001Mistral Nemo 2407 13b Instruct\u3002\uff08\u6240\u6709\u6a21\u578b\u5747\u70baQ4 K M\u91cf\u5316\uff09\u3002Intel\u7684\u7279\u5b9a\u914d\u7f6e\uff1a8\u500bCPU\u57f7\u884c\u7dd2\u3002AMD\u7684\u7279\u5b9a\u914d\u7f6e\uff1a12\u500b\u57f7\u884c\u7dd2\u3002\uff08Llama.cpp\u5efa\u8b70\u5c07\u57f7\u884c\u7dd2\u8a2d\u7f6e\u70ba\u7269\u7406\u6838\u5fc3\u7684\u6578\u91cf\uff09\u3002\u642d\u8f09AMD Ryzen AI 9 HX 375\u7684HP OmniBook Ultra\u7b46\u96fb\uff0c32GB 7500 MT\/s RAM\uff0c\u958b\u555fVBS\uff0cWindows 11 Pro 24H2\u3002\u642d\u8f09Intel Core Ultra 7 258V\u7684ASUS Zenbook S14 UX5406SA 14\u540b\u7b46\u96fb\u8166\uff0c32GB 8533 MT\/s RAM\uff0c\u555f\u7528VBS\uff0cWindows 11 Pro 24H2\u3002\u6548\u80fd\u53ef\u80fd\u6703\u6539\u8b8a\u3002<br>\u8a3b3\uff1aSTX-99\uff1a\u622a\u81f32024\u5e7410\u6708\u7531AMD\u9032\u884c\u7684\u6e2c\u8a66\u3002\u5c0d\u65bc\u6a23\u672c\u63d0\u793a\u300c\u7528\u4e94\u884c\u89e3\u91cb\u71b5\u7684\u6982\u5ff5\u300d\u9032\u884c3\u6b21\u57f7\u884c\u7684\u5e73\u5747\u6548\u80fd\u3002\u6240\u6709\u6e2c\u8a66\u5747\u5728LM Studio 0.3.4\u4e0a\u9032\u884c\u3002\u6e2c\u8a66\u7684\u6a21\u578b\u5305\u62ec\uff1aMeta Llama 3.2 1b Instruct\u3001Meta Llama 3.2 3b Instruct\u3001Microsoft Phi 3.1 4k Mini Instruct\u3001Google Gemma 2 9b Instruct\u3001Mistral Nemo 2407 13b Instruct\u3002\uff08\u6240\u6709\u6a21\u578b\u5747\u70baQ4 K M\u91cf\u5316\uff09\u300212\u500bCPU\u57f7\u884c\u7dd2\u3002\uff08Llama.cpp\u5efa\u8b70\u5c07\u57f7\u884c\u7dd2\u8a2d\u7f6e\u70ba\u7269\u7406\u6838\u5fc3\u7684\u6578\u91cf\uff09\u3002GPU\u00a0offload = MAX\u3002VGM\u5728VGM\u57f7\u884c\u671f\u9593\u8a2d\u7f6e\u70ba16GB\u3002\u642d\u8f09AMD Ryzen AI 9 HX 375\u7684HP OmniBook Ultra\u7b46\u96fb\uff0c32GB 7500 MT\/s RAM\uff0c\u555f\u7528VBS\uff0cWindows 11 Pro 24H2\u3002\u6548\u80fd\u53ef\u80fd\u6703\u6539\u8b8a\u3002<br>\u8a3b4\uff1aSTX-100\uff1a\u622a\u81f32024\u5e7410\u6708\u7531AMD\u9032\u884c\u7684\u6e2c\u8a66\u3002\u5c0d\u65bc\u6a23\u672c\u63d0\u793a\u300c\u5f9e10\u516c\u5c3a\u9ad8\u8655\u6389\u843d\u7684\u7403\u9700\u8981\u591a\u4e45\u6642\u9593\u624d\u80fd\u843d\u5730\uff1f\u300d\uff0c\u300c\u7528\u4e94\u884c\u89e3\u91cb\u71b5\u7684\u6982\u5ff5\u300d\u3002\u6240\u6709\u6e2c\u8a66\u5747\u5728AMD\u7b46\u96fb\u4e0a\u4f7f\u7528LM Studio 0.3.4\u9032\u884c\u3002\u6240\u6709\u6e2c\u8a66\u5747\u5728Intel\u7b46\u96fb\u4e0a\u4f7f\u7528Intel AI Playground 1.21b\u9032\u884c\u3002\u6e2c\u8a66\u7684\u6a21\u578b\u5305\u62ec\uff1aMistral 7b Instruct v0.3 Q4 K M\u3001Mistral 7b Instruct v0.3 sym_int4\u3001Microsoft Phi 3.1 4k Mini Instruct Q4 K M\u3001Microsoft Phi 3.1 4k Mini Instruct sym_int4\u3002AMD\u7684\u7279\u5b9a\u914d\u7f6e\uff1a12\u500b\u57f7\u884c\u7dd2\u3002\uff08Llama.cpp\u5efa\u8b70\u5c07\u57f7\u884c\u7dd2\u8a2d\u7f6e\u70ba\u7269\u7406\u6838\u5fc3\u7684\u6578\u91cf\uff09\u3002GPU\u00a0offload = MAX\u3002VGM\u5728VGM\u00a0\u6e2c\u8a66\u671f\u9593\u8a2d\u7f6e\u70ba16GB\u3002\u642d\u8f09AMD Ryzen AI 9 HX 375\u7684HP OmniBook Ultra\u7b46\u96fb\uff0c32GB 7500 MT\/s RAM\uff0c\u958b\u555fVBS\uff0cWindows 11 Pro 24H2\u3002\u642d\u8f09Intel Core Ultra 7 258V\u7684ASUS Zenbook S14 UX5406SA 14\u540b\u7b46\u96fb\uff0c32GB 8533 MT\/s RAM\uff0c\u555f\u7528VBS\uff0cWindows 11 Pro 24H2\u3002\u6548\u80fd\u53ef\u80fd\u6703\u6539\u8b8a\u3002<br>\u8a3b5\uff1aSTX-101\uff1a\u622a\u81f32024\u5e7410\u6708\u7531AMD\u9032\u884c\u7684\u6e2c\u8a66\u3002\u5c0d\u65bc\u6a23\u672c\u63d0\u793a\u300c\u7528\u4e94\u884c\u89e3\u91cb\u71b5\u7684\u6982\u5ff5\u300d\u9032\u884c3\u6b21\u57f7\u884c\u7684\u5e73\u5747\u6548\u80fd\u3002\u6240\u6709\u6e2c\u8a66\u5747\u5728AMD\u7b46\u96fb\u4e0a\u4f7f\u7528LM Studio 0.3.4\u9032\u884c\u3002\u6240\u6709\u6e2c\u8a66\u5747\u5728Intel\u7b46\u96fb\u4e0a\u4f7f\u7528Intel AI Playground 1.21b\u9032\u884c\u3002\u6e2c\u8a66\u7684\u6a21\u578b\u5305\u62ec\uff1aMistral 7b Instruct v0.3 Q4 K M\u3001Mistral 7b Instruct v0.3 sym_int4\u3002AMD\u7684\u7279\u5b9a\u914d\u7f6e\uff1a12\u500b\u57f7\u884c\u7dd2\u3002\uff08Llama.cpp\u5efa\u8b70\u5c07\u57f7\u884c\u7dd2\u8a2d\u7f6e\u70ba\u7269\u7406\u6838\u5fc3\u7684\u6578\u91cf\uff09\u3002GPU\u00a0offload = MAX\u3002VGM\u5728VGM\u6e2c\u8a66\u671f\u9593\u8a2d\u7f6e\u70ba16GB\u3002\u642d\u8f09AMD Ryzen AI 9 HX 375\u7684HP OmniBook Ultra\u7b46\u96fb\uff0c32GB 7500 MT\/s RAM\uff0c\u958b\u555fVBS\uff0cWindows 11 Pro 24H2\u3002\u642d\u8f09Intel Core Ultra 7 258V\u7684ASUS Zenbook S14 UX5406SA 14\u540b\u7b46\u96fb\uff0c32GB 8533 MT\/s RAM\uff0c\u555f\u7528VBS\uff0cWindows 11 Pro 24H2\u3002\u6548\u80fd\u53ef\u80fd\u6703\u6539\u8b8a\u3002<br>\u8a3b6\uff1aGD-220c\uff1aRyzen\u2122 AI\u88ab\u5b9a\u7fa9\u70ba\u5c08\u7528AI\u5f15\u64ce\u3001AMD Radeon\u2122\u986f\u793a\u5f15\u64ce\u548cRyzen\u8655\u7406\u5668\u6838\u5fc3\u7684\u7d44\u5408\uff0c\u4f7f\u5f97AI\u529f\u80fd\u5f97\u4ee5\u5be6\u73fe\u3002\u9700\u8981OEM\u00a0\u548cISV\u7684\u652f\u63f4\uff0c\u67d0\u4e9bAI\u529f\u80fd\u53ef\u80fd\u5c1a\u672a\u91dd\u5c0dRyzen AI\u8655\u7406\u5668\u9032\u884c\u6700\u4f73\u5316\u3002Ryzen AI\u8207\u4ee5\u4e0b\u7522\u54c1\u76f8\u5bb9\uff1a(a)\u9664\u4e86Ryzen 5 7540U\u3001Ryzen 5 8540U\u3001Ryzen 3 7440U\u548cRyzen 3 8440U\u8655\u7406\u5668\u4ee5\u5916\u7684\u6240\u6709AMD Ryzen 7040\u548c8040\u7cfb\u5217\u8655\u7406\u5668\uff1b(b)\u6240\u6709AMD Ryzen AI 300\u7cfb\u5217\u8655\u7406\u5668\uff1b(c)\u9664\u4e86Ryzen 5 8500G\/GE\u548cRyzen 3 8300G\/GE\u7684\u6240\u6709AMD Ryzen 8000G\u7cfb\u5217\u684c\u4e0a\u578b\u8655\u7406\u5668\u3002\u8acb\u5728\u8cfc\u8cb7\u524d\u5411\u7cfb\u7d71\u88fd\u9020\u5546\u78ba\u8a8d\u529f\u80fd\u7684\u53ef\u7528\u6027\u3002<\/sup><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>\u3000\u3000\u3000<\/p>\n\n\n\n<h4 class=\"wp-block-heading has-text-align-right has-very-light-gray-to-cyan-bluish-gray-gradient-background has-background\">\ud83d\udfe6<strong><a href=\"https:\/\/www.ioiotimes.com\/?p=85329\" data-type=\"link\" data-id=\"https:\/\/www.ioiotimes.com\/?p=85329\" target=\"_blank\" rel=\"noreferrer noopener\">\u770bioioTIEMS \u5b78\u96d911\u63a1\u8cfc\u6280\u5de7 \u6436\u62ff\u8d85\u7d1a\u597d\u79ae!<\/a><\/strong><br>\ud83d\udfe6\u73fe\u5728\u5c31\u52a0\u5165&nbsp;ioioTIMES \u81c9\u66f8\u7c89\u7d72\u5718&nbsp;\u66f4\u591a\u4e92\u52d5\u3001\u66f4\u591a\u597d\u5eb7\u650f\u62b5\u52a0!!<br>\ud83d\udfe6<strong>\u6211\u5011\u6709<a href=\"https:\/\/today.line.me\/tw\/v2\/publisher\/103117\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">LINE TODAY<\/a>\u983b\u9053\u4e86\uff0c\u5feb\u4f86\u8ffd\u8e2a\u6211\u5011\u5427!!&#8211;\u6700\u65b0\u79d1\u6280\u65b0\u805e \u76e1\u5728\u4f60\u624b<\/strong><\/h4>\n","protected":false},"excerpt":{"rendered":"<p>\u8a9e\u8a00\u6a21\u578b\u81ea GPT-2 \u4ee5\u4f86\u5df2\u53d6\u5f97\u5927<\/p>\n","protected":false},"author":3,"featured_media":88609,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"rank_math_lock_modified_date":false,"footnotes":""},"categories":[13],"tags":[181,580,9848,11707],"class_list":["post-88606","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-amd","tag-focus","tag-ryzen-ai-300","tag-11707"],"_links":{"self":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts\/88606"}],"collection":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=88606"}],"version-history":[{"count":2,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts\/88606\/revisions"}],"predecessor-version":[{"id":88614,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts\/88606\/revisions\/88614"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/media\/88609"}],"wp:attachment":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=88606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=88606"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=88606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}