{"id":58067,"date":"2024-02-14T11:35:44","date_gmt":"2024-02-14T03:35:44","guid":{"rendered":"https:\/\/www.ioiotimes.com\/?p=58067"},"modified":"2024-02-14T11:40:53","modified_gmt":"2024-02-14T03:40:53","slug":"nvidia%e6%8e%a8%e5%87%ba%e8%87%aa%e5%ae%b6%e7%9a%84chat-with-rtx%e8%81%8a%e5%a4%a9%e6%a9%9f%e5%99%a8%e4%ba%ba%ef%bc%8c%e7%94%b1tensorrt-llm%e6%8f%90%e4%be%9b%e6%94%af%e6%8f%b4%e3%80%81rtx-30-40-gp","status":"publish","type":"post","link":"https:\/\/www.ioiotimes.com\/?p=58067","title":{"rendered":"NVIDIA\u63a8\u51fa\u81ea\u5bb6\u7684&#8221;Chat With RTX&#8221;\u804a\u5929\u6a5f\u5668\u4eba\uff0c\u7531TensorRT-LLM\u63d0\u4f9b\u652f\u63f4\u3001RTX 30\/40 GPU\u514d\u8cbb\u4f7f\u7528"},"content":{"rendered":"\n<p>\u5728\u4e0a\u500b\u6708\u7684 CES \u5927\u5c55\u4e2d\uff0cNVIDIA \u85c9\u8457\u767c\u5e03 RTX Super \u7cfb\u5217\u5c31\u5df2\u7d93\u9810\u544a\u5c07\u63a8\u51fa\u5168\u65b0\u7684 RTX AI \u8edf\u9ad4\u5de5\u5177\uff0c\u9664\u4e86\u5373\u5c07\u767b\u5834\u7684 AI Workbench \u4e4b\u5916\uff0cTensorRT-LLM(TRT-LLM) \u4ee5\u53ca\u900f\u904e TRT-LLM \u52a0\u901f\u7684 Chat With RTX \u4e5f\u5c07\u6b63\u5f0f\u4e0a\u9663\u3002<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"715\" height=\"469\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-01.jpg\" alt=\"\" class=\"wp-image-58074\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-01.jpg 715w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-01-300x197.jpg 300w\" sizes=\"(max-width: 715px) 100vw, 715px\" \/><figcaption class=\"wp-element-caption\">\u25b2NVIDIA\u81ea\u5bb6\u804a\u5929\u6a5f\u5668\u4eba&#8221;Chat With RTX&#8221;\u767b\u5834<\/figcaption><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p>\u90a3\u9019\u500b Chat With RTX \u662f\u751a\u9ebc\u4f5c\u7528\uff1f\u5176\u5be6\u9019\u8207\u4e4b\u524d\u7684\u804a\u5929\u6a5f\u5668\u4eba\u985e\u4f3c (Chat GPT)\uff0c\u4f46\u7121\u9808\u4f7f\u7528\u8005\u900f\u904e\u7e41\u8907\u8a2d\u5b9a\uff0c\u53ea\u8981\u900f\u904e\u642d\u8f09 NVIDIA GeForce RTX 30 \u8207 40 \u7cfb\u5217\u7684 GPU\u3001\u5c31\u80fd\u5229\u7528\u986f\u793a\u5361\u5167\u5efa\u7684\u5f37\u5927\u529f\u80fd\u8f15\u9b06\u57f7\u884c AI \u904b\u7b97\uff0c\u4e26\u975e\u4e00\u5b9a\u5f97\u900f\u904e\u96f2\u7aef\u5927\u6578\u64da\u4e2d\u5fc3\u624d\u80fd\u9054\u6210\uff0c\u5229\u7528\u6aa2\u7d22\u589e\u5f37\u5347\u6210 (RAG)\u3001TensorRT-LLM \u548c RTX \u52a0\u901f\uff0c\u53ef\u4ee5\u5feb\u901f\u8207\u81ea\u8a02\u6a5f\u5668\u4eba\u804a\u5929\u7372\u5f97\u76f8\u95dc\u89e3\u7b54\uff0c\u7531\u65bc\u662f\u5728\u81ea\u5bb6\u7684 Windows RTX PC (\u6216\u5de5\u4f5c\u7ad9) \u4e0a\u672c\u5730\u904b\u4f5c\u3001\u7121\u9808\u4e0a\u7db2\uff0c\u6240\u4ee5\u6703\u66f4\u5feb\u901f\u8207\u5b89\u5168\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-06-1024x576.png\" alt=\"\" class=\"wp-image-58078\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-06-1024x576.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-06-300x169.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-06-768x432.png 768w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-06.png 1440w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>Chat With RTX \u652f\u63f4\u591a\u7a2e\u6587\u4ef6\u683c\u5f0f\uff0c\u5305\u62ec\u6587\u5b57 (TXT)\u3001PDF\u3001DOC\/DOCX\u3001XML \u7b49\uff0c\u4f7f\u7528\u8005\u53ea\u9700\u8981\u5c07\u57f7\u884c\u6307\u5411\u6587\u4ef6\u593e\u5c31\u80fd\u5728\u8d85\u77ed\u6642\u9593\u5167\u52a0\u8f09\u5230\u8cc7\u6599\u5eab\u4e2d\uff0c\u751a\u81f3\u900f\u904e YouTube \u64ad\u653e\u5217\u8868\u7684 URL\u3001\u4e5f\u80fd\u5feb\u901f\u5730\u5c07\u5176\u8f49\u9304\u4e26\u67e5\u8a62\u6db5\u84cb\u5167\u5bb9\uff0c\u800c\u5f9e\u5b98\u65b9\u7684\u8cc7\u8a0a\u4f86\u770b\uff0c\u4f7f\u7528\u8005\u900f\u904e\u8207 Chat GPT \u76f8\u540c\u7684\u65b9\u5f0f\u4f7f\u7528 Chat With RTX\u3001\u751f\u6210\u7684\u7d50\u679c\u5247\u6703\u5b8c\u5168\u4f9d\u64da\u7279\u5b9a\u7684\u6578\u64da\u5eab\u800c\u5b9a\uff0c\u66f4\u80fd\u9069\u7528\u65bc\u751f\u6210\u5982\u6458\u8981\u3001\u5feb\u901f\u641c\u7d22\u6587\u4ef6\u7b49\u9762\u5411\uff0c\u53e6\u5916\uff0c\u652f\u63f4 TensorRT-LLM \u8207 RTX GPU \u904b\u7b97\u4e5f\u8868\u793a\u53ef\u76f4\u63a5\u900f\u904e\u672c\u5730\u7aef\uff0c\u4e0d\u7528\u4e0a\u7db2\u4e5f\u66f4\u80fd\u7bc0\u7701\u6642\u9593\u4e14\u7372\u5f97\u66f4\u7cbe\u78ba\u7684\u7d50\u679c\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"349\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-04-1024x349.jpg\" alt=\"\" class=\"wp-image-58077\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-04-1024x349.jpg 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-04-300x102.jpg 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-04-768x262.jpg 768w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-04.jpg 1090w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>\u76ee\u524d\u7684\u63a8\u51fa\u6642\u7a0b\u9810\u8a08\u5c07\u6703\u5728\u6708\u5e95\u524d\u767b\u5834\uff0c\u73fe\u968e\u6bb5\u7684 TensorRT-LLM v0.6 \u5c07\u80fd\u63d0\u5347 5 \u500d\u6027\u80fd\uff0c\u4e5f\u652f\u63f4\u5176\u4ed6\u7684LLM\uff0c\u50cf\u662f Mistral\u3001Nemortron-3 8B \u7b49\uff0c\u76ee\u524d\u5b98\u65b9\u78ba\u8a8d\u50c5\u652f\u63f4 RTX 30 \u8207 40 GPU\u3001\u800c\u4e14\u9700\u8981\u81f3\u5c11 8GB \u8a18\u61b6\u9ad4\uff0c\u770b\u4f86\u820a\u6b3e\u7684 RTX 20 \u7cfb\u5217\u4ee5\u53ca RTX 3050 6GB \u9019\u4e9b\u7248\u672c\u5c31\u7121\u6cd5\u4f7f\u7528\u4e86XD\uff5e<\/p>\n\n\n\n<p>\u66f4\u591a\u76f8\u95dc\u8cc7\u8a0a\u53ef\u67e5\u95b1\u5b98\u65b9\u9023\u7d50\uff1a<a href=\"https:\/\/www.nvidia.com\/en-us\/ai-on-rtx\/chat-with-rtx-generative-ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">www.nvidia.com\/en-us\/ai-on-rtx\/chat-with-rtx-generative-ai\/<\/a><\/p>\n\n\n\n<p><\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-05.png\" alt=\"\" class=\"wp-image-58076\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-05.png 1024w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-05-300x169.png 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-05-768x432.png 768w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">\u25b25\u500d\u6027\u80fd\u63d0\u5347<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"908\" height=\"353\" src=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-02.jpg\" alt=\"\" class=\"wp-image-58075\" title=\"\" srcset=\"https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-02.jpg 908w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-02-300x117.jpg 300w, https:\/\/www.ioiotimes.com\/wordpress\/wp-content\/uploads\/2024\/02\/20240214nvidiachatwithrtx-02-768x299.jpg 768w\" sizes=\"(max-width: 908px) 100vw, 908px\" \/><figcaption class=\"wp-element-caption\">\u25b2\u5b98\u65b9\u5efa\u8b70\u7684\u6700\u4f4e\u7cfb\u7d71\u8981\u6c42<\/figcaption><\/figure><\/div>\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>\u25bcCreate A Personalized AI Chatbot with Chat With RTX<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Create A Personalized AI Chatbot with Chat With RTX\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/gdsRJZT3IJw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>   <\/p>\n\n\n\n<h4 class=\"wp-block-heading has-text-align-right has-very-light-gray-to-cyan-bluish-gray-gradient-background has-background\"><strong><img loading=\"lazy\" decoding=\"async\" height=\"16\" width=\"16\" src=\"https:\/\/static.xx.fbcdn.net\/images\/emoji.php\/v9\/t83\/1\/16\/1f7e9.png\" alt=\"\ud83d\udfe9\" title=\"\"><\/strong>ioioTIMES\u300c\u5e74\u5ea6\u91d1\u8cde2023\u300d <a href=\"https:\/\/reurl.cc\/qrppny\" target=\"_blank\" data-type=\"link\" data-id=\"https:\/\/reurl.cc\/qrppny\" rel=\"noreferrer noopener\">\u770b\u6587\u7ae0\u3001\u5206\u4eab  \u62ff\u597d\u79ae!!<\/a>  <strong>~\u5feb\u4f86\u53c3\u52a0~<\/strong><br>\ud83d\udfe6\u770b\u6587\u7ae0\u514d\u8cbb\u62ffWi-Fi 7\u8def\u7531\u5668&nbsp;<a href=\"https:\/\/www.facebook.com\/ioioTIMES\/posts\/pfbid0mjaveqE1XYq75XGdyRTuvN6RWSdgt5xHZMpPF12SThDtEkVuE7b8SjBXW8YDWbf3l\" target=\"_blank\" rel=\"noreferrer noopener\">\u6d3b\u52d5\u7531\u6b64\u9032<\/a><br>\ud83d\udfe6<strong>\u73fe\u5728\u5c31\u52a0\u5165&nbsp;<a href=\"https:\/\/www.facebook.com\/profile.php?id=100086628162118\" target=\"_blank\" rel=\"noreferrer noopener\">ioioTIMES \u81c9\u66f8\u7c89\u7d72\u5718<\/a>&nbsp;\u66f4\u591a\u4e92\u52d5\u3001\u66f4\u591a\u597d\u5eb7\u650f\u62b5\u52a0!!<\/strong><br>\ud83d\udfe6<strong>\u6211\u5011\u6709<a href=\"https:\/\/today.line.me\/tw\/v2\/publisher\/103117\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">LINE TODAY<\/a>\u983b\u9053\u4e86\uff0c\u5feb\u4f86\u8ffd\u8e2a\u6211\u5011\u5427!!&#8211;\u6700\u65b0\u79d1\u6280\u65b0\u805e \u76e1\u5728\u4f60\u624b<\/strong><\/h4>\n","protected":false},"excerpt":{"rendered":"<p>\u5728\u4e0a\u500b\u6708\u7684 CES \u5927\u5c55\u4e2d\uff0cNVID<\/p>\n","protected":false},"author":7,"featured_media":58074,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"rank_math_lock_modified_date":false,"footnotes":""},"categories":[459,17],"tags":[8710,580,581,71,8711,7182],"class_list":["post-58067","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-info","category-it-info","tag-chat-with-rtx","tag-focus","tag-new-post","tag-nvidia","tag-rtx-30-40-gpu","tag-tensorrt-llm"],"_links":{"self":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts\/58067"}],"collection":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=58067"}],"version-history":[{"count":8,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts\/58067\/revisions"}],"predecessor-version":[{"id":58088,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/posts\/58067\/revisions\/58088"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=\/wp\/v2\/media\/58074"}],"wp:attachment":[{"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=58067"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=58067"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ioiotimes.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=58067"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}