{"id":15003,"date":"2026-09-14T16:27:20","date_gmt":"2026-09-14T08:27:20","guid":{"rendered":"https:\/\/ai-stack.ai\/?p=15003"},"modified":"2026-09-14T16:27:28","modified_gmt":"2026-09-14T08:27:28","slug":"rcs-vllm-deployment","status":"publish","type":"post","link":"https:\/\/ai-stack.ai\/zh-hant\/rcs-vllm-deployment","title":{"rendered":"\u5982\u4f55\u5728AI-Stack\u7528RCS\u529f\u80fd\u548cvLLM\u6846\u67b6\u90e8\u7f72\u5927\u578b\u8a9e\u8a00\u6a21\u578b\u670d\u52d9\uff1f"},"content":{"rendered":"\n

\u628a LLM \u8dd1\u8d77\u4f86\uff0c\u771f\u7684\u53ea\u662f\u628a\u6a21\u578b\u4e0b\u8f09\u4e0b\u4f86\u5c31\u597d\u4e86\u55ce\uff1f\u7b54\u6848\u662f\uff1a\u9084\u6c92\u3002GPU \u8cc7\u6e90\u600e\u9ebc\u914d\u3001\u63a8\u8ad6\u5f15\u64ce\u600e\u9ebc\u9078\u3001\u6a21\u578b\u600e\u9ebc\u4fdd\u5b58\uff0c\u751a\u81f3 Hugging Face \u7684\u6a21\u578b\u6388\u6b0a\u8207 Token \u90fd\u53ef\u80fd\u6210\u70ba\u90e8\u7f72\u6642\u7684\u95dc\u5361\u3002<\/p>\n\n\n\n

\u6578\u4f4d\u7121\u9650\u7684 AI-Stack<\/a> \u5e73\u53f0\uff0c\u5354\u52a9\u4f01\u696d\u7d71\u4e00\u8abf\u5ea6 GPU \u7b97\u529b\u8207\u7ba1\u7406 AI \u57fa\u790e\u8a2d\u65bd\uff1b \u5176\u4e2d\u7684\u5feb\u901f\u5bb9\u5668\u670d\u52d9 (RCS) \u529f\u80fd\uff0c\u8b93\u4f7f\u7528\u8005\u7121\u9700\u91cd\u5efa\u74b0\u5883\uff0c\u5373\u53ef\u5feb\u901f\u90e8\u7f72\u6a21\u578b\u8207\u61c9\u7528\u670d\u52d9\u3002\u00a0<\/p>\n\n\n\n

\u672c\u7bc7\u6587\u7ae0\uff0c\u6211\u5011\u5c31\u4e00\u6b65\u6b65\u793a\u7bc4\u7d66\u5927\u5bb6\u770b\uff0c\u5982\u4f55\u5728 AI-Stack \u4e0a\u4f7f\u7528 RCS \u529f\u80fd\u642d\u914d vLLM \u90e8\u7f72 google\/gemma-3-1b-it \u8a9e\u8a00\u6a21\u578b\uff01\u53e6\u5916\uff0c\u4e5f\u6703\u5be6\u969b\u793a\u7bc4\u9047\u5230 Hugging Face<\/a> \u53d7\u9650\u6a21\u578b (Gated model) \u6642\uff0c\u8a72\u5982\u4f55\u5b8c\u6210\u6388\u6b0a\u8207 Token \u8a2d\u5b9a\u3002<\/p>\n\n\n\n

\u52d5\u624b\u5be6\u4f5c\uff1a\u7528 RCS \u90e8\u7f72 vLLM\uff0c\u8b93 Gemma-3-1B \u8dd1\u8d77\u4f86\u00a0<\/h2>\n\n\n\n

\u7ba1\u7406\u8005\u5e73\u53f0\u8a2d\u5b9a\u5132\u5b58\u53e2\u96c6<\/h3>\n\n\n\n

\u9996\u5148\uff0c\u70ba\u907f\u514d\u6bcf\u6b21\u90e8\u7f72\u6642\u91cd\u8907\u4e0b\u8f09\u6a21\u578b\uff0c\u6211\u5011\u9700\u8981\u914d\u7f6e\u4e00\u500b\u5132\u5b58\u53e2\u96c6\u7528\u4f86\u5b58\u653e\u6a21\u578b \u6a94\u6848\u3002\u767b\u5165 AI-Stack \u7ba1\u7406\u8005\u5e73\u53f0\uff0c\u9032\u5165[\u8a2d\u5b9a] > [\u5132\u5b58\u53e2\u96c6] > [\u5132\u5b58\u53e2\u96c6 \u7ba1\u7406] \u9801\u9762\uff0c\u65b0\u589e\u4e00\u500b\u5132\u5b58\u53e2\u96c6\u3002 <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

\u5132\u5b58\u53e2\u96c6\u5efa\u7acb\u597d\u5f8c\uff0c\u78ba\u8a8d\u72c0\u614b\u986f\u793a\u70ba \u300c\u555f\u7528\u300d\uff0c\u5c31\u53ef\u4ee5\u5728\u6b64\u5132\u5b58\u53e2\u96c6\u4e0a\u5efa\u7acb\u5132\u5b58\u7a7a\u9593\uff0c\u4f9b\u5f8c\u7e8c\u90e8\u7f72 vLLM \u6642\u4f7f\u7528\u3002<\/p>\n\n\n\n

\u518d\u4f86\uff0c\u767b\u5165 AI-Stack \u7684\u4f7f\u7528\u8005\u5e73\u53f0\u3002\u9032\u5165\u5de6\u5074\u9078\u55ae\u7684\u300c\u6a5f\u5668\u5b78\u7fd2\u5c08\u6848\u300d>\u300c\u5c08\u6848\u5217\u8868\u300d\uff0c\u9078\u64c7\u8981\u7528\u4f86\u90e8\u7f72\u6a21\u578b\u7684\u5c08\u6848\uff0c\u672c\u7bc4\u4f8b\u9078\u64c7 Project 1\u3002<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

\u5efa\u7acb RCS \u5bb9\u5668<\/h3>\n\n\n\n

\u63a5\u4e0b\u4f86\uff0c\u5c31\u53ef\u4ee5\u53bb\u300c\u5feb\u901f\u5bb9\u5668\u670d\u52d9\u300d>\u300c\u90e8\u7f72\u61c9\u7528\u7a0b\u5f0f\u300d\uff0c\u8a2d\u5b9a\u4ee5\u4e0b\u5167\u5bb9\uff1a<\/p>\n\n\n\n

    \n
  1. \u300c\u540d\u7a31\u300d\uff1a\u81ea\u8a02\uff0c\u672c\u7bc4\u4f8b\u586b\u5165 demo\u3002<\/li>\n\n\n\n
  2. \u300c\u6b77\u53f2\u7248\u672c\u8a18\u9304\u4e0a\u9650\u300d\uff1a\u6c7a\u5b9a\u8981\u7559\u591a\u5c11\u7248\u672c\uff0c\u65b9\u4fbf\u65e5\u5f8c\u9700\u8981\u6642\u56de\u5fa9\u3002<\/li>\n\n\n\n
  3. \u300c\u5bb9\u5668\u96c6\u6578\u91cf\u300d\uff1a\u8a2d\u5b9a\u540c\u6642\u555f\u52d5\u5e7e\u500b\u5bb9\u5668\u526f\u672c\u5c0d\u5916\u63d0\u4f9b\u670d\u52d9\u3002\u6578\u91cf\u8d8a\u591a\uff0c\u80fd\u627f\u8f09\u7684\u4f75\u767c\u8acb\u6c42\u4e5f\u8d8a\u591a\uff1b\u672c\u6b21\u70ba\u529f\u80fd\u793a\u7bc4\uff0c\u56e0\u6b64\u8a2d\u5b9a\u70ba 1 \u5373\u53ef\u3002<\/li>\n<\/ol>\n\n\n\n

    \u8a2d\u5b9a\u5b8c\u6210\u5f8c\uff0c\u9ede\u9078 \u300c\u65b0\u589e\u5bb9\u5668\u300d\u3002<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \u63a5\u8457\u5c31\u53ef\u4ee5\u65b0\u589e\u5bb9\u5668\u4e86\uff01\u9ede\u9078 [\u65b0\u589e\u5bb9\u5668]\uff0c[\u540d\u7a31] \u81ea\u8a02\uff0c\u518d\u9ede\u9078 [\u8acb\u9078\u64c7\u93e1\u50cf]\u3002<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \u5728\u93e1\u50cf\u9078\u64c7\u9801\u9762\u4e2d\uff0c\u9078\u64c7 \u300c\u624b\u52d5\u4e0b\u8f09\u300d\uff0c\u4e26\u5728\u300c\u93e1\u50cf\u8def\u5f91\u300d\u586b\u5165 vLLM \u7684\u5b98\u65b9\u93e1\u50cf\u3002\u672c\u7bc4\u4f8b\u4f7f\u7528\uff1avllm\/vllm-openai:v0.26.0-cu129-ubuntu2404<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \u9078\u64c7\u597d\u93e1\u50cf\u5f8c\uff0c\u56de\u5230\u65b0\u589e\u5bb9\u5668\u7684\u8a2d\u5b9a\u9801\u9762\u3002<\/p>\n\n\n\n

    \u63a5\u4e0b\u4f86\uff0c\u8a2d\u5b9a\u5bb9\u5668\u7684\u57fa\u672c\u8cc7\u6e90\uff1a<\/p>\n\n\n\n

      \n
    1. \u300c\u898f\u683c\u300d\uff1a\u4f9d\u7167\u6a21\u578b\u5927\u5c0f\u9078\u64c7\u9069\u5408\u7684 GPU \u8cc7\u6e90\u3002\u53ef\u4ee5\u5148\u4f30\u7b97\u6a21\u578b\u672c\u8eab\u6240\u9700\u7684 GPU \u8a18\u61b6\u9ad4\uff0c\u518d\u9810\u7559\u4e00\u4e9b\u7a7a\u9593\u7d66 vLLM \u904b\u7b97\u4f7f\u7528\u3002\u4f8b\u5982\u6a21\u578b\u7d04\u9700\u8981 6 GB GPU \u8a18\u61b6\u9ad4\uff0c\u5efa\u8b70\u9078\u64c7 8\uff5e9 GB \u7684 GPU \u898f\u683c\uff0c\u4fdd\u7559\u4e00\u5b9a\u7684\u7de9\u885d\u7a7a\u9593\u3002<\/li>\n\n\n\n
    2. \u300c\u901a\u8a0a\u57e0\u300d\uff1a\u586b\u5165\u9810\u8a2d port \u865f 8000\u3002vLLM \u9810\u8a2d\u6703\u900f\u904e\u6b64 Port \u63d0\u4f9b API \u670d\u52d9\u3002<\/li>\n<\/ol>\n\n\n\n
      \"\"<\/figure>\n\n\n\n

      \u53d6\u5f97 Hugging Face \u6a21\u578b\u5b58\u53d6\u6b0a\u9650<\/h3>\n\n\n\n

      \u63a5\u4e0b\u4f86\u662f\u9019\u6b21\u90e8\u7f72\u6bd4\u8f03\u7279\u5225\u7684\u5730\u65b9\u3002\u56e0\u70ba gemma-3-1b-it \u662f\u53d7\u9650\u6a21\u578b\uff0c\u9700\u8981\u5148\u53d6\u5f97\u6a21\u578b\u7684\u5b58\u53d6\u6b0a\u9650\u3002\u9996\u5148\uff0c\u767b\u5165 Hugging Face \u5e33\u865f\uff0c\u958b\u555f\u4e00\u500b\u65b0\u5206\u9801\uff0c\u524d\u5f80\u4f60\u8981\u90e8\u7f72\u7684\u6a21\u578b\u9801\u9762\u3002\u9019\u908a\u662f\u7528 huggingface.co\/google\/gemma-3-1b-it<\/a>\uff0c\u9ede\u9078\u300cAcknowledge license\u300d\u5b8c\u6210\u6388\u6b0a\u3002<\/p>\n\n\n\n

      \u9019\u4e00\u6b65\u5f88\u91cd\u8981\uff0c\u56e0\u70ba\u53ea\u6709\u5b8c\u6210\u6a21\u578b\u6388\u6b0a\u5f8c\uff0c\u5e33\u865f\u624d\u6703\u53d6\u5f97\u8a72\u6a21\u578b\u7684\u5b58\u53d6\u6b0a\u9650\u3002<\/p>\n\n\n\n

      \"\"<\/figure>\n\n\n\n

      \uff08\u5716\u4e00: \u7db2\u5740\u8f38\u5165\u4f60\u8981\u7684\u6a21\u578b\u7db2\u5740\uff09<\/p>\n\n\n\n

      \"\"<\/figure>\n\n\n\n

      \u53d6\u5f97\u6a21\u578b\u5b58\u53d6\u6b0a\u9650\u5f8c\uff0c\u9700\u5efa\u7acb\u4e00\u7d44 Hugging Face Token\uff0c\u8b93\u7a0d\u5f8c\u5efa\u7acb\u7684 vLLM \u5bb9\u5668\u53ef\u4ee5\u4f7f\u7528\u9019\u7d44 Token \u9a57\u8b49\u8eab\u5206\u4e26\u4e0b\u8f09\u6a21\u578b\u3002\u9032\u5165https:\/\/huggingface.co\/settings\/tokens\u9801\u9762\uff0c\u63a5\u8457\u9ede\u9078 \u300c Create new token \u300d\u3002<\/p>\n\n\n\n

      \"\"<\/figure>\n\n\n\n

      \u5efa\u7acb Token \u6642\uff0c\u4e3b\u8981\u9700\u8981\u8a2d\u5b9a\u4ee5\u4e0b\u5169\u9805\uff1a<\/p>\n\n\n\n

        \n
      • Token name\uff1a\u81ea\u8a02\uff0c\u672c\u7bc4\u4f8b\u586b\u5165 demo\u3002<\/li>\n\n\n\n
      • Token Type\uff1a\u5982\u679c\u53ea\u662f\u8b93 vLLM \u4e0b\u8f09\u6a21\u578b\uff0c\u9078\u64c7 Read \u5373\u53ef\u3002<\/li>\n<\/ul>\n\n\n\n

        \u8a2d\u5b9a\u5b8c\u6210\u5f8c\uff0c\u9ede\u9078 \u300cCreate Token\u300d\uff0c\u7cfb\u7d71\u6703\u7522\u751f\u4e00\u4e32\u4ee5 hf_ \u958b\u982d\u7684 Token\u3002<\/p>\n\n\n\n

        \"\"<\/figure>\n\n\n\n

        \u9019\u88e1\u8981\u7279\u5225\u6ce8\u610f\uff1aToken \u5b8c\u6574\u5167\u5bb9\u53ea\u6703\u5728\u5efa\u7acb\u6642\u986f\u793a\u9019\u4e00\u6b21\u3002\u6240\u4ee5\u9019\u4e00\u6b65\u4e00\u5b9a\u8981\u7acb\u523b\u6309\u65c1\u908a\u7684\u8907\u88fd\u6309\u9215\u3002<\/p>\n\n\n\n

        \"\"<\/figure>\n\n\n\n

        Token \u8907\u88fd\u5b8c\u6210\u5f8c\uff0c\u5207\u56de AI-Stack \u7684\u5bb9\u5668\u8a2d\u5b9a\u9801\u9762\uff0c\u627e\u5230 \u300c\u74b0\u5883\u8b8a\u6578\u300d\uff0c\u65b0\u589e\u4e00\u7d44\u74b0\u5883\u8b8a\u6578<\/p>\n\n\n\n

          \n
        • Key\uff1aHF_TOKEN \uff08\u9019\u662f Hugging Face \u7684\u51fd\u5f0f\u5eab\u9810\u8a2d\u8b80\u53d6\u7684\u74b0\u5883\u8b8a\u6578\u540d\u7a31\uff09<\/li>\n\n\n\n
        • Value\uff1a\u8cbc\u4e0a\u525b\u525b\u8907\u88fd\u7684 hf_ \u958b\u982d Token<\/li>\n<\/ul>\n\n\n\n
          \"\"<\/figure>\n\n\n\n

          \u639b\u8f09\u6a21\u578b\u5132\u5b58\u7a7a\u9593<\/h3>\n\n\n\n

          \u63a5\u8457\u9ede\u9078 \u300c\u639b\u8f09\u300d>\u300c\u639b\u8f09\u78c1\u789f\u5340\u300d\u3002<\/p>\n\n\n\n

          \"\"<\/figure>\n\n\n\n

          \u9078\u64c7\u524d\u9762\u5efa\u7acb\u597d\u7684\u5132\u5b58\u78c1\u789f\u5340\u3002\u5728\u300c\u639b\u8f09\u8def\u5f91\u300d\u586b\u5165\uff1a\/root\/.cache\/huggingface<\/p>\n\n\n\n

          \"\"<\/figure>\n\n\n\n

          \u5c07 Hugging Face \u7684\u5feb\u53d6\u76ee\u9304\u639b\u8f09\u5230\u5132\u5b58\u7a7a\u9593\u5f8c\uff0c\u4e0b\u8f09\u597d\u7684\u6a21\u578b\u5c31\u53ef\u4ee5\u4fdd\u5b58\u4e0b\u4f86\u3002\u4e4b\u5f8c\u91cd\u65b0\u5efa\u7acb\u6216\u555f\u52d5\u5bb9\u5668\u6642\uff0c\u5c31\u4e0d\u9700\u8981\u6bcf\u6b21\u90fd\u91cd\u65b0\u4e0b\u8f09\u6a21\u578b\u3002<\/p>\n\n\n\n

          \u8a2d\u5b9a vLLM \u555f\u52d5\u6307\u4ee4<\/h3>\n\n\n\n

          \u63a5\u4e0b\u4f86\u56de\u5230\u65b0\u589e\u5bb9\u5668\u9801\u9762\uff0c\u627e\u5230 \u300c\u57f7\u884c\u547d\u4ee4\u300d\uff0c\u586b\u5165\uff1a<\/p>\n\n\n\n

          vllm serve –model google\/gemma-3-1b-it –served-model-name gemma3-1b –gpu-memory-utilization 0.7 –enforce-eager<\/p>\n\n\n\n

          \u9019\u4e32\u6307\u4ee4\u6703\u555f\u52d5 vLLM \u4e26\u8f09\u5165\u6307\u5b9a\u6a21\u578b\uff0c\u5176\u4e2d\uff1a<\/p>\n\n\n\n

            \n
          • –model google\/gemma-3-1b-it\uff1a–model \u7528\u4f86\u6307\u5b9a\u8981\u8f09\u5165\u7684\u6a21\u578b\uff0c\u5f8c\u9762\u7684 google\/gemma-3-1b-it \u5247\u662f Hugging Face \u4e0a\u7684\u6a21\u578b\u540d\u7a31\u3002<\/li>\n\n\n\n
          • –served-model-name gemma3-1b\uff1a\u8a2d\u5b9a API \u5c0d\u5916\u4f7f\u7528\u7684\u6a21\u578b\u540d\u7a31\uff0c\u4e4b\u5f8c\u547c\u53eb API \u6642\u53ef\u4ee5\u4f7f\u7528 gemma3-1b\u3002<\/li>\n\n\n\n
          • –gpu-memory-utilization 0.95\uff1a\u8a2d\u5b9a vLLM \u4f7f\u7528 GPU \u8a18\u61b6\u9ad4\u7684\u6bd4\u4f8b\uff0c\u672c\u7bc4\u4f8b\u8a2d\u5b9a\u70ba 95%\u3002<\/li>\n<\/ul>\n\n\n\n
            \"\"<\/figure>\n\n\n\n

            \u8a2d\u5b9a\u5171\u4eab\u8a18\u61b6\u9ad4<\/h3>\n\n\n\n

            \u63a5\u8457\uff0c\u5728 [\u5171\u4eab\u8a18\u61b6\u9ad4] \u7684\u6b04\u4f4d\uff0c\u8acb\u4f9d\u7167\u6a21\u578b\u8207\u63a8\u8ad6\u9700\u6c42\u6c7a\u5b9a\u662f\u5426\u9700\u8981\u555f\u7528\u5171\u4eab\u8a18\u61b6\u9ad4\u3002\u672c\u7bc4\u4f8b\u4f7f\u7528\u7684 google\/gemma-3-1b-it \u6a21\u578b\u8f03\u5c0f\uff0c\u56e0\u6b64\u4e0d\u9700\u8981\u7279\u5225\u914d\u7f6e\uff1b\u82e5\u4f7f\u7528\u8f03\u5927\u7684\u6a21\u578b\uff0c\u5247\u53ef\u4f9d\u5be6\u969b\u9700\u6c42\u589e\u52a0\u3002<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n

            \u4ee5\u4e0a\u8a2d\u5b9a\u5b8c\u6210\u5f8c\uff0c\u5c31\u53ef\u4ee5\u9ede\u9078\u53f3\u5074\u7684 \u300c\u90e8\u7f72\u300d \u6309\u9215\uff0c\u6b63\u5f0f\u555f\u52d5 vLLM \u5bb9\u5668\u3002<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n

            \u78ba\u8a8d vLLM \u662f\u5426\u6210\u529f\u555f\u52d5<\/h3>\n\n\n\n

            \u90e8\u7f72\u5b8c\u6210\u5f8c\uff0c\u9ede\u9078\u5de6\u5074\u7684 \u300cPod\u300d \u9078\u55ae\uff0c\u7b49\u5f85\u72c0\u614b\u66f4\u65b0\u70ba Running\u3002\u7576 Pod \u6b63\u5e38\u904b\u884c\u5f8c\uff0c\u52fe\u9078\u8a72 Pod\uff0c\u9078\u64c7 \u300c\u5bb9\u5668\u300d\uff0c\u518d\u52fe\u9078\u5c0d\u61c9\u7684\u5bb9\u5668\u4e26\u9ede\u9078 \u300c\u65e5\u8a8c\u300d\u3002<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n

            \u5728\u65e5\u8a8c\u756b\u9762\u4e2d\uff0c\u53ef\u4ee5\u770b\u5230 vLLM \u5bb9\u5668\u76ee\u524d\u7684\u555f\u52d5\u72c0\u614b\u3002\u6301\u7e8c\u91cd\u65b0\u6574\u7406\u65e5\u8a8c\u5167\u5bb9\uff0c\u7576\u770b\u5230\uff1aApplication startup complete.<\/p>\n\n\n\n

            \u5c31\u4ee3\u8868 vLLM \u5df2\u7d93\u6210\u529f\u555f\u52d5\uff0c\u6a21\u578b\u4e5f\u5df2\u5b8c\u6210\u8f09\u5165\u3002<\/p>\n\n\n\n

            \"\"<\/figure>\n\n\n\n

            \u8a2d\u5b9a\u670d\u52d9<\/h3>\n\n\n\n

            vLLM \u5bb9\u5668\u6210\u529f\u555f\u52d5\u5f8c\uff0c\u9084\u9700\u8981\u5c0d\u5916\u958b\u653e\u4e00\u500b\u670d\u52d9\u7a97\u53e3\uff0c\u624d\u80fd\u8b93\u5176\u4ed6\u61c9\u7528\u7a0b\u5f0f\u547c\u53eb\u9019\u500b\u6a21\u578b\u3002\u63a5\u4e0b\u4f86\uff0c\u6211\u5011\u5c31\u5230\u300c\u670d\u52d9\u300d\u529f\u80fd\uff0c\u8a2d\u5b9a\u5c0d\u5916\u7684 API Endpoint\u3002<\/p>\n\n\n\n

            \u9032\u5165\u300c\u670d\u52d9\u300d\u9801\u9762\uff0c\u9ede\u9078\u300c\u65b0\u589e\u670d\u52d9\u300d\uff0c\u4e26\u4f9d\u5e8f\u8a2d\u5b9a\u4ee5\u4e0b\u5167\u5bb9\uff1a<\/p>\n\n\n\n

              \n
            1. \u300c\u540d\u7a31\u300d\uff1a\u81ea\u8a02\uff0c\u5efa\u8b70\u8207\u525b\u525b\u90e8\u7f72\u7684\u5bb9\u5668\u540d\u7a31\u4e00\u81f4\uff0c\u65b9\u4fbf\u65e5\u5f8c\u5c0d\u61c9\u7ba1\u7406\u3002<\/li>\n\n\n\n
            2. \u300c\u985e\u578b\u300d\uff1a\u9078\u64c7 NodePort\u3002<\/li>\n\n\n\n
            3. \u300cPort\u300d\uff1a\u586b\u5165 8000\uff0c\u6b64\u70ba vLLM \u9810\u8a2d\u5c0d\u5916\u63d0\u4f9b API \u670d\u52d9\u7684 Port\u3002<\/li>\n\n\n\n
            4. \u300c\u5354\u5b9a\u300d\uff1a\u9078\u64c7 TCP\u3002<\/li>\n<\/ol>\n\n\n\n

              \u8a2d\u5b9a\u5b8c\u6210\u5f8c\uff0c\u9ede\u9078\u300c\u65b0\u589e\u300d\u5373\u53ef\u5b8c\u6210\u670d\u52d9\u5efa\u7acb\u3002<\/p>\n\n\n\n

              \"\"<\/figure>\n\n\n\n

              \u65b0\u589e\u5b8c\u6210\u5f8c\uff0c\u9ede\u9078\u8a72\u670d\u52d9\u5373\u53ef\u770b\u5230\u5c0d\u61c9\u7684 Endpoint \u9023\u7d50\u3002\u8907\u88fd\u9019\u7d44\u9023\u7d50\uff0c\u5c31\u53ef\u4ee5\u7528\u4f86\u4e32\u63a5\u4f60\u7684 Agent \u61c9\u7528\uff0c\u8b93 Gemma-3-1B \u6a21\u578b\u6b63\u5f0f\u5c0d\u5916\u63d0\u4f9b\u63a8\u8ad6\u670d\u52d9\uff01 <\/p>\n\n\n\n

              \"\"<\/figure>\n\n\n\n

              \u4ee5\u4e0a\u5c31\u662f\u4f7f\u7528 AI-Stack \u900f\u904e RCS \u90e8\u7f72\u6a21\u578b\u7684\u6d41\u7a0b\u5566\uff01\u9019\u6b21\u6211\u5011\u4e0d\u53ea\u5b78\u6703\u5982\u4f55\u5efa\u7acb vLLM \u5bb9\u5668\u3001\u914d\u7f6e GPU \u8207\u5132\u5b58\u7a7a\u9593\uff0c\u4e5f\u5be6\u969b\u793a\u7bc4\u4e86 Gated model \u7684\u6a21\u578b\u6388\u6b0a\u8207 Token \u8a2d\u5b9a\u3002\u900f\u904e AI-Stack \u7684 RCS\uff0c\u958b\u767c\u8005\u5c31\u80fd\u66f4\u5f48\u6027\u5730\u90e8\u7f72\u81ea\u5df1\u9700\u8981\u7684 LLM \u6a21\u578b\uff0c\u5feb\u901f\u5efa\u7acb\u5c08\u5c6c\u7684 AI \u63a8\u8ad6\u670d\u52d9\uff01<\/p>\n\n\n\n

              <\/p>\n","protected":false},"excerpt":{"rendered":"

              \u672c\u7bc7\u6587\u7ae0\u5c07\u793a\u7bc4\u5982\u4f55\u5728 AI-Stack \u4e0a\u4f7f\u7528 RCS \u529f\u80fd\u642d\u914d vLLM \u90e8\u7f72 google\/gemma-3-1b-it \u8a9e\u8a00\u6a21\u578b\uff01<\/p>\n","protected":false},"author":253372381,"featured_media":15092,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[96987582,96987561],"tags":[96989041],"class_list":["post-15003","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-product-features","category-technical-support","tag-rcs"],"blocksy_meta":[],"acf":[],"jetpack_shortlink":"https:\/\/wp.me\/ph344V-3TZ","jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/09\/2b8fdc56.png?fit=1920%2C1080&quality=100&ct=202603031250&ssl=1","_links":{"self":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts\/15003","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/users\/253372381"}],"replies":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/comments?post=15003"}],"version-history":[{"count":1,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts\/15003\/revisions"}],"predecessor-version":[{"id":15096,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts\/15003\/revisions\/15096"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/media\/15092"}],"wp:attachment":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/media?parent=15003"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/categories?post=15003"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/tags?post=15003"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}