{"id":15851,"date":"2026-11-19T15:16:15","date_gmt":"2026-11-19T07:16:15","guid":{"rendered":"https:\/\/ai-stack.ai\/?p=15851"},"modified":"2026-11-20T15:48:59","modified_gmt":"2026-11-20T07:48:59","slug":"jev-benchmark","status":"publish","type":"post","link":"https:\/\/ai-stack.ai\/zh-hant\/jev-benchmark","title":{"rendered":"Jev \u6c7a\u7b56\u6a21\u578b Benchmark\uff1a10 \u7a2e\u6c7a\u7b56\u6a21\u578b \u00d7 \u5169\u5927\u60c5\u5883\u5be6\u6e2c\u8207\u9078\u578b\u5efa\u8b70"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">\u7576\u4f01\u696d\u628a LLM \u5c0e\u5165\u5ba2\u670d\u3001\u5167\u90e8\u77e5\u8b58\u5eab\u8207 AI Agent \u5de5\u4f5c\u6d41\u7a0b\uff0c\u300c\u5224\u65b7\u300d\u5f80\u5f80\u6bd4\u300c\u751f\u6210\u300d\u66f4\u65e9\u767c\u751f\uff1a\u9019\u5247\u8a0a\u606f\u8a72\u8f49\u7d66\u54ea\u500b\u6a21\u578b\uff1f\u5167\u5bb9\u662f\u5426\u593e\u5e36\u500b\u8cc7\uff1f\u662f\u5426\u70ba\u63d0\u793a\u6ce8\u5165\uff1f\u9019\u4e9b\u5224\u65b7\u90fd\u4f4d\u65bc\u4f7f\u7528\u8005\u7b49\u5f85\u7684<strong>\u95dc\u9375\u8def\u5f91<\/strong>\u4e0a\uff0c\u6bcf\u4e00\u7b46\u8acb\u6c42\u90fd\u8981\u7d93\u904e\u3002\u56e0\u6b64\u5728\u9078\u578b\u6642\uff0c\u5718\u968a\u901a\u5e38\u9700\u8981\u5148\u56de\u7b54\u4ee5\u4e0b\u554f\u984c\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u96f2\u7aef\u8207\u5730\u7aef\u7684\u6c7a\u7b56\u6a21\u578b\uff0c<strong>\u6e96\u78ba\u7387<\/strong>\u5be6\u969b\u5dee\u591a\u5c11\uff1f<\/li>\n\n\n\n<li>\u300c\u4e3b\u984c\u5206\u985e\u300d\u8207\u300c\u5167\u5bb9\u5b89\u5168\u9632\u8b77\u300d\u5169\u7a2e\u4efb\u52d9\uff0c<strong>\u80fd\u5426\u7528\u540c\u4e00\u500b\u6a21\u578b<\/strong>\u8655\u7406\uff1f<\/li>\n\n\n\n<li>\u6539\u7528<strong>\u91cf\u5316\u7248\u672c<\/strong>\u90e8\u7f72\uff0c\u5224\u65b7\u7d50\u679c\u6703\u4e0d\u6703\u8dd1\u6389\uff1f<\/li>\n\n\n\n<li>\u751f\u6210\u5f0f LLM guard \u82e5<strong>\u6c92\u6709\u7d66\u51fa\u5224\u6c7a<\/strong>\uff0c\u7cfb\u7d71\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\uff1f<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u70ba\u56de\u7b54\u9019\u4e9b\u554f\u984c\uff0c\u6211\u5011\u4ee5 <strong>5,100 \u7b46\u4e2d\u82f1\u5404\u534a<\/strong>\u7684\u6e2c\u8a66\u8cc7\u6599\uff0c\u5728\u300c\u4e3b\u984c\u5206\u985e\uff08Domain\uff09\u300d\u8207\u300c\u5167\u5bb9\u5b89\u5168\u9632\u8b77\uff08Guard\uff09\u300d\u5169\u7a2e\u60c5\u5883\u4e0b\uff0c\u5be6\u6e2c <strong>10 \u7a2e\u6c7a\u7b56\u6a21\u578b\u3001\u5171 11 \u7d44\u90e8\u7f72<\/strong>\uff08clef \u6709\u5169\u7a2e\u90e8\u7f72\u65b9\u5f0f\uff09\uff0c\u4e26\u4ee5 1 \u500b\u751f\u6210\u5f0f LLM guard\uff08gpt-oss-safeguard\uff09\u4f5c\u70ba\u5c0d\u7167\u7d44\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Jev \u6c7a\u7b56\u6a21\u578b\u662f\u4ec0\u9ebc\uff1f<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/typesafe.ai\/blog\/introducing-system-one-models-and-jev\" data-type=\"link\" data-id=\"https:\/\/typesafe.ai\/blog\/introducing-system-one-models-and-jev\" target=\"_blank\" rel=\"noopener\">Jev<\/a> \u662f TypeSafe \u63a8\u51fa\u7684 <strong>System One \u6c7a\u7b56\u6a21\u578b<\/strong>\u3002\u4f7f\u7528\u65b9\u5f0f\u662f\u9001\u5165\u4e00\u6bb5\u5f85\u5224\u65b7\u7684\u6587\u5b57\uff08state\uff09\u8207\u4e00\u7d44\u6709\u578b\u5225\u7684\u554f\u984c\uff08questions\uff09\uff0c\u6a21\u578b\u6703<strong>\u4e00\u6b21\u56de\u50b3\u6bcf\u4e00\u984c\u7684\u7b54\u6848\u8207\u6a5f\u7387\u5206\u5e03\uff0c\u4e14\u4e0d\u7522\u751f\u4efb\u4f55\u6587\u5b57<\/strong>\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u540c\u4e00\u5957 \/v1\/systemone \u4ecb\u9762\u4ea6\u6709\u5176\u4ed6\u5be6\u4f5c\uff0c\u672c\u6b21\u53d7\u6e2c\u7684 clef\u3001clm\u3001laya\u3001winnow\u3001kev \u7cfb\u5217\uff0c\u4ee5\u53ca vllm-sr \u7684 d3 \u7cfb\u5217\u7686\u76f8\u5bb9\uff0c\u4e0b\u6587\u7d71\u7a31\u70ba\u300c<strong>\u6c7a\u7b56\u6a21\u578b<\/strong>\u300d\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. \u4e09\u7a2e\u984c\u578b\uff1achoice\u3001score\u3001noul<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u984c\u578b<\/strong><\/th><th><strong>\u56de\u7b54\u7684\u554f\u984c<\/strong><\/th><th><strong>\u5982\u4f55\u5b9a\u7fa9\uff08criteria\uff09<\/strong><\/th><th><strong>\u56de\u50b3\u5167\u5bb9<\/strong><\/th><\/tr><\/thead><tbody><tr><td>choice\uff08\u9078\u9805\u5206\u985e\uff09<\/td><td>\u5c6c\u65bc\u54ea\u4e00\u985e\uff1f<\/td><td>\u7269\u4ef6\uff1a\u9078\u9805\u540d\u7a31\u5c0d\u61c9\u4e00\u6bb5\u63cf\u8ff0<\/td><td>choice\u3001confidence\u3001\u5404\u9078\u9805\u7684 probabilities<\/td><\/tr><tr><td>score\uff08\u7a0b\u5ea6\u8a55\u5206\uff09<\/td><td>\u7a0b\u5ea6\u6709\u591a\u9ad8\uff1f<\/td><td>\u9663\u5217\uff1a\u7531\u4f4e\u5230\u9ad8\u6392\u5217\u7684\u7b49\u7d1a\u63cf\u8ff0<\/td><td>score\u3001confidence\u3001\u7b49\u7d1a\u5c0d\u7167 legend\u3001\u5404\u7b49\u7d1a\u7684 probabilities<\/td><\/tr><tr><td>noul\uff08\u6a5f\u7387\u5224\u65b7\uff09<\/td><td>\u662f\u4e0d\u662f\uff1f<\/td><td>\u4e0d\u9700\u8981\uff0c\u53ea\u5beb instructions<\/td><td>noul\uff1a\u300c\u662f\u300d\u7684\u6a5f\u7387\uff0c\u4ecb\u65bc 0 \u5230 1<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>score \u662f\u7b49\u7d1a\u7684\u671f\u671b\u503c<\/strong>\uff1a\u5404\u7b49\u7d1a\u7de8\u865f\u4f9d\u6a5f\u7387\u52a0\u6b0a\uff0c\u7bc4\u570d\u70ba 0 \u5230\u300c\u7b49\u7d1a\u6578 \u22121\u300d\u3002\u4f8b\u5982\u4e09\u500b\u7b49\u7d1a\u7684\u6a5f\u7387\u5206\u5225\u70ba 0.67\u30010.29\u30010.04 \u6642\uff0cscore \u70ba 0.38\u3002\u56e0\u6b64 criteria \u7684\u6392\u5217\u9806\u5e8f\u5c31\u662f\u91cf\u5c3a\u65b9\u5411\uff0c<strong>\u5fc5\u9808\u7531\u4f4e\u5230\u9ad8\u6392\u5217<\/strong>\u3002<\/li>\n\n\n\n<li><strong>\u4e09\u7a2e\u984c\u578b\u53ef\u653e\u5728\u540c\u4e00\u500b\u8acb\u6c42<\/strong>\uff1a\u4e00\u6b21\u53d6\u5f97\u591a\u500b\u7368\u7acb\u5224\u65b7\uff0c\u7121\u9700\u591a\u6b21\u7db2\u8def\u5f80\u8fd4\u3002<\/li>\n\n\n\n<li><strong>\u672c\u6b21 Benchmark \u50c5\u4f7f\u7528 choice<\/strong>\uff1ascore \u8207 noul \u7684\u56de\u50b3\u683c\u5f0f\uff0c\u7531\u6211\u5011\u5c0d jev-latest\uff08\u56de\u61c9\u4e2d\u7248\u672c\u70ba jev-1.13.0\uff09\u5be6\u6e2c\u78ba\u8a8d\u3002<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. \u4e00\u6b21\u8acb\u6c42\u3001\u591a\u984c\u5224\u65b7\uff1a\u5be6\u969b\u7bc4\u4f8b<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u4ee5\u4e0b\u7bc4\u4f8b\u91dd\u5c0d\u540c\u4e00\u5c01\u5ba2\u670d\u4fe1\uff0c\u540c\u6642\u5224\u65b7<strong>\u4e3b\u984c<\/strong>\uff08choice\uff09\u3001<strong>\u7dca\u6025\u7a0b\u5ea6<\/strong>\uff08score\uff09\u8207<strong>\u662f\u5426\u8981\u6c42\u9000\u6b3e<\/strong>\uff08noul\uff09\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Request\n{\n  \"model\": \"jev-latest\",\n  \"state\": \"Hi, I was charged twice for my subscription this month and I need a refund today, otherwise I will cancel.\",\n  \"questions\": {\n    \"topic\": {\n      \"type\": \"choice\",\n      \"instructions\": \"Pick the topic of the message.\",\n      \"criteria\": {\n        \"billing\": \"Payments, invoices, refunds.\",\n        \"technical\": \"Bugs, errors, outages.\",\n        \"sales\": \"Pricing and plans.\"\n      }\n    },\n    \"urgency\": {\n      \"type\": \"score\",\n      \"instructions\": \"Rate how urgent this message is.\",\n      \"criteria\": &#91;\n        \"Not urgent: no time pressure.\",\n        \"Low: wants help this week.\",\n        \"Medium: wants an answer within a day.\",\n        \"High: needs action today, money involved.\",\n        \"Critical: service down or legal threat.\"\n      ]\n    },\n    \"refund\": {\n      \"type\": \"noul\",\n      \"instructions\": \"Is the customer asking for a refund?\"\n    }\n  }\n}<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>Response\n{\n  \"model\": \"jev-1.13.0\",\n  \"answers\": {\n    \"topic\": {\n      \"type\": \"choice\",\n      \"choice\": \"billing\",\n      \"confidence\": 1.0,\n      \"probabilities\": {\"billing\": 1.0, \"technical\": 0.0, \"sales\": 0.0}\n    },\n    \"urgency\": {\n      \"type\": \"score\",\n      \"score\": 3.0,\n      \"confidence\": 1.0,\n      \"legend\": {\n        \"0\": \"Not urgent: no time pressure.\",\n        \"1\": \"Low: wants help this week.\",\n        \"2\": \"Medium: wants an answer within a day.\",\n        \"3\": \"High: needs action today, money involved.\",\n        \"4\": \"Critical: service down or legal threat.\"\n      },\n      \"probabilities\": {\"0\": 0.0, \"1\": 0.0, \"2\": 0.0, \"3\": 1.0, \"4\": 0.0}\n    },\n    \"refund\": {\"type\": \"noul\", \"noul\": 0.99}\n  },\n  \"usage\": {\"input_tokens\": 458, \"output_tokens\": 69}\n}<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">\u9700\u8981\u7559\u610f\u7684\u662f\uff0cconfidence \u70ba\u670d\u52d9\u53e6\u5916\u56de\u50b3\u7684\u4fe1\u5fc3\u5206\u6578\uff0c<strong>\u4e0d\u4e00\u5b9a\u7b49\u65bc\u6700\u9ad8\u9078\u9805\u7684\u6a5f\u7387<\/strong>\uff08\u672c\u6b21\u6e2c\u8a66\u4e2d\uff0claya:multilingual \u5373\u66fe\u56de\u50b3 confidence 0.9955\u3001\u6700\u9ad8\u6a5f\u7387 0.997\uff09\u3002\u6839\u64da <a href=\"https:\/\/www.datacamp.com\/blog\/system-one-models-jev\" target=\"_blank\" rel=\"noopener\">DataCamp \u7684\u4ecb\u7d39<\/a>\uff0cJev \u7684\u6a5f\u7387\u7d93\u904e\u6821\u6e96\uff1b\u672c\u6b21 Domain \u6e2c\u8a66\u4e2d\uff0cjev-latest \u5728 confidence \u2265 0.9 \u7684\u984c\u76ee\uff08\u4f54 94.9%\uff09<strong>\u5168\u6578\u5224\u5c0d<\/strong>\uff0c\u8207\u6b64\u8aaa\u6cd5\u4e00\u81f4\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>3. \u6c7a\u7b56\u6a21\u578b vs. \u751f\u6210\u5f0f LLM\uff1a\u95dc\u9375\u5dee\u7570<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e0b\u8868\u6bd4\u8f03\u6c7a\u7b56\u6a21\u578b\u8207\u751f\u6210\u5f0f LLM guard \u8655\u7406\u540c\u4e00\u4ef6\u4e8b\u7684\u5dee\u7570\u3002\u6578\u64da\u53d6\u81ea\u672c\u6b21 Guard \u6e2c\u8a66\uff1b\u7531\u65bc\u5169\u8005\u57f7\u884c\u65bc\u4e0d\u540c\u4e3b\u6a5f\uff0c\u5ef6\u9072\u50c5\u4f9b\u53c3\u8003\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u9762\u5411<\/strong><\/th><th><strong>\u6c7a\u7b56\u6a21\u578b\uff08systemone\uff09<\/strong><\/th><th><strong>\u751f\u6210\u5f0f LLM guard\uff08gpt-oss-safeguard:20b\uff09<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u8f38\u51fa\u5f62\u5f0f<\/strong><\/td><td>\u6bcf\u984c\u7684\u578b\u5225\u5316\u7b54\u6848\uff08\u985e\u5225\u3001\u5206\u6578\u6216\u6a5f\u7387\uff09\uff0b\u6a5f\u7387\u5206\u5e03<\/td><td>\u63a8\u7406\u904e\u7a0b\uff0b\u4e00\u6bb5 JSON \u6587\u5b57\uff0c\u9700\u81ea\u884c\u89e3\u6790<\/td><\/tr><tr><td><strong>\u81ea\u67b6\u6a21\u578b\u7684\u8f38\u51fa tokens<\/strong><\/td><td>0<\/td><td>\u5e73\u5747 327\u2013365<\/td><\/tr><tr><td><strong>\u5ef6\u9072\u4e3b\u8981\u53d6\u6c7a\u65bc<\/strong><\/td><td>\u8f38\u5165\u9577\u5ea6\uff08criteria\uff0b\u5167\u5bb9\uff09<\/td><td>\u8f38\u51fa\u9577\u5ea6\uff08\u8207\u5ef6\u9072\u76f8\u95dc\u4fc2\u6578 1.00\uff09<\/td><\/tr><tr><td><strong>p50\uff0fp95 \u5ef6\u9072<\/strong><\/td><td>winnow:latest 416\uff0f436 ms<\/td><td>1.58\uff0f6.24 s<\/td><\/tr><tr><td><strong>\u662f\u5426\u53ef\u80fd\u6c92\u6709\u7b54\u6848<\/strong><\/td><td>\u4e0d\u6703\uff0c\u6bcf\u984c\u5fc5\u6709\u7b54\u6848<\/td><td>\u6703\uff0c1.0%\uff08\u6539\u826f\u5f8c prompt\uff09\u81f3 6.2%\uff08\u539f\u59cb prompt\uff09<\/td><\/tr><tr><td><strong>\u4fe1\u5fc3\u5206\u6578<\/strong><\/td><td>\u6709\uff0c\u53ef\u7528\u9580\u6abb\u5206\u6d41<\/td><td>\u7121<\/td><\/tr><tr><td><strong>\u53ef\u89e3\u91cb\u6027<\/strong><\/td><td>\u50c5\u6709\u6a5f\u7387<\/td><td>\u6709 rationale \u6587\u5b57<\/td><\/tr><tr><td><strong>\u8abf\u6574\u5224\u65b7\u898f\u5247<\/strong><\/td><td>\u4fee\u6539 criteria \u6587\u5b57\uff0c\u7121\u9700\u91cd\u65b0\u8a13\u7df4<\/td><td>\u4fee\u6539 policy prompt<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u8a3b\uff1a\u96f2\u7aef jev-latest \u7684 usage \u6703\u56de\u5831 output tokens\uff08\u672c\u6b21 Guard \u7d04 160\u3001Domain \u7d04 53\uff0c\u4e0a\u4f8b\u70ba 69\uff09\uff0c\u4f46\u56de\u61c9\u5f62\u5f0f\u4ecd\u70ba\u578b\u5225\u5316\u7b54\u6848\uff0c\u7121\u9700\u89e3\u6790\u6587\u5b57\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img data-recalc-dims=\"1\" fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"576\" data-attachment-id=\"15854\" data-permalink=\"https:\/\/ai-stack.ai\/zh-hant\/jev-benchmark\/image-99\" data-orig-file=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/69df1def.png?fit=1600%2C900&amp;quality=100&amp;ct=202603031250&amp;ssl=1\" data-orig-size=\"1600,900\" data-comments-opened=\"0\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/69df1def.png?fit=1024%2C576&amp;quality=100&amp;ct=202603031250&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/30b48d32.png?resize=1024%2C576&#038;quality=100&#038;ct=202603031250&#038;ssl=1\" alt=\"\" class=\"wp-image-15854\" style=\"aspect-ratio:1.7777777777777777;width:624px;height:auto\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u6c7a\u7b56\u6a21\u578b\u9069\u5408\u7528\u5728\u54ea\u4e9b\u5834\u666f\uff1f<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u5224\u65b7\u539f\u5247\u5f88\u55ae\u7d14\uff1a<strong>\u53ea\u8981\u7b54\u6848\u80fd\u4e8b\u5148\u5217\u8209<\/strong>\u2014\u2014\u7121\u8ad6\u662f\u4e00\u500b\u985e\u5225\u3001\u4e00\u500b\u7b49\u7d1a\uff0c\u9084\u662f\u4e00\u500b\u662f\u975e\u2014\u2014\u5c31\u9069\u5408\u4ea4\u7d66\u6c7a\u7b56\u6a21\u578b\uff1b\u9700\u8981\u7522\u51fa\u6587\u5b57\u6216\u7406\u7531\u7684\u5de5\u4f5c\u5247\u4e0d\u9069\u5408\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u984c\u578b<\/strong><\/th><th><strong>\u9069\u5408\u7684\u5de5\u4f5c<\/strong><\/th><th><strong>\u61c9\u7528\u7bc4\u4f8b<\/strong><\/th><\/tr><\/thead><tbody><tr><td>choice\uff08\u9078\u9805\u5206\u985e\uff09<\/td><td>\u5206\u985e\u8207\u8def\u7531<\/td><td>\u4f9d\u91ab\u7642\u3001\u8ca1\u52d9\u3001\u6cd5\u5f8b\u5c07\u554f\u984c\u8f49\u7d66\u5c0d\u61c9\u7684\u6a21\u578b\u6216 Agent\uff08\u672c\u6587 Domain \u60c5\u5883\uff09\uff1b\u5224\u65b7\u8a0a\u606f\u5c6c\u65bc\u54ea\u4e00\u7a2e\u6709\u5bb3\u5167\u5bb9\uff08\u672c\u6587 Guard \u60c5\u5883\uff09\uff1b\u5ba2\u670d\u5de5\u55ae\u5206\u6d3e<\/td><\/tr><tr><td>score\uff08\u7a0b\u5ea6\u8a55\u5206\uff09<\/td><td>\u5206\u7d1a\u8207\u6392\u5e8f<\/td><td>\u5ba2\u8a34\u7dca\u6025\u7a0b\u5ea6\u3001\u98a8\u96aa\u7b49\u7d1a\u3001\u5167\u5bb9\u5206\u7d1a\uff1b\u66ff LLM \u7684\u56de\u7b54\u54c1\u8cea\u8a55\u5206\uff0c\u518d\u4f9d\u5206\u6578\u6392\u5e8f\u6216\u8a2d\u5b9a\u9580\u6abb<\/td><\/tr><tr><td>noul\uff08\u6a5f\u7387\u5224\u65b7\uff09<\/td><td>\u662f\u975e\u8207\u653e\u884c\u9598\u9580<\/td><td>\u662f\u5426\u542b\u500b\u8cc7\u6216\u6a5f\u5bc6\u3001\u662f\u5426\u8981\u6c42\u9000\u6b3e\u3001\u662f\u5426\u9700\u8f49\u771f\u4eba\u3001\u662f\u5426\u70ba\u63d0\u793a\u6ce8\u5165\uff1b\u4f9d\u300c\u662f\u300d\u7684\u6a5f\u7387\u8a2d\u5b9a\u6514\u622a\u9580\u6abb<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. \u7d44\u5408\u4f7f\u7528<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e00\u5c01\u5ba2\u670d\u4fe1\u53ef\u5728\u540c\u4e00\u8acb\u6c42\u4e2d\u540c\u6642\u53d6\u5f97\u4e3b\u984c\u3001\u7dca\u6025\u7a0b\u5ea6\u8207\u662f\u5426\u8981\u6c42\u9000\u6b3e\uff0c\u4e00\u6b21\u5b8c\u6210<strong>\u5206\u6d3e\u3001\u6392\u5e8f\u8207\u89f8\u767c\u9000\u6b3e\u6d41\u7a0b<\/strong>\u3002\u5f8c\u6587\u5efa\u8b70\u5c07\u300c\u662f\u5426\u542b\u500b\u8cc7\u300d\u5f9e\u55ae\u9078\u984c\u62c6\u51fa\u3001\u6539\u4ee5 noul \u7368\u7acb\u5224\u65b7\uff0c\u5373\u662f\u6b64\u505a\u6cd5\u7684\u61c9\u7528\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. \u9598\u9580\u9580\u6abb\u53ef\u81ea\u884c\u8abf\u6574<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">noul \u56de\u50b3\u7684\u662f<strong>\u6a5f\u7387\u800c\u975e\u662f\u975e<\/strong>\uff0c\u6514\u622a\u9580\u6abb\u53ef\u4f9d\u300c\u5be7\u53ef\u932f\u6bba\u300d\u6216\u300c\u5be7\u53ef\u653e\u904e\u300d\u7684\u696d\u52d9\u9700\u6c42\u81ea\u884c\u8a2d\u5b9a\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>3. \u4e0d\u9069\u5408\u7684\u5de5\u4f5c<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u9700\u8981\u7522\u751f\u6587\u5b57\uff08\u64b0\u5beb\u4fe1\u4ef6\u3001\u6458\u8981\u3001\u7a0b\u5f0f\u78bc\uff09\uff0c\u6216\u9700\u8981<strong>\u66f8\u9762\u7406\u7531\u624d\u80fd\u7a3d\u6838<\/strong>\u7684\u6c7a\u7b56\u3002\u6c7a\u7b56\u6a21\u578b\u53ea\u56de\u50b3\u7b54\u6848\u8207\u6a5f\u7387\uff0c\u9019\u985e\u5de5\u4f5c\u4ecd\u61c9\u4ea4\u7d66 LLM\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u7531\u65bc\u4e0a\u8ff0\u5834\u666f\u5927\u591a\u4f4d\u65bc\u4f7f\u7528\u8005\u7b49\u5f85\u7684\u95dc\u9375\u8def\u5f91\u4e0a\uff0c<strong>\u5ef6\u9072<\/strong>\u8207\u300c<strong>\u6c92\u6709\u7b54\u6848\u6642\u600e\u9ebc\u8fa6<\/strong>\u300d\u8207\u6e96\u78ba\u7387\u540c\u7b49\u91cd\u8981\u3002\u6b64\u5916\uff0c\u5224\u65b7\u898f\u5247\u5beb\u5728 criteria \u6587\u5b57\u4e2d\uff1a\u65b0\u589e\u4e00\u500b\u985e\u5225\u6216\u8abf\u6574\u4e00\u500b\u7b49\u7d1a\uff0c\u53ea\u9700\u4fee\u6539\u4e00\u6bb5\u63cf\u8ff0\uff0c<strong>\u7121\u9700\u91cd\u65b0\u8a13\u7df4<\/strong>\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u53d7\u6e2c\u6a21\u578b\u4e00\u89bd<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u53d7\u6e2c\u7684 10 \u7a2e\u6c7a\u7b56\u6a21\u578b\uff0811 \u7d44\u90e8\u7f72\uff09\u6db5\u84cb\u5f9e <strong>322M \u7684\u7de8\u78bc\u5668\u5230 27B \u7684\u96f2\u7aef\u6a21\u578b<\/strong>\uff1b\u5730\u7aef 5 \u500b\u7cfb\u5217\u5404\u63a1\u7528\u4e0d\u540c\u7684\u5167\u90e8\u505a\u6cd5\u3002\u67b6\u69cb\u8aaa\u660e\u53d6\u81ea\u5404\u670d\u52d9 \/v1\/models \u56de\u50b3\u7684\u5b98\u65b9\u63cf\u8ff0\uff0c\u8a18\u61b6\u9ad4\u70ba\u8f09\u5165\u5f8c\u5be6\u969b\u4f54\u7528\u5927\u5c0f\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6a21\u578b<\/strong><\/th><th><strong>\u67b6\u69cb\uff08\u5b98\u65b9\u63cf\u8ff0\uff09<\/strong><\/th><th><strong>\u53c3\u6578\u91cf\uff0f\u7cbe\u5ea6<\/strong><\/th><th><strong>\u8a18\u61b6\u9ad4<\/strong><\/th><th><strong>\u90e8\u7f72\u4f4d\u7f6e<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>jev-latest<\/strong><\/td><td>TypeSafe \u7684 System One \u6c7a\u7b56\u6a21\u578b\uff0c\u672a\u516c\u958b\u67b6\u69cb<\/td><td>\u672a\u516c\u958b<\/td><td>\u2014<\/td><td>\u96f2\u7aef api.typesafe.ai<\/td><\/tr><tr><td><strong>vllm-sr\/d3<\/strong><\/td><td>d3-turbo \u7684\u5225\u540d\uff0c\u53ef\u8b80\u53d6\u6587\u5b57\u3001\u5716\u7247\u3001\u5f71\u7247<\/td><td>27B<\/td><td>\u2014<\/td><td>\u96f2\u7aef decision.vllm-sr.ai<\/td><\/tr><tr><td><strong>vllm-sr\/d3-flash<\/strong><\/td><td>\u540c\u7cfb\u5217\u8f03\u5c0f\u7248\u672c<\/td><td>9B<\/td><td>\u2014<\/td><td>\u96f2\u7aef decision.vllm-sr.ai<\/td><\/tr><tr><td><strong>vllm-sr\/d3-mini<\/strong><\/td><td>\u540c\u7cfb\u5217\u8f03\u5c0f\u7248\u672c<\/td><td>4B<\/td><td>\u2014<\/td><td>\u96f2\u7aef decision.vllm-sr.ai<\/td><\/tr><tr><td><strong>winnow:latest<\/strong><\/td><td>Gemma 4 12B IT \u5fae\u8abf\uff0c\u65bc\u81ea\u6709 prompt \u5f8c\u8b80\u53d6\u9078\u9805\u6a19\u7c64\u7684 logits<\/td><td>12B\uff0fQ8_0 GGUF<\/td><td>12.7 GB<\/td><td>\u5730\u7aef Ollaya<\/td><\/tr><tr><td><strong>winnow:e4b<\/strong><\/td><td>Gemma 4 E4B IT \u5fae\u8abf\uff0c\u505a\u6cd5\u540c\u4e0a\uff0c\u53e6\u52a0\u4f5c\u8005\u64ec\u5408\u7684 temperature<\/td><td>7.5B\uff0fQ8_0 GGUF<\/td><td>8.0 GB<\/td><td>\u5730\u7aef Ollaya<\/td><\/tr><tr><td><strong>clef:flash<\/strong><\/td><td>Qwen3.5-9B \u5f8c\u8a13\u7df4\uff0c\u806f\u5408 schema head \u65bc\u4e00\u6b21 forward pass \u4e2d\u66ff\u6240\u6709\u554f\u984c\u7684\u6240\u6709\u9078\u9805\u8a55\u5206<\/td><td>9B\uff0fF32 ONNX<\/td><td>19 GB<\/td><td>\u5730\u7aef Ollaya<\/td><\/tr><tr><td><strong>clef-flash@ollama-q8<\/strong><\/td><td>\u540c\u4e00\u500b clef-flash\uff0c\u6539\u4ee5 llama.cpp \u57f7\u884c<\/td><td>9.1B\uff0fQ8_0 GGUF<\/td><td>12.8 GB<\/td><td>\u5730\u7aef ollama<\/td><\/tr><tr><td><strong>kev:4b<\/strong><\/td><td>Qwen3.5-4B base \u52a0 LoRA \u8207 pointer head<\/td><td>4.2B\uff0fF32 ONNX<\/td><td>9.5 GB<\/td><td>\u5730\u7aef Ollaya<\/td><\/tr><tr><td><strong>clm:8b<\/strong><\/td><td>\u5c0d\u6bd4\u5f0f\uff1aQwen3-8B \u7de8\u78bc\u5668\u5206\u5225\u5d4c\u5165 state \u8207\u6bcf\u500b\u9078\u9805\uff0c\u4ee5\u76f8\u4f3c\u5ea6\u8a55\u5206\uff0c\u91cd\u8907\u9078\u9805\u6703\u5feb\u53d6<\/td><td>8.2B\uff0fF32 ONNX<\/td><td>16 GB<\/td><td>\u5730\u7aef Ollaya<\/td><\/tr><tr><td><strong>laya:multilingual<\/strong><\/td><td>mmBERT-base\uff0c\u652f\u63f4 100 \u591a\u7a2e\u8a9e\u8a00<\/td><td>322M\uff0fF16<\/td><td>0.7 GB<\/td><td>\u5730\u7aef Ollaya<\/td><\/tr><tr><td><strong>gpt-oss-safeguard:20b<\/strong><\/td><td>\u751f\u6210\u5f0f\u63a8\u7406\u6a21\u578b\uff0c\u4f9d\u653f\u7b56\u6587\u5b57\u505a\u5b89\u5168\u5206\u985e\uff08\u5c0d\u7167\u7d44\uff09<\/td><td>20B<\/td><td>12.9 GB<\/td><td>\u53e6\u4e00\u53f0\u5171\u7528\u7684 Ollama \u4e3b\u6a5f<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u67b6\u69cb\u5dee\u7570\u53ef\u80fd\u76f4\u63a5\u53cd\u6620\u5728\u7d50\u679c\u4e0a\uff1a\u4ee5<strong>\u76f8\u4f3c\u5ea6\u8a55\u5206<\/strong>\u7684 laya \u8207 clm\uff0c\u5728\u672c\u6b21 criteria \u4e0b\u5e7e\u4e4e\u7121\u6cd5\u4f7f\u7528\u3002\u6211\u5011\u63a8\u6e2c\u9019\u8207 criteria \u4e2d\u7684<strong>\u5426\u5b9a\u53e5\u8207\u512a\u5148\u898f\u5247<\/strong>\u6709\u95dc\uff08\u8a73\u898b\u300c\u4e09\u9805\u95dc\u9375\u6280\u8853\u89c0\u5bdf\u300d\uff09\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u6211\u5011\u5982\u4f55\u6e2c\u8a66\uff1f<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u5169\u7a2e\u60c5\u5883\u5171\u7528\u540c\u4e00\u5957\u6d41\u7a0b\uff1a\u6bcf\u500b\u6a21\u578b\u7686\u4ee5<strong>\u540c\u4e00\u6279\u3001\u540c\u6a23\u9806\u5e8f<\/strong>\u7684\u984c\u76ee\u9010\u7b46\u547c\u53eb\uff1b\u5730\u7aef Ollaya \u8207 ollama \u4e0a\u7684\u6a21\u578b\u7686\u5728<strong>\u7368\u4f54 GPU<\/strong> \u4e0b\u6e2c\u8a66\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. \u5169\u7a2e\u6e2c\u8a66\u60c5\u5883<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u9805\u76ee<\/strong><\/th><th><strong>Domain\uff08\u4e3b\u984c\u5206\u985e\uff09<\/strong><\/th><th><strong>Guard\uff08\u5167\u5bb9\u5b89\u5168\uff09<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u985e\u5225<\/strong><\/td><td>\u91ab\u7642\u3001\u8ca1\u52d9\u3001\u6cd5\u5f8b\u3001\u654f\u611f\u8cc7\u6599\u3001\u4e00\u822c\uff0c\u5171 5 \u985e<\/td><td>\u9a37\u64fe\u3001\u4ec7\u6068\u8a00\u8ad6\u3001\u66b4\u529b\u3001\u9f13\u52f5\u81ea\u6bba\u3001\u63d0\u793a\u6ce8\u5165\u3001\u6b63\u5e38\u7b49\uff0c\u5171 13 \u985e<\/td><\/tr><tr><td><strong>\u5224\u65b7\u898f\u5247<\/strong><\/td><td>\u593e\u5e36\u6a5f\u5bc6\u6216\u500b\u8cc7\u6642\uff0c\u4e0d\u8ad6\u4e3b\u984c\u4e00\u5f8b\u5224\u70ba\u300c\u654f\u611f\u8cc7\u6599\u300d<\/td><td>\u4e00\u4efd 13 \u985e\u7684 prompt guard criteria\uff0c\u6e2c\u8a66\u6642\u4e00\u5b57\u4e0d\u6539<\/td><\/tr><tr><td><strong>\u8cc7\u6599\u91cf<\/strong><\/td><td>\u6bcf\u985e 500 \u7b46\uff0c\u5171 2,500 \u7b46<\/td><td>\u6bcf\u985e 200 \u7b46\uff0c\u5171 2,600 \u7b46<\/td><\/tr><tr><td><strong>\u8a9e\u8a00<\/strong><\/td><td>\u7e41\u4e2d\u3001\u82f1\u6587\u5404\u534a<\/td><td>\u7e41\u4e2d\u3001\u82f1\u6587\u5404\u534a<\/td><\/tr><tr><td><strong>\u56f0\u96e3\u984c\u6bd4\u4f8b<\/strong><\/td><td>20%\uff1b\u654f\u611f\u8cc7\u6599\u985e 40%<\/td><td>\u591a\u6578\u985e\u5225 25%\uff1b\u6b63\u5e38\u985e 60%<\/td><\/tr><tr><td><strong>\u6bcf\u6b21\u8acb\u6c42\u8f38\u5165\u91cf<\/strong><\/td><td>\u7d04 480 tokens<\/td><td>\u7d04 1,150 tokens<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. \u6e2c\u8a66\u8cc7\u6599\u4f86\u6e90<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u7531 LLM \u4f9d\u64b0\u5beb\u898f\u683c\u9010\u7b46\u751f\u6210<\/strong>\uff0c\u7981\u6b62\u4ee5\u6a21\u677f\u5957\u5b57\u3002\u7e41\u4e2d\u8207\u82f1\u6587\u5404\u81ea\u7368\u7acb\u64b0\u5beb\u3001\u975e\u4e92\u8b6f\uff1b\u5f62\u5f0f\u6db5\u84cb\u77ed\u554f\u53e5\u3001\u804a\u5929\u8a0a\u606f\u3001email \u8207\u8ad6\u58c7\u8cbc\u6587\u3002<\/li>\n\n\n\n<li><strong>\u56f0\u96e3\u984c\u523b\u610f\u6df7\u5165\u5176\u4ed6\u985e\u5225\u7684\u5b57\u773c<\/strong>\u3002\u4f8b\u5982\u300c\u6709\u6c92\u6709\u8ddf\u300a\u6a5f\u667a\u91ab\u751f\u751f\u6d3b\u300b\u4e00\u6a23\u597d\u770b\u7684\u97d3\u5287\uff1f\u300d\u5c6c\u65bc\u4e00\u822c\u985e\uff1b\u300c\u75c5\u60a3\u9673\u6021\u541b\uff0c\u8eab\u5206\u8b49 A225678901\uff0c\u78ba\u8a3a\u7b2c\u4e8c\u671f\u4e73\u764c\u2026\u2026\u300d\u4e3b\u984c\u662f\u91ab\u7642\uff0c\u4f46\u542b\u865b\u69cb\u500b\u8cc7\uff0c\u61c9\u5224\u70ba\u654f\u611f\u8cc7\u6599\u3002<\/li>\n\n\n\n<li><strong>\u4ee5\u7a0b\u5f0f\u9a57\u8b49\u54c1\u8cea<\/strong>\uff1a\u53bb\u9664\u91cd\u8907\u3001\u6aa2\u67e5\u6b04\u4f4d\uff0c\u4e26\u4ee5\u6b63\u898f\u8868\u793a\u5f0f\u6383\u63cf\u975e\u654f\u611f\u985e\u5225\u662f\u5426\u8aa4\u542b\u500b\u8cc7\u6a23\u5f0f\u3002<\/li>\n\n\n\n<li><strong>Guard \u8cc7\u6599\u4f86\u6e90\u8aaa\u660e<\/strong>\uff1a13 \u985e\u4e2d 9 \u985e\u7531 LLM \u64b0\u5beb\uff1b\u96b1\u79c1\u985e\u6cbf\u7528 Domain \u7684\u500b\u8cc7\u984c\uff1b\u4ec7\u6068\u8a00\u8ad6\u3001\u9f13\u52f5\u81ea\u6bba\u3001\u9055\u6cd5\u5354\u52a9 3 \u985e\u56e0\u64b0\u5beb\u6642\u906d LLM \u5b89\u5168\u6a5f\u5236\u963b\u64cb\uff0c\u6539\u7528\u53e6\u884c\u53d6\u5f97\u7684\u8cc7\u6599\uff0c\u53e5\u578b\u8f03\u6a21\u677f\u5316\u3001\u7bc7\u5e45\u8f03\u77ed\u3002<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>3. \u57f7\u884c\u74b0\u5883<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5730\u7aef<\/strong>\uff1a\u4e00\u5f35 NVIDIA RTX 3090\uff0824 GB\uff09\u3002\u6c7a\u7b56\u6a21\u578b\u7531 Ollaya \u63d0\u4f9b\u2014\u2014\u9019\u662f\u4e00\u5957\u985e\u4f3c Ollama\u3001\u63d0\u4f9b \/v1\/systemone \u4ecb\u9762\u7684\u63a8\u8ad6\u4f3a\u670d\u5668\uff1bclef-flash \u7684 Q8 \u7248\u672c\u5247\u7531\u540c\u4e00\u53f0\u6a5f\u5668\u4e0a\u7684 ollama\uff08llama.cpp\uff09\u63d0\u4f9b\u3002<\/li>\n\n\n\n<li><strong>\u5c0d\u7167\u7d44<\/strong>\uff1agpt-oss-safeguard:20b \u57f7\u884c\u65bc\u53e6\u4e00\u53f0\u5171\u7528\u7684 Ollama \u4e3b\u6a5f\u3002\u6a21\u578b\u5b8c\u6574\u8f09\u5165 VRAM\uff0c\u4f46\u540c\u6a5f\u53e6\u8f09\u6709\u5176\u4ed6\u4f7f\u7528\u8005\u7684\u6a21\u578b\uff0c<strong>\u7121\u6cd5\u4fdd\u8b49\u7368\u4f54<\/strong>\u3002<\/li>\n\n\n\n<li><strong>\u96f2\u7aef<\/strong>\uff1ajev-latest\uff08api.typesafe.ai\uff09\u3001vllm-sr d3 \u7cfb\u5217\uff08decision.vllm-sr.ai\uff09\uff0c\u5ef6\u9072\u5305\u542b\u53f0\u7063\u81f3\u8a72\u670d\u52d9\u7684\u7db2\u8def\u5f80\u8fd4\u3002<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>4. \u6e2c\u8a66\u6d41\u7a0b<\/strong><\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u900f\u904e SSH \u57f7\u884c systemctl restart ollaya \u6e05\u7a7a VRAM\u3002\u7531\u65bc ollama \u8207 Ollaya \u5171\u7528\u540c\u4e00\u5f35 GPU\uff0c\u6e2c\u8a66 clef-flash \u524d\u4ea6\u5148\u6e05\u7a7a Ollaya\u3002<\/li>\n\n\n\n<li><strong>\u6696\u6a5f<\/strong>\uff1a\u9700\u6210\u529f\u56de\u61c9 3 \u6b21\u624d\u6b63\u5f0f\u958b\u59cb\u3002\u9996\u6b21\u8acb\u6c42\u7d66\u4e88 900 \u79d2\u903e\u6642\uff0c\u8b93\u4f3a\u670d\u5668\u6709\u6642\u9593\u8f09\u5165\u6a21\u578b\uff1b\u5931\u6557\u5373\u91cd\u8a66\u3002<\/li>\n\n\n\n<li>\u4ee5 ollaya ps \u6216 \/api\/ps \u78ba\u8a8d\u6a21\u578b\u5b8c\u6574\u4f4d\u65bc GPU \u4e0a\uff0c\u5426\u5247\u4e0d\u4e88\u6e2c\u8a66\u3002<\/li>\n\n\n\n<li>\u6240\u6709\u6a21\u578b\u4f7f\u7528\u540c\u4e00\u4efd\u4ee5<strong>\u56fa\u5b9a\u4e82\u6578\u7a2e\u5b50<\/strong>\u6253\u4e82\u7684\u984c\u76ee\u9806\u5e8f\uff0c\u4ee5\u55ae\u4e00 keep-alive \u9023\u7dda\u9010\u7b46\u9001\u51fa\uff08concurrency = 1\uff09\u3002<\/li>\n\n\n\n<li>\u6bcf\u7b46\u7d50\u679c\u7acb\u5373\u5beb\u5165 JSONL\uff0c\u4e2d\u65b7\u5f8c\u53ef\u5f9e\u65b7\u9ede\u7e8c\u8dd1\u3002<\/li>\n\n\n\n<li>\u50b3\u8f38\u932f\u8aa4\u8207 5xx \u91cd\u8a66 2 \u6b21\uff1b429 \u4f9d\u4f3a\u670d\u5668\u6307\u793a\u7b49\u5f85\u5f8c\u91cd\u8a66\uff0c\u4e0d\u8a08\u70ba\u932f\u8aa4\u3002<strong>\u91cd\u8a66\u904e\u7684\u8acb\u6c42\u4e0d\u7d0d\u5165\u5ef6\u9072\u7d71\u8a08<\/strong>\u3002<\/li>\n\n\n\n<li>\u6e2c\u8a66\u7d50\u675f\u5f8c\u518d\u6b21\u78ba\u8a8d\u6a21\u578b\u4ecd\u4f4d\u65bc GPU \u4e0a\uff0c\u4e26\u6aa2\u67e5 Ollaya \u672a\u88ab\u5176\u4ed6\u4eba\u8f09\u5165\u6a21\u578b\u3002<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u8a55\u4f30\u6307\u6a19\u600e\u9ebc\u770b\uff1f<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u300c<strong>\u5206\u985e\u6e96\u78ba\u7387<\/strong>\u300d\u56de\u7b54\u7684\u662f\u985e\u5225\u5224\u5f97\u5c0d\u4e0d\u5c0d\uff1b\u300c<strong>\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387<\/strong>\u300d\u56de\u7b54\u7684\u662f\u8a72\u64cb\u7684\u6709\u6c92\u6709\u64cb\u3001\u4e0d\u8a72\u64cb\u7684\u6709\u6c92\u6709\u653e\u3002\u5c0d prompt guard \u800c\u8a00\uff0c\u5f8c\u8005\u624d\u662f\u4e3b\u8981\u6307\u6a19\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. \u5206\u985e\u6307\u6a19<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6307\u6a19<\/strong><\/th><th><strong>\u8a08\u7b97\u65b9\u5f0f<\/strong><\/th><th><strong>\u4ee3\u8868\u610f\u7fa9<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u6e96\u78ba\u7387\uff08Accuracy\uff09<\/strong><\/td><td>\u5224\u5c0d\u7b46\u6578 \u00f7 \u7e3d\u7b46\u6578 N<\/td><td>\u6574\u9ad4\u5224\u5c0d\u6bd4\u4f8b\uff1b\u672a\u56de\u61c9\u6216\u7121\u6cd5\u89e3\u6790\u8005\u4ea6\u8a08\u70ba\u932f\u8aa4<\/td><\/tr><tr><td><strong>Precision\uff08\u985e\u5225 c\uff09<\/strong><\/td><td>TP \u00f7 (TP + FP)<\/td><td>\u9810\u6e2c\u70ba c \u6642\u7684\u6b63\u78ba\u6bd4\u4f8b<\/td><\/tr><tr><td><strong>Recall\uff08\u985e\u5225 c\uff09<\/strong><\/td><td>TP \u00f7 (TP + FN)<\/td><td>\u985e\u5225 c \u88ab\u6b63\u78ba\u8fa8\u8b58\u7684\u6bd4\u4f8b<\/td><\/tr><tr><td><strong>F1\uff08\u985e\u5225 c\uff09<\/strong><\/td><td>2 \u00d7 Precision \u00d7 Recall \u00f7 (Precision + Recall)<\/td><td>Precision \u8207 Recall \u7684\u8abf\u548c\u5e73\u5747<\/td><\/tr><tr><td><strong>Macro-F1<\/strong><\/td><td>\u5404\u985e\u5225 F1 \u7684\u5e73\u5747<\/td><td>\u6bcf\u985e\u6b0a\u91cd\u76f8\u540c\uff0c\u5c11\u6578\u985e\u5225\u8868\u73fe\u5dee\u6703\u76f4\u63a5\u53cd\u6620<\/td><\/tr><tr><td><strong>\u5bec\u9b06\u6e96\u78ba\u7387\uff08Guard\uff09<\/strong><\/td><td>\u5224\u6210 criteria \u5b9a\u7fa9\u4e0a\u91cd\u758a\u7684\u985e\u5225\u4ea6\u8a08\u70ba\u6b63\u78ba<\/td><td>\u4f8b\u5982\u4ec7\u6068\u8a00\u8ad6\u70ba\u9a37\u64fe\u7684\u5b50\u96c6\uff0c\u5224\u6210\u9a37\u64fe\u4e0d\u7b97\u932f<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u8a3b\uff1aTP \u70ba\u7b54\u6848\u8207\u9810\u6e2c\u7686\u70ba c \u7684\u7b46\u6578\uff1bFP \u70ba\u9810\u6e2c\u70ba c \u4f46\u7b54\u6848\u4e0d\u662f c\uff1bFN \u70ba\u7b54\u6848\u70ba c \u4f46\u9810\u6e2c\u4e0d\u662f c\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. \u6514\u622a\uff0f\u653e\u884c\u6307\u6a19\uff08Guard\uff09<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u9810\u6e2c\u70ba\u300c\u6b63\u5e38\u300d\u4ee5\u5916\u7684\u4efb\u4f55\u985e\u5225\u7686\u8996\u70ba<strong>\u6514\u622a<\/strong>\uff0c\u4e0d\u8ad6\u985e\u5225\u662f\u5426\u6b63\u78ba\u3002\u300c\u53d7\u4fdd\u8b77\u7279\u5fb5\u300d\u7684\u984c\u76ee\u5c6c\u4e2d\u6027\u5167\u5bb9\uff0c\u4e0d\u5217\u5165\u8a08\u7b97\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6307\u6a19<\/strong><\/th><th><strong>\u8a08\u7b97\u65b9\u5f0f<\/strong><\/th><th><strong>\u4ee3\u8868\u610f\u7fa9<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u6709\u5bb3\u6514\u622a\u7387\uff08TPR\uff09<\/strong><\/td><td>\u88ab\u6514\u622a\u7684\u6709\u5bb3\u984c \u00f7 \u6709\u5bb3\u984c<\/td><td>\u8a72\u64cb\u7684\u64cb\u4e86\u591a\u5c11<\/td><\/tr><tr><td><strong>\u8aa4\u64cb\u7387\uff08FPR\uff09<\/strong><\/td><td>\u88ab\u6514\u622a\u7684\u6b63\u5e38\u984c \u00f7 \u6b63\u5e38\u984c<\/td><td>\u4e0d\u8a72\u64cb\u7684\u64cb\u4e86\u591a\u5c11<\/td><\/tr><tr><td><strong>\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387<\/strong><\/td><td>(TPR + (1 \u2212 FPR)) \u00f7 2<\/td><td>\u5169\u8005\u5e73\u5747\uff0c\u4e0d\u53d7\u6709\u5bb3\u984c\u8207\u6b63\u5e38\u984c\u6bd4\u4f8b\u5f71\u97ff<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e4b\u6240\u4ee5\u63a1\u7528\u5e73\u8861\u6e96\u78ba\u7387\u800c\u975e\u4e00\u822c\u6b63\u78ba\u7387\uff0c\u662f\u56e0\u70ba\u6709\u5bb3\u984c\u6709 2,200 \u7b46\u3001\u6b63\u5e38\u984c\u50c5 200 \u7b46\uff1a\u4e00\u500b<strong>\u4ec0\u9ebc\u90fd\u64cb<\/strong>\u7684\u6a21\u578b\uff0c\u4e00\u822c\u6b63\u78ba\u7387\u53ef\u9054 91.7%\uff0c\u5e73\u8861\u6e96\u78ba\u7387\u537b\u53ea\u6709 50%\u3002laya:multilingual \u6b63\u662f\u5982\u6b64\u2014\u2014\u6514\u622a\u7387 98.9%\u3001\u8aa4\u64cb\u7387 98.5%\uff0c\u5e73\u8861\u6e96\u78ba\u7387\u50c5 50.2%\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>3. \u901f\u5ea6\u6307\u6a19<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6307\u6a19<\/strong><\/th><th><strong>\u8a08\u7b97\u65b9\u5f0f<\/strong><\/th><th><strong>\u4ee3\u8868\u610f\u7fa9<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u5ef6\u9072<\/strong><\/td><td>Client \u7aef\u91cf\u6e2c\u7684\u7aef\u5230\u7aef\u6642\u9593\uff0c\u91cd\u8a66\u904e\u7684\u8acb\u6c42\u4e0d\u7d0d\u5165<\/td><td>\u542b\u7db2\u8def\u8207\u4f3a\u670d\u5668\u6392\u968a\u7684\u5be6\u969b\u7b49\u5f85\u6642\u9593<\/td><\/tr><tr><td><strong>p50\u3001p95\u3001p99<\/strong><\/td><td>\u5ef6\u9072\u7531\u5c0f\u5230\u5927\u6392\u5e8f\uff0c\u4ee4 h = (n \u2212 1) \u00d7 q\uff0c\u53d6\u7b2c \u230ah\u230b \u8207\u7b2c \u230ah\u230b + 1 \u7b46\uff08\u5f9e 0 \u8d77\u7b97\uff09\uff0c\u4f9d h \u7684\u5c0f\u6578\u90e8\u5206\u7dda\u6027\u5167\u63d2<\/td><td>p95 \u8207 p50 \u7684\u5dee\u8ddd\u53cd\u6620\u5c3e\u7aef\u5ef6\u9072\u7684\u7a69\u5b9a\u5ea6<\/td><\/tr><tr><td><strong>\u55ae\u9023\u7dda\u541e\u5410\u91cf<\/strong><\/td><td>1000 \u00f7 \u5e73\u5747\u5ef6\u9072\uff08ms\uff09<\/td><td>\u55ae\u4e00\u9023\u7dda\u6bcf\u79d2\u53ef\u8655\u7406\u7b46\u6578\uff1b\u591a\u9023\u7dda\u7e3d\u541e\u5410\u91cf\u672c\u6b21\u672a\u6e2c<\/td><\/tr><tr><td><strong>\u51b7\u555f\u52d5<\/strong><\/td><td>\u91cd\u555f\u5f8c\u7b2c\u4e00\u6b21\u8acb\u6c42\u7684\u5ef6\u9072<\/td><td>\u5305\u542b\u8f09\u5165\u6a21\u578b\u7684\u6642\u9593<\/td><\/tr><tr><td><strong>tokens\u2013\u5ef6\u9072\u76f8\u95dc\u4fc2\u6578<\/strong><\/td><td>\u8f38\u5165\uff08\u6216\u8f38\u51fa\uff09tokens \u8207\u5ef6\u9072\u7684 Pearson r<\/td><td>\u5224\u65b7\u5ef6\u9072\u7531\u8f38\u5165\u9577\u5ea6\u6216\u8f38\u51fa\u9577\u5ea6\u9a45\u52d5<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>4. \u4fe1\u5fc3\u5206\u6578<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u6c7a\u7b56\u6a21\u578b\u6703\u56de\u50b3 confidence\u3002\u6211\u5011\u8a08\u7b97\u300c<strong>confidence \u2265 0.9 \u7684\u8986\u84cb\u7387<\/strong>\u300d\u53ca\u8a72\u90e8\u5206\u7684\u6e96\u78ba\u7387\uff0c\u7528\u4ee5\u8a55\u4f30\u80fd\u5426\u4ee5\u9580\u6abb\u5206\u6d41\uff1a\u9ad8\u4fe1\u5fc3\u8005\u76f4\u63a5\u63a1\u7528\uff0c\u5176\u9918\u4ea4\u7531\u66f4\u5f37\u7684\u6a21\u578b\u8655\u7406\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u6e2c\u8a66\u7d50\u679c\u4e00\uff1aDomain \u4e3b\u984c\u5206\u985e<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u524d\u4e09\u540d\u6e96\u78ba\u7387\u7686\u5728 <strong>98.9% \u4ee5\u4e0a<\/strong>\uff0c\u5dee\u8ddd\u4e0d\u5230 1 \u500b\u767e\u5206\u9ede\uff1b\u771f\u6b63\u62c9\u958b\u5dee\u8ddd\u7684\u662f\u300c<strong>\u654f\u611f\u8cc7\u6599<\/strong>\u300d\u9019\u4e00\u985e\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6a21\u578b<\/strong><\/th><th><strong>\u90e8\u7f72<\/strong><\/th><th><strong>\u6e96\u78ba\u7387<\/strong><\/th><th><strong>\u7e41\u4e2d\uff0f\u82f1\u6587<\/strong><\/th><th><strong>\u654f\u611f\u8cc7\u6599 Recall<\/strong><\/th><th><strong>p50<\/strong><\/th><th><strong>p95<\/strong><\/th><\/tr><\/thead><tbody><tr><td>jev-latest<\/td><td>\u96f2\u7aef<\/td><td>99.8%<\/td><td>99.8%\uff0f99.7%<\/td><td>99.2%<\/td><td>205 ms<\/td><td>286 ms<\/td><\/tr><tr><td>winnow:latest<\/td><td>\u5730\u7aef<\/td><td>99.0%<\/td><td>99.0%\uff0f99.0%<\/td><td>100.0%<\/td><td>203 ms<\/td><td>225 ms<\/td><\/tr><tr><td>vllm-sr\/d3<\/td><td>\u96f2\u7aef<\/td><td>98.9%<\/td><td>98.7%\uff0f99.0%<\/td><td>94.8%<\/td><td>276 ms<\/td><td>296 ms<\/td><\/tr><tr><td>vllm-sr\/d3-flash<\/td><td>\u96f2\u7aef<\/td><td>97.0%<\/td><td>97.0%\uff0f97.0%<\/td><td>86.6%<\/td><td>231 ms<\/td><td>240 ms<\/td><\/tr><tr><td>vllm-sr\/d3-mini<\/td><td>\u96f2\u7aef<\/td><td>95.5%<\/td><td>95.0%\uff0f95.9%<\/td><td>79.6%<\/td><td>228 ms<\/td><td>235 ms<\/td><\/tr><tr><td>clef:flash<\/td><td>\u5730\u7aef\uff08F32\uff09<\/td><td>94.2%<\/td><td>93.7%\uff0f94.7%<\/td><td>73.2%<\/td><td>809 ms<\/td><td>878 ms<\/td><\/tr><tr><td>clef-flash@ollama-q8<\/td><td>\u5730\u7aef\uff08Q8\uff09<\/td><td>94.2%<\/td><td>93.8%\uff0f94.6%<\/td><td>73.6%<\/td><td>246 ms<\/td><td>264 ms<\/td><\/tr><tr><td>winnow:e4b<\/td><td>\u5730\u7aef<\/td><td>93.2%<\/td><td>93.8%\uff0f92.6%<\/td><td>99.2%<\/td><td>106 ms<\/td><td>119 ms<\/td><\/tr><tr><td>kev:4b<\/td><td>\u5730\u7aef<\/td><td>87.9%<\/td><td>87.4%\uff0f88.3%<\/td><td>47.0%<\/td><td>479 ms<\/td><td>537 ms<\/td><\/tr><tr><td>laya:multilingual<\/td><td>\u5730\u7aef<\/td><td>35.8%<\/td><td>35.5%\uff0f36.2%<\/td><td>55.4%<\/td><td>30 ms<\/td><td>39 ms<\/td><\/tr><tr><td>clm:8b<\/td><td>\u5730\u7aef<\/td><td>32.7%<\/td><td>34.0%\uff0f31.4%<\/td><td>10.0%<\/td><td>186 ms<\/td><td>239 ms<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" decoding=\"async\" width=\"1024\" height=\"504\" data-attachment-id=\"15861\" data-permalink=\"https:\/\/ai-stack.ai\/zh-hant\/jev-benchmark\/image-100\" data-orig-file=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/ed06174a-edited.png?fit=1459%2C718&amp;quality=100&amp;ct=202603031250&amp;ssl=1\" data-orig-size=\"1459,718\" data-comments-opened=\"0\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/ed06174a-edited.png?fit=1024%2C504&amp;quality=100&amp;ct=202603031250&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/ed06174a-edited-1024x504.png?resize=1024%2C504&#038;quality=100&#038;ct=202603031250&#038;ssl=1\" alt=\"\" class=\"wp-image-15861\"\/><\/figure>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u5dee\u8ddd\u96c6\u4e2d\u5728\u300c\u654f\u611f\u8cc7\u6599\u300d<\/strong>\uff1a\u91ab\u7642\u3001\u8ca1\u52d9\u3001\u6cd5\u5f8b\u3001\u4e00\u822c\u56db\u985e\uff0c\u524d\u4e03\u540d\u7686\u5728 95% \u4ee5\u4e0a\uff1b\u654f\u611f\u8cc7\u6599\u7684 Recall \u5247\u5f9e 100% \u4e00\u8def\u4e0b\u6ed1\u81f3 47%\u3002\u5224\u932f\u7684\u591a\u70ba\u300c<strong>\u4e3b\u984c\u662f\u6cd5\u5f8b\u6216\u8ca1\u52d9\u3001\u5167\u5bb9\u593e\u5e36\u6a5f\u5bc6<\/strong>\u300d\u7684\u56f0\u96e3\u984c\u2014\u2014\u6a21\u578b\u4f9d\u4e3b\u984c\u5206\u985e\uff0c\u5ffd\u7565\u4e86\u300c\u6709\u654f\u611f\u8cc7\u6599\u5c31\u512a\u5148\u300d\u7684\u898f\u5247\u3002jev-latest \u5224\u932f\u7684 6 \u7b46\u4e2d\uff0c\u6709 4 \u7b46\u662f\u5167\u90e8\u6295\u6a19\u91d1\u984d\u6216\u5408\u7d04\u55ae\u50f9\u3002<\/li>\n\n\n\n<li><strong>\u4e2d\u82f1\u6587\u7121\u660e\u986f\u5dee\u7570<\/strong>\uff1a\u53ef\u7528\u6a21\u578b\u7684\u7e41\u4e2d\u8207\u82f1\u6587\u6e96\u78ba\u7387\u5dee\u8ddd\uff0c\u7686\u5728 <strong>1.2 \u500b\u767e\u5206\u9ede<\/strong>\u4ee5\u5167\u3002<\/li>\n\n\n\n<li><strong>\u901f\u5ea6\u8868\u73fe<\/strong>\uff1a\u53ef\u7528\u6a21\u578b\u4e2d\u4ee5 <strong>winnow:e4b \u6700\u5feb<\/strong>\uff08p50 106 ms\uff09\u3002\u540c\u4e00\u500b clef-flash \u6539\u4ee5 llama.cpp \u57f7\u884c Q8 \u5f8c\uff0cp50 \u5f9e 809 ms \u964d\u81f3 246 ms\u3002\u5730\u7aef\u6a21\u578b\u91cd\u555f\u5f8c\u7684\u7b2c\u4e00\u6b21\u8acb\u6c42\uff0c\u9700 1.4\u20136.7 \u79d2\u8f09\u5165\u3002<\/li>\n\n\n\n<li><strong>\u6e96\u78ba\u7387 \u00d7 \u901f\u5ea6\u7684 Pareto \u524d\u7de3<\/strong>\uff1a\u6c92\u6709\u5176\u4ed6\u6a21\u578b\u80fd\u540c\u6642\u66f4\u6e96\u53c8\u66f4\u5feb\u7684\u7d44\u5408\u70ba\uff1ajev-latest\u3001winnow:latest\u3001winnow:e4b \u8207 laya:multilingual\u3002\u5176\u4e2d laya \u4e0a\u699c\u7d14\u7cb9\u56e0\u70ba\u901f\u5ea6\u6700\u5feb\uff0c35.8% \u7684\u6e96\u78ba\u7387<strong>\u4e26\u4e0d\u5177\u5be6\u7528\u6027<\/strong>\u3002<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u6e2c\u8a66\u7d50\u679c\u4e8c\uff1aGuard \u5167\u5bb9\u5b89\u5168<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">jev-latest\u3001vllm-sr\/d3\u3001winnow:latest \u4e09\u500b\u6a21\u578b\u7686\u6514\u4e0b <strong>94\u201395% \u7684\u6709\u5bb3\u5167\u5bb9<\/strong>\uff0c\u8aa4\u64cb\u7387\u5728 <strong>2% \u4ee5\u4e0b<\/strong>\u3002\u4ee5\u4e0b\u4f9d\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387\u6392\u5e8f\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1. \u6514\u622a\u8868\u73fe\u8207\u5ef6\u9072<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6a21\u578b<\/strong><\/th><th><strong>\u90e8\u7f72<\/strong><\/th><th><strong>\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387<\/strong><\/th><th><strong>\u6709\u5bb3\u6514\u622a\u7387<\/strong><\/th><th><strong>\u8aa4\u64cb\u7387\uff0895% \u4fe1\u8cf4\u5340\u9593\uff09<\/strong><\/th><th><strong>p50<\/strong><\/th><\/tr><\/thead><tbody><tr><td>jev-latest<\/td><td>\u96f2\u7aef<\/td><td>97.4%<\/td><td>95.3%<\/td><td>0.5%\uff080.1\u20132.8%\uff09<\/td><td>207 ms<\/td><\/tr><tr><td>vllm-sr\/d3<\/td><td>\u96f2\u7aef<\/td><td>96.9%<\/td><td>94.3%<\/td><td>0.5%\uff080.1\u20132.8%\uff09<\/td><td>344 ms<\/td><\/tr><tr><td>winnow:latest<\/td><td>\u5730\u7aef<\/td><td>96.3%<\/td><td>94.6%<\/td><td>2.0%\uff080.8\u20135.0%\uff09<\/td><td>416 ms<\/td><\/tr><tr><td>gpt-oss-safeguard\uff08\u6539\u826f prompt\uff09<\/td><td>\u5730\u7aef\uff08\u53e6\u4e00\u4e3b\u6a5f\uff09<\/td><td>94.6%<\/td><td>89.2%<\/td><td>0.0%\uff080.0\u20131.9%\uff09<\/td><td>1.58 s<\/td><\/tr><tr><td>vllm-sr\/d3-flash<\/td><td>\u96f2\u7aef<\/td><td>94.1%<\/td><td>94.8%<\/td><td>6.5%\uff083.8\u201310.8%\uff09<\/td><td>257 ms<\/td><\/tr><tr><td>vllm-sr\/d3-mini<\/td><td>\u96f2\u7aef<\/td><td>93.7%<\/td><td>93.0%<\/td><td>5.5%\uff083.1\u20139.6%\uff09<\/td><td>243 ms<\/td><\/tr><tr><td>gpt-oss-safeguard\uff08\u539f\u59cb prompt\uff09<\/td><td>\u5730\u7aef\uff08\u53e6\u4e00\u4e3b\u6a5f\uff09<\/td><td>91.8%<\/td><td>83.6%<\/td><td>0.0%\uff080.0\u20131.9%\uff09<\/td><td>1.92 s<\/td><\/tr><tr><td>winnow:e4b<\/td><td>\u5730\u7aef<\/td><td>90.6%<\/td><td>91.3%<\/td><td>10.0%\uff086.6\u201314.9%\uff09<\/td><td>208 ms<\/td><\/tr><tr><td>kev:4b<\/td><td>\u5730\u7aef<\/td><td>90.0%<\/td><td>94.4%<\/td><td>14.5%\uff0810.3\u201320.0%\uff09<\/td><td>1.08 s<\/td><\/tr><tr><td>clef-flash@ollama-q8<\/td><td>\u5730\u7aef\uff08Q8\uff09<\/td><td>79.6%<\/td><td>98.7%<\/td><td>39.5%\uff0833.0\u201346.4%\uff09<\/td><td>514 ms<\/td><\/tr><tr><td>clef:flash<\/td><td>\u5730\u7aef\uff08F32\uff09<\/td><td>79.3%<\/td><td>98.6%<\/td><td>40.0%\uff0833.5\u201346.9%\uff09<\/td><td>1.79 s<\/td><\/tr><tr><td>laya:multilingual<\/td><td>\u5730\u7aef<\/td><td>50.2%<\/td><td>98.9%<\/td><td>98.5%\uff0895.7\u201399.5%\uff09<\/td><td>30 ms<\/td><\/tr><tr><td>clm:8b<\/td><td>\u5730\u7aef<\/td><td>49.1%<\/td><td>1.3%<\/td><td>3.0%\uff081.4\u20136.4%\uff09<\/td><td>139 ms<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>2. \u5206\u985e\u6e96\u78ba\u7387\u8207\u91cd\u9ede\u985e\u5225\u6514\u622a\u7387<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6a21\u578b<\/strong><\/th><th><strong>\u5206\u985e\u6e96\u78ba\u7387<\/strong><\/th><th><strong>\u96b1\u79c1\u6514\u622a\u7387<\/strong><\/th><th><strong>\u63d0\u793a\u6ce8\u5165\u6514\u622a\u7387<\/strong><\/th><\/tr><\/thead><tbody><tr><td>jev-latest<\/td><td>83.2%<\/td><td>61.5%<\/td><td>100.0%<\/td><\/tr><tr><td>vllm-sr\/d3<\/td><td>80.6%<\/td><td>64.5%<\/td><td>100.0%<\/td><\/tr><tr><td>winnow:latest<\/td><td>78.3%<\/td><td>73.0%<\/td><td>98.0%<\/td><\/tr><tr><td>gpt-oss-safeguard\uff08\u6539\u826f prompt\uff09<\/td><td>73.3%<\/td><td>72.0%<\/td><td>76.5%<\/td><\/tr><tr><td>vllm-sr\/d3-flash<\/td><td>83.3%<\/td><td>85.5%<\/td><td>100.0%<\/td><\/tr><tr><td>vllm-sr\/d3-mini<\/td><td>80.1%<\/td><td>67.5%<\/td><td>100.0%<\/td><\/tr><tr><td>gpt-oss-safeguard\uff08\u539f\u59cb prompt\uff09<\/td><td>69.0%<\/td><td>60.5%<\/td><td>62.5%<\/td><\/tr><tr><td>winnow:e4b<\/td><td>73.4%<\/td><td>48.0%<\/td><td>84.0%<\/td><\/tr><tr><td>kev:4b<\/td><td>76.3%<\/td><td>70.0%<\/td><td>86.5%<\/td><\/tr><tr><td>clef-flash@ollama-q8<\/td><td>77.9%<\/td><td>95.5%<\/td><td>99.5%<\/td><\/tr><tr><td>clef:flash<\/td><td>77.9%<\/td><td>95.5%<\/td><td>99.5%<\/td><\/tr><tr><td>laya:multilingual<\/td><td>21.6%<\/td><td>100.0%<\/td><td>100.0%<\/td><\/tr><tr><td>clm:8b<\/td><td>7.5%<\/td><td>1.5%<\/td><td>0.0%<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>3. \u7d50\u679c\u89e3\u8b80<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u524d\u4e09\u540d\u5728\u7d71\u8a08\u4e0a\u96e3\u5206\u9ad8\u4e0b<\/strong>\uff1a\u8aa4\u64cb\u7387\u50c5\u4f86\u81ea 200 \u7b46\u6b63\u5e38\u984c\uff0c0.5% \u8207 2.0% \u5be6\u969b\u4e0a\u53ea\u662f 1 \u7b46\u8207 4 \u7b46\u7684\u5dee\u5225\uff0c\u4fe1\u8cf4\u5340\u9593\u5927\u5e45\u91cd\u758a\u3002<\/li>\n\n\n\n<li><strong>\u96b1\u79c1\u662f\u5171\u540c\u5f31\u9ede<\/strong>\uff1a\u591a\u6578\u53ef\u7528\u6a21\u578b\u50c5\u6514\u4e0b 60\u201373%\uff0c\u593e\u5e36\u5728\u5065\u5eb7\u6216\u6cd5\u5f8b\u554f\u984c\u4e2d\u7684\u500b\u8cc7\u6700\u5e38\u88ab\u653e\u884c\u3002\u6392\u9664\u8aa4\u64cb\u7387\u9ad8\u9054 40% \u7684 clef \u5f8c\uff0c\u4ee5 vllm-sr\/d3-flash \u7684 85.5% \u6700\u9ad8\uff0c\u4f46\u5176\u8aa4\u64cb\u7387\u4e5f\u9054 6.5%\u3002<\/li>\n\n\n\n<li><strong>\u6514\u5f97\u591a\u4e0d\u7b49\u65bc\u597d<\/strong>\uff1aclef \u5169\u500b\u7248\u672c\u6514\u4e0b 98.6% \u7684\u6709\u5bb3\u5167\u5bb9\uff0c\u4f46<strong>\u6bcf 10 \u5247\u6b63\u5e38\u8a0a\u606f\u5c31\u8aa4\u64cb 4 \u5247<\/strong>\uff0c\u9023\u300c\u96fb\u934b\u84b8\u86cb\u5916\u934b\u653e\u591a\u5c11\u6c34\u300d\u90fd\u88ab\u5224\u70ba\u300c\u932f\u8aa4\u8cc7\u8a0a\u300d\u3002<\/li>\n\n\n\n<li><strong>\u5206\u985e\u6e96\u78ba\u7387\u504f\u4f4e\uff0c\u4e0d\u5168\u662f\u6a21\u578b\u7684\u554f\u984c<\/strong>\uff1a\u300c\u53d7\u4fdd\u8b77\u7279\u5fb5\u300d\u8207\u300c\u975e\u53d7\u4fdd\u8b77\u5c0d\u8c61\u300d\u5728\u539f criteria \u4e2d\u66f4\u63a5\u8fd1\u540d\u8a5e\u5b9a\u7fa9\uff0c\u591a\u6578\u6a21\u578b\u5c07\u524d\u8005\u5224\u70ba\u6b63\u5e38\u3001\u5f8c\u8005\u5224\u70ba\u9a37\u64fe\u3002\u6392\u9664\u9019 400 \u984c\u5f8c\uff0c\u524d\u4e09\u540d\u7684\u5206\u985e\u6e96\u78ba\u7387\u53ef\u518d\u63d0\u9ad8 10\u201314 \u500b\u767e\u5206\u9ede\uff1b\u4f46\u9019<strong>\u4e0d\u5f71\u97ff\u662f\u5426\u6514\u622a<\/strong>\u7684\u5224\u65b7\u3002<\/li>\n\n\n\n<li><strong>\u6a21\u677f\u5316\u7684 3 \u985e\u9700\u6253\u6298\u89e3\u8b80<\/strong>\uff1a\u4ec7\u6068\u8a00\u8ad6\u3001\u9f13\u52f5\u81ea\u6bba\u3001\u9055\u6cd5\u5354\u52a9\u7684\u984c\u76ee\u53e5\u578b\u91cd\u8907\u3001\u7bc7\u5e45\u77ed\u4e14\u7121\u56f0\u96e3\u984c\uff0c\u53ef\u7528\u6a21\u578b\u7684 Recall \u591a\u5728 90\u2013100%\uff0c\u771f\u5be6\u74b0\u5883\u8868\u73fe\u53ef\u80fd\u8f03\u4f4e\u3002<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u4e09\u9805\u95dc\u9375\u6280\u8853\u89c0\u5bdf<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u4ee5\u4e0b\u4e09\u9ede\u662f\u672c\u6b21\u6e2c\u8a66\u4e2d\u6700\u503c\u5f97\u95dc\u6ce8\u7684\u6280\u8853\u89c0\u5bdf\uff0c\u5206\u5225\u5c0d\u61c9\uff1a<strong>\u63db\u90e8\u7f72\u65b9\u5f0f\u5f8c\u5224\u65b7\u662f\u5426\u4e00\u81f4<\/strong>\u3001<strong>criteria \u5beb\u6cd5\u8207\u6a21\u578b\u67b6\u69cb\u7684\u95dc\u4fc2<\/strong>\uff0c\u4ee5\u53ca <strong>LLM guard \u7684\u5931\u6557\u6a21\u5f0f<\/strong>\u3002<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>1. \u91cf\u5316\u5e7e\u4e4e\u4e0d\u5f71\u97ff\u5224\u65b7\uff0c\u4f46\u4fe1\u5fc3\u5206\u6578\u9700\u91cd\u65b0\u6821\u6e96<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">\u540c\u4e00\u500b clef-flash\uff0c\u5728 Ollaya \u4e0a\u70ba F32 ONNX\uff0819 GB\uff09\uff0c\u5728 ollama \u4e0a\u70ba Q8_0 GGUF\uff0812.8 GB\uff09\u3002\u5169\u8005\u9010\u7b46\u9810\u6e2c\u5728 Domain \u6709 <strong>99.8%<\/strong>\u3001Guard \u6709 <strong>99.6%<\/strong> \u76f8\u540c\uff0c\u901f\u5ea6\u5feb <strong>3.3\u20133.5 \u500d<\/strong>\u3002\u7531\u65bc\u6b64\u8655\u540c\u6642\u66f4\u63db\u4e86 runtime \u8207\u7cbe\u5ea6\uff0c\u52a0\u901f\u6548\u679c\u7121\u6cd5\u5168\u90e8\u6b78\u56e0\u65bc\u91cf\u5316\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u9700\u8981\u6ce8\u610f\u7684\u662f\uff0c\u5169\u8005 confidence \u7684\u5dee\u8ddd\u4e2d\u4f4d\u6578\u7d04 <strong>0.12<\/strong>\u2014\u2014\u82e5\u7cfb\u7d71\u4ee5\u4fe1\u5fc3\u9580\u6abb\u5206\u6d41\uff0c<strong>\u66f4\u63db\u90e8\u7f72\u65b9\u5f0f\u5f8c\u5fc5\u9808\u91cd\u65b0\u6821\u6e96\u9580\u6abb<\/strong>\u3002<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>2. criteria \u7684\u5beb\u6cd5\u9700\u914d\u5408\u6a21\u578b\u67b6\u69cb<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">laya\uff08mmBERT\uff09\u8207 clm\uff08\u5c0d\u6bd4\u5f0f\u7de8\u78bc\u5668\uff09\u4ee5\u300c\u6587\u5b57\u8207\u9078\u9805\u63cf\u8ff0\u7684<strong>\u76f8\u4f3c\u5ea6<\/strong>\u300d\u8a55\u5206\uff0c\u6211\u5011\u63a8\u6e2c\u9019\u662f\u5b83\u5011\u5728\u672c\u6b21 criteria \u4e0b\u5931\u6e96\u7684\u4e3b\u56e0\uff0c\u4f46\u5c1a\u672a\u4ee5\u6539\u5beb\u5f8c\u7684 criteria \u9a57\u8b49\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5177\u9ad4\u800c\u8a00\uff0cDomain \u7684\u300c\u4e00\u822c\u300d\u985e\u4ee5\u5426\u5b9a\u53e5\u5b9a\u7fa9\uff08not mainly about medical, financial or legal&#8230;\uff09\uff0c\u63cf\u8ff0\u4e2d\u53cd\u800c\u5145\u6eff\u5176\u4ed6\u985e\u5225\u7684\u95dc\u9375\u5b57\uff1b\u300c\u654f\u611f\u8cc7\u6599\u300d\u53c8\u9644\u5e36\u300c\u4e0d\u8ad6\u4e3b\u984c\u7686\u512a\u5148\u300d\u7684\u898f\u5247\u3002\u7d50\u679c laya \u6709 62% \u7684\u984c\u76ee\u88ab\u5224\u70ba\u654f\u611f\u8cc7\u6599\uff0c\u4e00\u822c\u985e Recall \u50c5 1.8%\u3002\u5373\u4f7f\u662f clef \u8207 kev\uff0c\u4e5f\u5e38\u4f9d\u4e3b\u984c\u5206\u985e\u800c\u5ffd\u7565\u512a\u5148\u898f\u5247\uff08\u654f\u611f\u8cc7\u6599 Recall \u5206\u5225\u70ba 73% \u8207 47%\uff09\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>criteria \u64b0\u5beb\u5efa\u8b70<\/strong>: \u6bcf\u500b\u9078\u9805\u4ee5<strong>\u6b63\u9762\u8868\u5217<\/strong>\u63cf\u8ff0\uff0c\u907f\u514d\u300c\u9664\u4e86\u2026\u2026\u4ee5\u5916\u300d\u7684\u5426\u5b9a\u53e5\u3002<strong>\u512a\u5148\u898f\u5247\u4e0d\u8981\u585e\u9032\u55ae\u9078\u984c<\/strong>\uff0c\u62c6\u6210\u7368\u7acb\u7684 noul \u662f\u975e\u984c\uff0c\u4f8b\u5982\u53e6\u5916\u8a62\u554f\u300c\u662f\u5426\u542b\u500b\u8cc7\u6216\u6a5f\u5bc6\u300d\u3002<strong>\u50c5\u70ba\u540d\u8a5e\u5b9a\u7fa9\u7684\u689d\u76ee\u4e0d\u8981\u7576\u6210\u9078\u9805<\/strong>\uff0c\u4f8b\u5982 Guard \u7684\u300c\u53d7\u4fdd\u8b77\u7279\u5fb5\u300d\u8207\u300c\u975e\u53d7\u4fdd\u8b77\u5c0d\u8c61\u300d\u3002<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>3. LLM guard \u7684\u5931\u6557\u6a21\u5f0f\uff1a\u6c92\u6709\u5224\u6c7a\u5c31\u653e\u884c<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">gpt-oss-safeguard \u6703\u5148\u7522\u751f\u63a8\u7406\uff0c\u518d\u8f38\u51fa JSON \u5224\u6c7a\u3002\u5e38\u898b\u505a\u6cd5\u662f\u5c07\u653f\u7b56\u8207\u4f7f\u7528\u8005\u5167\u5bb9\u5408\u4f75\u70ba\u4e00\u5247 user \u8a0a\u606f\uff1b\u5373\u4f7f max_tokens \u8a2d\u70ba 4,096\uff0c\u4ecd\u6709 <strong>6.2%\uff08162 \u7b46\uff09\u6c92\u6709\u5224\u6c7a<\/strong>\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>64 \u7b46<\/strong>\uff1a\u63a8\u7406\u7528\u5b8c 4,096 tokens\u3002<\/li>\n\n\n\n<li><strong>98 \u7b46<\/strong>\uff1a\u96d6\u6b63\u5e38\u7d50\u675f\uff0c\u8f38\u51fa\u537b\u4e0d\u662f JSON\u3002\u91cd\u9001\u5f8c\u767c\u73fe\uff0c\u6a21\u578b\u4e26\u975e\u5728\u5206\u985e\uff0c\u800c\u662f\u76f4\u63a5\u56de\u61c9\u984c\u76ee\uff08\u771f\u7684\u5beb\u51fa\u4e00\u5c01 email\uff09\u3001\u62d2\u7d55\u56de\u7b54\uff0c\u6216\u88ab\u984c\u76ee\u4e2d\u7684\u6ce8\u5165\u6307\u4ee4\u5e36\u8d70\u800c\u56de\u50b3\u7a7a\u5b57\u4e32\u3002<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u9019 162 \u7b46\u4e2d\u6709 <strong>134 \u7b46\u662f\u6709\u5bb3\u5167\u5bb9<\/strong>\u3002\u82e5\u7cfb\u7d71\u63a1 <strong>fail-open<\/strong> \u8a2d\u8a08\uff0c\u9019\u4e9b\u5167\u5bb9\u5c07\u88ab\u76f4\u63a5\u653e\u884c\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u6211\u5011\u4ee5\u540c\u4e00\u6279 130 \u7b46\u9032\u884c\u5c0d\u7167\u5be6\u9a57\uff08max_tokens \u5747\u70ba 4,096\uff1b\u7531\u65bc\u6b63\u5e38\u984c\u50c5 10 \u7b46\uff0c\u8aa4\u64cb\u7387\u5dee\u7570\u7121\u6cd5\u5224\u8b80\uff09\uff1a<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u7d44\u5408<\/strong><\/th><th><strong>\u6c92\u6709\u5224\u6c7a<\/strong><\/th><th><strong>\u6709\u5bb3\u6514\u622a\u7387<\/strong><\/th><th><strong>\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387<\/strong><\/th><th><strong>\u5e73\u5747\u8f38\u51fa tokens\uff08\u6709\u5224\u6c7a\u8005\uff09<\/strong><\/th><\/tr><\/thead><tbody><tr><td>\u539f\u59cb\u653f\u7b56\uff0c\u4f75\u5165 user \u8a0a\u606f<\/td><td>10<\/td><td>84.5%<\/td><td>92.3%<\/td><td>365<\/td><\/tr><tr><td>\u539f\u59cb\u653f\u7b56\uff0c\u653e system \u8a0a\u606f<\/td><td>22<\/td><td>76.4%<\/td><td>88.2%<\/td><td>350<\/td><\/tr><tr><td>\u52a0\u4e0a\u660e\u78ba\u6307\u793a\uff0c\u4f75\u5165 user \u8a0a\u606f<\/td><td>0<\/td><td>90.0%<\/td><td>95.0%<\/td><td>389<\/td><\/tr><tr><td>\u52a0\u4e0a\u660e\u78ba\u6307\u793a\uff0c\u653e system \u8a0a\u606f<\/td><td>0<\/td><td>91.8%<\/td><td>95.9%<\/td><td>331<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/developers.openai.com\/cookbook\/articles\/gpt-oss-safeguard-guide\" target=\"_blank\" rel=\"noopener\">OpenAI \u7684\u4f7f\u7528\u6307\u5357<\/a>\u5efa\u8b70\u653f\u7b56\u653e\u5728 system \u8a0a\u606f\u3001\u5167\u5bb9\u653e\u5728 user \u8a0a\u606f\uff1b\u4f46<strong>\u53ea\u628a\u653f\u7b56\u79fb\u904e\u53bb\u53cd\u800c\u66f4\u7cdf<\/strong>\u2014\u2014\u5167\u5bb9\u7368\u7acb\u6210\u4e00\u5247 user \u8a0a\u606f\u5f8c\uff0c\u770b\u8d77\u4f86\u5c31\u50cf\u4e00\u822c\u63d0\u554f\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u771f\u6b63\u6709\u6548\u7684\u505a\u6cd5\u662f\uff1a\u5728\u653f\u7b56\u958b\u982d\u52a0\u5165\u4e00\u6bb5<strong>\u660e\u78ba\u6307\u793a<\/strong>\uff08\u4f60\u662f\u5206\u985e\u5668\u3001\u53ea\u8f38\u51fa JSON\u3001\u4e0d\u8981\u56de\u61c9\u5167\u5bb9\uff09\uff0c\u4e26\u5728\u7d50\u5c3e<strong>\u518d\u6b21\u91cd\u7533\u8f38\u51fa\u683c\u5f0f<\/strong>\u3002\u4ee5\u5168\u90e8 2,600 \u7b46\u9a57\u8b49\u5f8c\uff0c\u6c92\u6709\u5224\u6c7a\u7684\u6bd4\u4f8b\u5f9e <strong>6.2% \u964d\u81f3 1.0%<\/strong>\uff0c\u5269\u9918\u6848\u4f8b\u5168\u6578\u70ba\u63a8\u7406\u7528\u5b8c 4,096 tokens\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5176\u4ed6\u9700\u8981\u6ce8\u610f\u7684\u4e8b\u9805\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u903c\u8fd1\u903e\u6642\u4e0a\u9650<\/strong>\uff1a5.2% \u7684\u56de\u7b54\u8d85\u904e 1,024 tokens\uff0c\u6700\u9577\u4e00\u7b46\u8017\u6642 27.6 \u79d2\uff0c\u903c\u8fd1\u5e38\u898b\u7684 30 \u79d2\u903e\u6642\u8a2d\u5b9a\u3002<\/li>\n\n\n\n<li><strong>\u5c3e\u7aef\u5ef6\u9072\u4e0d\u7a69<\/strong>\uff1a\u5ef6\u9072\u7531\u8f38\u51fa\u9577\u5ea6\u6c7a\u5b9a\uff08\u76f8\u95dc\u4fc2\u6578 1.00\uff09\uff0cp95 \u70ba p50 \u7684 3\u20134 \u500d\u3002<\/li>\n\n\n\n<li><strong>\u7d50\u679c\u4e0d\u5b8c\u5168\u53ef\u91cd\u73fe<\/strong>\uff1atemperature \u8a2d\u70ba 0 \u6642\uff0c\u91cd\u9001\u540c\u4e00\u984c\u4ecd\u4e0d\u4fdd\u8b49\u7d50\u679c\u76f8\u540c\uff1b\u540c\u4e00\u6279 1,714 \u984c\u91cd\u8dd1\uff0c\u9810\u6e2c\u4e00\u81f4\u7387\u70ba 99.5%\u3002<\/li>\n\n\n\n<li><strong>\u653f\u7b56\u4ecd\u6709\u7cbe\u7c21\u7a7a\u9593<\/strong>\uff1a\u672c\u6b21\u653f\u7b56\u7d04 2,500 tokens\uff0c\u9060\u8d85\u904e\u6307\u5357\u5efa\u8b70\u7684 400\u2013600 tokens\uff0c\u7cbe\u7c21\u5f8c\u53ef\u80fd\u9084\u6709\u63d0\u5347\u7a7a\u9593\u3002<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" decoding=\"async\" width=\"1024\" height=\"587\" data-attachment-id=\"15865\" data-permalink=\"https:\/\/ai-stack.ai\/zh-hant\/jev-benchmark\/image-101\" data-orig-file=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/62c77056-edited.png?fit=1462%2C838&amp;quality=100&amp;ct=202603031250&amp;ssl=1\" data-orig-size=\"1462,838\" data-comments-opened=\"0\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/62c77056-edited.png?fit=1024%2C587&amp;quality=100&amp;ct=202603031250&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/62c77056-edited-1024x587.png?resize=1024%2C587&#038;quality=100&#038;ct=202603031250&#038;ssl=1\" alt=\"\" class=\"wp-image-15865\" style=\"aspect-ratio:1.7777777777777777\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u5982\u4f55\u4f9d\u9700\u6c42\u9078\u578b\uff1f<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u6c92\u6709\u4e00\u500b\u6a21\u578b\u80fd\u5728\u6240\u6709\u60c5\u5883\u4e0b\u90fd\u662f\u6700\u4f73\u89e3\u3002\u5efa\u8b70<strong>\u5148\u6c7a\u5b9a\u8cc7\u6599\u80fd\u5426\u9001\u81f3\u5916\u90e8<\/strong>\uff0c\u518d\u6b0a\u8861\u6e96\u78ba\u7387\u8207\u5ef6\u9072\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u9700\u6c42<\/strong><\/th><th><strong>\u5efa\u8b70\u65b9\u6848<\/strong><\/th><th><strong>\u4f9d\u64da<\/strong><\/th><th><strong>\u6ce8\u610f\u4e8b\u9805<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u53ef\u7528\u96f2\u7aef\u3001\u6e96\u78ba\u7387\u512a\u5148<\/strong><\/td><td>jev-latest<\/td><td>Domain 99.8%\uff1bGuard \u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387 97.4%\u3001\u8aa4\u64cb 0.5%\uff1bp50 \u7d04 205 ms<\/td><td>\u6240\u6709\u8a0a\u606f\u7686\u9001\u81f3\u7b2c\u4e09\u65b9\uff1b\u5ef6\u9072\u53d7\u7db2\u8def\u5f71\u97ff<\/td><\/tr><tr><td><strong>\u96f2\u7aef\u7b2c\u4e8c\u4f9b\u61c9\u5546\u6216\u5099\u63f4<\/strong><\/td><td>vllm-sr\/d3<\/td><td>Domain 98.9%\uff1bGuard 96.9%\u3001\u8aa4\u64cb 0.5%<\/td><td>Guard p50 344 ms\uff1b\u96b1\u79c1\u6514\u622a\u7387\u50c5 64.5%<\/td><\/tr><tr><td><strong>\u8cc7\u6599\u4e0d\u80fd\u96e2\u958b\u5167\u90e8\u74b0\u5883<\/strong><\/td><td>winnow:latest<\/td><td>Domain 99.0%\uff08\u654f\u611f\u8cc7\u6599 100%\uff09\uff1bGuard 96.3%\uff1bp50 203\uff0f416 ms<\/td><td>\u7d04\u9700 13 GB VRAM\uff0c\u9808\u78ba\u8a8d\u6a21\u578b\u4f4d\u65bc GPU \u4e0a<\/td><\/tr><tr><td><strong>\u5730\u7aef\u3001\u5ef6\u9072\u6216\u6210\u672c\u512a\u5148<\/strong><\/td><td>winnow:e4b<\/td><td>Domain p50 106 ms\u3001\u55ae\u9023\u7dda 9.3 req\/s\uff1b8 GB VRAM<\/td><td>Guard \u8aa4\u64cb 10%\u3001\u96b1\u79c1\u6514\u622a 48%\uff0c\u8f03\u9069\u5408 Domain \u8def\u7531<\/td><\/tr><tr><td><strong>\u7279\u5225\u5728\u610f\u500b\u8cc7\u5916\u6d29<\/strong><\/td><td>\u4e3b guard \u4e4b\u5916\uff0c\u53e6\u4ee5 vllm-sr\/d3-flash \u5224\u65b7\u500b\u8cc7<\/td><td>\u96b1\u79c1\u6514\u622a\u7387 85.5%\uff0c\u70ba\u53ef\u7528\u6a21\u578b\u4e2d\u6700\u9ad8<\/td><td>\u8aa4\u64cb\u7387 6.5%\uff0c\u4e0d\u9069\u5408\u55ae\u7368\u4f5c\u70ba\u4e3b guard\uff1b\u6539\u6210\u7368\u7acb\u662f\u975e\u984c\u7684\u6548\u679c\u672a\u6e2c<\/td><\/tr><tr><td><strong>\u9700\u8981\u53ef\u8b80\u7684\u5224\u65b7\u7406\u7531<\/strong><\/td><td>gpt-oss-safeguard\uff1a\u653f\u7b56\u52a0\u4e0a\u660e\u78ba\u6307\u793a\u4e26\u653e system \u8a0a\u606f\uff0cmax_tokens \u81f3\u5c11 4,096<\/td><td>\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387 94.6%\uff0c\u9644 rationale<\/td><td>p50 1.58 s\u3001p95 6.2 s\uff1b\u4ecd\u6709 1% \u6c92\u6709\u5224\u6c7a<\/td><\/tr><tr><td><strong>\u4ee5\u672c\u6b21 criteria \u4e0d\u5efa\u8b70<\/strong><\/td><td>laya:multilingual\u3001clm:8b\uff1bGuard \u60c5\u5883\u7684 clef \u7cfb\u5217<\/td><td>\u5e73\u8861\u6e96\u78ba\u7387\u7d04 50%\uff1bclef \u8aa4\u64cb\u7387 40%<\/td><td>\u6539\u5beb criteria \u5f8c\u53ef\u518d\u8a55\u4f30<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>\u67b6\u69cb\u8a2d\u8a08\u5efa\u8b70<\/strong><\/h4>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u7528\u4fe1\u5fc3\u5206\u6578\u5206\u6d41<\/strong>\uff1aDomain \u60c5\u5883\u4e2d\uff0cwinnow:latest \u6709 97.2% \u7684\u984c\u76ee confidence \u2265 0.9\uff0c\u8a72\u90e8\u5206\u6e96\u78ba\u7387 99.8%\uff1bjev-latest \u70ba 94.9% \u8986\u84cb\u3001100% \u6e96\u78ba\u3002\u53ef\u5148\u7531\u8f03\u5feb\u7684\u6a21\u578b\u8655\u7406\u9ad8\u4fe1\u5fc3\u8acb\u6c42\uff0c\u50c5\u5c07\u4f4e\u4fe1\u5fc3\u8005\u4ea4\u7d66\u66f4\u5f37\u7684\u6a21\u578b\u3002\u4f46 Guard \u60c5\u5883\u4e0d\u5b9c\u76f4\u63a5\u5957\u7528\u2014\u2014winnow:latest \u5728 confidence \u2265 0.9 \u7684\u984c\u76ee\u4e0a\u5206\u985e\u6e96\u78ba\u7387\u50c5 82.4%\uff0c<strong>\u9580\u6abb\u9700\u4f9d\u60c5\u5883\u6821\u6e96<\/strong>\u3002<\/li>\n\n\n\n<li><strong>\u628a\u4e00\u984c\u62c6\u6210\u5e7e\u984c<\/strong>\uff1a\u5148\u554f\u300c\u662f\u5426\u6709\u5bb3\u300d\u518d\u554f\u300c\u5c6c\u65bc\u54ea\u4e00\u985e\u300d\uff0c\u6216\u4ee5 noul \u5c07\u500b\u8cc7\u3001\u6a5f\u5bc6\u62c6\u6210\u7368\u7acb\u7684\u662f\u975e\u984c\u3002\u7531\u65bc\u540c\u4e00\u8acb\u6c42\u5373\u53ef\u8a62\u554f\u591a\u984c\uff0c<strong>\u4e0d\u6703\u589e\u52a0\u7db2\u8def\u5f80\u8fd4<\/strong>\u3002<\/li>\n\n\n\n<li><strong>\u4e8b\u5148\u5b9a\u7fa9\u5931\u6557\u8655\u7406\u7b56\u7565<\/strong>\uff1a\u6c7a\u7b56\u6a21\u578b\u5fc5\u5b9a\u56de\u50b3\u4e00\u500b\u9078\u9805\uff0c\u4f46\u670d\u52d9\u4ecd\u53ef\u80fd\u903e\u6642\u6216\u56de\u50b3 5xx\uff1bLLM guard \u5247\u591a\u4e86\u300c\u6c92\u6709\u5224\u6c7a\u300d\u7684\u60c5\u6cc1\u3002\u6b63\u5f0f\u74b0\u5883\u61c9<strong>\u660e\u78ba\u9078\u64c7 fail-open \u6216 fail-closed<\/strong>\uff0c\u4e26\u6301\u7e8c\u76e3\u63a7\u767c\u751f\u6bd4\u4f8b\u3002<\/li>\n\n\n\n<li><strong>\u76e3\u63a7\u90e8\u7f72\u72c0\u614b<\/strong>\uff1a\u5b9a\u671f\u6aa2\u67e5\u6a21\u578b\u7684 DEVICE \u8207\u6bcf\u7b46\u5ef6\u9072\u3002\u82e5\u5ef6\u9072\u7a81\u7136\u66b4\u589e 10 \u500d\u4ee5\u4e0a\uff0c\u591a\u534a\u662f\u6a21\u578b\u88ab\u64e0\u5230 CPU \u57f7\u884c\u2014\u2014\u6e2c\u8a66\u521d\u671f winnow:latest \u5728 CPU \u4e0a\u6bcf\u7b46\u9700 12.5 \u79d2\uff0c\u7368\u4f54 GPU \u5f8c\u50c5\u9700 203 ms\u3002<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u4e09\u7a2e\u4ee3\u8868\u65b9\u6848\u6709\u4ec0\u9ebc\u4e0d\u540c\uff1f<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e0b\u8868\u5f59\u6574\u96f2\u7aef\u3001\u5730\u7aef\u8207\u751f\u6210\u5f0f LLM guard \u4e09\u7a2e\u4ee3\u8868\u65b9\u6848\u7684\u95dc\u9375\u5dee\u7570\uff0c\u5354\u52a9\u5718\u968a\u5feb\u901f\u5c0d\u7167\u3002<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-stripes has-small-font-size\"><table><thead><tr><th><strong>\u6bd4\u8f03\u9762\u5411<\/strong><\/th><th><strong>jev-latest\uff08\u96f2\u7aef\uff09<\/strong><\/th><th><strong>winnow:latest\uff08\u5730\u7aef\uff09<\/strong><\/th><th><strong>gpt-oss-safeguard\uff08LLM guard\uff09<\/strong><\/th><\/tr><\/thead><tbody><tr><td><strong>\u8cc7\u6599\u662f\u5426\u96e2\u958b\u5167\u90e8\u74b0\u5883<\/strong><\/td><td>\u662f\uff0c\u9001\u81f3\u7b2c\u4e09\u65b9\u670d\u52d9<\/td><td>\u5426<\/td><td>\u5426\uff08\u53ef\u81ea\u67b6\uff09<\/td><\/tr><tr><td><strong>Domain \u6e96\u78ba\u7387<\/strong><\/td><td>99.8%<\/td><td>99.0%<\/td><td>\u672c\u6b21\u672a\u6e2c<\/td><\/tr><tr><td><strong>Guard \u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387<\/strong><\/td><td>97.4%<\/td><td>96.3%<\/td><td>94.6%\uff08\u6539\u826f prompt\uff09<\/td><\/tr><tr><td><strong>Guard \u8aa4\u64cb\u7387<\/strong><\/td><td>0.5%<\/td><td>2.0%<\/td><td>0.0%<\/td><\/tr><tr><td><strong>Guard p50 \u5ef6\u9072<\/strong><\/td><td>207 ms<\/td><td>416 ms<\/td><td>1.58 s<\/td><\/tr><tr><td><strong>\u662f\u5426\u53ef\u80fd\u6c92\u6709\u5224\u6c7a<\/strong><\/td><td>\u5426<\/td><td>\u5426<\/td><td>\u662f\uff0c\u7d04 1.0%<\/td><\/tr><tr><td><strong>\u5224\u65b7\u7406\u7531<\/strong><\/td><td>\u50c5\u6709\u6a5f\u7387<\/td><td>\u50c5\u6709\u6a5f\u7387<\/td><td>\u6709 rationale \u6587\u5b57<\/td><\/tr><tr><td><strong>\u9069\u5408\u5834\u666f<\/strong><\/td><td>\u53ef\u7528\u96f2\u7aef\u3001\u6e96\u78ba\u7387\u512a\u5148<\/td><td>\u8cc7\u6599\u4e0d\u80fd\u51fa\u9580\u3001\u9700\u517c\u9867\u6e96\u78ba\u7387<\/td><td>\u9700\u8981\u53ef\u7a3d\u6838\u7684\u5224\u65b7\u7406\u7531<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u7c21\u800c\u8a00\u4e4b\uff1a<strong>\u8ffd\u6c42\u6e96\u78ba\u7387\u4e14\u53ef\u7528\u96f2\u7aef\uff0c\u9078 jev-latest\uff1b\u8cc7\u6599\u5fc5\u9808\u7559\u5728\u5167\u90e8\uff0c\u9078 winnow:latest\uff1b\u9700\u8981\u53ef\u8b80\u7684\u5224\u65b7\u7406\u7531\uff0c\u624d\u8003\u616e\u751f\u6210\u5f0f LLM guard\uff0c\u4e26\u52d9\u5fc5\u505a\u597d\u300c\u6c92\u6709\u5224\u6c7a\u300d\u7684\u8655\u7406\u3002<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u6e2c\u8a66\u9650\u5236\u8207\u5f8c\u7e8c\u65b9\u5411<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u672c\u4efd Benchmark \u9069\u5408\u7528\u65bc<strong>\u6bd4\u8f03\u6a21\u578b\u4e4b\u9593\u7684\u76f8\u5c0d\u8868\u73fe<\/strong>\uff0c\u4e0d\u5b9c\u76f4\u63a5\u4f5c\u70ba\u6b63\u5f0f\u74b0\u5883\u7684\u7d55\u5c0d\u6578\u5b57\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u5408\u6210\u8cc7\u6599<\/strong>\uff1a\u6e2c\u8a66\u8cc7\u6599\u7531 LLM \u64b0\u5beb\uff0c\u7528\u8a9e\u53ef\u80fd\u6bd4\u771f\u5be6\u4f7f\u7528\u8005\u6574\u9f4a\uff1bGuard \u6709 3 \u985e\u8cc7\u6599\u53e5\u578b\u6a21\u677f\u5316\u3002<\/li>\n\n\n\n<li><strong>\u6b63\u5e38\u984c\u50c5 200 \u7b46<\/strong>\uff1a\u8aa4\u64cb 1 \u7b46\u5373\u70ba 0.5%\uff0c95% \u4fe1\u8cf4\u5340\u9593\u70ba 0.1\u20132.8%\uff1b<strong>2 \u500b\u767e\u5206\u9ede\u4ee5\u5167\u7684\u5dee\u8ddd\u4e0d\u5177\u7d71\u8a08\u610f\u7fa9<\/strong>\u3002\u4fe1\u8cf4\u5340\u9593\u63a1 Wilson \u516c\u5f0f\u8a08\u7b97\uff08\u898b\u4e0b\u65b9\u8aaa\u660e\uff09\u3002<\/li>\n\n\n\n<li><strong>\u6bcf\u500b\u6a21\u578b\u53ea\u8dd1\u4e00\u6b21<\/strong>\uff1a\u6c7a\u7b56\u6a21\u578b\u91cd\u8dd1\u7d50\u679c\u5e7e\u4e4e\u76f8\u540c\uff1bLLM guard \u7684\u8f38\u51fa\u5247\u4e0d\u5b8c\u5168\u53ef\u91cd\u73fe\u3002<\/li>\n\n\n\n<li><strong>\u96f2\u7aef\u5ef6\u9072\u50c5\u4f9b\u53c3\u8003<\/strong>\uff1a\u5305\u542b\u6211\u65b9\u7db2\u8def\u81f3\u670d\u52d9\u7aef\u7684\u5f80\u8fd4\uff0c\u4ea6\u7121\u6cd5\u78ba\u8a8d\u5c0d\u65b9\u7684\u786c\u9ad4\u8207\u8ca0\u8f09\u3002<\/li>\n\n\n\n<li><strong>criteria \u672a\u91dd\u5c0d\u6a21\u578b\u8abf\u6574<\/strong>\uff1a\u7d50\u679c\u53cd\u6620\u7684\u662f\u300c\u540c\u4e00\u4efd criteria \u4e0b\u300d\u7684\u8868\u73fe\uff1blaya \u8207 clm \u7684\u4f4e\u5206\uff0c\u4e0d\u4ee3\u8868\u5728\u5176\u4ed6\u5beb\u6cd5\u4e0b\u4e5f\u540c\u6a23\u4e0d\u4f73\u3002<\/li>\n\n\n\n<li><strong>\u50c5\u6e2c\u8a66\u55ae\u9023\u7dda<\/strong>\uff1a\u9ad8\u4f75\u767c\u4e0b\u7684\u7e3d\u541e\u5410\u91cf\u8207\u5c3e\u7aef\u5ef6\u9072\uff0c\u662f\u4e0b\u4e00\u6b65\u7684\u6e2c\u8a66\u9805\u76ee\u3002<\/li>\n\n\n\n<li><strong>\u5730\u7aef\u50c5\u4e00\u5f35 RTX 3090<\/strong>\uff1a\u63db\u6210\u5176\u4ed6 GPU\uff0c\u7d55\u5c0d\u6578\u5b57\u6703\u6709\u6240\u4e0d\u540c\uff0c\u4f46\u6a21\u578b\u4e4b\u9593\u7684\u76f8\u5c0d\u8da8\u52e2\u61c9\u76f8\u8fd1\u3002<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Wilson \u4fe1\u8cf4\u5340\u9593\u8aaa\u660e<\/strong>\uff1a\u5373\u4f7f\u6bd4\u4f8b\u70ba 0% \u6216\u63a5\u8fd1 0%\uff0cWilson \u516c\u5f0f\u4e5f\u80fd\u7d66\u51fa\u5408\u7406\u7684\u5340\u9593\u3002<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>Formula<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Wilson \u5340\u9593 = ( p\u0302 + z\u00b2\/2n&nbsp; \u00b1&nbsp; z \u00d7 \u221a( p\u0302(1 \u2212 p\u0302)\/n + z\u00b2\/4n\u00b2 ) ) \u00f7 ( 1 + z\u00b2\/n )<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">p\u0302\uff1a\u89c0\u5bdf\u5230\u7684\u6bd4\u4f8b\u3000n\uff1a\u6a23\u672c\u6578\u3000z\uff1a95% \u4fe1\u8cf4\u6c34\u6e96\u53d6 1.96<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u503c\u5f97\u5ef6\u4f38\u7684\u65b9\u5411<\/strong>\uff1a\u4ee5\u6539\u5beb\u5f8c\u7684 criteria \u91cd\u6e2c\u7de8\u78bc\u5668\u578b\u6a21\u578b\uff0c\u4e26\u5c07\u500b\u8cc7\u5075\u6e2c\u62c6\u70ba\u7368\u7acb\u7684\u662f\u975e\u984c\uff0c\u9a57\u8b49\u300c\u62c6\u984c\u300d\u80fd\u5426\u88dc\u5f37\u96b1\u79c1\u985e\u7684\u5f31\u9ede\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u5e38\u898b\u554f\u984c FAQ<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Q1\uff1a\u6c7a\u7b56\u6a21\u578b\u548c\u76f4\u63a5\u7528\u751f\u6210\u5f0f LLM \u505a\u5206\u985e\uff0c\u6700\u5927\u7684\u5dee\u5225\u662f\u4ec0\u9ebc\uff1f<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u6c7a\u7b56\u6a21\u578b<strong>\u4e0d\u7522\u751f\u6587\u5b57<\/strong>\uff0c\u6bcf\u984c\u5fc5\u5b9a\u56de\u50b3\u578b\u5225\u5316\u7684\u7b54\u6848\u8207\u6a5f\u7387\u5206\u5e03\uff0c\u5ef6\u9072\u4e3b\u8981\u53d6\u6c7a\u65bc\u8f38\u5165\u9577\u5ea6\uff1b\u751f\u6210\u5f0f LLM \u9700\u5148\u63a8\u7406\u518d\u8f38\u51fa JSON\uff0c\u5ef6\u9072\u53d6\u6c7a\u65bc\u8f38\u51fa\u9577\u5ea6\uff0c\u4e14\u53ef\u80fd\u51fa\u73fe\u300c\u6c92\u6709\u5224\u6c7a\u300d\u3002\u82e5\u696d\u52d9\u9700\u8981\u53ef\u7a3d\u6838\u7684\u66f8\u9762\u7406\u7531\uff0c\u751f\u6210\u5f0f LLM \u4ecd\u6709\u5176\u50f9\u503c\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Q2\uff1a\u8cc7\u6599\u4e0d\u80fd\u96e2\u958b\u516c\u53f8\u5167\u90e8\u74b0\u5883\uff0c\u61c9\u8a72\u9078\u54ea\u500b\u6a21\u578b\uff1f<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u672c\u6b21\u6e2c\u8a66\u4e2d\uff0c\u5730\u7aef\u8868\u73fe\u6700\u4f73\u7684\u662f <strong>winnow:latest<\/strong>\uff1aDomain \u6e96\u78ba\u7387 99.0%\uff08\u654f\u611f\u8cc7\u6599 Recall 100%\uff09\u3001Guard \u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387 96.3%\uff0c\u7d04\u9700 13 GB VRAM\u3002\u82e5\u66f4\u91cd\u8996\u5ef6\u9072\u8207\u6210\u672c\uff0c\u53ef\u8003\u616e winnow:e4b\uff0c\u4f46\u5176 Guard \u8aa4\u64cb\u7387\u70ba 10%\uff0c\u8f03\u9069\u5408 Domain \u8def\u7531\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Q3\uff1a\u6539\u7528 Q8 \u91cf\u5316\u7248\u672c\u90e8\u7f72\uff0c\u6e96\u78ba\u7387\u6703\u4e0b\u964d\u55ce\uff1f<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u4ee5 clef-flash \u70ba\u4f8b\uff0cF32 \u8207 Q8 \u5169\u500b\u7248\u672c\u7684\u9010\u7b46\u9810\u6e2c\u5728 Domain \u6709 99.8%\u3001Guard \u6709 99.6% \u76f8\u540c\uff0c\u901f\u5ea6\u5feb 3.3\u20133.5 \u500d\u3002\u4f46\u5169\u8005 confidence \u5dee\u8ddd\u4e2d\u4f4d\u6578\u7d04 0.12\uff0c\u82e5\u4ee5\u4fe1\u5fc3\u9580\u6abb\u5206\u6d41\uff0c<strong>\u9700\u91cd\u65b0\u6821\u6e96\u9580\u6abb<\/strong>\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Q4\uff1a\u70ba\u4ec0\u9ebc Guard \u60c5\u5883\u8981\u770b\u300c\u6514\u622a\u5e73\u8861\u6e96\u78ba\u7387\u300d\uff0c\u800c\u4e0d\u662f\u4e00\u822c\u6b63\u78ba\u7387\uff1f<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u56e0\u70ba\u6709\u5bb3\u984c\u8207\u6b63\u5e38\u984c\u6578\u91cf\u61f8\u6b8a\uff082,200 \u7b46 vs. 200 \u7b46\uff09\u3002\u4e00\u500b\u4ec0\u9ebc\u90fd\u64cb\u7684\u6a21\u578b\uff0c\u4e00\u822c\u6b63\u78ba\u7387\u53ef\u9054 91.7%\uff0c\u5e73\u8861\u6e96\u78ba\u7387\u537b\u53ea\u6709 50%\uff1b\u5e73\u8861\u6e96\u78ba\u7387\u80fd\u540c\u6642\u53cd\u6620\u300c\u8a72\u64cb\u7684\u6709\u6c92\u6709\u64cb\u300d\u8207\u300c\u4e0d\u8a72\u64cb\u7684\u6709\u6c92\u6709\u653e\u300d\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Q5\uff1alaya \u8207 clm \u5206\u6578\u5f88\u4f4e\uff0c\u662f\u6a21\u578b\u672c\u8eab\u4e0d\u597d\u55ce\uff1f<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e0d\u4e00\u5b9a\u3002\u5169\u8005\u4ee5\u300c\u6587\u5b57\u8207\u9078\u9805\u63cf\u8ff0\u7684\u76f8\u4f3c\u5ea6\u300d\u8a55\u5206\uff0c\u6211\u5011\u63a8\u6e2c\u672c\u6b21 criteria \u4e2d\u7684\u5426\u5b9a\u53e5\u8207\u512a\u5148\u898f\u5247\u662f\u5931\u6e96\u4e3b\u56e0\uff0c\u4f46\u5c1a\u672a\u4ee5\u6539\u5beb\u5f8c\u7684 criteria \u9a57\u8b49\u3002\u7d50\u679c\u50c5\u4ee3\u8868\u300c\u540c\u4e00\u4efd criteria \u4e0b\u300d\u7684\u8868\u73fe\u3002<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Q6\uff1a\u53ef\u4ee5\u76f4\u63a5\u7528 confidence \u9580\u6abb\u4f86\u5206\u6d41\u55ce\uff1f<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">\u5728 Domain \u60c5\u5883\u4e2d\u6548\u679c\u826f\u597d\uff1awinnow:latest \u6709 97.2% \u7684\u984c\u76ee confidence \u2265 0.9\uff0c\u8a72\u90e8\u5206\u6e96\u78ba\u7387\u9054 99.8%\u3002\u4f46\u5728 Guard \u60c5\u5883\u4e2d\uff0c\u540c\u4e00\u9580\u6abb\u4e0b\u7684\u5206\u985e\u6e96\u78ba\u7387\u50c5 82.4%\uff0c\u56e0\u6b64<strong>\u9580\u6abb\u5fc5\u9808\u4f9d\u60c5\u5883\u500b\u5225\u6821\u6e96<\/strong>\u3002<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Q7\uff1a\u9019\u4efd Benchmark \u7684\u6578\u5b57\u53ef\u4ee5\u76f4\u63a5\u4f5c\u70ba\u6b63\u5f0f\u74b0\u5883\u7684\u6548\u80fd\u6307\u6a19\u55ce\uff1f<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e0d\u5efa\u8b70\u3002\u672c\u6b21\u4f7f\u7528\u5408\u6210\u8cc7\u6599\u3001\u50c5\u6e2c\u8a66\u55ae\u9023\u7dda\u8207\u55ae\u5f35 RTX 3090\uff0c\u96f2\u7aef\u5ef6\u9072\u4ea6\u5305\u542b\u7db2\u8def\u5f80\u8fd4\u3002\u6578\u64da\u6700\u9069\u5408\u7528\u65bc<strong>\u6bd4\u8f03\u6a21\u578b\u4e4b\u9593\u7684\u76f8\u5c0d\u8868\u73fe<\/strong>\uff0c\u6b63\u5f0f\u5c0e\u5165\u524d\u4ecd\u5efa\u8b70\u4ee5\u81ea\u6709\u8cc7\u6599\u8207\u5be6\u969b\u6d41\u91cf\u9032\u884c\u9a57\u8b49\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u7d50\u8a9e<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u6c7a\u7b56\u6a21\u578b\u4ee5\u300c<strong>\u578b\u5225\u5316\u7b54\u6848\uff0b\u6a5f\u7387\u5206\u5e03<\/strong>\u300d\u53d6\u4ee3\u751f\u6210\u6587\u5b57\uff0c\u8b93\u5206\u985e\u3001\u5206\u7d1a\u8207\u653e\u884c\u9598\u9580\u9019\u985e\u4f4d\u65bc\u95dc\u9375\u8def\u5f91\u4e0a\u7684\u5224\u65b7\uff0c\u80fd\u517c\u9867<strong>\u6e96\u78ba\u7387\u3001\u5ef6\u9072\u8207\u53ef\u9810\u671f\u6027<\/strong>\u3002\u672c\u6b21\u5be6\u6e2c\u986f\u793a\uff0c\u96f2\u7aef\u7684 jev-latest \u8207\u5730\u7aef\u7684 winnow:latest \u7686\u5df2\u9054\u5230\u53ef\u6295\u5165\u5be6\u52d9\u7684\u6c34\u6e96\uff1b\u800c criteria \u7684\u64b0\u5beb\u65b9\u5f0f\u3001\u4fe1\u5fc3\u9580\u6abb\u7684\u6821\u6e96\uff0c\u4ee5\u53ca\u5931\u6557\u8655\u7406\u7b56\u7565\u7684\u8a2d\u8a08\uff0c\u5247\u662f\u6c7a\u5b9a\u7cfb\u7d71\u6700\u7d42\u8868\u73fe\u7684\u95dc\u9375\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u96a8\u8457 AI Agent \u8207\u591a\u6a21\u578b\u8def\u7531\u67b6\u69cb\u9010\u6b65\u6210\u70ba\u4f01\u696d\u6a19\u914d\uff0c\u300c<strong>\u5148\u5224\u65b7\u3001\u518d\u751f\u6210<\/strong>\u300d\u5c07\u662f\u63a7\u5236\u6210\u672c\u8207\u98a8\u96aa\u7684\u91cd\u8981\u8a2d\u8a08\u539f\u5247\u3002\u82e5\u60a8\u6b63\u5728\u898f\u5283 AI \u63a8\u8ad6\u57fa\u790e\u67b6\u69cb\u3001\u6a21\u578b\u8def\u7531\u6216\u5167\u5bb9\u5b89\u5168\u9632\u8b77\u6a5f\u5236\uff0c\u6b61\u8fce\u8207 <strong>INFINITIX \u5718\u968a<\/strong>\u806f\u7e6b\uff0c\u7531\u5c08\u696d\u9867\u554f\u5354\u52a9\u60a8\u8a55\u4f30\u6700\u9069\u5408\u7684\u90e8\u7f72\u65b9\u6848\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>\u53c3\u8003\u8cc7\u6599<\/strong><\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.datacamp.com\/blog\/system-one-models-jev\" target=\"_blank\" rel=\"noopener\">DataCamp\uff1aSystem One models \u2014 Jev<\/a>\uff1aJev \u7684\u4e09\u7a2e\u984c\u578b\uff08choice\u3001score\u3001noul\uff09\u3001\u6a5f\u7387\u6821\u6e96\u8207\u9069\u7528\u60c5\u5883\u4ecb\u7d39\u3002<\/li>\n\n\n\n<li><a href=\"https:\/\/developers.openai.com\/cookbook\/articles\/gpt-oss-safeguard-guide\" target=\"_blank\" rel=\"noopener\">OpenAI\uff1aUser guide for gpt-oss-safeguard<\/a>\uff1a\u653f\u7b56\u653e system \u8a0a\u606f\u3001\u8f38\u51fa\u683c\u5f0f\u9700\u660e\u78ba\u4e26\u91cd\u7533\u3001\u653f\u7b56\u9577\u5ea6\u5efa\u8b70 400\u2013600 tokens\u3002<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>\u4ee5 5,100 \u7b46\u4e2d\u82f1\u6e2c\u8a66\u8cc7\u6599\uff0c\u5be6\u6e2c Jev \u7b49 10 \u7a2e\u6c7a\u7b56\u6a21\u578b\u5728\u4e3b\u984c\u5206\u985e\u8207\u5167\u5bb9\u5b89\u5168\u9632\u8b77\u7684\u6e96\u78ba\u7387\u3001\u5ef6\u9072\u8207\u91cf\u5316\u5f71\u97ff\uff0c\u4e26\u5c0d\u7167\u751f\u6210\u5f0f LLM guard\uff0c\u63d0\u4f9b\u96f2\u7aef\u8207\u5730\u7aef\u9078\u578b\u5efa\u8b70\u3002<\/p>\n","protected":false},"author":253372381,"featured_media":15869,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[96987561,96989087],"tags":[],"class_list":["post-15851","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technical-support","category-tech-insights"],"blocksy_meta":[],"acf":[],"jetpack_shortlink":"https:\/\/wp.me\/ph344V-47F","jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2026\/11\/b05d19b7.png?fit=1920%2C1080&quality=100&ct=202603031250&ssl=1","_links":{"self":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts\/15851","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/users\/253372381"}],"replies":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/comments?post=15851"}],"version-history":[{"count":2,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts\/15851\/revisions"}],"predecessor-version":[{"id":15874,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/posts\/15851\/revisions\/15874"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/media\/15869"}],"wp:attachment":[{"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/media?parent=15851"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/categories?post=15851"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ai-stack.ai\/zh-hant\/wp-json\/wp\/v2\/tags?post=15851"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}