{"id":19356,"date":"2024-02-12T20:09:19","date_gmt":"2024-02-12T12:09:19","guid":{"rendered":"https:\/\/www.aisharenet.com\/?p=19356"},"modified":"2025-01-25T21:05:55","modified_gmt":"2025-01-25T13:05:55","slug":"cod","status":"publish","type":"post","link":"https:\/\/www.kdjingpai.com\/en\/cod\/","title":{"rendered":"CoD\uff1a\u5bc6\u5ea6\u94fe"},"content":{"rendered":"<p><strong>\u539f\u6587\uff1a<\/strong>https:\/\/arxiv.org\/pdf\/2309.04269<\/p>\n<p><strong>\u901f\u8bfb\uff1a<\/strong>\u300a\u4ece\u7a00\u758f\u5230\u5bc6\u96c6\uff1a\u4f7f\u7528\u94fe\u5f0f\u5bc6\u5ea6\u63d0\u793a\u7684GPT-4\u6458\u8981\u751f\u6210\u300b<\/p>\n<p><strong>\u6536\u5f55\u5230\uff1a<\/strong><a href=\"https:\/\/www.kdjingpai.com\/zongjieprompt\/\">\u603b\u7ed3\u77e5\u8bc6\u5e38\u7528prompts<\/a><\/p>\n<p>&nbsp;<\/p>\n<h2>\u6458\u8981<\/h2>\n<p>\u5728\u81ea\u52a8\u6587\u672c\u6458\u8981\u4e2d\uff0c\u786e\u5b9a\u8981\u5305\u542b\u7684\u201c\u6b63\u786e\u201d\u4fe1\u606f\u91cf\u662f\u4e00\u4e2a\u5177\u6709\u6311\u6218\u6027\u7684\u4efb\u52a1\u3002\u4e00\u4e2a\u597d\u7684\u6458\u8981\u9700\u8981\u5728\u4fdd\u6301\u8be6\u7ec6\u548c\u4ee5\u5b9e\u4f53\u4e3a\u4e2d\u5fc3\u7684\u540c\u65f6\uff0c\u907f\u514d\u8fc7\u4e8e\u5197\u957f\u548c\u96be\u4ee5\u7406\u89e3\u3002\u4e3a\u4e86\u66f4\u597d\u5730\u7406\u89e3\u8fd9\u79cd\u6743\u8861\uff0c\u6211\u4eec\u63d0\u51fa\u4e86\u4e00\u79cd\u540d\u4e3a\u201c\u94fe\u5f0f\u5bc6\u5ea6\u201d\uff08Chain of Density, CoD\uff09\u7684\u63d0\u793a\u65b9\u6cd5\uff0c\u901a\u8fc7\u8fd9\u79cd\u65b9\u6cd5\uff0cGPT-4\u80fd\u591f\u751f\u6210\u8d8a\u6765\u8d8a\u5bc6\u96c6\u7684\u6458\u8981\u3002\u6211\u4eec\u53d1\u73b0\uff0cCoD\u751f\u6210\u7684\u6458\u8981\u6bd4\u4f7f\u7528\u666e\u901a\u63d0\u793a\u751f\u6210\u7684GPT-4\u6458\u8981\u66f4\u5177\u62bd\u8c61\u6027\u3001\u878d\u5408\u6027\uff0c\u5e76\u4e14\u51cf\u5c11\u4e86\u5f00\u5934\u504f\u5dee\u3002\u901a\u8fc7\u5bf9100\u7bc7CNN\/DailyMail\u6587\u7ae0\u8fdb\u884c\u4eba\u7c7b\u504f\u597d\u7814\u7a76\uff0c\u6211\u4eec\u53d1\u73b0\u4eba\u7c7b\u66f4\u559c\u6b22\u6bd4\u666e\u901a\u63d0\u793a\u751f\u6210\u7684GPT-4\u6458\u8981\u66f4\u5bc6\u96c6\u7684\u6458\u8981\uff0c\u5e76\u4e14\u5176\u5bc6\u5ea6\u51e0\u4e4e\u4e0e\u4eba\u5de5\u7f16\u5199\u7684\u6458\u8981\u76f8\u5f53\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>1. \u5f15\u8a00<\/h2>\n<p>\u8fd1\u5e74\u6765\uff0c\u81ea\u52a8\u6458\u8981\u6280\u672f\u53d6\u5f97\u4e86\u957f\u8db3\u7684\u8fdb\u6b65\uff0c\u8fd9\u4e3b\u8981\u5f52\u529f\u4e8e\u4ece\u76d1\u7763\u5fae\u8c03\u5230\u4f7f\u7528\u5927\u578b\u8bed\u8a00\u6a21\u578b\uff08LLMs\uff09\u8fdb\u884c\u96f6\u6837\u672c\u63d0\u793a\u7684\u8303\u5f0f\u8f6c\u53d8\u3002\u4f8b\u5982\uff0cGPT-4\u53ef\u4ee5\u5728\u6ca1\u6709\u989d\u5916\u8bad\u7ec3\u7684\u60c5\u51b5\u4e0b\uff0c\u901a\u8fc7\u7cbe\u5fc3\u8bbe\u8ba1\u7684\u63d0\u793a\u5b9e\u73b0\u5bf9\u6458\u8981\u7279\u5f81\uff08\u5982\u957f\u5ea6\u3001\u4e3b\u9898\u548c\u98ce\u683c\uff09\u7684\u7cbe\u7ec6\u63a7\u5236\u3002<\/p>\n<p>\u7136\u800c\uff0c\u6458\u8981\u7684\u4fe1\u606f\u5bc6\u5ea6\u662f\u4e00\u4e2a\u5e38\u88ab\u5ffd\u89c6\u7684\u65b9\u9762\u3002\u7406\u8bba\u4e0a\uff0c\u4f5c\u4e3a\u5bf9\u53e6\u4e00\u6587\u672c\u7684\u538b\u7f29\uff0c\u6458\u8981\u5e94\u8be5\u6bd4\u6e90\u6587\u6863\u5305\u542b\u66f4\u9ad8\u7684\u4fe1\u606f\u6d53\u5ea6\u3002\u7136\u800c\uff0c\u6458\u8981\u7684\u5bc6\u5ea6\u662f\u4e00\u4e2a\u5f00\u653e\u6027\u95ee\u9898\u3002\u5982\u679c\u6458\u8981\u5305\u542b\u7684\u4fe1\u606f\u4e0d\u8db3\uff0c\u5219\u4f1a\u663e\u5f97\u65e0\u8db3\u8f7b\u91cd\uff1b\u5982\u679c\u5305\u542b\u8fc7\u591a\u4fe1\u606f\uff0c\u5219\u53ef\u80fd\u4f1a\u53d8\u5f97\u96be\u4ee5\u7406\u89e3\uff0c\u800c\u4e0d\u4f1a\u589e\u52a0\u6574\u4f53\u957f\u5ea6\u3002\u5728\u56fa\u5b9a\u7684token\u9884\u7b97\u4e0b\u4f20\u8fbe\u66f4\u591a\u4fe1\u606f\u9700\u8981\u7ed3\u5408\u62bd\u8c61\u3001\u538b\u7f29\u548c\u878d\u5408\u3002\u5728\u53d8\u5f97\u96be\u4ee5\u7406\u89e3\u751a\u81f3\u4e8b\u5b9e\u9519\u8bef\u4e4b\u524d\uff0c\u53ef\u4ee5\u4e3a\u989d\u5916\u4fe1\u606f\u817e\u51fa\u7684\u7a7a\u95f4\u662f\u6709\u9650\u7684\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>2. \u94fe\u5f0f\u5bc6\u5ea6\u63d0\u793a\uff08CoD\uff09<\/h2>\n<h3>2.1 \u76ee\u6807<\/h3>\n<p>\u6211\u4eec\u7684\u76ee\u6807\u662f\u751f\u6210\u4e00\u7ec4\u5177\u6709\u4e0d\u540c\u4fe1\u606f\u5bc6\u5ea6\u7684GPT-4\u6458\u8981\uff0c\u540c\u65f6\u63a7\u5236\u957f\u5ea6\uff0c\u56e0\u4e3a\u957f\u5ea6\u5728\u8bc4\u4f30\u6458\u8981\u65f6\u5df2\u88ab\u8bc1\u660e\u662f\u4e00\u4e2a\u5f3a\u70c8\u7684\u6df7\u6742\u56e0\u7d20\u3002\u4e3a\u6b64\uff0c\u6211\u4eec\u8bbe\u8ba1\u4e86\u4e00\u4e2a\u5355\u4e00\u7684\u94fe\u5f0f\u5bc6\u5ea6\uff08CoD\uff09\u63d0\u793a\uff0c\u901a\u8fc7\u8be5\u63d0\u793a\u751f\u6210\u4e00\u4e2a\u521d\u59cb\u6458\u8981\uff0c\u5e76\u4f7f\u5176\u9010\u6e10\u53d8\u5f97\u5b9e\u4f53\u5bc6\u96c6\u3002\u5177\u4f53\u6765\u8bf4\uff0c\u5bf9\u4e8e\u56fa\u5b9a\u6570\u91cf\u7684\u8f6e\u6b21\uff0c\u4ece\u6e90\u6587\u672c\u4e2d\u8bc6\u522b\u51fa\u4e00\u7ec4\u72ec\u7279\u7684\u663e\u8457\u5b9e\u4f53\uff0c\u5e76\u5c06\u5176\u878d\u5408\u5230\u524d\u4e00\u4e2a\u6458\u8981\u4e2d\uff0c\u800c\u4e0d\u4f1a\u589e\u52a0\u957f\u5ea6\u3002\u7b2c\u4e00\u4e2a\u6458\u8981\u7531\u4e8e\u53ea\u5173\u6ce81-3\u4e2a\u521d\u59cb\u5b9e\u4f53\uff0c\u56e0\u6b64\u662f\u5b9e\u4f53\u7a00\u758f\u7684\u3002<\/p>\n<h3>2.2 \u6570\u636e<\/h3>\n<p>\u6211\u4eec\u4eceCNN\/DailyMail\u6458\u8981\u6d4b\u8bd5\u96c6\u4e2d\u968f\u673a\u62bd\u53d6\u4e86100\u7bc7\u6587\u7ae0\uff0c\u7528\u4e8e\u751f\u6210CoD\u6458\u8981\u3002<\/p>\n<h3>2.3 \u53c2\u8003\u70b9<\/h3>\n<p>\u4e3a\u4e86\u4fbf\u4e8e\u6bd4\u8f83\uff0c\u6211\u4eec\u5c06CoD\u6458\u8981\u7684\u7edf\u8ba1\u6570\u636e\u4e0e\u4eba\u5de5\u7f16\u5199\u7684\u8981\u70b9\u5f0f\u53c2\u8003\u6458\u8981\u4ee5\u53ca\u4f7f\u7528\u666e\u901a\u63d0\u793a\u751f\u6210\u7684GPT-4\u6458\u8981\u8fdb\u884c\u4e86\u6bd4\u8f83\uff1a<\/p>\n<ul>\n<li><strong>\u666e\u901a\u63d0\u793a<\/strong>: \u201c\u7528\u4e0d\u8d85\u8fc770\u4e2a\u5355\u8bcd\u4e3a\u6587\u7ae0\u5199\u4e00\u4e2a\u975e\u5e38\u7b80\u77ed\u7684\u6458\u8981\u3002\u201d<\/li>\n<\/ul>\n<p>\u6211\u4eec\u8bbe\u7f6e\u6240\u9700\u7684token\u957f\u5ea6\u4ee5\u5339\u914dCoD\u6458\u8981\u7684\u957f\u5ea6\uff08\u5982\u4e0b\u8868\u6240\u793a\uff09\u3002<\/p>\n<h3>2.4 \u63d0\u793a\u793a\u4f8b<\/h3>\n<p>\u4ee5\u4e0b\u662fCoD\u63d0\u793a\u7684\u793a\u4f8b\uff1a<\/p>\n<pre><code>\u8bf7\u751f\u6210\u4e00\u4e2a\u975e\u5e38\u7b80\u77ed\u7684\u6458\u8981\uff0c\u4e0d\u8d85\u8fc770\u4e2a\u5355\u8bcd\u3002\u7136\u540e\uff0c\u9010\u6b65\u6dfb\u52a01-3\u4e2a\u7f3a\u5931\u7684\u91cd\u8981\u5b9e\u4f53\uff0c\u800c\u4e0d\u589e\u52a0\u957f\u5ea6\u3002\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<p><strong>\u5b8c\u6574\u7684CoD\u63d0\u793a\u8bcd\u793a\u4f8b (\u82f1\u6587\u539f\u6587):<\/strong><\/p>\n<pre><code>Article: {{ ARTICLE }}\r\nYou will generate increasingly concise, entity-dense summaries of the above article. \r\nRepeat the following 2 steps 5 times. \r\nStep 1. Identify 1-3 informative entities (\";\" delimited) from the article which are missing from the previously generated summary. \r\nStep 2. Write a new, denser summary of identical length which covers every entity and detail from the previous summary plus the missing entities. \r\nA missing entity is:\r\n- relevant to the main <a href=\"https:\/\/www.kdjingpai.com\/pt\/storyvideos\/\">story<\/a>, \r\n- specific yet concise (5 words or fewer), \r\n- novel (not in the previous summary), \r\n- faithful (present in the article), \r\n- anywhere (can be located anywhere in the article).\r\nGuidelines:\r\n- The first summary should be long (4-5 sentences, ~80 words) yet highly non-specific, containing little information beyond the entities marked as missing. Use overly verbose language and fillers (e.g., \"this article discusses\") to reach ~80 words.\r\n- Make every word count: rewrite the previous summary to improve flow and make space for additional entities.\r\n- Make space with fusion, compression, and removal of uninformative phrases like \"the article discusses\".\r\n- The summaries should become highly dense and concise yet self-contained, i.e., easily understood without the article. \r\n- Missing entities can appear anywhere in the new summary.\r\n- Never drop entities from the previous summary. If space cannot be made, add fewer new entities. \r\nRemember, use the exact same number of words for each summary.\r\nAnswer in JSON. The JSON should be a list (length 5) of dictionaries whose keys are \"Missing_Entities\" and \"Denser_Summary\".\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<p><strong>\u63d0\u793a\u8bcd\u89e3\u91ca:<\/strong><\/p>\n<p>\u8fd9\u4e2a\u8be6\u7ec6\u7684CoD\u63d0\u793a\u8bcd\u65e8\u5728\u5f15\u5bfcGPT-4\u9010\u6b65\u751f\u6210\u66f4\u5bc6\u96c6\u7684\u6458\u8981\uff0c\u5176\u6838\u5fc3\u601d\u60f3\u662f\u901a\u8fc7\u8fed\u4ee3\u7684\u65b9\u5f0f\uff0c\u6bcf\u4e00\u8f6e\u90fd\u5411\u6458\u8981\u4e2d\u6dfb\u52a0\u65b0\u7684\u5173\u952e\u5b9e\u4f53\uff0c\u540c\u65f6\u4fdd\u6301\u6458\u8981\u7684\u957f\u5ea6\u4e0d\u53d8\u3002\u8ba9\u6211\u4eec\u5206\u89e3\u4e00\u4e0b\u8fd9\u4e2a\u63d0\u793a\u8bcd\u7684\u5404\u4e2a\u90e8\u5206\uff1a<\/p>\n<ul>\n<li><strong><code>Article: {{ ARTICLE }}<\/code><\/strong>: \u8fd9\u662f\u4e00\u4e2a\u5360\u4f4d\u7b26\uff0c\u60a8\u9700\u8981\u5c06\u60a8\u60f3\u8981\u6458\u8981\u7684\u6587\u7ae0\u5185\u5bb9\u66ff\u6362\u00a0<code>{{ ARTICLE }}<\/code>\u3002<\/li>\n<li><strong><code>You will generate increasingly concise, entity-dense summaries of the above article.<\/code><\/strong>: \u8fd9\u662f\u6307\u4ee4\u7684\u6838\u5fc3\uff0c\u544a\u8bc9\u6a21\u578b\u76ee\u6807\u662f\u751f\u6210\u8d8a\u6765\u8d8a\u7b80\u6d01\u4e14\u5b9e\u4f53\u5bc6\u96c6\u7684\u6458\u8981\u3002<\/li>\n<li><strong><code>Repeat the following 2 steps 5 times.<\/code><\/strong>: \u6307\u5b9a\u8fed\u4ee3\u6b21\u6570\u4e3a5\u6b21\uff0c\u610f\u5473\u7740\u6a21\u578b\u5c06\u91cd\u590d\u6267\u884c\u63a5\u4e0b\u6765\u7684\u4e24\u4e2a\u6b65\u9aa4\u4e94\u8f6e\uff0c\u9010\u6b65\u589e\u52a0\u6458\u8981\u7684\u5bc6\u5ea6\u3002<\/li>\n<li><strong><code>Step 1. Identify 1-3 informative entities (\";\" delimited) from the article which are missing from the previously generated summary.<\/code><\/strong>:\u00a0<strong>\u6b65\u9aa41\uff1a\u8bc6\u522b\u7f3a\u5931\u5b9e\u4f53<\/strong>\u3002\u6a21\u578b\u9700\u8981\u4ece\u539f\u59cb\u6587\u7ae0\u4e2d\u8bc6\u522b1\u52303\u4e2a\u4fe1\u606f\u91cf\u5927\u7684\u5b9e\u4f53\uff0c\u8fd9\u4e9b\u5b9e\u4f53\u5fc5\u987b\u662f\u4e4b\u524d\u751f\u6210\u7684\u6458\u8981\u4e2d\u6ca1\u6709\u51fa\u73b0\u8fc7\u7684\u3002\u5b9e\u4f53\u4e4b\u95f4\u7528\u5206\u53f7\u00a0<code>;<\/code>\u00a0\u5206\u9694\u3002<\/li>\n<li><strong><code>Step 2. Write a new, denser summary of identical length which covers every entity and detail from the previous summary plus the missing entities.<\/code><\/strong>:\u00a0<strong>\u6b65\u9aa4 2\uff1a\u751f\u6210\u66f4\u5bc6\u96c6\u7684\u6458\u8981<\/strong>\u3002 \u6a21\u578b\u9700\u8981\u57fa\u4e8e\u4e4b\u524d\u7684\u6458\u8981\uff0c\u878d\u5165\u6b65\u9aa41\u4e2d\u8bc6\u522b\u51fa\u7684\u7f3a\u5931\u5b9e\u4f53\uff0c\u751f\u6210\u4e00\u4e2a\u65b0\u7684\u6458\u8981\u3002\u5173\u952e\u662f\u65b0\u6458\u8981\u7684\u957f\u5ea6\u8981\u4e0e\u4e4b\u524d\u7684\u6458\u8981\u5b8c\u5168\u76f8\u540c\uff0c\u8fd9\u5c31\u8feb\u4f7f\u6a21\u578b\u5fc5\u987b\u538b\u7f29\u548c\u878d\u5408\u4fe1\u606f\uff0c\u4ee5\u5bb9\u7eb3\u65b0\u5b9e\u4f53\u3002<\/li>\n<li><strong><code>A missing entity is:<\/code><\/strong>: \u5b9a\u4e49\u4e86\u201c\u7f3a\u5931\u5b9e\u4f53\u201d\u7684\u6807\u51c6\uff0c\u786e\u4fdd\u9009\u62e9\u7684\u5b9e\u4f53\u662f\u9ad8\u8d28\u91cf\u4e14\u76f8\u5173\u7684\uff1a\n<ul>\n<li><strong><code>- relevant to the main story<\/code><\/strong>: \u4e0e\u6587\u7ae0\u7684\u4e3b\u8981\u6545\u4e8b\u76f8\u5173\u3002<\/li>\n<li><strong><code>- specific yet concise (5 words or fewer)<\/code><\/strong>: \u5177\u4f53\u4e14\u7b80\u6d01\uff0c\u4e0d\u8d85\u8fc75\u4e2a\u8bcd\u3002<\/li>\n<li><strong><code>- novel (not in the previous summary)<\/code><\/strong>: \u5728\u4e4b\u524d\u7684\u6458\u8981\u4e2d\u6ca1\u6709\u51fa\u73b0\u8fc7\u3002<\/li>\n<li><strong><code>- faithful (present in the article)<\/code><\/strong>: \u5fc5\u987b\u5728\u6587\u7ae0\u4e2d\u771f\u5b9e\u5b58\u5728\u3002<\/li>\n<li><strong><code>- anywhere (can be located anywhere in the article)<\/code><\/strong>: \u53ef\u4ee5\u4f4d\u4e8e\u6587\u7ae0\u7684\u4efb\u4f55\u4f4d\u7f6e\u3002<\/li>\n<\/ul>\n<\/li>\n<li><strong><code>Guidelines:<\/code><\/strong>: \u63d0\u4f9b\u4e86\u4e00\u7cfb\u5217\u6307\u5357\uff0c\u66f4\u8be6\u7ec6\u5730\u6307\u5bfc\u6a21\u578b\u5982\u4f55\u6267\u884c\u6458\u8981\u751f\u6210\u4efb\u52a1\uff1a\n<ul>\n<li><strong><code>- The first summary should be long (4-5 sentences, ~80 words) yet highly non-specific...<\/code><\/strong>:\u00a0<strong>\u7b2c\u4e00\u4e2a\u6458\u8981\u7684\u6307\u5bfc<\/strong>\uff1a\u8981\u6c42\u7b2c\u4e00\u4e2a\u6458\u8981\u8f83\u957f\uff08\u7ea680\u8bcd\uff0c4-5\u53e5\uff09\uff0c\u4f46\u4fe1\u606f\u91cf\u8f83\u4f4e\uff0c\u4e3b\u8981\u76ee\u7684\u662f\u4e3a\u540e\u7eed\u8fed\u4ee3\u6253\u4e0b\u57fa\u7840\u3002\u53ef\u4ee5\u4f7f\u7528\u5197\u4f59\u7684\u8bed\u8a00\u548c\u586b\u5145\u8bcd\u3002<\/li>\n<li><strong><code>- Make every word count: rewrite the previous summary to improve flow and make space for additional entities.<\/code><\/strong>:\u00a0<strong>\u7cbe\u7b80\u8bed\u8a00<\/strong>: \u5f3a\u8c03\u9700\u8981\u91cd\u5199\u4e4b\u524d\u7684\u6458\u8981\uff0c\u4f18\u5316\u8bed\u8a00\u8868\u8fbe\uff0c\u4e3a\u65b0\u5b9e\u4f53\u7684\u52a0\u5165\u817e\u51fa\u7a7a\u95f4\u3002<\/li>\n<li><strong><code>- Make space with fusion, compression, and removal of uninformative phrases like \"the article discusses\".<\/code><\/strong>:\u00a0<strong>\u7a7a\u95f4\u817e\u632a\u6280\u5de7<\/strong>: \u660e\u786e\u6307\u51fa\u4f7f\u7528\u878d\u5408\u3001\u538b\u7f29\u548c\u5220\u9664\u65e0\u4fe1\u606f\u77ed\u8bed\u7b49\u6280\u5de7\u6765\u538b\u7f29\u6458\u8981\u3002<\/li>\n<li><strong><code>- The summaries should become highly dense and concise yet self-contained, i.e., easily understood without the article.<\/code><\/strong>:\u00a0<strong>\u6458\u8981\u8d28\u91cf\u76ee\u6807<\/strong>: \u8981\u6c42\u6700\u7ec8\u7684\u6458\u8981\u8981\u9ad8\u5ea6\u5bc6\u96c6\u3001\u7b80\u6d01\uff0c\u4f46\u540c\u65f6\u4e5f\u8981\u662f\u81ea\u5305\u542b\u7684\uff0c\u5373\u4e0d\u770b\u539f\u6587\u4e5f\u80fd\u7406\u89e3\u6458\u8981\u7684\u5185\u5bb9\u3002<\/li>\n<li><strong><code>- Missing entities can appear anywhere in the new summary.<\/code><\/strong>:\u00a0<strong>\u5b9e\u4f53\u4f4d\u7f6e<\/strong>: \u65b0\u52a0\u5165\u7684\u5b9e\u4f53\u53ef\u4ee5\u51fa\u73b0\u5728\u65b0\u6458\u8981\u7684\u4efb\u4f55\u4f4d\u7f6e\u3002<\/li>\n<li><strong><code>- Never drop entities from the previous summary. If space cannot be made, add fewer new entities.<\/code><\/strong>:\u00a0<strong>\u5b9e\u4f53\u4fdd\u7559<\/strong>: \u5f3a\u8c03\u7edd\u4e0d\u80fd\u5220\u9664\u4e4b\u524d\u6458\u8981\u4e2d\u7684\u5b9e\u4f53\u3002\u5982\u679c\u7a7a\u95f4\u5b9e\u5728\u4e0d\u591f\uff0c\u53ef\u4ee5\u5c11\u6dfb\u52a0\u65b0\u7684\u5b9e\u4f53\u3002<\/li>\n<li><strong><code>- Remember, use the exact same number of words for each summary.<\/code><\/strong>:\u00a0<strong>\u957f\u5ea6\u4e00\u81f4<\/strong>: \u518d\u6b21\u5f3a\u8c03\u6bcf\u4e00\u8f6e\u751f\u6210\u7684\u6458\u8981\u7684\u957f\u5ea6\u5fc5\u987b\u4fdd\u6301\u4e00\u81f4\u3002<\/li>\n<li><strong><code>Answer in JSON. The JSON should be a list (length 5) of dictionaries whose keys are \"Missing_Entities\" and \"Denser_Summary\".<\/code><\/strong>:\u00a0<strong>\u8f93\u51fa\u683c\u5f0f<\/strong>: \u8981\u6c42\u6a21\u578b\u4ee5JSON\u683c\u5f0f\u8f93\u51fa\u7ed3\u679c\u3002JSON\u5e94\u8be5\u662f\u4e00\u4e2a\u5305\u542b5\u4e2a\u5b57\u5178\u7684\u5217\u8868\uff0c\u6bcf\u4e2a\u5b57\u5178\u5305\u542b &#8220;Missing_Entities&#8221; (\u672c\u8f6e\u6dfb\u52a0\u7684\u7f3a\u5931\u5b9e\u4f53) \u548c &#8220;Denser_Summary&#8221; (\u672c\u8f6e\u751f\u6210\u7684\u66f4\u5bc6\u96c6\u7684\u6458\u8981) \u4e24\u4e2a\u952e\u3002<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-21364\" src=\"https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/e36cbe50492dad6.jpg\" width=\"1344\" height=\"690\" alt=\"CoD\uff1a\u5bc6\u5ea6\u94fe-1\" title=\"CoD\uff1a\u5bc6\u5ea6\u94fe-1\" srcset=\"https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/e36cbe50492dad6.jpg 1344w, https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/e36cbe50492dad6-768x394.jpg 768w\" sizes=\"auto, (max-width: 1344px) 100vw, 1344px\" \/><\/p>\n<p><strong>\u56fe1<\/strong>: \u94fe\u5f0f\u5bc6\u5ea6\uff08CoD\uff09\u63d0\u793a\u548c\u793a\u4f8b\u8f93\u51fa\u3002\u5728\u6bcf\u4e00\u6b65\u4e2d\uff0c\u90fd\u4f1a\u5411\u4e4b\u524d\u7684\u6458\u8981\u4e2d\u6dfb\u52a01-3\u4e2a\u989d\u5916\u7684\u7ec6\u8282\uff08\u5b9e\u4f53\uff09\uff0c\u800c\u4e0d\u589e\u52a0\u957f\u5ea6\u3002\u4e3a\u4e86\u817e\u51fa\u7a7a\u95f4\u5bb9\u7eb3\u65b0\u5b9e\u4f53\uff0c\u73b0\u6709\u5185\u5bb9\u4f1a\u88ab\u6539\u5199\uff08\u4f8b\u5982\uff0c\u538b\u7f29\u3001\u878d\u5408\uff09\u3002\u4e00\u534a\u7684\u6ce8\u91ca\u8005\uff082\/4\uff09\u66f4\u559c\u6b22\u5012\u6570\u7b2c\u4e8c\u4e2a\u6458\u8981\uff0c\u5176\u4f59\u7684\u5219\u66f4\u559c\u6b22\u6700\u540e\u4e00\u4e2a\u6458\u8981\u3002<\/p>\n<p>&nbsp;<\/p>\n<p><strong>CoD\u63d0\u793a\u8bcd\u5b9e\u9645\u5de5\u4f5c\u4f7f\u7528\u793a\u4f8b\uff1a<\/strong><\/p>\n<p>\u5047\u8bbe\u6211\u4eec\u6709\u4e00\u7bc7\u5173\u4e8e\u201c\u7f8e\u56fd\u603b\u7edf\u62dc\u767b\u8bbf\u95ee\u6ce2\u5170\u201d\u7684\u65b0\u95fb\u6587\u7ae0\uff0c\u6211\u4eec\u60f3\u8981\u4f7f\u7528CoD\u63d0\u793a\u8bcd\u751f\u6210\u4e00\u7cfb\u5217\u4e0d\u540c\u5bc6\u5ea6\u7684\u6458\u8981\u3002<\/p>\n<p><strong>\u6b65\u9aa4 1: \u51c6\u5907\u8f93\u5165\u6587\u7ae0<\/strong><\/p>\n<p>\u9996\u5148\uff0c\u6211\u4eec\u9700\u8981\u5c06\u65b0\u95fb\u6587\u7ae0\u7684\u5185\u5bb9\u51c6\u5907\u597d\uff0c\u4f8b\u5982\uff1a<\/p>\n<pre><code>\u7f8e\u56fd\u603b\u7edf\u4e54\u00b7\u62dc\u767b \u043d\u0435\u043e\u0436\u0438\u0434\u0430\u043d\u043d\u043e \u62b5\u8fbe\u6ce2\u5170\u8fdb\u884c\u8bbf\u95ee\uff0c\u4e0e\u6ce2\u5170\u603b\u7edf\u5b89\u6770\u4f0a\u00b7\u675c\u8fbe\u4e3e\u884c\u4f1a\u6664\u3002\u6b64\u6b21\u8bbf\u95ee\u6b63\u503c\u4fc4\u4e4c\u51b2\u7a81\u4e00\u5468\u5e74\u4e4b\u9645\uff0c\u9884\u8ba1\u4e24\u56fd\u9886\u5bfc\u4eba\u5c06\u8ba8\u8bba\u5730\u533a\u5b89\u5168\u3001\u5bf9\u4e4c\u514b\u5170\u7684\u8fdb\u4e00\u6b65\u652f\u6301\u4ee5\u53ca\u52a0\u5f3a\u5317\u7ea6\u4e1c\u7ffc\u7b49\u8bae\u9898\u3002\u62dc\u767b\u7684\u8bbf\u95ee\u662f\u5bf9\u6ce2\u5170\u5728\u652f\u6301\u4e4c\u514b\u5170\u96be\u6c11\u548c\u5411\u4e4c\u514b\u5170\u63d0\u4f9b\u519b\u4e8b\u63f4\u52a9\u65b9\u9762\u6240\u505a\u52aa\u529b\u7684\u80af\u5b9a\u3002\u6b64\u5916\uff0c\u62dc\u767b\u8fd8\u8ba1\u5212\u5728\u534e\u6c99\u5c31\u4fc4\u4e4c\u51b2\u7a81\u53d1\u8868\u91cd\u8981\u8bb2\u8bdd\uff0c\u5e76\u4f1a\u89c1\u5728\u6ce2\u5170\u7684\u7f8e\u519b\u58eb\u5175\u3002\r\n<\/code><\/pre>\n<p><strong>\u6b65\u9aa4 2: \u6784\u5efaAPI\u8bf7\u6c42 (\u4ee5OpenAI API\u4e3a\u4f8b)<\/strong><\/p>\n<p>\u6211\u4eec\u5c06\u4f7f\u7528OpenAI API (\u6216\u5176\u4ed6\u652f\u6301GPT-4\u6a21\u578b\u7684API) \u6765\u53d1\u9001\u8bf7\u6c42\u3002 \u8bf7\u6c42\u7684body\u90e8\u5206\u5c06\u5305\u542b\u6211\u4eec\u7684CoD\u63d0\u793a\u8bcd\uff0c\u5e76\u5c06\u00a0<code>{{ ARTICLE }}<\/code>\u00a0\u66ff\u6362\u4e3a\u51c6\u5907\u597d\u7684\u6587\u7ae0\u5185\u5bb9\u3002<\/p>\n<pre><code>{\r\n\"model\": \"gpt-4\",\r\n\"prompt\": \"Article: \u7f8e\u56fd\u603b\u7edf\u4e54\u00b7\u62dc\u767b \u043d\u0435\u043e\u0436\u0438\u0434\u0430\u043d\u043d\u043e \u62b5\u8fbe\u6ce2\u5170\u8fdb\u884c\u8bbf\u95ee\uff0c\u4e0e\u6ce2\u5170\u603b\u7edf\u5b89\u6770\u4f0a\u00b7\u675c\u8fbe\u4e3e\u884c\u4f1a\u6664\u3002\u6b64\u6b21\u8bbf\u95ee\u6b63\u503c\u4fc4\u4e4c\u51b2\u7a81\u4e00\u5468\u5e74\u4e4b\u9645\uff0c\u9884\u8ba1\u4e24\u56fd\u9886\u5bfc\u4eba\u5c06\u8ba8\u8bba\u5730\u533a\u5b89\u5168\u3001\u5bf9\u4e4c\u514b\u5170\u7684\u8fdb\u4e00\u6b65\u652f\u6301\u4ee5\u53ca\u52a0\u5f3a\u5317\u7ea6\u4e1c\u7ffc\u7b49\u8bae\u9898\u3002\u62dc\u767b\u7684\u8bbf\u95ee\u662f\u5bf9\u6ce2\u5170\u5728\u652f\u6301\u4e4c\u514b\u5170\u96be\u6c11\u548c\u5411\u4e4c\u514b\u5170\u63d0\u4f9b\u519b\u4e8b\u63f4\u52a9\u65b9\u9762\u6240\u505a\u52aa\u529b\u7684\u80af\u5b9a\u3002\u6b64\u5916\uff0c\u62dc\u767b\u8fd8\u8ba1\u5212\u5728\u534e\u6c99\u5c31\u4fc4\u4e4c\u51b2\u7a81\u53d1\u8868\u91cd\u8981\u8bb2\u8bdd\uff0c\u5e76\u4f1a\u89c1\u5728\u6ce2\u5170\u7684\u7f8e\u519b\u58eb\u5175\u3002\\nYou will generate increasingly concise, entity-dense summaries of the above article.\\n\\nRepeat the following 2 steps 5 times.\\n\\nStep 1. Identify 1-3 informative entities (\\\";\\\" delimited) from the article which are missing from the previously generated summary.\\nStep 2. Write a new, denser summary of identical length which covers every entity and detail from the previous summary plus the missing entities.\\n\\nA missing entity is:\\n- relevant to the main story, \\n- specific yet concise (5 words or fewer), \\n- novel (not in the previous summary), \\n- faithful (present in the article), \\n- anywhere (can be located anywhere in the article).\\n\\nGuidelines:\\n\\n- The first summary should be long (4-5 sentences, ~80 words) yet highly non-specific, containing little information beyond the entities marked as missing. Use overly verbose language and fillers (e.g., \\\"this article discusses\\\") to reach ~80 words.\\n- Make every word count: rewrite the previous summary to improve flow and make space for additional entities.\\n- Make space with fusion, compression, and removal of uninformative phrases like \\\"the article discusses\\\".\\n- The summaries should become highly dense and concise yet self-contained, i.e., easily understood without the article. \\n- Missing entities can appear anywhere in the new summary.\\n- Never drop entities from the previous summary. If space cannot be made, add fewer new entities. \\n\\nRemember, use the exact same number of words for each summary.\\nAnswer in JSON. The JSON should be a list (length 5) of dictionaries whose keys are \\\"Missing_Entities\\\" and \\\"Denser_Summary\\\".\",\r\n\"max_tokens\": 1000,  \/\/ \u786e\u4fdd\u6a21\u578b\u6709\u8db3\u591f\u7684token\u751f\u6210\u5b8c\u6574JSON\u8f93\u51fa\r\n\"temperature\": 0.7\/\/ \u53ef\u8c03\u6574temperature\u63a7\u5236\u751f\u6210\u7ed3\u679c\u7684\u968f\u673a\u6027\r\n}\r\n<\/code><\/pre>\n<p><strong>\u6b65\u9aa4 3: \u53d1\u9001API\u8bf7\u6c42\u5e76\u63a5\u6536JSON\u54cd\u5e94<\/strong><\/p>\n<p>\u5c06\u4e0a\u8ff0JSON\u8bf7\u6c42\u53d1\u9001\u5230OpenAI API\u7aef\u70b9\u3002 API\u4f1a\u8fd4\u56de\u4e00\u4e2aJSON\u683c\u5f0f\u7684\u54cd\u5e94\uff0c\u5176\u4e2d\u5305\u542b\u4e94\u4e2a\u4e0d\u540c\u5bc6\u5ea6\u7684\u6458\u8981\u4ee5\u53ca\u6bcf\u4e00\u6b65\u6dfb\u52a0\u7684\u7f3a\u5931\u5b9e\u4f53\u3002<\/p>\n<p><strong>\u6b65\u9aa4 4: \u89e3\u6790JSON\u54cd\u5e94\u5e76\u4f7f\u7528\u6458\u8981<\/strong><\/p>\n<p>\u89e3\u6790API\u8fd4\u56de\u7684JSON\u54cd\u5e94\u3002 \u60a8\u4f1a\u5f97\u5230\u4e00\u4e2aJSON\u5217\u8868\uff0c\u7c7b\u4f3c\u4e8e\uff1a<\/p>\n<pre><code>{\r\n\"Missing_Entities\": [],\r\n\"Denser_Summary\": \"This article discusses a visit. It is about a president visiting a country. The president is American. The country is Poland. This is related to international relations.  The visit is happening during a time of conflict. This conflict involves Russia and Ukraine.  The visit aims to show support and discuss important matters.  More details will be provided.\"\r\n},\r\n{\r\n\"Missing_Entities\": [\"Joe Biden\"; \"Andrzej Duda\"],\r\n\"Denser_Summary\": \"U.S. President Joe Biden visited Poland and met with Polish President Andrzej Duda. This visit is about international relations and is happening during the Russia-Ukraine conflict. They will discuss support and security. More details are expected.\"\r\n},\r\n{\r\n\"Missing_Entities\": [\"one-year anniversary of the Russia-Ukraine conflict\"; \"regional security\"; \"support for Ukraine\"],\r\n\"Denser_Summary\": \"U.S. President Joe Biden met Polish President Andrzej Duda in Poland on the one-year anniversary of the Russia-Ukraine conflict. They discussed regional security and support for Ukraine, focusing on international relations.\"\r\n},\r\n{\r\n\"Missing_Entities\": [\"strengthening NATO's eastern flank\"; \"support for Ukrainian refugees\"; \"military aid to Ukraine\"],\r\n\"Denser_Summary\": \"On the Russia-Ukraine conflict's one-year anniversary, U.S. President Joe Biden visited Poland, meeting President Andrzej Duda to discuss regional security, support for Ukraine (including refugees and military aid), and strengthening NATO's eastern flank.\"\r\n},\r\n{\r\n\"Missing_Entities\": [\"Warsaw\"; \"major speech\"; \"U.S. troops in Poland\"],\r\n\"Denser_Summary\": \"To mark the Russia-Ukraine conflict's one-year mark, U.S. President Joe Biden visited Warsaw, Poland, meeting President Andrzej Duda to discuss regional security, Ukrainian refugee and military aid support, strengthening NATO's eastern flank, and Biden's planned major speech and meeting with U.S. troops in Poland.\"\r\n}\r\n]\r\n<\/code><\/pre>\n<p>\u60a8\u53ef\u4ee5\u6839\u636e\u60a8\u7684\u9700\u6c42\u9009\u62e9\u5408\u9002\u7684\u6458\u8981\u5bc6\u5ea6\u3002 \u4f8b\u5982\uff0c\u5982\u679c\u60a8\u9700\u8981\u4e00\u4e2a\u975e\u5e38\u7b80\u77ed\u7684\u6458\u8981\uff0c\u53ef\u4ee5\u9009\u62e9\u7b2c\u4e00\u4e2a\u6216\u7b2c\u4e8c\u4e2a\uff1b \u5982\u679c\u60a8\u9700\u8981\u66f4\u8be6\u7ec6\u4f46\u4ecd\u7136\u7b80\u6d01\u7684\u6458\u8981\uff0c\u53ef\u4ee5\u9009\u62e9\u7b2c\u56db\u4e2a\u6216\u7b2c\u4e94\u4e2a\u3002<\/p>\n<p>&nbsp;<\/p>\n<p><strong>\u5b9e\u9645\u5e94\u7528\u573a\u666f\uff1a<\/strong><\/p>\n<ul>\n<li>\u65b0\u95fb\u805a\u5408\u548c\u5185\u5bb9\u63a8\u8350:\u00a0\u4e3a\u4e0d\u540c\u7684\u7528\u6237\u6216\u5e73\u53f0\u63d0\u4f9b\u4e0d\u540c\u5bc6\u5ea6\u7684\u6458\u8981\uff0c\u6ee1\u8db3\u4e0d\u540c\u4fe1\u606f\u9700\u6c42\u3002<\/li>\n<li>\u4fe1\u606f\u68c0\u7d22:\u00a0\u5728\u641c\u7d22\u7ed3\u679c\u4e2d\u5c55\u793a\u4e0d\u540c\u5bc6\u5ea6\u7684\u6458\u8981\uff0c\u5e2e\u52a9\u7528\u6237\u5feb\u901f\u5224\u65ad\u6587\u7ae0\u76f8\u5173\u6027\u3002<\/li>\n<li>\u8f85\u52a9\u9605\u8bfb\u7406\u89e3:\u00a0\u901a\u8fc7\u9010\u6b65\u589e\u52a0\u6458\u8981\u5bc6\u5ea6\uff0c\u5e2e\u52a9\u8bfb\u8005\u7531\u6d45\u5165\u6df1\u5730\u7406\u89e3\u6587\u7ae0\u5185\u5bb9\u3002<\/li>\n<li>\u793e\u4ea4\u5a92\u4f53\u5185\u5bb9\u751f\u6210:\u00a0\u9488\u5bf9\u4e0d\u540c\u793e\u4ea4\u5e73\u53f0\uff08\u5982Twitter, Facebook\uff09\u751f\u6210\u957f\u5ea6\u548c\u5bc6\u5ea6\u4e0d\u540c\u7684\u6458\u8981\u3002<\/li>\n<\/ul>\n<p>\u901a\u8fc7\u4ee5\u4e0a\u6b65\u9aa4\uff0c\u60a8\u5c31\u53ef\u4ee5\u5728\u5b9e\u9645\u5de5\u4f5c\u4e2d\u6709\u6548\u5730\u4f7f\u7528CoD\u63d0\u793a\u8bcd\uff0c\u5229\u7528GPT-4\u751f\u6210\u9ad8\u8d28\u91cf\u3001\u591a\u5bc6\u5ea6\u7684\u6587\u672c\u6458\u8981\u3002<\/p>\n<p>&nbsp;<\/p>\n<h3>3. \u7edf\u8ba1\u6570\u636e<\/h3>\n<h3>3.1 \u76f4\u63a5\u7edf\u8ba1\u6570\u636e<\/h3>\n<p>\u5728\u88681\u4e2d\uff0c\u6211\u4eec\u4f7f\u7528NLTK\u8ba1\u7b97token\uff0c\u4f7f\u7528Spacy\u6d4b\u91cf\u552f\u4e00\u5b9e\u4f53\uff0c\u5e76\u5c06\u5b9e\u4f53\u5bc6\u5ea6\u8ba1\u7b97\u4e3a\u6bd4\u7387\u3002CoD\u63d0\u793a\u5728\u5f88\u5927\u7a0b\u5ea6\u4e0a\u9075\u5faa\u4e86\u56fa\u5b9a\u7684token\u9884\u7b97\u3002\u5b9e\u9645\u4e0a\uff0c\u7b2c\u4e8c\u6b65\u5bfc\u81f4\u5e73\u5747\u51cf\u5c11\u4e865\u4e2atoken\uff08\u4ece72\u4e2a\u51cf\u5c11\u523067\u4e2a\uff09\uff0c\u56e0\u4e3a\u4ece\u6700\u521d\u5197\u957f\u7684\u6458\u8981\u4e2d\u5220\u9664\u4e86\u4e0d\u5fc5\u8981\u7684\u5355\u8bcd\u3002\u5b9e\u4f53\u5bc6\u5ea6\u4e0a\u5347\u2014\u2014\u4ece\u6700\u521d\u76840.089\u5f00\u59cb\uff0c\u4f4e\u4e8e\u4eba\u7c7b\u548c\u666e\u901aGPT-4\uff08\u5206\u522b\u4e3a0.151\u548c0.122\uff09\u2014\u2014\u57285\u6b65\u5bc6\u96c6\u5316\u540e\u8fbe\u52300.167\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th>CoD\u6b65\u9aa4<\/th>\n<th><a href=\"https:\/\/www.kdjingpai.com\/pt\/tokenization\/\">Token<\/a><\/th>\n<th>\u5b9e\u4f53<\/th>\n<th>\u5bc6\u5ea6\uff08E\/T\uff09<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>1<\/td>\n<td>72<\/td>\n<td>6.4<\/td>\n<td>0.089<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>67<\/td>\n<td>8.7<\/td>\n<td>0.129<\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>67<\/td>\n<td>9.9<\/td>\n<td>0.148<\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>69<\/td>\n<td>10.8<\/td>\n<td>0.158<\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>72<\/td>\n<td>12.1<\/td>\n<td>0.167<\/td>\n<\/tr>\n<tr>\n<td>\u4eba\u7c7b<\/td>\n<td>60<\/td>\n<td>8.8<\/td>\n<td>0.151<\/td>\n<\/tr>\n<tr>\n<td>\u666e\u901aGPT-4<\/td>\n<td>70<\/td>\n<td>8.5<\/td>\n<td>0.122<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3>3.2 \u95f4\u63a5\u7edf\u8ba1\u6570\u636e<\/h3>\n<p>\u968f\u7740\u6bcf\u4e00\u6b65CoD\uff0c\u62bd\u8c61\u6027\u5e94\u8be5\u4f1a\u589e\u52a0\uff0c\u56e0\u4e3a\u6458\u8981\u88ab\u53cd\u590d\u6539\u5199\u4ee5\u817e\u51fa\u7a7a\u95f4\u5bb9\u7eb3\u6bcf\u4e2a\u989d\u5916\u7684\u5b9e\u4f53\u3002\u6211\u4eec\u4f7f\u7528\u63d0\u53d6\u5bc6\u5ea6\uff08extractive density\uff09\u6765\u8861\u91cf\u62bd\u8c61\u6027\uff1a\u63d0\u53d6\u7247\u6bb5\u7684\u5e73\u5747\u5e73\u65b9\u957f\u5ea6\u3002\u540c\u6837\uff0c\u968f\u7740\u5728\u56fa\u5b9a\u957f\u5ea6\u6458\u8981\u4e2d\u6dfb\u52a0\u5b9e\u4f53\uff0c\u878d\u5408\uff08Fusion\uff09\u7684\u6c34\u5e73\u5e94\u8be5\u4f1a\u5355\u8c03\u589e\u52a0\u3002\u6211\u4eec\u5c06\u878d\u5408\u4ee3\u7406\u4e3a\u6bcf\u4e2a\u6458\u8981\u53e5\u5b50\u5bf9\u9f50\u7684\u6e90\u53e5\u5b50\u7684\u5e73\u5747\u6570\u91cf\u3002\u5bf9\u4e8e\u5bf9\u9f50\uff0c\u6211\u4eec\u4f7f\u7528\u76f8\u5bf9ROUGE\u589e\u76ca\u65b9\u6cd5\uff0c\u8be5\u65b9\u6cd5\u5c06\u5bf9\u6e90\u53e5\u5b50\u4e0e\u76ee\u6807\u53e5\u5b50\u5bf9\u9f50\uff0c\u76f4\u5230\u6dfb\u52a0\u53e5\u5b50\u7684\u76f8\u5bf9ROUGE\u589e\u76ca\u4e0d\u518d\u4e3a\u6b63\u3002\u6211\u4eec\u8fd8\u9884\u8ba1\u5185\u5bb9\u5206\u5e03\uff08Content Distribution\uff09\u2014\u2014\u6458\u8981\u5185\u5bb9\u6765\u6e90\u7684\u6587\u7ae0\u4e2d\u7684\u4f4d\u7f6e\u2014\u2014\u5c06\u4f1a\u6539\u53d8\u3002\u5177\u4f53\u6765\u8bf4\uff0c\u6211\u4eec\u9884\u8ba1CoD\u6458\u8981\u6700\u521d\u4f1a\u8868\u73b0\u51fa\u5f3a\u70c8\u7684\u5f00\u5934\u504f\u5dee\uff08Lead Bias\uff09\uff0c\u4f46\u9010\u6e10\u5f00\u59cb\u4ece\u6587\u7ae0\u7684\u4e2d\u90e8\u548c\u7ed3\u5c3e\u5f15\u5165\u5b9e\u4f53\u3002\u4e3a\u4e86\u8861\u91cf\u8fd9\u4e00\u70b9\uff0c\u6211\u4eec\u4f7f\u7528\u878d\u5408\u4e2d\u7684\u5bf9\u9f50\uff0c\u5e76\u6d4b\u91cf\u6240\u6709\u5bf9\u9f50\u6e90\u53e5\u5b50\u7684\u5e73\u5747\u53e5\u5b50\u6392\u540d\u3002\u56fe2\u8bc1\u5b9e\u4e86\u8fd9\u4e9b\u5047\u8bbe\uff1a\u968f\u7740\u6539\u5199\u6b65\u9aa4\u7684\u589e\u52a0\uff0c\u62bd\u8c61\u6027\u589e\u52a0\uff08\u5de6\u56fe\uff09\uff0c\u878d\u5408\u7387\u4e0a\u5347\uff08\u4e2d\u95f4\u56fe\uff09\uff0c\u5e76\u4e14\u6458\u8981\u5f00\u59cb\u5305\u542b\u6765\u81ea\u6587\u7ae0\u4e2d\u95f4\u548c\u7ed3\u5c3e\u7684\u5185\u5bb9\uff08\u53f3\u56fe\uff09\u3002\u6709\u8da3\u7684\u662f\uff0c\u6240\u6709CoD\u6458\u8981\u90fd\u6bd4\u4eba\u5de5\u7f16\u5199\u548c\u57fa\u7ebf\u6458\u8981\u66f4\u5177\u62bd\u8c61\u6027\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-21365\" src=\"https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/e55495f3949ada6.jpg\" width=\"1350\" height=\"285\" alt=\"CoD\uff1a\u5bc6\u5ea6\u94fe-2\" title=\"CoD\uff1a\u5bc6\u5ea6\u94fe-2\" srcset=\"https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/e55495f3949ada6.jpg 1350w, https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/e55495f3949ada6-768x162.jpg 768w\" sizes=\"auto, (max-width: 1350px) 100vw, 1350px\" \/><\/p>\n<p><strong>\u56fe2<\/strong>: CoD\u751f\u6210\u7684\u6458\u8981\u53d8\u5f97\u8d8a\u6765\u8d8a\u62bd\u8c61\uff0c\u540c\u65f6\u8868\u73b0\u51fa\u66f4\u591a\u7684\u878d\u5408\u548c\u66f4\u5c11\u7684\u5f00\u5934\u504f\u5dee\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>4. \u7ed3\u679c<\/h2>\n<h3>4.1 \u4eba\u7c7b\u504f\u597d<\/h3>\n<p>\u4e3a\u4e86\u66f4\u597d\u5730\u4e86\u89e3CoD\u6458\u8981\u6240\u5448\u73b0\u7684\u6743\u8861\uff0c\u6211\u4eec\u8fdb\u884c\u4e86\u57fa\u4e8e\u504f\u597d\u7684\u7814\u7a76\uff0c\u5e76\u5bf9GPT-4\u8fdb\u884c\u4e86\u8bc4\u5206\u8bc4\u4f30\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th><strong>CoD\u6b65\u9aa4<\/strong><\/th>\n<th><strong>\u7b2c\u4e00\u540d\u6295\u7968\u767e\u5206\u6bd4\uff08\u5355\u4e2a\u6ce8\u91ca\u8005\uff09<\/strong><\/th>\n<th><\/th>\n<th><\/th>\n<th><strong>\u5408\u8ba1<\/strong><\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>1<\/strong><\/td>\n<td><strong>3.0 2.0<\/strong><\/td>\n<td><strong>13.0<\/strong><\/td>\n<td><strong>17.4<\/strong><\/td>\n<td><strong>8.3<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>2<\/strong><\/td>\n<td><strong>25.0 28.0<\/strong><\/td>\n<td><strong>43.0<\/strong><\/td>\n<td><strong>31.4<\/strong><\/td>\n<td><strong>30.8<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>3<\/strong><\/td>\n<td><strong>22.0 28.0 21.0<\/strong><\/td>\n<td><\/td>\n<td><strong>24.4<\/strong><\/td>\n<td><strong>23.0<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>4<\/strong><\/td>\n<td><strong>29.0 25.0 13.0<\/strong><\/td>\n<td><\/td>\n<td><strong>26.7<\/strong><\/td>\n<td><strong>22.5<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>5<\/strong><\/td>\n<td><strong>21.0 17.0 10.0<\/strong><\/td>\n<td><\/td>\n<td><strong>16.3<\/strong><\/td>\n<td><strong>15.5<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>\u88681<\/strong>: CoD\u6458\u8981\u6309\u6b65\u9aa4\u5212\u5206\u7684\u7b2c\u4e00\u540d\u6295\u7968\u767e\u5206\u6bd4\u3002\u6839\u636e\u5408\u8ba1\u504f\u597d\uff0cCoD\u6b65\u9aa4\u7684\u4f17\u6570\u662f2\uff0c\u4e2d\u4f4d\u6570\u662f3\uff0c\u671f\u671b\u503c\u662f3.06\u3002<\/p>\n<p>\u9996\u5148\uff0c\u6211\u4eec\u62a5\u544a\u4e86Fleiss&#8217; kappa\uff08Fleiss, 1971\uff09\u7684\u4f4e\u503c0.112\uff0c\u8fd9\u8868\u660e\u6458\u8981\u4e4b\u95f4\u7684\u5fae\u5999\u5dee\u5f02\u548c\u4efb\u52a1\u7684\u672c\u8d28\u662f\u4e3b\u89c2\u7684\u3002\u6700\u8fd1\u7684\u7814\u7a76\u4e5f\u6ce8\u610f\u5230\u4e86\u5728\u5224\u65ad\u57fa\u4e8eGPT\u7684\u6458\u8981\u65f6\uff0c\u4f4e\u5b9e\u4f8b\u7ea7\u4e00\u81f4\u6027\uff08Goyal et al., 2022\uff09\u3002<\/p>\n<p>\u7136\u800c\uff0c\u5728\u7cfb\u7edf\u5c42\u9762\uff0c\u4e00\u4e9b\u8d8b\u52bf\u5f00\u59cb\u663e\u73b0\u3002\u5bf9\u4e8e4\u4f4d\u6ce8\u91ca\u8005\u4e2d\u76843\u4f4d\uff0cCoD\u6b65\u9aa41\u5728100\u4e2a\u793a\u4f8b\u4e2d\u83b7\u5f97\u4e86\u7b2c\u4e00\u540d\u6295\u7968\u7684\u6700\u5927\u4efd\u989d\uff08\u5206\u522b\u4e3a28%\u300143%\u548c31.4%\uff09\u3002\u7136\u800c\uff0c\u5408\u8ba1\u8d77\u6765\uff0c61%\u7684\u7b2c\u4e00\u540d\u6458\u8981\uff0823.0+22.5+15.5\uff09\u6d89\u53ca\u4e86\u22653\u4e2a\u5bc6\u96c6\u5316\u6b65\u9aa4\u3002\u9996\u9009\u7684CoD\u6b65\u9aa4\u7684\u4e2d\u4f4d\u6570\u5728\u4e2d\u95f4\uff083\uff09\uff0c\u671f\u671b\u6b65\u9aa4\u662f3.06\u3002<\/p>\n<p>\u6839\u636e\u7b2c3\u6b65\u6458\u8981\u7684\u5e73\u5747\u5bc6\u5ea6\uff0c\u6211\u4eec\u53ef\u4ee5\u7c97\u7565\u5730\u63a8\u65ad\u51fa\u5728CoD\u5019\u9009\u8005\u4e2d\u9996\u9009\u7684\u5b9e\u4f53\u5bc6\u5ea6\u7ea6\u4e3a0.15\u3002\u4ece\u88681\u4e2d\u6211\u4eec\u53ef\u4ee5\u770b\u51fa\uff0c\u8fd9\u4e2a\u5bc6\u5ea6\u4e0e\u4eba\u5de5\u7f16\u5199\u7684\u6458\u8981\uff080.151\uff09\u4e00\u81f4\uff0c\u4f46\u660e\u663e\u9ad8\u4e8e\u4f7f\u7528\u666e\u901aGPT-4\u63d0\u793a\u751f\u6210\u7684\u6458\u8981\uff080.122\uff09\u3002<\/p>\n<h3>4.2 \u81ea\u52a8\u6307\u6807<\/h3>\n<p>\u4f5c\u4e3a\u8bc4\u4f30\u8005\uff0cGPT-4\u5df2\u88ab\u8bc1\u660e\u80fd\u591f\u5145\u5206\u5730\u4e0e\u4eba\u7c7b\u5224\u65ad\u76f8\u4e00\u81f4\uff08Fu et al., 2023; Liu et al., 2023a\uff09\uff0c\u751a\u81f3\u5728\u67d0\u4e9b\u6ce8\u91ca\u4efb\u52a1\u4e0a\u53ef\u80fd\u4f18\u4e8e\u4f17\u5305\u5de5\u4eba\uff08Gilardi et al., 2023\uff09\u3002\u4f5c\u4e3a\u5bf9\u6211\u4eec\u4eba\u7c7b\u8bc4\u4f30\u7684\u8865\u5145\uff0c\u6211\u4eec\u63d0\u793aGPT-4\u5bf9CoD\u6458\u8981\u8fdb\u884c1-5\u8bc4\u5206\uff0c\u8bc4\u5206\u7ef4\u5ea6\u5305\u62ec\uff1a\u4fe1\u606f\u91cf\u3001\u8d28\u91cf\u3001\u8fde\u8d2f\u6027\u3001\u53ef\u5f52\u56e0\u6027\u548c\u603b\u4f53\u3002\u4fe1\u606f\u91cf\u3001\u8d28\u91cf\u548c\u53ef\u5f52\u56e0\u6027\u7684\u5b9a\u4e49\u6765\u81eaAharoni et al. (2023)\uff0c\u800c\u8fde\u8d2f\u6027\u6765\u81eaFabbri et al. (2021)\u3002\u603b\u4f53\u65e8\u5728\u6355\u6349\u8054\u5408\u54c1\u8d28\u3002\u8bf7\u53c2\u89c1\u9644\u5f55A\uff0c\u4e86\u89e3\u7528\u4e8e\u83b7\u53d6\u6bcf\u4e2a\u7ef4\u5ea6\u5206\u6570\u7684\u63d0\u793a\u3002\u88683\u8868\u660e\uff0c\u5bc6\u96c6\u5316\u4e0e\u4fe1\u606f\u91cf\u76f8\u5173\uff0c\u4f46\u6709\u4e00\u4e2a\u9650\u5ea6\uff0c\u5f97\u5206\u5728\u7b2c4\u6b65\u8fbe\u5230\u5cf0\u503c\uff084.74\uff09\u3002\u65e0\u6587\u7ae0\u7ef4\u5ea6\uff1a\u8d28\u91cf\u548c\u8fde\u8d2f\u6027\uff0c\u57282\u6b65\u548c1\u6b65\u540e\u5206\u522b\u4e0b\u964d\u3002\u6240\u6709\u6458\u8981\u90fd\u88ab\u8ba4\u4e3a\u662f\u53ef\u5f52\u56e0\u4e8e\u6e90\u6587\u7ae0\u7684\u3002\u603b\u4f53\u5f97\u5206\u504f\u5411\u4e8e\u66f4\u5bc6\u96c6\u548c\u4fe1\u606f\u91cf\u66f4\u5927\u7684\u6458\u8981\uff0c\u7b2c4\u6b65\u7684\u5f97\u5206\u6700\u9ad8\u3002\u5e73\u5747\u800c\u8a00\uff0c\u7b2c\u4e00\u548c\u6700\u540e\u4e00\u4e2aCoD\u6b65\u9aa4\u6700\u4e0d\u53d7\u6b22\u8fce\uff0c\u800c\u4e2d\u95f4\u4e09\u4e2a\u6b65\u9aa4\u7684\u5f97\u5206\u63a5\u8fd1\uff08\u5206\u522b\u4e3a4.78\u30014.77\u548c4.76\uff09\u3002<\/p>\n<p>\u5728\u9644\u5f55A\u4e2d\uff0c\u6211\u4eec\u62a5\u544a\u4e86\u603b\u4f53\u6307\u6807\u4e0e\u4eba\u7c7b\u5224\u65ad\u7684\u6700\u9ad8\u6458\u8981\u7ea7\u76f8\u5173\u6027\uff08Pearson\u76f8\u5173\u6027\u4e3a0.31\uff09\uff0c\u4f46\u6ce8\u610f\u5230\u603b\u4f53\u76f8\u5173\u6027\u4ecd\u7136\u5f88\u4f4e\u2014\u2014\u8fd9\u79cd\u73b0\u8c61\u5728Deutsch et al. (2022)\u7684\u7814\u7a76\u4e2d\u4e5f\u89c2\u5bdf\u5230\uff0c\u5f53\u6458\u8981\u8d28\u91cf\u76f8\u4f3c\u65f6\u3002<\/p>\n<h3>4.3 \u5b9a\u6027\u5206\u6790<\/h3>\n<p>\u6458\u8981\u7684\u8fde\u8d2f\u6027\/\u53ef\u8bfb\u6027\u4e0e\u4fe1\u606f\u91cf\u4e4b\u95f4\u5b58\u5728\u660e\u663e\u7684\u6743\u8861\u3002\u4e3a\u4e86\u8bf4\u660e\u8fd9\u4e00\u70b9\uff0c\u5728\u56fe4\u4e2d\uff0c\u6211\u4eec\u5c55\u793a\u4e86\u4e24\u4e2aCoD\u6b65\u9aa4\uff1a\u4e00\u4e2a\u6458\u8981\u901a\u8fc7\u66f4\u591a\u7ec6\u8282\u5f97\u5230\u4e86\u6539\u8fdb\uff0c\u53e6\u4e00\u4e2a\u6458\u8981\u5219\u53d7\u5230\u4e86\u635f\u5bb3\u3002\u5e73\u5747\u800c\u8a00\uff0c\u4e2d\u95f4\u7684CoD\u6458\u8981\u6700\u597d\u5730\u5b9e\u73b0\u4e86\u8fd9\u79cd\u5e73\u8861\uff0c\u4f46\u6211\u4eec\u5c06\u5176\u7559\u5f85\u672a\u6765\u7684\u5de5\u4f5c\u6765\u7cbe\u786e\u5b9a\u4e49\u548c\u91cf\u5316\u8fd9\u79cd\u6743\u8861\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-21366\" src=\"https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/2e5df2f74c62e02.jpg\" width=\"1341\" height=\"288\" alt=\"CoD\uff1a\u5bc6\u5ea6\u94fe-3\" title=\"CoD\uff1a\u5bc6\u5ea6\u94fe-3\" srcset=\"https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/2e5df2f74c62e02.jpg 1341w, https:\/\/www.kdjingpai.com\/wp-content\/uploads\/2024\/02\/2e5df2f74c62e02-768x165.jpg 768w\" sizes=\"auto, (max-width: 1341px) 100vw, 1341px\" \/><\/p>\n<p><strong>\u56fe4<\/strong>: \u4eba\u7c7b\u504f\u597d\u7684\u5bc6\u96c6\u5316\u6b65\u9aa4\u793a\u4f8b\uff08\u5de6\uff09\u548c\u4e00\u4e2a\u4e0d\u504f\u597d\u7684\u793a\u4f8b\uff08\u53f3\uff09\u3002\u5bf9\u4e8e\u5de6\u8fb9\uff0c\u5e95\u90e8\u7684\u6458\u8981\u66f4\u53d7\u6b22\u8fce\uff0c\u56e0\u4e3a\u6dfb\u52a0\u201c\u5229\u7269\u6d66\u201d\u548c\u8fdb\u7403\u8005\u662f\u4e0e\u4e3b\u9898\u76f8\u5173\u7684\u3002\u7b2c\u4e8c\u4e2a\u6458\u8981\u901a\u8fc7\u5408\u7406\u7684\u538b\u7f29\u817e\u51fa\u4e86\u7a7a\u95f4\uff0c\u4f8b\u5982\u5c06\u201c\u6f5c\u5728\u7684\u56de\u5230\u6bd4\u8d5b\u4e2d\u7684\u8def\u7ebf\u201d\u5408\u6210\u4e3a\u201c\u53cd\u51fb\u201d\u3002\u5bf9\u4e8e\u53f3\u8fb9\uff0c\u6dfb\u52a0\u66f4\u591a\u5173\u4e8e\u201cTVMonde\u201d\u7684\u7ec6\u8282\u5e76\u4e0d\u80fd\u5f25\u8865\u5b9e\u4f53\uff08\u201c\u7f51\u7edc\u653b\u51fb\u201d\u548c\u201cYves Bigot\u201d\uff09\u7684\u5c34\u5c2c\u878d\u5408\uff0c\u8fd9\u662f\u7531\u4e8e\u5fc5\u987b\u6536\u7d27\u4e4b\u524d\u7684\u6458\u8981\u800c\u76f4\u63a5\u5bfc\u81f4\u7684\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>5. \u76f8\u5173\u5de5\u4f5c<\/h2>\n<h3>GPT\u6458\u8981<\/h3>\n<p>Goyal et al. (2022)\u5bf9GPT-3\u5728\u65b0\u95fb\u6587\u7ae0\u6458\u8981\u751f\u6210\u65b9\u9762\u8fdb\u884c\u4e86\u57fa\u51c6\u6d4b\u8bd5\uff0c\u5e76\u53d1\u73b0\u4eba\u7c7b\u66f4\u559c\u6b22GPT-3\u6458\u8981\uff0c\u800c\u4e0d\u662f\u4e4b\u524d\u7684\u76d1\u7763\u57fa\u7ebf\uff0c\u8fd9\u5e76\u6ca1\u6709\u53cd\u6620\u51fa\u73b0\u6709\u7684\u57fa\u4e8e\u53c2\u8003\u548c\u65e0\u53c2\u8003\u7684\u6307\u6807\u3002Zhang et al. (2023)\u53d1\u73b0\uff0c\u901a\u8fc7\u4ece\u81ea\u7531\u804c\u4e1a\u8005\u90a3\u91cc\u5f81\u96c6\u9ad8\u8d28\u91cf\u7684\u6458\u8981\uff0c\u96f6\u6837\u672cGPT-3\u6458\u8981\u4e0e\u4eba\u7c7b\u7684\u8868\u73b0\u76f8\u5f53\u3002<\/p>\n<h3>\u57fa\u4e8e\u5b9e\u4f53\u7684\u6458\u8981<\/h3>\n<p>Narayan et al. (2021)\u63d0\u51fa\u751f\u6210\u5b9e\u4f53\u94fe\u4f5c\u4e3a\u76d1\u7763\u5fae\u8c03\u6458\u8981\u6a21\u578b\u7684\u89c4\u5212\u6b65\u9aa4\uff0c\u4e0e\u5173\u952e\u8bcd\uff08Li et al., 2020; Dou et al., 2021\uff09\u6216\u7eaf\u63d0\u53d6\u5355\u5143\uff08Dou et al., 2021; Adams et al., 2023a\uff09\u5f62\u6210\u5bf9\u6bd4\u3002\u5b9e\u4f53\u4e5f\u88ab\u7eb3\u5165\u6458\u8981\u4f5c\u4e3a\u4e00\u79cd\u63a7\u5236\u5f62\u5f0f\uff08Liu and Chen, 2021; He et al., 2022; Maddela et al., 2022\uff09\uff0c\u4ee5\u63d0\u9ad8\u5fe0\u5b9e\u5ea6\uff08Nan et al., 2021; Adams et al., 2022\uff09\uff0c\u4ee5\u53ca\u4f5c\u4e3a\u8bc4\u4f30\u7684\u5355\u4f4d\uff08Cao et al., 2022; Adams et al., 2023b\uff09\u3002<\/p>\n<h2>6. \u7ed3\u8bba<\/h2>\n<p>\u6211\u4eec\u7814\u7a76\u4e86\u6458\u8981\u5bc6\u96c6\u5316\u5bf9\u4eba\u7c7b\u5bf9\u6574\u4f53\u8d28\u91cf\u504f\u597d\u7684\u5f71\u54cd\u3002\u6211\u4eec\u53d1\u73b0\uff0c\u4e00\u5b9a\u7a0b\u5ea6\u7684\u5bc6\u96c6\u5316\u662f\u53d7\u6b22\u8fce\u7684\uff0c\u7136\u800c\uff0c\u5f53\u6458\u8981\u5305\u542b\u8fc7\u591a\u7684\u5b9e\u4f53\u65f6\uff0c\u5f88\u96be\u4fdd\u6301\u53ef\u8bfb\u6027\u548c\u8fde\u8d2f\u6027\u3002\u6211\u4eec\u5f00\u6e90\u4e86\u5e26\u6ce8\u91ca\u7684\u6d4b\u8bd5\u96c6\u4ee5\u53ca\u4e00\u4e2a\u66f4\u5927\u7684\u672a\u6ce8\u91ca\u8bad\u7ec3\u96c6\uff0c\u4ee5\u4fbf\u8fdb\u4e00\u6b65\u7814\u7a76\u56fa\u5b9a\u957f\u5ea6\u3001\u53ef\u53d8\u5bc6\u5ea6\u6458\u8981\u7684\u4e3b\u9898\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>7. \u5c40\u9650\u6027<\/h2>\n<p>\u6211\u4eec\u4ec5\u5206\u6790\u4e86\u5355\u4e00\u9886\u57df\u7684CoD\uff0c\u5373\u65b0\u95fb\u6458\u8981\u3002\u6ce8\u91ca\u5e76\u6ca1\u6709\u663e\u793a\u51fa\u9ad8\u6458\u8981\u7ea7\u7684\u4e00\u81f4\u6027\uff0c\u4f46\u786e\u5b9e\u5f00\u59cb\u663e\u793a\u51fa\u7cfb\u7edf\u7ea7\u8d8b\u52bf\uff0c\u8fd9\u4e0e\u4e4b\u524d\u5173\u4e8e\u57fa\u4e8eLLM\u7684\u8bc4\u4f30\u7684\u5de5\u4f5c\u662f\u4e00\u81f4\u7684\uff08Goyal et al., 2022\uff09\u3002\u6700\u540e\uff0cGPT-4\u662f\u4e00\u4e2a\u5c01\u95ed\u6e90\u4ee3\u7801\u7684\u6a21\u578b\uff0c\u56e0\u6b64\u6211\u4eec\u65e0\u6cd5\u5171\u4eab\u6a21\u578b\u6743\u91cd\u3002\u7136\u800c\uff0c\u6211\u4eec\u786e\u5b9e\u53d1\u5e03\u4e86\u6240\u6709\u8bc4\u4f30\u6570\u636e\u3001\u6ce8\u91ca\u4ee5\u53ca5,000\u4e2a\u672a\u6ce8\u91ca\u7684CoD\uff0c\u7528\u4e8e\u4e0b\u6e38\u7528\u4f8b\uff0c\u4f8b\u5982\uff0c\u5c06\u5bc6\u5ea6\u63d0\u53d6\u5230\u5f00\u6e90\u6a21\u578b\uff08\u5982LLAMA-2\uff08Touvron et al., 2023\uff09\uff09\u4e2d\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>\u53c2\u8003\u6587\u732e<\/h2>\n<p>\uff08\u6b64\u5904\u7701\u7565\u53c2\u8003\u6587\u732e\u5217\u8868\uff09<\/p>\n<p>&nbsp;<\/p>\n<h2>GPT-4\u6307\u6807<\/h2>\n<p>\u5bf9\u4e8eGPT-4\u7684Likert\u98ce\u683c\u8bc4\u4f30\uff0c\u6211\u4eec\u4f7f\u7528\u4ee5\u4e0b\u63d0\u793a\u6a21\u677f\u3002<\/p>\n<pre><code>\u6458\u8981: {{\u6458\u8981}} {{\u5b9a\u4e49}}\r\n<\/code><\/pre>\n<p><strong>\u4ee5\u4e0b\u662f\u63d0\u4f9b\u7ed9\u6bcf\u4e2a\u8d28\u91cf\u6307\u6807\u7684\u5b9a\u4e49\u7684\u793a\u4f8b\u3002<\/strong><\/p>\n<ul>\n<li><strong>\u4fe1\u606f\u91cf<\/strong>: \u4fe1\u606f\u91cf\u9ad8\u7684\u6458\u8981\u80fd\u591f\u6355\u6349\u6587\u7ae0\u4e2d\u7684\u91cd\u8981\u4fe1\u606f\uff0c\u5e76\u4ee5\u51c6\u786e\u548c\u7b80\u6d01\u7684\u65b9\u5f0f\u5448\u73b0\u3002<\/li>\n<li><strong>\u8d28\u91cf<\/strong>: \u9ad8\u8d28\u91cf\u7684\u6458\u8981\u6613\u4e8e\u7406\u89e3\u548c\u7406\u89e3\u3002<\/li>\n<li><strong>\u8fde\u8d2f\u6027<\/strong>: \u8fde\u8d2f\u7684\u6458\u8981\u7ed3\u6784\u826f\u597d\uff0c\u7ec4\u7ec7\u826f\u597d\u3002<\/li>\n<li><strong>\u53ef\u5f52\u56e0\u6027<\/strong>: \u6458\u8981\u4e2d\u7684\u6240\u6709\u4fe1\u606f\u662f\u5426\u5b8c\u5168\u53ef\u5f52\u56e0\u4e8e\u6587\u7ae0\uff1f<\/li>\n<li><strong>\u603b\u4f53\u504f\u597d<\/strong>: \u4e00\u4e2a\u597d\u7684\u6458\u8981\u5e94\u8be5\u4ee5\u7b80\u6d01\u3001\u903b\u8f91\u548c\u8fde\u8d2f\u7684\u65b9\u5f0f\u4f20\u8fbe\u6587\u7ae0\u7684\u4e3b\u8981\u601d\u60f3\u3002<\/li>\n<\/ul>\n<p>\u8d28\u91cf\u548c\u8fde\u8d2f\u6027\u63d0\u793a\u4e0d\u5305\u62ec\u6587\u7ae0\u4e2d\u7684\u63d0\u793a\u3002\u8fd9\u4e9b\u5b9a\u4e49\u662f\u4ece\u4e4b\u524d\u7684\u6458\u8981\u6ce8\u91ca\u5de5\u4f5c\u4e2d\u6539\u5199\u7684\uff1a\uff08Fabbri et al., 2021; Aharoni et al., 2023\uff09\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th><strong>\u7ef4\u5ea6<\/strong><\/th>\n<th><strong>\u76f8\u5173\u6027<\/strong><\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>\u4fe1\u606f\u91cf<\/strong><\/td>\n<td><strong>0.215<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>\u8d28\u91cf<\/strong><\/td>\n<td><strong>0.120<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>\u8fde\u8d2f\u6027<\/strong><\/td>\n<td><strong>0.178<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>\u53ef\u5f52\u56e0\u6027<\/strong><\/td>\n<td><strong>0.245<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>\u603b\u4f53<\/strong><\/td>\n<td><strong>0.311<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>\u88682<\/strong>: \u4eba\u7c7b\u504f\u597d\u4e0eGPT-4 Likert\u8bc4\u5206\u4e4b\u95f4\u7684\u6458\u8981\u7ea7Pearson\u76f8\u5173\u7cfb\u6570\u3002<\/p>\n<h3>\u5143\u8bc4\u4f30<\/h3>\n<p>\u4e3a\u4e86\u8ba1\u7b97\u6458\u8981\u7ea7\u76f8\u5173\u6027\uff0c\u6211\u4eec\u9996\u5148\u5c06\u504f\u597d\u6570\u636e\u8f6c\u6362\u4e3a\u5411\u91cf\uff0c\u8868\u793a\u8be5\u6458\u8981\u83b7\u5f97\u7b2c\u4e00\u540d\u6295\u7968\u7684\u6b21\u6570\u3002\u88684\u663e\u793a\u4e86\uff0c\u4e0d\u51fa\u6240\u6599\uff0c\u65e8\u5728\u6355\u6349\u603b\u4f53\u6458\u8981\u8bc4\u7ea7\u7684\u63d0\u793a\u4e0e\u603b\u4f53\u504f\u597d\u7684\u603b\u4f53\u7ea7Pearson\u76f8\u5173\u6027\u6700\u9ad8\uff080.31\uff09\uff0c\u4f46\u603b\u4f53\u76f8\u5173\u6027\u4ecd\u7136\u5f88\u4f4e\u3002<\/p>\n<p>&nbsp;<\/p>\n<h2>\u603b\u7ed3<\/h2>\n<p>\u8fd9\u7bc7\u8bba\u6587\u63a2\u8ba8\u4e86\u5982\u4f55\u901a\u8fc7\u94fe\u5f0f\u5bc6\u5ea6\u63d0\u793a\uff08CoD\uff09\u65b9\u6cd5\uff0c\u5229\u7528GPT-4\u751f\u6210\u8d8a\u6765\u8d8a\u5bc6\u96c6\u7684\u6458\u8981\u3002\u7814\u7a76\u53d1\u73b0\uff0c\u4e00\u5b9a\u7a0b\u5ea6\u7684\u5bc6\u96c6\u5316\u80fd\u591f\u63d0\u5347\u6458\u8981\u7684\u8d28\u91cf\uff0c\u4f46\u8fc7\u9ad8\u7684\u5bc6\u5ea6\u5219\u4f1a\u635f\u5bb3\u53ef\u8bfb\u6027\u548c\u8fde\u8d2f\u6027\u3002\u7814\u7a76\u56e2\u961f\u901a\u8fc7\u4eba\u7c7b\u504f\u597d\u7814\u7a76\u548cGPT-4\u81ea\u52a8\u8bc4\u4f30\uff0c\u9a8c\u8bc1\u4e86\u8fd9\u4e00\u7ed3\u8bba\uff0c\u5e76\u5f00\u6e90\u4e86\u76f8\u5173\u7684\u6ce8\u91ca\u6570\u636e\u548c\u672a\u6ce8\u91ca\u7684\u6458\u8981\u6570\u636e\uff0c\u4e3a\u672a\u6765\u7684\u7814\u7a76\u63d0\u4f9b\u4e86\u5b9d\u8d35\u7684\u8d44\u6e90\u3002<\/p>\n<h3>\u5173\u952e\u70b9\u603b\u7ed3\uff1a<\/h3>\n<ul>\n<li><strong>\u94fe\u5f0f\u5bc6\u5ea6\u63d0\u793a\uff08CoD\uff09<\/strong>: \u901a\u8fc7\u9010\u6b65\u6dfb\u52a0\u7f3a\u5931\u7684\u5b9e\u4f53\u800c\u4e0d\u589e\u52a0\u957f\u5ea6\uff0c\u751f\u6210\u66f4\u5bc6\u96c6\u7684\u6458\u8981\u3002<\/li>\n<li><strong>\u5b9e\u4f53\u5bc6\u5ea6<\/strong>: \u4f7f\u7528\u5b9e\u4f53\u5bc6\u5ea6\u4f5c\u4e3a\u8861\u91cf\u6458\u8981\u4fe1\u606f\u91cf\u7684\u6307\u6807\uff0c\u53d1\u73b0\u4eba\u7c7b\u504f\u597d\u63a5\u8fd1\u4eba\u5de5\u7f16\u5199\u6458\u8981\u7684\u5bc6\u5ea6\u3002<\/li>\n<li><strong>\u62bd\u8c61\u6027\u4e0e\u878d\u5408<\/strong>: CoD\u751f\u6210\u7684\u6458\u8981\u66f4\u5177\u62bd\u8c61\u6027\u548c\u878d\u5408\u6027\uff0c\u4e14\u51cf\u5c11\u4e86\u5f00\u5934\u504f\u5dee\u3002<\/li>\n<li><strong>\u4eba\u7c7b\u504f\u597d<\/strong>: \u4eba\u7c7b\u66f4\u559c\u6b22\u6bd4\u666e\u901aGPT-4\u6458\u8981\u66f4\u5bc6\u96c6\u7684\u6458\u8981\uff0c\u4f46\u8fc7\u9ad8\u7684\u5bc6\u5ea6\u4f1a\u964d\u4f4e\u53ef\u8bfb\u6027\u3002<\/li>\n<li><strong>\u81ea\u52a8\u8bc4\u4f30<\/strong>: GPT-4\u7684\u81ea\u52a8\u8bc4\u4f30\u7ed3\u679c\u4e0e\u4eba\u7c7b\u504f\u597d\u57fa\u672c\u4e00\u81f4\uff0c\u4f46\u603b\u4f53\u76f8\u5173\u6027\u8f83\u4f4e\u3002<\/li>\n<\/ul>\n<h3>\u672a\u6765\u7814\u7a76\u65b9\u5411\uff1a<\/h3>\n<ul>\n<li><strong>\u66f4\u7cbe\u786e\u7684\u6743\u8861\u5b9a\u4e49<\/strong>: \u672a\u6765\u7684\u7814\u7a76\u53ef\u4ee5\u8fdb\u4e00\u6b65\u5b9a\u4e49\u548c\u91cf\u5316\u4fe1\u606f\u91cf\u4e0e\u53ef\u8bfb\u6027\u4e4b\u95f4\u7684\u6743\u8861\u3002<\/li>\n<li><strong>\u591a\u9886\u57df\u5e94\u7528<\/strong>: \u5c06CoD\u65b9\u6cd5\u5e94\u7528\u4e8e\u5176\u4ed6\u9886\u57df\uff0c\u5982\u5b66\u672f\u8bba\u6587\u3001\u6280\u672f\u6587\u6863\u7b49\uff0c\u4ee5\u9a8c\u8bc1\u5176\u901a\u7528\u6027\u3002<\/li>\n<li><strong>\u6a21\u578b\u6539\u8fdb<\/strong>: \u63a2\u7d22\u5982\u4f55\u6539\u8fdb\u6a21\u578b\u4ee5\u5728\u4fdd\u6301\u9ad8\u4fe1\u606f\u91cf\u7684\u540c\u65f6\u63d0\u5347\u53ef\u8bfb\u6027\u3002<\/li>\n<\/ul>\n<p>\u901a\u8fc7\u8fd9\u7bc7\u8bba\u6587\uff0c\u6211\u4eec\u53ef\u4ee5\u770b\u5230\uff0cAI\u5728\u6587\u672c\u5904\u7406\u548c\u751f\u6210\u65b9\u9762\u5df2\u7ecf\u53d6\u5f97\u4e86\u4ee4\u4eba\u77a9\u76ee\u7684\u8fdb\u5c55\uff0c\u4f46\u4ecd\u7136\u9762\u4e34\u7740\u4fe1\u606f\u91cf\u4e0e\u53ef\u8bfb\u6027\u4e4b\u95f4\u7684\u5e73\u8861\u6311\u6218\u3002\u672a\u6765\uff0c\u968f\u7740\u6280\u672f\u7684\u4e0d\u65ad\u8fdb\u6b65\uff0c\u6211\u4eec\u6709\u7406\u7531\u76f8\u4fe1\uff0cAI\u751f\u6210\u7684\u6458\u8981\u5c06\u66f4\u52a0\u667a\u80fd\u548c\u4eba\u6027\u5316\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u539f\u6587\uff1ahttps:\/\/arxiv.org\/pdf\/2309.04269 \u901f\u8bfb\uff1a\u300a\u4ece\u7a00\u758f\u5230\u5bc6\u96c6\uff1a\u4f7f\u7528\u94fe\u5f0f\u5bc6\u5ea6\u63d0\u793a\u7684GPT-4\u6458\u8981\u751f\u6210\u300b \u6536\u5f55\u5230\uff1a\u603b\u7ed3\u77e5\u8bc6\u5e38\u7528prompts &nbsp; \u6458\u8981 \u5728\u81ea\u52a8\u6587\u672c\u6458\u8981\u4e2d\uff0c\u786e\u5b9a\u8981\u5305\u542b\u7684\u201c\u6b63\u786e\u201d\u4fe1\u606f\u91cf\u662f\u4e00\u4e2a&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[],"class_list":["post-19356","post","type-post","status-publish","format-standard","hentry","category-knowledge"],"_links":{"self":[{"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/posts\/19356","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/comments?post=19356"}],"version-history":[{"count":0,"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/posts\/19356\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/media?parent=19356"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/categories?post=19356"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.kdjingpai.com\/en\/wp-json\/wp\/v2\/tags?post=19356"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}