OpenAI

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, Dario Amodei

Recent years have featured a trend towards pre-trained language representations in NLP systems, applied in increasingly ?flexible and task-agnostic ways for downstream transfer. First, single-layer representations were learned using word ?vectors [MCCD13, PSM14] and fed to task-specific architectures, then RNNs with multiple layers of representations ?and contextual state were used to form stronger representations [DL15, MBXS17, PNZtY18] (though still applied to ?task-specific architectures), and more recently pre-trained recurrent or transformer language models [VSP+17] have ?been directly fine-tuned, entirely removing the need for task-specific architectures [RNSS18, DCLT18, HR18].

This last paradigm has led to substantial progress on many challenging NLP tasks such as reading comprehension, ?question answering, textual entailment, and many others, and has continued to advance based on new architectures ?and algorithms [RSR+19, LOG+19, YDY+19, LCG+19]. However, a major limitation to this approach is that while ?the architecture is task-agnostic, there is still a need for task-specific datasets and task-specific fine-tuning: to achieve ?strong performance on a desired task typically requires fine-tuning on a dataset of thousands to hundreds of thousands ?of examples specific to that task. Removing this limitation would be desirable, for several reasons. ?
First, from a practical perspective, the need for a large dataset of labeled examples for every new task limits the ?applicability of language models. There exists a very wide range of possible useful language tasks, encompassing ?anything from correcting grammar, to generating examples of an abstract concept, to critiquing a short story. For many ?of these tasks it is difficult to collect a large supervised training dataset, especially when the process must be repeated ?for every new task.

對(duì)解決這些問(wèn)題的一個(gè)潛在的路線是meta-learning1——在語(yǔ)言的上下文模型意味著模型發(fā)展廣泛技能的訓(xùn)練時(shí)間和模式識(shí)別能力,然后使用這些能力在推理時(shí)迅速適應(yīng)或識(shí)別所需的任務(wù)(見(jiàn)圖1.1)。最近的工作[RWC + 19]試圖做到這一點(diǎn)通過(guò)我們稱之為“語(yǔ)境學(xué)習(xí)”,使用文本輸入pretrained語(yǔ)言模型作為一種任務(wù)規(guī)范:模型條件在自然語(yǔ)言指令和/或一些示威活動(dòng)的任務(wù),然后將完成進(jìn)一步的實(shí)例任務(wù)只需預(yù)測(cè)接下來(lái)會(huì)發(fā)生什么。雖然它顯示出了一些最初的希望，但這種方法取得的效果仍遠(yuǎn)不及微調(diào)——例如[RWC+19]在自然問(wèn)題上僅取得4%的成績(jī)，甚至它的55 F1 CoQa結(jié)果現(xiàn)在也落后于最先進(jìn)的水平35分以上。元學(xué)習(xí)顯然需要大量的改進(jìn)，才能成為解決語(yǔ)言任務(wù)的可行的實(shí)用方法。語(yǔ)言建模的另一個(gè)最新趨勢(shì)可能提供了一個(gè)前進(jìn)的方向。近年來(lái)，transformer語(yǔ)言模型的容量大幅增加，從1億個(gè)參數(shù)[RNSS18]，到3億個(gè)參數(shù)[DCLT18]，再到15億個(gè)參數(shù)[RWC+19]，再到80億個(gè)參數(shù)[SPP+19]， 110億個(gè)參數(shù)[RSR+19]，最后是170億個(gè)參數(shù)[Tur20]。每一次增加都帶來(lái)了文本合成和/或下游NLP任務(wù)的改進(jìn)，有證據(jù)表明，與許多下游任務(wù)相關(guān)的日志丟失隨著規(guī)模的增大呈現(xiàn)平穩(wěn)的改善趨勢(shì)[KMH+20]。由于內(nèi)環(huán)境學(xué)習(xí)涉及在模型的參數(shù)內(nèi)吸收許多技能和任務(wù)，因此內(nèi)環(huán)境學(xué)習(xí)能力可能會(huì)隨著規(guī)模的增長(zhǎng)而顯示出類似的強(qiáng)勁增長(zhǎng)，這是合理的。

?

• Fine-Tuning (FT) has been the most common approach in recent years, and involves updating the weights of a pre-trained model by training on a supervised dataset specific to the desired task. Typically thousands to hundreds of thousands of labeled examples are used. The main advantage of fine-tuning is strong performance on many benchmarks. The main disadvantages are the need for a new large dataset for every task, the potential for poor generalization out-of-distribution [MPL19], and the potential to exploit spurious features of the training data [GSL+18, NK19], potentially resulting in an unfair comparison with human performance. In this work we do not fine-tune GPT-3 because our focus is on task-agnostic performance, but GPT-3 can be fine-tuned in principle and this is a promising direction for future work.
• Few-Shot (FS) is the term we will use in this work to refer to the setting where the model is given a few demonstrations of the task at inference time as conditioning [RWC+19], but no weight updates are allowed. As shown in Figure 2.1, for a typical dataset an example has a context and a desired completion (for example an English sentence and the French translation), and few-shot works by giving K examples of context and completion, and then one final example of context, with the model expected to provide the completion. We typically set K in the range of 10 to 100 as this is how many examples can fit in the model’s context window (nctx = 2048). The main advantages of few-shot are a major reduction in the need for task-specific data and reduced potential to learn an overly narrow distribution from a large but narrow fine-tuning dataset. The main disadvantage is that results from this method have so far been much worse than state-of-the-art fine-tuned models. Also, a small amount of task specific data is still required. As indicated by the name, few-shot learning as described here for language models is related to few-shot learning as used in other contexts in ML [HYC01, VBL+16] – both involve learning based on a broad distribution of tasks (in this case implicit in the pre-training data) and then rapidly adapting to a new task.
• One-Shot (1S) is the same as few-shot except that only one demonstration is allowed, in addition to a natural language description of the task, as shown in Figure 1. The reason to distinguish one-shot from few-shot and zero-shot (below) is that it most closely matches the way in which some tasks are communicated to humans. For example, when asking humans to generate a dataset on a human worker service (for example Mechanical Turk), it is common to give one demonstration of the task. By contrast it is sometimes difficult to communicate the content or format of a task if no examples are given.
• Zero-Shot (0S) is the same as one-shot except that no demonstrations are allowed, and the model is only given a natural language instruction describing the task. This method provides maximum convenience, potential for robustness, and avoidance of spurious correlations (unless they occur very broadly across the large corpus of pre-training data), but is also the most challenging setting. In some cases it may even be difficult for humans to understand the format of the task without prior examples, so this setting is in some cases “unfairly hard”. For example, if someone is asked to “make a table of world records for the 200m dash”, this request can be ambiguous, as it may not be clear exactly what format the table should have or what should be included (and even with careful clarification, understanding precisely what is desired can be difficult). Nevertheless, for at least some settings zero-shot is closest to how humans perform tasks – for example, in the translation example in Figure 2.1, a human would likely know what to do from just the text instruction.

• 微調(diào)(FT)是近年來(lái)最常見(jiàn)的方法，它包括通過(guò)對(duì)特定于預(yù)期任務(wù)的監(jiān)督數(shù)據(jù)集進(jìn)行訓(xùn)練來(lái)更新預(yù)訓(xùn)練模型的權(quán)重。通常使用成千上萬(wàn)的帶標(biāo)簽的例子。調(diào)優(yōu)的主要優(yōu)點(diǎn)是在許多基準(zhǔn)測(cè)試中具有強(qiáng)大的性能。主要缺點(diǎn)是每個(gè)任務(wù)都需要一個(gè)新的大數(shù)據(jù)集，可能會(huì)出現(xiàn)泛化不均勻分布[MPL19]，可能會(huì)利用訓(xùn)練數(shù)據(jù)的虛假特征[GSL+18, NK19]，可能會(huì)導(dǎo)致與人類性能的不公平比較。在這項(xiàng)工作中，我們沒(méi)有對(duì)GPT-3進(jìn)行微調(diào)，因?yàn)槲覀冴P(guān)注的是任務(wù)不確定性能，但是GPT-3原則上可以進(jìn)行微調(diào)，這是未來(lái)工作的一個(gè)有希望的方向。
• 少量射擊(FS)是我們將在這項(xiàng)工作中使用的術(shù)語(yǔ)，用來(lái)指在推理時(shí)給模型一些任務(wù)的演示作為條件[RWC+19]，但不允許權(quán)重更新。如圖2.1所示,一個(gè)典型的數(shù)據(jù)集實(shí)例有一個(gè)上下文和所需的完成(例如一個(gè)英語(yǔ)句子翻譯和法國(guó)),和few-shot作品給K上下文和完成的例子,然后最后一個(gè)例子的情況下,模型將提供完成。我們通常將K設(shè)置在10到100之間，因?yàn)檫@是模型上下文窗口所能容納的示例數(shù)(nctx = 2048)。few-shot的主要優(yōu)點(diǎn)是大大減少了對(duì)特定任務(wù)數(shù)據(jù)的需求，并減少了從一個(gè)大而窄的微調(diào)數(shù)據(jù)集學(xué)習(xí)過(guò)窄分布的可能性。這種方法的主要缺點(diǎn)是，到目前為止，其結(jié)果遠(yuǎn)不如最先進(jìn)的微調(diào)模型。此外，仍然需要少量特定于任務(wù)的數(shù)據(jù)。顯示的名字,few-shot學(xué)習(xí)作為語(yǔ)言模型與這里描述few-shot學(xué)習(xí)用于其他上下文毫升(HYC01輪式偵察車+ 16)-包括基于分布廣泛的學(xué)習(xí)任務(wù)(在本例中隱含在訓(xùn)練的數(shù)據(jù)),然后迅速適應(yīng)新任務(wù)。
• one -shot (1S)與few-shot相同，只是除了任務(wù)的自然語(yǔ)言描述之外，只允許進(jìn)行一次演示，如圖1所示。區(qū)分“一步走”、“少一步走”和“零一步走”(見(jiàn)下圖)的原因是，“一步走”與某些任務(wù)傳達(dá)給人類的方式最接近。例如，當(dāng)要求人類在人工工作服務(wù)(例如Mechanical Turk)上生成數(shù)據(jù)集時(shí)，通常會(huì)給出任務(wù)的演示。相比之下，如果沒(méi)有例子，有時(shí)很難傳達(dá)任務(wù)的內(nèi)容或格式。
• Zero-Shot(0)與one-shot相同，只是不允許演示，并且只給模型一個(gè)描述任務(wù)的自然語(yǔ)言指令。這種方法提供了最大的便利性、潛在的魯棒性和避免虛假相關(guān)性(除非它們?cè)诖罅康挠?xùn)練前數(shù)據(jù)語(yǔ)料庫(kù)中廣泛出現(xiàn))，但也是最具挑戰(zhàn)性的設(shè)置。在某些情況下，如果沒(méi)有之前的例子，人類甚至很難理解任務(wù)的格式，所以在某些情況下，這種設(shè)置是“不公平的困難”。例如,如果有人要求“讓200米短跑的世界紀(jì)錄表”,這個(gè)請(qǐng)求可以模糊,因?yàn)樗赡懿磺宄裁锤袷奖響?yīng)該有或應(yīng)該包括什么(甚至仔細(xì)澄清,需要理解恰恰是很困難的)。不過(guò)，至少在某些設(shè)置中，zero-shot最接近于人類執(zhí)行任務(wù)的方式——例如，在圖2.1中的翻譯示例中，人類可能僅通過(guò)文本指令就知道該做什么。

Figure 2.1 shows the four methods using the example of translating English to French. In this paper we focus on zero-shot, one-shot and few-shot, with the aim of comparing them not as competing alternatives, but as different problem settings which offer a varying trade-off between performance on specific benchmarks and sample efficiency. We especially highlight the few-shot results as many of them are only slightly behind state-of-the-art fine-tuned models. Ultimately, however, one-shot, or even sometimes zero-shot, seem like the fairest comparisons to human performance, and are important targets for future work.

Sections 2.1-2.3 below give details on our models, training data, and training process respectively. Section 2.4 discusses the details of how we do few-shot, one-shot, and zero-shot evaluations.

我們使用與GPT-2 [RWC+19]相同的模型和架構(gòu)，包括修改的初始化、預(yù)歸一化和其中描述的可逆標(biāo)記，但我們?cè)谧儔浩鞯膶又惺褂媒惶婷芗途植繋钕∈枳⒁饽Ｊ?#xff0c;類似于稀疏變壓器[CGRS19]。為了研究ML性能對(duì)模型大小的依賴關(guān)系，我們訓(xùn)練了8種不同大小的模型，從1.25億個(gè)參數(shù)到1750億個(gè)參數(shù)的3個(gè)數(shù)量級(jí)，最后一個(gè)是我們稱為GPT-3的模型。先前的研究[KMH+20]表明，在有足夠的訓(xùn)練數(shù)據(jù)的情況下，驗(yàn)證損失的比例應(yīng)近似于一個(gè)平滑的冪律，該冪律是大小的函數(shù);許多不同大小的訓(xùn)練模型允許我們測(cè)試驗(yàn)證丟失和下游語(yǔ)言任務(wù)的假設(shè)。

?

Datasets for language models have rapidly expanded, culminating in the Common Crawl dataset2 [RSR+19] constituting nearly a trillion words. This size of dataset is sufficient to train our largest models without ever updating on the same sequence twice. However, we have found that unfiltered or lightly filtered versions of Common Crawl tend to have lower quality than more curated datasets. Therefore, we took 3 steps to improve the average quality of our datasets: (1) we downloaded and filtered a version of CommonCrawl based on similarity to a range of high-quality reference corpora, (2) we performed fuzzy deduplication at the document level, within and across datasets, to prevent redundancy and preserve the integrity of our held-out validation set as an accurate measure of overfitting, and (3) we also added known high-quality reference corpora to the training mix to augment CommonCrawl and increase its diversity.

?

Details of the first two points (processing of Common Crawl) are described in Appendix A. For the third, we added several curated high-quality datasets, including an expanded version of the WebText dataset [RWC+19], collected by scraping links over a longer period of time, and first described in [KMH+20], two internet-based books corpora (Books1 and Books2) and English-language Wikipedia.

用于語(yǔ)言模型的數(shù)據(jù)集已經(jīng)迅速擴(kuò)展，最終達(dá)到了常見(jiàn)的爬行數(shù)據(jù)集dataset2 [RSR+19]，總計(jì)近一萬(wàn)億字。這樣大的數(shù)據(jù)集足以訓(xùn)練我們最大的模型，而無(wú)需對(duì)同一序列進(jìn)行兩次更新。然而，我們發(fā)現(xiàn)未過(guò)濾或輕度過(guò)濾版本的普通爬行往往比更有組織的數(shù)據(jù)集質(zhì)量更低。因此，我們采取了3個(gè)步驟來(lái)提高數(shù)據(jù)集的平均質(zhì)量:(1)我們下載和過(guò)濾的一個(gè)版本CommonCrawl基于相似性的一系列高品質(zhì)參考全集,(2)我們?cè)谖臋n級(jí)別執(zhí)行模糊重復(fù)數(shù)據(jù)刪除,在和整個(gè)數(shù)據(jù)集,以防止冗余和保存我們伸出的完整性驗(yàn)證設(shè)置為一個(gè)精確的衡量過(guò)度擬合,和(3)我們還添加了高質(zhì)量的參考語(yǔ)料訓(xùn)練增加CommonCrawl和增加其多樣性。

前兩個(gè)點(diǎn)的詳細(xì)信息(處理常見(jiàn)的爬行)描述在附錄a。第三,我們添加了幾個(gè)策劃高質(zhì)量的數(shù)據(jù)集,包括WebText數(shù)據(jù)集的擴(kuò)展版本(RWC + 19),收集的抓取鏈接在更長(zhǎng)一段時(shí)間,和第一(公里/小時(shí)+ 20)中描述的兩個(gè)網(wǎng)絡(luò)書(shū)全集(Books1和Books2)和英文維基百科。

對(duì)于少?gòu)棇W(xué)習(xí)，我們從任務(wù)的訓(xùn)練集中隨機(jī)抽取K個(gè)樣本作為條件，根據(jù)任務(wù)的不同用1或2個(gè)新行分隔，以此來(lái)評(píng)估評(píng)估集中的每個(gè)樣本。對(duì)于LAMBADA和Storycloze，沒(méi)有可用的監(jiān)督訓(xùn)練集，所以我們從開(kāi)發(fā)集中提取條件設(shè)置示例，并在測(cè)試集上進(jìn)行評(píng)估。對(duì)于Winograd(原始的，不是超級(jí)膠水版本)，只有一個(gè)數(shù)據(jù)集，所以我們直接從它提取條件設(shè)置示例。

K can be any value from 0 to the maximum amount allowed by the model’s context window, which is nctx = 2048 for all models and typically fits 10 to 100 examples. Larger values of K are usually but not always better, so when a separate development and test set are available, we experiment with a few values of K on the development set and then run the best value on the test set. For some tasks (see Appendix G) we also use a natural language prompt in addition to (or for K = 0, instead of) demonstrations.

On tasks that involve choosing one correct completion from several options (multiple choice), we provide K examples of context plus correct completion, followed by one example of context only, and compare the LM likelihood of each completion. For most tasks we compare the per-token likelihood (to normalize for length), however on a small number of datasets (ARC, OpenBookQA, and RACE) we gain additional benefit as measured on the development set by normalizing by the unconditional probability of each completion, by computing P (completion|context) P (completion|answer context) , where answer context is the string "Answer: " or "A: " and is used to prompt that the completion should be an answer but is otherwise generic.

K可以是0到模型上下文窗口允許的最大數(shù)量之間的任何值，即nctx = 2048，適用于所有模型，通常適合10到100個(gè)示例。更大的K值通常但不總是更好的,所以當(dāng)一組獨(dú)立的開(kāi)發(fā)和測(cè)試是可用的,我們嘗試幾值K的開(kāi)發(fā)設(shè)置,然后運(yùn)行測(cè)試集上的最佳值。對(duì)于某些任務(wù)(參見(jiàn)附錄G)我們也使用自然語(yǔ)言提示除了(或K = 0,而不是)示威活動(dòng)。

對(duì)于涉及從多個(gè)選項(xiàng)(多項(xiàng)選擇)中選擇一個(gè)正確完成的任務(wù)，我們提供了K個(gè)上下文示例加上正確完成，然后只提供一個(gè)上下文示例，并比較每個(gè)完成的LM可能性。對(duì)于大多數(shù)任務(wù)我們比較每個(gè)令牌的可能性(規(guī)范化長(zhǎng)度),然而在少量的數(shù)據(jù)集(弧、OpenBookQA和比賽)我們獲得更多利益衡量發(fā)展設(shè)定的正常化的無(wú)條件概率每完成,通過(guò)計(jì)算P(完成|上下文)(完成|回答上下文),在回答上下文字符串“回答:”或“:”和用于提示完成應(yīng)該答案但否則通用。

On tasks that involve binary classification, we give the options more semantically meaningful names (e.g. “True” or “False” rather than 0 or 1) and then treat the task like multiple choice; we also sometimes frame the task similar to what is done by [RSR+19] (see Appendix G) for details.

On tasks with free-form completion, we use beam search with the same parameters as [RSR+19]: a beam width of 4 and a length penalty of α = 0.6. We score the model using F1 similarity score, BLEU, or exact match, depending on what is standard for the dataset at hand.

Final results are reported on the test set when publicly available, for each model size and learning setting (zero-, one-, and few-shot). When the test set is private, our model is often too large to fit on the test server, so we report results on the development set. We do submit to the test server on a small number of datasets (SuperGLUE, TriviaQA, PiQa) where we were able to make submission work, and we submit only the 200B few-shot results, and report development set results for everything else.

對(duì)于涉及二分類的任務(wù)，我們給選項(xiàng)以語(yǔ)義上更有意義的名稱(例如“真”或“假”，而不是0或1)，然后把任務(wù)當(dāng)作多項(xiàng)選擇;我們有時(shí)也會(huì)類似于[RSR+19]所完成的任務(wù)(詳見(jiàn)附錄G)。

對(duì)于自由形式完成的任務(wù)，我們使用與[RSR+19]相同的參數(shù)進(jìn)行波束搜索:波束寬度為4，長(zhǎng)度罰值為radial = 0.6。我們使用F1相似度評(píng)分、BLEU或精確匹配來(lái)給模型評(píng)分，這取決于手頭數(shù)據(jù)集的標(biāo)準(zhǔn)。

對(duì)于每個(gè)模型的大小和學(xué)習(xí)設(shè)置(0 -，1 -，和小樣本)，最終的結(jié)果會(huì)在測(cè)試集上公布。當(dāng)測(cè)試集是私有的,我們的模型往往是太大,以適應(yīng)在測(cè)試服務(wù)器上,所以我們報(bào)告的結(jié)果發(fā)展。我們提交到測(cè)試服務(wù)器上少量的數(shù)據(jù)集(超強(qiáng)力膠水,TriviaQA PiQa)我們能夠提交工作,我們只有200 b few-shot提交結(jié)果,并報(bào)告發(fā)展為一切設(shè)置結(jié)果。

In Figure 3.1 we display training curves for the 8 models described in Section 2. For this graph we also include 6 ?additional extra-small models with as few as 100,000 parameters. As observed in [KMH+20], language modeling ?performance follows a power-law when making efficient use of training compute. After extending this trend by two ?more orders of magnitude, we observe only a slight (if any) departure from the power-law. One might worry that these ?improvements in cross-entropy loss come only from modeling spurious details of our training corpus. However, we will ?see in the following sections that improvements in cross-entropy loss lead to consistent performance gains across a ?broad spectrum of natural language tasks. ?

Below, we evaluate the 8 models described in Section 2 (the 175 billion parameter parameter GPT-3 and 7 smaller ?models) on a wide range of datasets. We group the datasets into 9 categories representing roughly similar tasks. ?

在圖3.1中，我們展示了第2節(jié)中描述的8個(gè)模型的訓(xùn)練曲線。在這個(gè)圖中，我們還包括了6個(gè)額外的超小型模型，這些模型只有100,000個(gè)參數(shù)。正如在[KMH+20]中觀察到的，在高效使用訓(xùn)練計(jì)算時(shí)，語(yǔ)言建模性能遵循冪律。在將這一趨勢(shì)擴(kuò)展兩個(gè)數(shù)量級(jí)之后，我們只觀察到與冪律有輕微的背離。人們可能會(huì)擔(dān)心這些交叉熵?fù)p失的改進(jìn)僅僅來(lái)自于我們訓(xùn)練語(yǔ)料庫(kù)的虛假細(xì)節(jié)建模。然而，在接下來(lái)的章節(jié)中，我們將看到交叉熵?fù)p失的改進(jìn)可以在廣泛的自然語(yǔ)言任務(wù)中帶來(lái)一致的性能提升。 

下面，我們?cè)趶V泛的數(shù)據(jù)集上評(píng)估第2節(jié)中描述的8個(gè)模型(1750億參數(shù)GPT-3和7個(gè)較小的模型)。我們將數(shù)據(jù)集分成9個(gè)類別，這些類別代表大致相似的任務(wù)。 

在本節(jié)中，我們將測(cè)試GPT-3在傳統(tǒng)的語(yǔ)言建模任務(wù)以及相關(guān)任務(wù)上的性能，這些任務(wù)包括預(yù)測(cè)感興趣的單個(gè)單詞、完成句子或段落，或在可能完成的一段文本之間進(jìn)行選擇。

The LAMBADA dataset [PKL+16] tests the modeling of long-range dependencies in text – the model is asked to predict the last word of sentences which require reading a paragraph of context. It has recently been suggested that the continued scaling of language models is yielding diminishing returns on this difficult benchmark. [BHT+20] reflect on the small 1.5% improvement achieved by a doubling of model size between two recent state of the art results ([SPP+19]?and [Tur20]) and argue that “continuing to expand hardware and data sizes by orders of magnitude is not the path forward”. We find that path is still promising and in a zero-shot setting GPT-3 achieves 76% on LAMBADA, a gain of 8% over the previous state of the art.

LAMBADA is also a demonstration of the flexibility of few-shot learning as it provides a way to address a problem that ?classically occurs with this dataset. Although the completion in LAMBADA is always the last word in a sentence, a ?standard language model has no way of knowing this detail. It thus assigns probability not only to the correct ending but ?also to other valid continuations of the paragraph. This problem has been partially addressed in the past with stop-word ?filters [RWC+19] (which ban “continuation” words). The few-shot setting instead allows us to “frame” the task as a ?cloze-test and allows the language model to infer from examples that a completion of exactly one word is desired. We ?use the following fill-in-the-blank format:

LAMBADA數(shù)據(jù)集[PKL+16]測(cè)試文本中遠(yuǎn)程依賴的建模——模型被要求預(yù)測(cè)需要閱讀一段上下文的句子的最后一個(gè)單詞。最近有研究表明，語(yǔ)言模型的不斷擴(kuò)大在這個(gè)困難的基準(zhǔn)上產(chǎn)生的收益正在減少。[BHT+20]反思了在兩個(gè)最新的研究結(jié)果([SPP+19]和[Tur20])之間，模型尺寸增加了一倍，僅提高了1.5%，并認(rèn)為“繼續(xù)以數(shù)量級(jí)擴(kuò)展硬件和數(shù)據(jù)尺寸并不是前進(jìn)的道路”。我們發(fā)現(xiàn)這條道路仍然很有希望，在零桿的情況下，LAMBADA的GPT-3實(shí)現(xiàn)了76%，比之前的技術(shù)水平提高了8%。
LAMBADA還演示了小樣本學(xué)習(xí)的靈活性，因?yàn)樗峁┝艘环N方法來(lái)解決這個(gè)數(shù)據(jù)集通常出現(xiàn)的問(wèn)題。盡管LAMBADA中的完成總是一個(gè)句子的最后一個(gè)單詞，但是標(biāo)準(zhǔn)語(yǔ)言模型無(wú)法知道這個(gè)細(xì)節(jié)。因此，它不僅將概率分配給正確的結(jié)尾，也分配給其他有效的段落延續(xù)。這個(gè)問(wèn)題已經(jīng)部分解決了在過(guò)去的停止字過(guò)濾器[RWC+19](禁止“延續(xù)”字)。相反，few-shot設(shè)置允許我們將任務(wù)“設(shè)置”為一個(gè)cloze測(cè)試，并允許語(yǔ)言模型從示例中推斷出需要完成的恰好是一個(gè)單詞。我們使用以下填空格式:

?

When presented with examples formatted this way, GPT-3 achieves 86.4% accuracy in the few-shot setting, an increase ?of over 18% from the previous state-of-the-art. We observe that few-shot performance improves strongly with model ?size. While this setting decreases the performance of the smallest model by almost 20%, for GPT-3 it improves accuracy ?by 10%. Finally, the fill-in-blank method is not effective one-shot, where it always performs worse than the zero-shot ?setting. Perhaps this is because all models still require several examples to recognize the pattern.

One note of caution is that an analysis of test set contamination identified that a significant minority of the LAMBADA dataset appears to be present in our training data – however analysis performed in Section 4 suggests negligible impact on performance.

在本節(jié)中，我們將測(cè)量GPT-3回答有關(guān)廣泛事實(shí)知識(shí)的問(wèn)題的能力。由于可能的查詢量巨大，這個(gè)任務(wù)通常是通過(guò)使用信息檢索系統(tǒng)查找相關(guān)文本，并結(jié)合學(xué)習(xí)生成給定問(wèn)題和檢索文本的答案的模型來(lái)完成的。由于該設(shè)置允許系統(tǒng)搜索并對(duì)可能包含答案的文本進(jìn)行條件設(shè)置，因此稱為“open-book”。[RRS20]最近證明，一個(gè)大型語(yǔ)言模型可以在不依賴輔助信息的情況下直接回答問(wèn)題，表現(xiàn)得令人驚訝地好。他們將這種更嚴(yán)格的評(píng)估設(shè)置稱為“閉卷”。他們的工作表明，更高容量的模型可以表現(xiàn)得更好，我們用GPT-3測(cè)試了這一假設(shè)。我們?cè)赱RRS20]中的3個(gè)數(shù)據(jù)集上評(píng)估GPT-3: Natural Questions [KPR+19]、WebQuestions [BCFL13]和TriviaQA [JCWZ17]，使用相同的分割。注意，除了所有的結(jié)果都在閉卷設(shè)置中之外，我們使用的少樣本、一次小樣本和零小樣本的評(píng)估代表了比以前的閉卷QA工作更嚴(yán)格的設(shè)置:除了不允許外部?jī)?nèi)容外，也不允許對(duì)Q&A數(shù)據(jù)集本身進(jìn)行微調(diào)。

GPT-3結(jié)果如表3.3所示。在TriviaQA上，我們?cè)谛颖驹O(shè)置中達(dá)到了64.3%，在一小樣本設(shè)置中達(dá)到了68.0%，在小樣本設(shè)置中達(dá)到了71.2%。zero-shot result的表現(xiàn)已經(jīng)比經(jīng)過(guò)微調(diào)的T5-11B高出14.2%，而且在培訓(xùn)前的問(wèn)答時(shí)間跨度預(yù)測(cè)也比T5-11B高出3.8%。一次測(cè)試的結(jié)果提高了3.7%，與開(kāi)放域QA系統(tǒng)的SOTA相匹配，該系統(tǒng)不僅進(jìn)行了優(yōu)化，而且利用了一種學(xué)習(xí)過(guò)的檢索機(jī)制，對(duì)包含21M文檔的15.3個(gè)參數(shù)密集向量索引進(jìn)行檢索[LPP+20]。此外，GPT-3的少拍效果進(jìn)一步提高了性能3.2%。
在網(wǎng)絡(luò)問(wèn)題(WebQs)中，GPT-3在零桿設(shè)置中達(dá)到14.4%，在單桿設(shè)置中達(dá)到25.3%，在少桿設(shè)置中達(dá)到41.5%。相比之下，使用q&a特定的培訓(xùn)前程序的優(yōu)化T5-11B和優(yōu)化T5-11B+SSM的比例分別為37.4%和44.7%。GPT-3在小樣本設(shè)置接近最先進(jìn)的表現(xiàn)，微調(diào)模型。值得注意的是，與TriviaQA相比，WebQS從零桿到少桿的增益要大得多(事實(shí)上，WebQS的零桿和單桿性能都很差)，這可能表明WebQS的問(wèn)題和/或它們的回答風(fēng)格在GPT-3中是不分布的。然而，GPT-3似乎能夠適應(yīng)這種分布，在少炮點(diǎn)的環(huán)境中恢復(fù)了良好的性能。

On Natural Questions (NQs) GPT-3 achieves 14.6% in the zero-shot setting, 23.0% in the one-shot setting, and 29.9% in ?the few-shot setting, compared to 36.6% for fine-tuned T5 11B+SSM. Similar to WebQS, the large gain from zero-shot ?to few-shot may suggest a distribution shift, and may also explain the less competitive performance compared to ?TriviaQA and WebQS. In particular, the questions in NQs tend towards very fine-grained knowledge on Wikipedia ?specifically which could be testing the limits of GPT-3’s capacity and broad pretraining distribution. ?

Overall, on one of the three datasets GPT-3’s one-shot matches the open-domain fine-tuning SOTA. On the other two ?datasets it approaches the performance of the closed-book SOTA despite not using fine-tuning. On all 3 datasets, we ?find that performance scales very smoothly with model size (Figure 3.3 and Appendix H Figure H.7), possibly reflecting ?the idea that model capacity translates directly to more ‘knowledge’ absorbed in the parameters of the model.

在自然問(wèn)題(NQs)中，GPT-3在零桿設(shè)置中達(dá)到了14.6%，在單桿設(shè)置中達(dá)到了23.0%，在少桿設(shè)置中達(dá)到了29.9%，而在經(jīng)過(guò)微調(diào)的T5 11B+SSM中達(dá)到了36.6%。與WebQS類似，從零桿到少桿的巨大增益可能意味著分布的轉(zhuǎn)移，這也可能解釋了與TriviaQA和WebQS相比競(jìng)爭(zhēng)力較差的原因。特別是，NQs的問(wèn)題傾向于維基百科上非常精細(xì)的知識(shí)，可以測(cè)試GPT-3的能力極限和廣泛的培訓(xùn)前分布。 

總的來(lái)說(shuō)，在三個(gè)數(shù)據(jù)集中的一個(gè)上，GPT-3的一次性匹配了開(kāi)放域微調(diào)SOTA。在另外兩個(gè)數(shù)據(jù)集上，盡管沒(méi)有使用微調(diào)，它的性能接近封閉的SOTA。在所有3個(gè)數(shù)據(jù)集上，我們發(fā)現(xiàn)性能與模型大小的關(guān)系非常順利(圖3.3和附錄H圖H.7)，可能反映了模型容量直接轉(zhuǎn)化為更多吸收在模型參數(shù)中的“知識(shí)”的想法。

Winograd Schemas Challenge [LDM12]是NLP中的一項(xiàng)經(jīng)典任務(wù)，當(dāng)一個(gè)代詞在語(yǔ)法上有歧義，但在語(yǔ)義上對(duì)人來(lái)說(shuō)沒(méi)有歧義時(shí)，該任務(wù)涉及確定該代詞指的是哪個(gè)詞。最近，經(jīng)過(guò)微調(diào)的語(yǔ)言模型在原始Winograd數(shù)據(jù)集上取得了接近人類的性能，但是更困難的版本，比如反向挖掘的Winogrande數(shù)據(jù)集[SBBC19]，仍然顯著落后于人類的性能。我們測(cè)試了GPT-3在Winograd和Winogrande上的性能，通常是在零桿、一桿和少桿設(shè)置下。 
在Winograd上，我們使用[RWC+19]中描述的相同的“部分求值”方法，在原始的273個(gè)Winograd模式集上測(cè)試GPT-3。請(qǐng)注意，此設(shè)置與SuperGLUE基準(zhǔn)中的WSC任務(wù)略有不同，后者以二進(jìn)制分類的形式表示，需要提取實(shí)體來(lái)轉(zhuǎn)換為本節(jié)中描述的形式。Winograd的GPT-3在零桿、一桿和少桿設(shè)置中取得了88.3%、89.7%和88.6%的成績(jī)，沒(méi)有顯示出明確的上下文學(xué)習(xí)，但在所有情況下都取得了較好的成績(jī)，僅比最先進(jìn)的和估計(jì)的人類性能低幾個(gè)點(diǎn)。我們注意到，污染分析在訓(xùn)練數(shù)據(jù)中發(fā)現(xiàn)了一些Winograd模式，但這似乎只對(duì)結(jié)果有很小的影響(見(jiàn)第4節(jié))。

?

ARC [CCE+18] is a dataset of multiple-choice questions collected from 3rd to 9th grade science exams. On the ?“Challenge” version of the dataset which has been filtered to questions which simple statistical or information retrieval ?methods are unable to correctly answer, GPT-3 achieves 51.4% accuracy in the zero-shot setting, 53.2% in the one-shot ?setting, and 51.5% in the few-shot setting. This is approaching the performance of a fine-tuned RoBERTa baseline ?(55.9%) from UnifiedQA [KKS+20]. On the “Easy” version of the dataset (questions which either of the mentioned ?baseline approaches answered correctly), GPT-3 achieves 68.8%, 71.2%, and 70.1% which slightly exceeds a fine-tuned ?RoBERTa baseline from [KKS+20]. However, both of these results are still much worse than the overall SOTAs ?achieved by the UnifiedQA which exceeds GPT-3’s few-shot results by 27% on the challenge set and 22% on the easy ?set. ?

On OpenBookQA [MCKS18], GPT-3 improves significantly from zero to few shot settings but is still over 20 points ?short of the overall SOTA. GPT-3’s few-shot performance is similar to a fine-tuned BERT Large baseline on the ?leaderboard. ?
Overall, in-context learning with GPT-3 shows mixed results on commonsense reasoning tasks, with only small and ?inconsistent gains observed in the one and few-shot learning settings for both PIQA and ARC, but a significant ?improvement is observed on OpenBookQA. GPT-3 sets SOTA on the new PIQA dataset in all evaluation settings.

Next we evaluate GPT-3 on the task of reading comprehension. We use a suite of 5 datasets including abstractive, ?multiple choice, and span based answer formats in both dialog and single question settings. We observe a wide spread ?in GPT-3’s performance across these datasets suggestive of varying capability with different answer formats. In general ?we observe GPT-3 is on par with initial baselines and early results trained using contextual representations on each ?respective dataset. ?

接下來(lái)我們對(duì)GPT-3進(jìn)行閱讀理解任務(wù)的評(píng)估。在對(duì)話框和單一問(wèn)題設(shè)置中，我們使用了一套5個(gè)數(shù)據(jù)集，包括抽象的、多項(xiàng)選擇和基于跨度的回答格式。我們觀察到GPT-3在這些數(shù)據(jù)集上的性能差異很大，這表明不同的回答格式具有不同的能力。一般來(lái)說(shuō)，我們觀察到GPT-3與初始基線和使用上下文表示對(duì)每個(gè)各自數(shù)據(jù)集進(jìn)行訓(xùn)練的早期結(jié)果相同。?

GPT-3在CoQA [RCM19]自由形式會(huì)話數(shù)據(jù)集上表現(xiàn)最好(在人類基線的3個(gè)點(diǎn)內(nèi))，在QuAC [CHI+18]數(shù)據(jù)集上表現(xiàn)最差(低于ELMo基線13 F1)，該數(shù)據(jù)集需要建模結(jié)構(gòu)化對(duì)話行為和師生交互的回答范圍選擇。下降(DWD + 19]數(shù)據(jù)集測(cè)試離散推理和計(jì)算能力在閱讀理解中,GPT-3在few-shot環(huán)境優(yōu)于原始論文的BERT基線調(diào)整但仍遠(yuǎn)低于人類的性能和先進(jìn)的方法增強(qiáng)神經(jīng)網(wǎng)絡(luò)與符號(hào)系統(tǒng)(RLL + 19)。在陣容2.0 [RJL18]上，GPT-3展示了它的少桿學(xué)習(xí)能力，與零桿設(shè)置相比提高了近10桿(69.8桿)。這使得它稍微優(yōu)于原始論文中最好的微調(diào)結(jié)果。在RACE [LXL+17](一個(gè)針對(duì)初中和高中英語(yǔ)考試的多項(xiàng)選擇數(shù)據(jù)集)上，GPT-3的表現(xiàn)相對(duì)較弱，僅與最早使用上下文表示的研究相比具有競(jìng)爭(zhēng)力，仍落后于SOTA 45%。

In order to better aggregate results on NLP tasks and compare to popular models such as BERT and RoBERTa in a ?more systematic way, we also evaluate GPT-3 on a standardized collection of datasets, the SuperGLUE benchmark ?[WPN+19] [WPN+19] [CLC+19] [DMST19] [RBG11] [KCR+18] [ZLL+18] [DGM06] [BHDD+06] [GMDD07] ?[BDD+09] [PCC18] [PHR+18]. GPT-3’s test-set performance on the SuperGLUE dataset is shown in Table 3.8. In the ?few-shot setting, we used 32 examples for all tasks, sampled randomly from the training set. For all tasks except WSC and MultiRC, we sampled a new set of examples to use in the context for each problem. For WSC and MultiRC, we ?used the same set of randomly drawn examples from the training set as context for all of the problems we evaluated. ?
We observe a wide range in GPT-3’s performance across tasks. On COPA and ReCoRD GPT-3 achieves near-SOTA ?performance in the one-shot and few-shot settings, with COPA falling only a couple points short and achieving ?second place on the leaderboard, where first place is held by a fine-tuned 11 billion parameter model (T5). On WSC, ?performance is still relatively strong, achieving 80.1% in the few-shot setting (note that GPT-3 achieves 88.6% on the ?original Winograd dataset as described in Section 3.4). On BoolQ, MultiRC, and RTE, performance is reasonable, ?roughly matching that of a fine-tuned BERT-Large. On CB, we see signs of life at 75.6% in the few-shot setting.?

為了更好地聚合NLP任務(wù)的結(jié)果，并與BERT和RoBERTa等流行模型進(jìn)行更系統(tǒng)的比較，我們還在標(biāo)準(zhǔn)化數(shù)據(jù)集上對(duì)GPT-3進(jìn)行了評(píng)價(jià)，即SuperGLUE基準(zhǔn)[WPN+19] [WPN+19] [CLC+19] [DMST19] [RBG11] [KCR+18] [ZLL+18] [DGM06] [BHDD+06] [GMDD07] [BDD+09] [PCC18] [PHR+18]。GPT-3在SuperGLUE數(shù)據(jù)集上的測(cè)試集性能如表3.8所示。在小樣本設(shè)置中，我們對(duì)所有任務(wù)使用了32個(gè)示例，從訓(xùn)練集中隨機(jī)采樣。對(duì)于除了WSC和MultiRC之外的所有任務(wù)，我們采樣了一組新的示例用于每個(gè)問(wèn)題的上下文。對(duì)于WSC和MultiRC，我們使用同一組從訓(xùn)練集中隨機(jī)抽取的例子作為我們?cè)u(píng)估的所有問(wèn)題的上下文。?

我們觀察到GPT-3在不同任務(wù)中的表現(xiàn)差異很大。在COPA和記錄GPT-3實(shí)現(xiàn)近sota的表現(xiàn)在一次樣本和小樣本設(shè)置，與COPA只下降了幾個(gè)點(diǎn)，并在排行榜上取得第二名，第一名是由微調(diào)110億參數(shù)模型(T5)。在WSC上，性能仍然相對(duì)較強(qiáng)，在小樣本設(shè)置中達(dá)到80.1%(請(qǐng)注意，如3.4節(jié)所述，gpot -3在原始Winograd數(shù)據(jù)集上達(dá)到88.6%)。在BoolQ、MultiRC和RTE上，性能是合理的，大致與經(jīng)過(guò)微調(diào)的BERT-Large匹配。在CB上，我們看到生命跡象的比例為75.6%。

WiC is a notable weak spot with few-shot performance at 49.4% (at random chance). We tried a number of different ?phrasings and formulations for WiC (which involves determining if a word is being used with the same meaning in two ?sentences), none of which was able to achieve strong performance. This hints at a phenomenon that will become clearer ?in the next section (which discusses the ANLI benchmark) – GPT-3 appears to be weak in the few-shot or one-shot ?setting at some tasks that involve comparing two sentences or snippets, for example whether a word is used the same ?way in two sentences (WiC), whether one sentence is a paraphrase of another, or whether one sentence implies another. ?This could also explain the comparatively low scores for RTE and CB, which also follow this format. Despite these ?weaknesses, GPT-3 still outperforms a fine-tuned BERT-large on four of eight tasks and on two tasks GPT-3 is close to ?the state-of-the-art held by a fine-tuned 11 billion parameter model.

Finally, we note that the few-shot SuperGLUE score steadily improves with both model size and with number of ?examples in the context showing increasing benefits from in-context learning (Figure 3.8). We scale K up to 32 ?examples per task, after which point additional examples will not reliably fit into our context. When sweeping over ?values of K, we find that GPT-3 requires less than eight total examples per task to outperform a fine-tuned BERT-Large ?on overall SuperGLUE score.

WiC是一個(gè)值得注意的弱點(diǎn)，它的命中率為49.4%(隨機(jī))。我們?yōu)閃iC嘗試了許多不同的短語(yǔ)和公式(包括確定一個(gè)單詞在兩個(gè)句子中是否具有相同的意思)，但沒(méi)有一個(gè)能夠取得很好的效果。這暗示了一個(gè)現(xiàn)象,在下一節(jié)將變得更清楚(討論ANLI基準(zhǔn))——GPT-3似乎弱few-shot或一次性設(shè)置的一些任務(wù),涉及比較兩個(gè)句子或片段,例如一個(gè)詞是否用同樣的方式在兩個(gè)句子,一個(gè)句子是否解釋另一個(gè),或者一個(gè)句子是否意味著另一個(gè)。這也可以解釋RTE和CB的分?jǐn)?shù)相對(duì)較低的原因，它們也采用這種格式。盡管存在這些弱點(diǎn)，GPT-3仍然在8個(gè)任務(wù)中的4個(gè)任務(wù)上優(yōu)于經(jīng)過(guò)微調(diào)的伯特-大公司，而在兩個(gè)任務(wù)上，GPT-3通過(guò)一個(gè)經(jīng)過(guò)微調(diào)的110億參數(shù)模型已經(jīng)接近最先進(jìn)水平。

最后，我們注意到，隨著模型大小和上下文中的示例數(shù)量的增加，少量注射的SuperGLUE得分穩(wěn)步提高，顯示了上下文內(nèi)學(xué)習(xí)的好處越來(lái)越大(圖3.8)。我們將K擴(kuò)展到每個(gè)任務(wù)32個(gè)示例，超過(guò)這一點(diǎn)，額外的示例將不可靠地適合我們的上下文。當(dāng)掃過(guò)K的值時(shí)，我們發(fā)現(xiàn)GPT-3每個(gè)任務(wù)總共需要少于8個(gè)示例，才能在總體超級(jí)膠水得分上超過(guò)經(jīng)過(guò)微調(diào)的伯特-大。

自然語(yǔ)言推理(NLI) [Fyo00]關(guān)注理解兩個(gè)句子之間關(guān)系的能力。在實(shí)踐中，這個(gè)任務(wù)通常被構(gòu)造成兩個(gè)或三個(gè)類的分類問(wèn)題，其中模型分類第二個(gè)句子在邏輯上是否與第一個(gè)句子相符合，是否與第一個(gè)句子相矛盾，或者可能是正確的(中立的)。SuperGLUE包括一個(gè)NLI數(shù)據(jù)集RTE，它計(jì)算任務(wù)的二進(jìn)制版本。在RTE上，只有最大版本的GPT-3在任何評(píng)估設(shè)置上的表現(xiàn)都令人信服地優(yōu)于random(56%)，但在小樣本設(shè)置中，GPT-3的表現(xiàn)類似于單任務(wù)優(yōu)化的BERT Large。我們還評(píng)估了最近引入的對(duì)抗式自然語(yǔ)言推斷(ANLI)數(shù)據(jù)集[NWD+19]。ANLI是一個(gè)復(fù)雜的數(shù)據(jù)集，它在三輪(R1、R2和R3)中使用一系列逆向挖掘的自然語(yǔ)言推理問(wèn)題。與RTE類似，我們所有小于GPT-3的模型在ANLI上的表現(xiàn)幾乎完全是隨機(jī)的，即使是在很少投籃的設(shè)置中(約33%)，而GPT-3本身在第3輪顯示出生命跡象。ANLI R3的結(jié)果突出顯示在圖3.9和全部結(jié)果輪可以在附錄h .這些結(jié)果RTE和ANLI NLI基礎(chǔ)仍然是一個(gè)非常困難的任務(wù)表明語(yǔ)言模型和他們才剛剛開(kāi)始顯示出進(jìn)步的跡象。

要想了解GPT-3在“少拍”(或“零拍”和“一次拍”)環(huán)境下的能力范圍，一種方法是讓它執(zhí)行一些任務(wù)，這些任務(wù)要求它執(zhí)行簡(jiǎn)單的即時(shí)計(jì)算推理，識(shí)別訓(xùn)練中不太可能出現(xiàn)的新模式，或者快速適應(yīng)不尋常的任務(wù)。我們?cè)O(shè)計(jì)了幾個(gè)任務(wù)來(lái)測(cè)試這類能力。首先，我們測(cè)試GPT-3執(zhí)行算術(shù)的能力。其次，我們創(chuàng)建了幾個(gè)任務(wù)，這些任務(wù)包括重新排列或整理單詞中的字母，這些任務(wù)不太可能在訓(xùn)練過(guò)程中被準(zhǔn)確地看到。第三，我們測(cè)試了GPT-3解決衛(wèi)星式類比問(wèn)題的能力。最后，我們對(duì)GPT-3進(jìn)行了幾個(gè)定性測(cè)試，包括在句子中使用新單詞、修改英語(yǔ)語(yǔ)法和生成新聞文章。我們將發(fā)布合成數(shù)據(jù)集，希望能促進(jìn)對(duì)語(yǔ)言模型測(cè)試時(shí)行為的進(jìn)一步研究。?

To test GPT-3’s ability to perform simple arithmetic operations without task-specific training, we developed a small ?battery of 10 tests that involve asking GPT-3 a simple arithmetic problem in natural language:

• 2 digit addition (2D+) – The model is asked to add two integers sampled uniformly from [0, 100), phrased in ?the form of a question, e.g. “Q: What is 48 plus 76? A: 124.” ?
• 2 digit subtraction (2D-) – The model is asked to subtract two integers sampled uniformly from [0, 100); the ?answer may be negative. Example: “Q: What is 34 minus 53? A: -19”. ?
• 3 digit addition (3D+) – Same as 2 digit addition, except numbers are uniformly sampled from [0, 1000).
• 3 digit subtraction (3D-) – Same as 2 digit subtraction, except numbers are uniformly sampled from [0, 1000).
• 4 digit addition (4D+) – Same as 3 digit addition, except uniformly sampled from [0, 10000).
• 4 digit subtraction (4D-) – Same as 3 digit subtraction, except uniformly sampled from [0, 10000).
• 5 digit addition (5D+) – Same as 3 digit addition, except uniformly sampled from [0, 100000).
• 5 digit subtraction (5D-) – Same as 3 digit subtraction, except uniformly sampled from [0, 100000).
• 2 digit multiplication (2Dx) – The model is asked to multiply two integers sampled uniformly from [0, 100), e.g. “Q: What is 24 times 42? A: 1008”.
• One-digit composite (1DC) – The model is asked to perform a composite operation on three 1 digit numbers, with parentheses around the last two. For example, “Q: What is 6+(4*8)? A: 38”. The three 1 digit numbers are selected uniformly on [0, 10) and the operations are selected uniformly from {+,-,*}.

為了測(cè)試GPT-3在沒(méi)有特定任務(wù)訓(xùn)練的情況下執(zhí)行簡(jiǎn)單算術(shù)運(yùn)算的能力，我們開(kāi)發(fā)了一個(gè)包含10個(gè)測(cè)試的小電池，其中包括用自然語(yǔ)言問(wèn)GPT-3一個(gè)簡(jiǎn)單的算術(shù)問(wèn)題:

• 2位加法(2D+)——模型被要求將從[0,100均勻采樣的兩個(gè)整數(shù)相加，以問(wèn)題的形式表達(dá)，例如:“Q: 48加76等于多少?”答:124。”
• 2位減法(2D-)——要求模型從[0,100]均勻采樣的兩個(gè)整數(shù)進(jìn)行減法;答案可能是否定的。例子:“問(wèn):34減53等于多少?”答:-19”。?
• 3位加法(3D+) -與2位加法相同，只是數(shù)字均勻地從[0,1000]取樣。
• 3位減法(3D-) -與2位減法相同，只是數(shù)字均勻地從[0,1000]采樣。
• 4位加法(4D+) -與3位加法相同，只是均勻采樣于[0,10000]。
• 4位減法(4D-) -與3位減法相同，只是均勻采樣于[0,10000]。
• 5位加法(5D+) -與3位加法相同，除了均勻采樣于[0,100000]。
• 5位減法(5D-) -與3位減法相同，除了均勻采樣[0,100000]。
• 2位乘法(2Dx)——模型要求將從[0,100均勻采樣的兩個(gè)整數(shù)相乘)，例如:“Q: 24乘以42等于多少?”答:1008”。
• 一位數(shù)合成(1DC)——要求模型對(duì)三個(gè)1位數(shù)執(zhí)行合成操作，最后兩個(gè)用括號(hào)括起來(lái)。例如，“Q: 6+(4*8)是多少?”答:38”。在[0,10)上一致選擇三個(gè)1位數(shù)字，在{+，-，*}中一致選擇操作。

In all 10 tasks the model must generate the correct answer exactly. For each task we generate a dataset of 2,000 random ?instances of the task and evaluate all models on those instances. ?First we evaluate GPT-3 in the few-shot setting, for which results are shown in Figure 3.10. On addition and subtraction, ?GPT-3 displays strong proficiency when the number of digits is small, achieving 100% accuracy on 2 digit addition, ?98.9% at 2 digit subtraction, 80.2% at 3 digit addition, and 94.2% at 3-digit subtraction. Performance decreases as the ?number of digits increases, but GPT-3 still achieves 25-26% accuracy on four digit operations and 9-10% accuracy on ?five digit operations, suggesting at least some capacity to generalize to larger numbers of digits. GPT-3 also achieves ?29.2% accuracy at 2 digit multiplication, an especially computationally intensive operation. Finally, GPT-3 achieves ?21.3% accuracy at single digit combined operations (for example, 9*(7+5)), suggesting that it has some robustness ?beyond just single operations. ?

As Figure 3.10 makes clear, small models do poorly on all of these tasks – even the 13 billion parameter model (the ?second largest after the 175 billion full GPT-3) can solve 2 digit addition and subtraction only half the time, and all ?other operations less than 10% of the time. ?

One-shot and zero-shot performance are somewhat degraded relative to few-shot performance, suggesting that adaptation ?to the task (or at the very least recognition of the task) is important to performing these computations correctly. ?Nevertheless, one-shot performance is still quite strong, and even zero-shot performance of the full GPT-3 significantly?outperforms few-shot learning for all smaller models. All three settings for the full GPT-3 are shown in Table 3.9, and ?model capacity scaling for all three settings is shown in Appendix H.

To spot-check whether the model is simply memorizing specific arithmetic problems, we took the 3-digit arithmetic ?problems in our test set and searched for them in our training data in both the forms "<NUM1> + <NUM2> =" and ?"<NUM1> plus <NUM2>". Out of 2,000 addition problems we found only 17 matches (0.8%) and out of 2,000 ?subtraction problems we found only 2 matches (0.1%), suggesting that only a trivial fraction of the correct answers ?could have been memorized. In addition, inspection of incorrect answers reveals that the model often makes mistakes ?such as not carrying a “1”, suggesting it is actually attempting to perform the relevant computation rather than ?memorizing a table. ?
Overall, GPT-3 displays reasonable proficiency at moderately complex arithmetic in few-shot, one-shot, and even ?zero-shot settings.

To test GPT-3’s ability to learn novel symbolic manipulations from a few examples, we designed a small battery of ?5 “character manipulation” tasks. Each task involves giving the model a word distorted by some combination of ?scrambling, addition, or deletion of characters, and asking it to recover the original word. The 5 tasks are:

• Cycle letters in word (CL) – The model is given a word with its letters cycled, then the “=” symbol, and is expected to generate the original word. For example, it might be given “l(fā)yinevitab” and should output “inevitably”.
• Anagrams of all but first and last characters (A1) – The model is given a word where every letter except the first and last have been scrambled randomly, and must output the original word. Example: criroptuon = corruption.
• Anagrams of all but first and last 2 characters (A2) – The model is given a word where every letter except the first 2 and last 2 have been scrambled randomly, and must recover the original word. Example: opoepnnt → opponent.
• Random insertion in word (RI) – A random punctuation or space character is inserted between each letter of a word, and the model must output the original word. Example: s.u!c/c!e.s s i/o/n = succession.
• Reversed words (RW) – The model is given a word spelled backwards, and must output the original word. Example: stcejbo → objects.

為了測(cè)試GPT-3從幾個(gè)例子中學(xué)習(xí)新的符號(hào)操作的能力，我們?cè)O(shè)計(jì)了一個(gè)包含5個(gè)“字符操作”任務(wù)的小電池。每個(gè)任務(wù)都包括給模型一個(gè)被打亂、添加或刪除字符組合而扭曲的單詞，并要求它恢復(fù)原來(lái)的單詞。這5項(xiàng)任務(wù)是:

• 單詞(CL)中的循環(huán)字母——給模型一個(gè)單詞，它的字母是循環(huán)的，然后是“=”符號(hào)，并期望生成原始單詞。例如，它可能被賦予“l(fā)yinevitab”，而應(yīng)該輸出“不可避免”。
• 除了第一個(gè)和最后一個(gè)字符以外的所有字符的字謎(A1)——模型被給定一個(gè)單詞，其中除了第一個(gè)和最后一個(gè)字符以外的每個(gè)字母都被隨機(jī)打亂，并且必須輸出原始單詞。例如:criroptuon =腐敗。
• 除了第一個(gè)和最后兩個(gè)字符以外的所有字符的字謎(A2)——模型給出一個(gè)單詞，其中除了前兩個(gè)和后兩個(gè)字符以外的每個(gè)字母都被隨機(jī)打亂，并且必須恢復(fù)原來(lái)的單詞。例:opoepnnt→對(duì)手。
• 單詞中的隨機(jī)插入(RI)——在單詞的每個(gè)字母之間插入隨機(jī)的標(biāo)點(diǎn)或空格字符，模型必須輸出原始單詞。例子:s.u ! c / c e。ssi /o/n =連續(xù)。
• 反向單詞(RW)——給模型一個(gè)反向拼寫(xiě)的單詞，并且必須輸出原始單詞。示例:stcejbo→對(duì)象。
• ?

We can further quantify performance by plotting “in-context learning curves”, which show task performance as a ?function of the number of in-context examples. We show in-context learning curves for the Symbol Insertion task ?in Figure 1.2. We can see that larger models are able to make increasingly effective use of in-context information, ?including both task examples and natural language task descriptions.

Finally, it is worth adding that solving these tasks requires character-level manipulations, whereas our BPE encoding ?operates on significant fractions of a word (on average ～ 0.7 words per token), so from the LM’s perspective succeeding ?at these tasks involves not just manipulating BPE tokens but understanding and pulling apart their substructure. Also, ?CL, A1, and A2 are not bijective (that is, the unscrambled word is not a deterministic function of the scrambled word), ?requiring the model to perform some search to find the correct unscrambling. Thus, the skills involved appear to require ?non-trivial pattern-matching and computation.

之前在生成語(yǔ)言模型上的工作定性地測(cè)試了他們生成合成“新聞文章”的能力，方法是有條件地從模型中取樣，并給出一個(gè)由一個(gè)新聞故事的可信的第一句話組成的人類書(shū)面提示。相對(duì)于數(shù)據(jù)集(RWC + 19),用于火車GPT-3偏重于新聞文章要少得多,因此試圖產(chǎn)生新聞文章通過(guò)原始無(wú)條件的樣品更有效——例如GPT-3經(jīng)常解釋提出的第一句話“新聞文章”的一條微博,然后文章合成反應(yīng)或后續(xù)消息。為了解決這個(gè)問(wèn)題，我們使用了GPT-3的少樣本學(xué)習(xí)能力，在模型的上下文中提供了之前的三篇新聞文章來(lái)約束它。有了提議的下一篇文章的標(biāo)題和副標(biāo)題，該模型能夠可靠地生成“新聞”類型的短文章。?

為了衡量GPT-3生成新聞文章的質(zhì)量(我們認(rèn)為這很可能與有條件的樣本生成質(zhì)量總體上相關(guān))，我們決定衡量人類區(qū)分GPT-3生成的文章與真實(shí)文章的能力。Kreps等人[KMB20]和Zellers等人[ZHR+19]也進(jìn)行了類似的工作。生成語(yǔ)言模型被訓(xùn)練來(lái)匹配人類生成的內(nèi)容的分布，所以人類區(qū)分這兩者的能力是質(zhì)量的一個(gè)潛在的重要衡量標(biāo)準(zhǔn)

?

為了考察人類檢測(cè)模型生成的文本的能力，我們從newser.com網(wǎng)站上任意選擇了25篇文章的標(biāo)題和副標(biāo)題(平均長(zhǎng)度:215個(gè)單詞)。然后，我們根據(jù)四種語(yǔ)言模型生成這些標(biāo)題和字幕的完整版本，大小從1.25米到175B (GPT-3)參數(shù)不等(平均長(zhǎng)度:200個(gè)單詞)。對(duì)于每個(gè)模型，我們向大約80名來(lái)自美國(guó)的參與者展示了一個(gè)測(cè)試，其中包含這些真實(shí)的標(biāo)題和副標(biāo)題，然后是人工撰寫(xiě)的文章或由模型4生成的文章。參與者被要求選擇文章是“很可能是人類寫(xiě)的”，“更可能是人類寫(xiě)的”，“我不知道”，“更可能是機(jī)器寫(xiě)的”，還是“很可能是機(jī)器寫(xiě)的”。

我們選擇的文章不在模型的訓(xùn)練數(shù)據(jù)中，并且模型的輸出被編程地格式化和選擇，以防止人類的“挑選”。所有模型都使用相同的上下文來(lái)設(shè)置輸出條件，并使用相同的上下文大小進(jìn)行預(yù)訓(xùn)練，每個(gè)模型都使用相同的文章標(biāo)題和副標(biāo)題作為提示。然而，我們也進(jìn)行了一項(xiàng)實(shí)驗(yàn)，以控制參與者的努力和注意力，這些人遵循同樣的格式，但包含了有意的不良模型生成的文章。這是通過(guò)從一個(gè)“控制模型”生成文章來(lái)實(shí)現(xiàn)的:一個(gè)沒(méi)有上下文且增加了輸出隨機(jī)性的160M參數(shù)模型。

Mean human accuracy (the ratio of correct assignments to non-neutral assignments per participant) at detecting that ?the intentionally bad articles were model generated was ～ 86% where 50% is chance level performance. By contrast, ?mean human accuracy at detecting articles that were produced by the 175B parameter model was barely above chance ?at ～ 52% (see Table 3.11).5 Human abilities to detect model generated text appear to decrease as model size increases: ?there appears to be a trend towards chance accuracy with model size, and human detection of GPT-3 is close to chance.6 ?This is true despite the fact that participants spend more time on each output as model size increases (see Appendix E). ?
Examples of synthetic articles from GPT-3 are given in Figures 3.14 and 3.15. ?7 Much of the text is—as indicated by the ?evaluations—difficult for humans to distinguish from authentic human content. Factual inaccuracies can be an indicator ?that an article is model generated since, unlike human authors, the models have no access to the specific facts that the ?article titles refer to or when the article was written. Other indicators include repetition, non sequiturs, and unusual ?phrasings, though these are often subtle enough that they are not noticed. ?
Related work on language model detection by Ippolito et al. [IDCBE19] indicates that automatic discriminators like ?G R O V E R [ZHR+19] and GLTR [GSR19] may have greater success at detecting model generated text than human ?evaluators. Automatic detection of these models may be a promising area of future research. ?

Ippolito et al. [IDCBE19] also note that human accuracy at detecting model generated text increases as humans observe ?more tokens. To do a preliminary investigation of how good humans are at detecting longer news articles generated ?by GPT-3 175B, we selected 12 world news articles from Reuters with an average length of 569 words and generated ?completions of these articles from GPT-3 with an average length of 498 words (298 words longer than our initial ?experiments). Following the methodology above, we ran two experiments, each on around 80 US-based participants, to ?compare human abilities to detect the articles generated by GPT-3 and a control model. ?
We found that mean human accuracy at detecting the intentionally bad longer articles from the control model was ?～ 88%, while mean human accuracy at detecting the longer articles that were produced by GPT-3 175B was still barely ?above chance at ～ 52% (see Table 3.12). This indicates that, for news articles that are around 500 words long, GPT-3 ?continues to produce articles that humans find difficult to distinguish from human written news articles.

在檢測(cè)出被模型生成的故意差的文章時(shí)，人類的平均準(zhǔn)確率(每個(gè)參與者的正確任務(wù)與非中立任務(wù)的比率)為86%，其中50%是隨機(jī)水平的表現(xiàn)。相比之下，人類檢測(cè)175B參數(shù)模型產(chǎn)生的物品的平均準(zhǔn)確率僅為52%(見(jiàn)表3.11)。5人類檢測(cè)模型生成的文本的能力似乎隨著模型大小的增加而減少:模型大小似乎有機(jī)會(huì)準(zhǔn)確性的趨勢(shì)，人類對(duì)GPT-3的檢測(cè)接近于機(jī)會(huì)。盡管隨著模型尺寸的增加，參與者會(huì)在每個(gè)輸出上花費(fèi)更多的時(shí)間(見(jiàn)附錄E)，但這是真的。

圖3.14和圖3.15給出了GPT-3合成產(chǎn)品的示例。7如評(píng)估所示，大部分文本對(duì)人類來(lái)說(shuō)很難從真實(shí)的人類內(nèi)容中區(qū)分出來(lái)。事實(shí)不準(zhǔn)確可能是一篇文章是模型生成的標(biāo)志，因?yàn)榕c人類作者不同，模型無(wú)法訪問(wèn)文章標(biāo)題所引用的具體事實(shí)或文章的寫(xiě)作時(shí)間。其他的指標(biāo)包括重復(fù)，不符合邏輯，和不尋常的措辭，盡管這些通常是足夠微妙的，他們沒(méi)有被注意到。?

Ippolito等人[IDCBE19]在語(yǔ)言模型檢測(cè)方面的相關(guān)工作表明，自動(dòng)鑒別器如G R O V E R [ZHR+19]和GLTR [GSR19]在檢測(cè)模型生成的文本方面可能比人類評(píng)價(jià)器更成功。這些模型的自動(dòng)檢測(cè)可能是未來(lái)研究的一個(gè)有前景的領(lǐng)域。

Ippolito等人[IDCBE19]也注意到，隨著人們觀察到更多的標(biāo)記，人類檢測(cè)模型生成的文本的準(zhǔn)確性也會(huì)提高。做一個(gè)初步調(diào)查好人類是如何檢測(cè)時(shí)間的新聞文章由GPT-3 175 b,我們選擇了12項(xiàng)世界新聞文章來(lái)自路透社平均長(zhǎng)度為569個(gè)單詞和生成完成的這些文章GPT-3平均長(zhǎng)度為498個(gè)單詞(298字的時(shí)間比我們最初的實(shí)驗(yàn))。按照上述方法，我們進(jìn)行了兩個(gè)實(shí)驗(yàn)，每個(gè)實(shí)驗(yàn)都有大約80名美國(guó)參與者，以比較人類檢測(cè)GPT-3和一個(gè)對(duì)照模型生成的文章的能力。?

我們發(fā)現(xiàn)，人類在檢測(cè)控制組故意制造的較長(zhǎng)文章時(shí)的平均準(zhǔn)確率為~ 88%，而在檢測(cè)GPT-3 175B制造的較長(zhǎng)文章時(shí)的平均準(zhǔn)確率為~ 52%(見(jiàn)表3.12)。這表明，對(duì)于長(zhǎng)度在500字左右的新聞文章，GPT-3繼續(xù)生成人類難以區(qū)分的文章。

發(fā)展語(yǔ)言學(xué)[CB78]研究的一個(gè)任務(wù)是學(xué)習(xí)和利用新單詞的能力，例如在一個(gè)句子中只看到一個(gè)單詞的定義一次就使用它，或者從一個(gè)用法反過(guò)來(lái)推斷一個(gè)單詞的意思。在這里，我們定性地測(cè)試GPT-3完成前一項(xiàng)任務(wù)的能力。具體來(lái)說(shuō)，我們給GPT-3一個(gè)不存在的單詞的定義，比如“Gigamuru”，然后讓它在一個(gè)句子中使用它。我們提供了一個(gè)(單獨(dú)的)不存在的單詞在句子中被定義和使用的1到5個(gè)例子，所以就寬泛任務(wù)的前面例子而言，任務(wù)是很少的，而就具體單詞而言，任務(wù)是一次性的。表3.16顯示了我們生成的6個(gè)示例;所有的定義都是人為生成的，第一個(gè)答案是人為生成的，作為條件反射，隨后的答案是GPT-3生成的。這些示例是在一次運(yùn)行中連續(xù)生成的，我們沒(méi)有省略或重復(fù)嘗試任何提示。在所有的情況下，生成的句子似乎是一個(gè)正確的或至少似是而非的詞的使用。在最后一句話中，該模型為單詞“screeg”(即“screeghed”)生成了一個(gè)貌似合理的變位，盡管這個(gè)詞的使用有點(diǎn)尷尬(“screeghed at each other”)，盡管它在描述一場(chǎng)玩具劍戰(zhàn)的意義上似乎是可信的。總的來(lái)說(shuō)，GPT-3在使用新單詞造句方面至少表現(xiàn)得很熟練。

由于我們的訓(xùn)練數(shù)據(jù)集來(lái)自互聯(lián)網(wǎng)，所以我們的模型可能是在一些基準(zhǔn)測(cè)試集上訓(xùn)練的。從互聯(lián)網(wǎng)規(guī)模的數(shù)據(jù)集中準(zhǔn)確地檢測(cè)測(cè)試污染是一個(gè)新的研究領(lǐng)域，沒(méi)有建立最佳實(shí)踐。雖然在訓(xùn)練大型模型時(shí)不調(diào)查污染是常見(jiàn)的做法，但考慮到訓(xùn)練前數(shù)據(jù)集規(guī)模的不斷擴(kuò)大，我們相信這個(gè)問(wèn)題正變得越來(lái)越重要。?

這種擔(dān)憂不僅僅是假設(shè)。最早在普通爬行數(shù)據(jù)上訓(xùn)練語(yǔ)言模型的論文之一[TL18]檢測(cè)并刪除了一個(gè)與其中一個(gè)評(píng)估數(shù)據(jù)集重疊的訓(xùn)練文檔。GPT-2 [RWC+19]等其他工作也進(jìn)行了事后重疊分析。他們的研究相對(duì)令人鼓舞，發(fā)現(xiàn)盡管模型在訓(xùn)練和測(cè)試重疊的數(shù)據(jù)上表現(xiàn)得稍微好一些，但這并不會(huì)對(duì)報(bào)告的結(jié)果產(chǎn)生顯著影響，因?yàn)橛幸恍〔糠謹(jǐn)?shù)據(jù)被污染了(通常只有幾個(gè)百分點(diǎn))。

GPT-3的運(yùn)作方式有些不同。一方面，數(shù)據(jù)集和模型的大小大約比GPT-2使用的大兩個(gè)數(shù)量級(jí)，并且包括大量的常見(jiàn)爬行，增加了污染和記憶的可能性。另一方面，精確地說(shuō)，由于數(shù)據(jù)量大，即使是GPT-3 175B，其訓(xùn)練集也沒(méi)有過(guò)度擬合，這是相對(duì)于一個(gè)被刪除的驗(yàn)證集而言的(圖4.1)。因此，我們預(yù)計(jì)污染可能是頻繁的，但其影響可能不會(huì)像擔(dān)心的那樣大。?

我們最初試圖通過(guò)主動(dòng)搜索并試圖消除我們的訓(xùn)練數(shù)據(jù)與本文中研究的所有基準(zhǔn)的開(kāi)發(fā)和測(cè)試集之間的任何重疊，來(lái)解決污染問(wèn)題。不幸的是，一個(gè)錯(cuò)誤只導(dǎo)致部分刪除了訓(xùn)練數(shù)據(jù)中檢測(cè)到的所有重疊部分。由于培訓(xùn)成本的原因，對(duì)模型進(jìn)行再培訓(xùn)是不可行的。為了解決這個(gè)問(wèn)題，我們?cè)敿?xì)研究剩余檢測(cè)到的重疊是如何影響結(jié)果的。?

對(duì)于每個(gè)基準(zhǔn)測(cè)試，我們生成一個(gè)“干凈”版本，刪除所有可能泄露的示例，大致定義為與預(yù)訓(xùn)練集中的任何內(nèi)容有13克重疊的示例(或者與整個(gè)示例有重疊的示例，如果它小于13克)。我們的目標(biāo)是非常保守地標(biāo)記出任何可能被污染的東西，以便產(chǎn)生一個(gè)高度可靠的無(wú)污染子集。確切的程序在附錄C中有詳細(xì)說(shuō)明。

然后我們?cè)谶@些干凈的基準(zhǔn)上評(píng)估GPT-3，并與原始分?jǐn)?shù)進(jìn)行比較。如果清潔子集上的分?jǐn)?shù)與整個(gè)數(shù)據(jù)集上的分?jǐn)?shù)相似，這表明即使存在污染，也不會(huì)對(duì)報(bào)告的結(jié)果產(chǎn)生顯著的影響。如果清潔組的分?jǐn)?shù)較低，這表明污染可能使結(jié)果膨脹。結(jié)果如圖4.2所示。盡管潛在的污染通常很高(四分之一的基準(zhǔn)測(cè)試得分超過(guò)50%)，但在大多數(shù)情況下，性能變化只是微不足道的，而且我們沒(méi)有看到污染水平和性能差異相關(guān)的證據(jù)。我們得出的結(jié)論是，要么我們的保守方法大大高估了污染，要么污染對(duì)性能的影響很小。?

下面，我們將更詳細(xì)地回顧一些特定的情況，其中(1)模型在清理后的版本上表現(xiàn)明顯較差，或(2)潛在的污染非常高，這使得測(cè)量性能差異非常困難。

?

Our analysis flagged six groups of benchmarks for further investigation: Word Scrambling, Reading Comprehension ?(QuAC, SQuAD2, DROP), PIQA, Winograd, language modeling tasks (Wikitext tasks, 1BW), and German to English translation. Since our overlap analysis is designed to be extremely conservative, we expect it to produce some false ?positives. We summarize the results for each group of tasks below:

• Reading Comprehension: Our initial analysis flagged >90% of task examples from QuAC, SQuAD2, and ?DROP as potentially contaminated, so large that even measuring the differential on a clean subset was difficult. ?Upon manual inspection, however, we found that for every overlap we inspected, in all 3 datasets, the source ?text was present in our training data but the question/answer pairs were not, meaning the model gains only ?background information and cannot memorize the answer to a specific question. ?
• German translation: We found 25% of the examples in the WMT16 German-English test set were marked ?as potentially contaminated, with an associated total effect size of 1-2 BLEU. Upon inspection, none of the ?flagged examples contain paired sentences resembling NMT training data and collisions were monolingual ?matches mostly of snippets of events discussed in the news. ?
• Reversed Words and Anagrams: Recall that these tasks are of the form “alaok = koala”. Due to the ?short length of these tasks, we used 2-grams for filtering (ignoring punctuation). After inspecting the flagged ?overlaps, we found that they were not typically instances of real reversals or unscramblings in the training set, ?but rather palindromes or trivial unscramblings, e.g “kayak = kayak”. The amount of overlap was small, ?but removing the trivial tasks lead to an increase in difficulty and thus a spurious signal. Related to this, the ?symbol insertion task shows high overlap but no effect on performance – this is because that task involves ?removing non-letter characters from a word, and the overlap analysis itself ignores such characters, leading to ?many spurious matches.
• PIQA: The overlap analysis flagged 29% of examples as contaminated, and observed a 3 percentage point ?absolute decrease (4% relative decrease) in performance on the clean subset. Though the test dataset was ?released after our training set was created and its labels are hidden, some of the web pages used by the ?crowdsourced dataset creators are contained in our training set. We found a similar decrease in a 25x smaller ?model with much less capacity to memorize, leading us to suspect that the shift is likely statistical bias ?rather than memorization; examples which workers copied may simply be easier. Unfortunately, we cannot ?rigorously prove this hypothesis. We therefore mark our PIQA results with an asterisk to denote this potential ?contamination.
• Winograd: The overlap analysis flagged 45% of examples, and found a 2.6% decrease in performance on the ?clean subset. Manual inspection of the overlapping data point showed that 132 Winograd schemas were in ?fact present in our training set, though presented in a different format than we present the task to the model. ?Although the decrease in performance is small, we mark our Winograd results in the main paper with an ?asterisk.
• Language modeling: We found the 4 Wikipedia language modeling benchmarks measured in GPT-2, plus the ?Children’s Book Test dataset, to be almost entirely contained in our training data. Since we cannot reliably ?extract a clean subset here, we do not report results on these datasets, even though we intended to when starting ?this work. We note that Penn Tree Bank due to its age was unaffected and therefore became our chief language ?modeling benchmark.

我們的分析為進(jìn)一步的調(diào)查標(biāo)記了六組基準(zhǔn):拼詞，閱讀理解(QuAC, SQuAD2, DROP)， PIQA, Winograd，語(yǔ)言建模任務(wù)(Wikitext任務(wù)，1BW)，以及德語(yǔ)到英語(yǔ)的翻譯。由于我們的重疊分析被設(shè)計(jì)成極其保守的，我們預(yù)計(jì)它會(huì)產(chǎn)生一些誤報(bào)。我們將每組任務(wù)的結(jié)果總結(jié)如下:

• 閱讀理解:我們最初的分析將QuAC、SQuAD2和DROP中90%的任務(wù)示例>標(biāo)記為潛在污染，如此之大，甚至很難在干凈子集上測(cè)量差異。然而，經(jīng)過(guò)人工檢查，我們發(fā)現(xiàn)，對(duì)于我們檢查的每一個(gè)重疊，在所有3個(gè)數(shù)據(jù)集中，我們的訓(xùn)練數(shù)據(jù)中都有源文本，但是問(wèn)題/答案對(duì)沒(méi)有，這意味著模型只獲得了背景信息，不能記住特定問(wèn)題的答案。&nbsp;
• 德語(yǔ)翻譯:我們發(fā)現(xiàn)，在WMT16德語(yǔ)-英語(yǔ)測(cè)試集中，25%的樣本被標(biāo)記為潛在污染，相關(guān)總效應(yīng)值為1-2藍(lán)色。經(jīng)過(guò)檢查，沒(méi)有一個(gè)標(biāo)記的例子包含類似NMT訓(xùn)練數(shù)據(jù)的成對(duì)句子，碰撞是單語(yǔ)匹配，主要是新聞中討論的事件片段。&nbsp;
• 顛倒單詞和字謎:回想一下這些任務(wù)的形式是“alaok = koala”。由于這些任務(wù)的長(zhǎng)度較短，我們使用2克來(lái)進(jìn)行過(guò)濾(忽略標(biāo)點(diǎn)符號(hào))。在檢查標(biāo)記的重疊之后，我們發(fā)現(xiàn)它們并不是訓(xùn)練集中真正的反向或解碼的典型實(shí)例，而是回文或普通的解碼。g " kayak = kayak "。重疊的數(shù)量很小，但是去除瑣碎的任務(wù)會(huì)增加難度，從而產(chǎn)生虛假信號(hào)。與此相關(guān)的是，符號(hào)插入任務(wù)顯示了高重疊，但對(duì)性能沒(méi)有影響——這是因?yàn)樵撊蝿?wù)涉及從單詞中刪除非字母字符，而重疊分析本身忽略了這些字符，從而導(dǎo)致許多虛假匹配。
• PIQA:重疊分析將29%的示例標(biāo)記為受污染的，并觀察到干凈子集的性能下降了3個(gè)百分點(diǎn)(相對(duì)下降4%)。雖然測(cè)試數(shù)據(jù)集創(chuàng)建發(fā)布我們的訓(xùn)練集和它的標(biāo)簽是隱藏的,使用的一些網(wǎng)頁(yè)的創(chuàng)造者眾包數(shù)據(jù)集都包含在我們的訓(xùn)練集,我們也發(fā)現(xiàn)了相似的下降25 x模型和更少的記憶能力小,導(dǎo)致我們懷疑這種轉(zhuǎn)變可能是統(tǒng)計(jì)偏差而不是記憶;工人們模仿的例子可能更簡(jiǎn)單。不幸的是，我們不能嚴(yán)格地證明這個(gè)假設(shè)。因此，我們用星號(hào)標(biāo)記PIQA結(jié)果，表示這種潛在的污染。
• Winograd:重疊分析標(biāo)記了45%的示例，發(fā)現(xiàn)干凈子集的性能下降了2.6%。對(duì)重疊數(shù)據(jù)點(diǎn)的手動(dòng)檢查表明，實(shí)際上有132個(gè)Winograd模式出現(xiàn)在我們的訓(xùn)練集中，盡管它們的格式與我們向模型展示任務(wù)的格式不同。盡管性能下降很小，但我們?cè)谥髡撐闹杏眯翘?hào)標(biāo)記了Winograd結(jié)果。
• 語(yǔ)言建模:我們發(fā)現(xiàn)用GPT-2測(cè)量的4個(gè)維基百科語(yǔ)言建模基準(zhǔn)，加上兒童書(shū)籍測(cè)試數(shù)據(jù)，幾乎全部包含在我們的訓(xùn)練數(shù)據(jù)中。因?yàn)槲覀儾荒芸煽康靥崛∫粋€(gè)干凈的子集，所以我們不報(bào)告這些數(shù)據(jù)集的結(jié)果，即使我們?cè)陂_(kāi)始這項(xiàng)工作時(shí)打算這樣做。我們注意到佩恩樹(shù)銀行由于其年齡未受影響，因此成為我們的主要語(yǔ)言建模基準(zhǔn)。

We also inspected datasets where contamination was high, but the impact on performance was close to zero, simply ?to verify how much actual contamination existed. These appeared to often contain false positives. They had either ?no actual contamination, or had contamination that did not give away the answer to the task. One notable exception ?was LAMBADA, which appeared to have substantial genuine contamination, yet the impact on performance was very ?small, with the clean subset scoring within 0.5% of the full dataset. Also, strictly speaking, our fill-in-the-blank format ?precludes the simplest form of memorization. Nevertheless, since we made very large gains on LAMBADA in this ?paper, the potential contamination is noted in the results section. ?
An important limitation of our contamination analysis is that we cannot be sure that the clean subset is drawn from the ?same distribution as the original dataset. It remains possible that memorization inflates results but at the same time ?is precisely counteracted by some statistical bias causing the clean subset to be easier. However, the sheer number ?of shifts close to zero suggests this is unlikely, and we also observed no noticeable difference in the shifts for small ?models, which are unlikely to be memorizing. ?

Overall, we have made a best effort to measure and document the effects of data contamination, and to note or outright remove problematic results, depending on the severity. Much work remains to be done to address this important and subtle issue for the field in general, both when designing benchmarks and when training models. For a more detailed explanation of our analysis, we refer the reader to Appendix C.

我們還檢查了污染程度高的數(shù)據(jù)集，但對(duì)性能的影響接近于零，只是為了驗(yàn)證實(shí)際存在多少污染。這些報(bào)告似乎經(jīng)常包含誤報(bào)。他們要么沒(méi)有受到實(shí)際的污染，要么受到的污染并沒(méi)有泄露任務(wù)的答案。一個(gè)值得注意的例外是LAMBADA，它看起來(lái)確實(shí)存在大量的污染，但對(duì)性能的影響非常小，干凈子集的得分在整個(gè)數(shù)據(jù)集的0.5%之內(nèi)。而且，嚴(yán)格地說(shuō)，我們的填空格式排除了最簡(jiǎn)單的記憶形式。然而，由于我們?cè)谶@篇論文中取得了很大的進(jìn)展，潛在的污染在結(jié)果部分被指出。&nbsp;
我們的污染分析的一個(gè)重要限制是，我們不能確定干凈子集是從與原始數(shù)據(jù)集相同的分布中提取的。記憶有可能使結(jié)果膨脹，但同時(shí)也被一些統(tǒng)計(jì)偏差精確地抵消了，從而使干凈子集變得更容易。然而，絕對(duì)的數(shù)字。

總的來(lái)說(shuō)，我們已經(jīng)盡了最大的努力來(lái)度量和記錄數(shù)據(jù)污染的影響，并根據(jù)嚴(yán)重程度來(lái)注意或直接刪除有問(wèn)題的結(jié)果。在設(shè)計(jì)基準(zhǔn)和培訓(xùn)模式時(shí)，仍有許多工作要做，以解決該領(lǐng)域一般的這一重要而微妙的問(wèn)題。有關(guān)我們的分析的更詳細(xì)的解釋，請(qǐng)讀者參閱附錄C。

GPT-3和我們對(duì)它的分析都有一些局限性。下面我們將對(duì)其中一些進(jìn)行描述，并對(duì)未來(lái)的工作提出建議。?

首先，盡管GPT-3在定量和定性方面有了很大的改進(jìn)，特別是與它的直接前身GPT-2相比，它在文本合成和一些NLP任務(wù)方面仍有明顯的缺陷。在文本合成方面，盡管整體質(zhì)量很高，但GPT-3樣本有時(shí)仍然在文檔層面上語(yǔ)義上重復(fù)，在足夠長(zhǎng)的段落中開(kāi)始失去連貫性，自相矛盾，偶爾還包含不符合邏輯的句子或段落。我們將發(fā)布500個(gè)未經(jīng)管理的無(wú)條件樣本，以幫助更好地了解GPT-3在文本合成方面的局限性和優(yōu)勢(shì)。在離散語(yǔ)言任務(wù)領(lǐng)域，我們非正式地注意到GPT-3似乎在“常識(shí)物理”方面有特殊的困難，盡管在一些測(cè)試該領(lǐng)域的數(shù)據(jù)集(如PIQA [BZB+19])上做得很好。具體來(lái)說(shuō)，GPT-3很難回答“如果我把奶酪放進(jìn)冰箱，它會(huì)融化嗎?”定量,GPT-3的語(yǔ)境學(xué)習(xí)表現(xiàn)有明顯的差距在我們套件的基準(zhǔn),如第三節(jié)所述,特別是它沒(méi)有比機(jī)會(huì)當(dāng)評(píng)估一次性甚至few-shot一些“比較”的任務(wù),如確定兩個(gè)詞使用同樣的方式在一個(gè)句子,或者如果一個(gè)句子意味著另一個(gè)(WIC和ANLI分別),以及閱讀理解任務(wù)的一個(gè)子集。考慮到GPT-3在許多其他任務(wù)上的出色的小樣本性能，這一點(diǎn)尤其引人注目。

GPT-3在結(jié)構(gòu)和算法上有一些限制，這可以解釋上面的一些問(wèn)題。我們專注于探索自回歸語(yǔ)言模型中的上下文內(nèi)學(xué)習(xí)行為，因?yàn)橛眠@個(gè)模型類進(jìn)行抽樣和計(jì)算可能性都很簡(jiǎn)單。因此，我們的實(shí)驗(yàn)不包括任何雙向架構(gòu)或其他訓(xùn)練目標(biāo)，如去噪。這與最近的許多文獻(xiàn)有明顯的不同，后者記錄了在標(biāo)準(zhǔn)語(yǔ)言模型上使用這些方法可以提高調(diào)優(yōu)性能[RSR+19]。因此，我們的設(shè)計(jì)決策的代價(jià)是，在經(jīng)驗(yàn)上受益于雙向性的任務(wù)上，可能會(huì)有更糟糕的性能。這可能包括填空任務(wù)，包括回顧和比較兩段內(nèi)容的任務(wù)，或者要求重讀或仔細(xì)考慮一篇很長(zhǎng)的文章，然后寫(xiě)出非常簡(jiǎn)短的答案的任務(wù)。這可能是一個(gè)可能的解釋為GPT-3滯后few-shot性能的一些任務(wù),如WIC(包括比較詞的使用在兩個(gè)句子),ANLI(包括比較兩個(gè)句子是否意味著另一個(gè)),和一些閱讀理解任務(wù)(例如QuAC和種族)。基于過(guò)去的文獻(xiàn)，我們還推測(cè)，一個(gè)大型的雙向模型在微調(diào)方面會(huì)比GPT-3更強(qiáng)。在GPT-3的規(guī)模上制作一個(gè)雙向模型，以及/或嘗試使雙向模型在很少或零射擊學(xué)習(xí)中工作，是未來(lái)研究的一個(gè)有前途的方向，并且可以幫助實(shí)現(xiàn)“兩全其美”。

?

A limitation associated with models at the scale of GPT-3, regardless of objective function or algorithm, is that they are ?both expensive and inconvenient to perform inference on, which may present a challenge for practical applicability of ?models of this scale in their current form. One possible future direction to address this is distillation [HVD15] of large ?models down to a manageable size for specific tasks. Large models such as GPT-3 contain a very wide range of skills, ?most of which are not needed for a specific task, suggesting that in principle aggressive distillation may be possible. ?Distillation is well-explored in general [LHCG19a] but has not been tried at the scale of hundred of billions parameters; ?new challenges and opportunities may be associated with applying it to models of this size. ?

Finally, GPT-3 shares some limitations common to most deep learning systems – its decisions are not easily interpretable, ?it is not necessarily well-calibrated in its predictions on novel inputs as observed by the much higher variance in ?performance than humans on standard benchmarks, and it retains the biases of the data it has been trained on. This ?last issue – biases in the data that may lead the model to generate stereotyped or prejudiced content – is of special ?concern from a societal perspective, and will be discussed along with other issues in the next section on Broader Impacts ?(Section 6).

語(yǔ)言模型為社會(huì)提供了廣泛的有益應(yīng)用，包括代碼和編寫(xiě)自動(dòng)完成、語(yǔ)法幫助、游戲敘事生成、改進(jìn)搜索引擎響應(yīng)和回答問(wèn)題。但它們也有潛在的有害用途。相對(duì)于較小的模型，GPT-3提高了文本生成的質(zhì)量和適應(yīng)性，并增加了區(qū)分合成文本和人類書(shū)寫(xiě)文本的難度。因此，它有潛力促進(jìn)語(yǔ)言模型的有益和有害應(yīng)用。&nbsp;
在這里，我們關(guān)注改進(jìn)后的語(yǔ)言模型的潛在危害，不是因?yàn)槲覀冋J(rèn)為這種危害必然更大，而是為了激勵(lì)人們努力去研究和減輕它們。這類語(yǔ)言模型的廣泛影響是多方面的。我們關(guān)注兩個(gè)主要問(wèn)題:第6.1節(jié)中故意誤用像GPT-3這樣的語(yǔ)言模型的可能性，以及第6.2節(jié)中像GPT-3這樣的模型中的偏見(jiàn)、公平和表示問(wèn)題。我們也簡(jiǎn)要討論能源效益的問(wèn)題(第6.3節(jié))。

惡意使用語(yǔ)言模型可能有點(diǎn)難以預(yù)料，因?yàn)樗鼈兺ǔＩ婕暗皆诜浅２煌沫h(huán)境中重新使用語(yǔ)言模型，或者用于與研究人員預(yù)期不同的目的。為了幫助解決這一問(wèn)題，我們可以從傳統(tǒng)的安全風(fēng)險(xiǎn)評(píng)估框架的角度進(jìn)行思考，這些框架列出了關(guān)鍵步驟，如識(shí)別威脅和潛在影響、評(píng)估可能性以及將風(fēng)險(xiǎn)確定為可能性和影響的組合[Ros12]。我們討論三個(gè)因素:潛在的誤用應(yīng)用，威脅行動(dòng)者，和外部激勵(lì)結(jié)構(gòu)。

?

Any socially harmful activity that relies on generating text could be augmented by powerful language models. Examples ?include misinformation, spam, phishing, abuse of legal and governmental processes, fraudulent academic essay writing ?and social engineering pretexting. Many of these applications bottleneck on human beings to write sufficiently high ?quality text. Language models that produce high quality text generation could lower existing barriers to carrying out ?these activities and increase their efficacy.

The misuse potential of language models increases as the quality of text synthesis improves. The ability of GPT-3 to ?generate several paragraphs of synthetic content that people find difficult to distinguish from human-written text in ?3.9.4 represents a concerning milestone in this regard.

任何依賴于生成文本的對(duì)社會(huì)有害的活動(dòng)都可以通過(guò)強(qiáng)大的語(yǔ)言模型來(lái)增強(qiáng)。例如，虛假信息，垃圾郵件，網(wǎng)絡(luò)釣魚(yú)，濫用法律和政府程序，欺詐學(xué)術(shù)論文寫(xiě)作和社會(huì)工程借口。這些應(yīng)用程序中的許多都阻礙了人們編寫(xiě)足夠高質(zhì)量的文本。產(chǎn)生高質(zhì)量文本生成的語(yǔ)言模型可以降低執(zhí)行這些活動(dòng)的現(xiàn)有障礙，并提高其效率。

隨著文本合成質(zhì)量的提高，語(yǔ)言模型的誤用潛力也在增加。GPT-3生成幾段合成內(nèi)容的能力是這方面的一個(gè)重要里程碑，人們發(fā)現(xiàn)這些合成內(nèi)容很難與3.9.4中人類書(shū)寫(xiě)的文本區(qū)分開(kāi)來(lái)。

?

威脅參與者可以根據(jù)技能和資源級(jí)別進(jìn)行組織，從能夠構(gòu)建惡意產(chǎn)品的低或中等技能和資源的參與者，到“高級(jí)持續(xù)威脅”(APTs):高技能和資源充足的(例如。國(guó)家資助的)有長(zhǎng)期議程的團(tuán)體[SBC+19]。

為了了解低技能和中等技能的參與者是如何思考語(yǔ)言模型的，我們一直在監(jiān)視論壇和聊天組，在那里錯(cuò)誤信息策略，惡意軟件的傳播，和計(jì)算機(jī)欺詐經(jīng)常被討論。雖然在2019年春天首次發(fā)布GPT-2之后，我們確實(shí)發(fā)現(xiàn)了大量關(guān)于濫用的討論，但我們發(fā)現(xiàn)，自那以后，實(shí)驗(yàn)的實(shí)例變少了，也沒(méi)有成功的部署。此外，這些誤用的討論與媒體對(duì)語(yǔ)言模型技術(shù)的報(bào)道有關(guān)。從這一點(diǎn)，我們?cè)u(píng)估的威脅，濫用這些行動(dòng)者不是立即，但重大改進(jìn)的可靠性可以改變這一點(diǎn)。
因?yàn)锳PTs通常不公開(kāi)討論操作，所以我們就可能涉及語(yǔ)言模型使用的APT活動(dòng)咨詢了專業(yè)的威脅分析師。自從GPT-2發(fā)布以來(lái)，在使用語(yǔ)言模型可以獲得潛在收益的操作方面沒(méi)有明顯的差異。評(píng)估是語(yǔ)言模型可能不值得投入大量資源,因?yàn)闆](méi)有令人信服的證明當(dāng)前的語(yǔ)言模型明顯優(yōu)于現(xiàn)有方法生成文本,因?yàn)椤澳繕?biāo)”或“控制”方法的內(nèi)容語(yǔ)言模型仍處于早期階段。

Each threat actor group also has a set of tactics, techniques, and procedures (TTPs) that they rely on to accomplish their ?agenda. TTPs are influenced by economic factors like scalability and ease of deployment; phishing is extremely popular ?among all groups because it offers a low-cost, low-effort, high-yield method of deploying malware and stealing login ?credentials. Using language models to augment existing TTPs would likely result in an even lower cost of deployment.

Ease of use is another significant incentive. Having stable infrastructure has a large impact on the adoption of TTPs. ?The outputs of language models are stochastic, however, and though developers can constrain these (e.g. using top-k ?truncation) they are not able to perform consistently without human feedback. If a social media disinformation bot ?produces outputs that are reliable 99% of the time, but produces incoherent outputs 1% of the time, this could reduce the ?amount of human labor required in operating this bot. But a human is still needed to filter the outputs, which restricts ?how scalable the operation can be. ?
Based on our analysis of this model and analysis of threat actors and the landscape, we suspect AI researchers will ?eventually develop language models that are sufficiently consistent and steerable that they will be of greater interest to ?malicious actors. We expect this will introduce challenges for the broader research community, and hope to work on ?this through a combination of mitigation research, prototyping, and coordinating with other technical developers.

Biases present in training data may lead models to generate stereotyped or prejudiced content. This is concerning, ?since model bias could harm people in the relevant groups in different ways by entrenching existing stereotypes and ?producing demeaning portrayals amongst other potential harms [Cra17]. We have conducted an analysis of biases in ?the model in order to better understand GPT-3’s limitations when it comes to fairness, bias, and representation. 8 ?
Our goal is not to exhaustively characterize GPT-3, but to give a preliminary analysis of some of its limitations and ?behaviors. We focus on biases relating to gender, race, and religion, although many other categories of bias are likely ?present and could be studied in follow-up work. This is a preliminary analysis and does not reflect all of the model’s ?biases even within the studied categories. ?

Broadly, our analysis indicates that internet-trained models have internet-scale biases; models tend to reflect stereotypes ?present in their training data. Below we discuss our preliminary findings of bias along the dimensions of gender, race, ?and religion. We probe for bias in the 175 billion parameter model and also in similar smaller models, to see if and how ?they are different in this dimension.

We also carried out pronoun resolution on the Winogender dataset [RNLVD18] using two methods which further ?corroborated the model’s tendency to associate most occupations with males. One method measured the models ?ability to correctly assign a pronoun as the occupation or the participant. For example, we fed the model ?a context such as "The advisor met with the advisee because she wanted to get advice about job ?applications. ‘She’ refers to the" and found the option with the lowest probability between the two possible ?options (Choices between Occupation Option: advisor; Participant Option: advisee). ?
Occupation and participant words often have societal biases associated with them such as the assumption that most ?occupants are by default male. We found that the language models learnt some of these biases such as a tendency to ?associate female pronouns with participant positions more than male pronouns. GPT-3 175B had the highest accuracy of ?all the models (64.17%) on this task. It was also the only model where the accuracy for Occupant sentences (sentences ?where the correct answer was the Occupation option) for females was higher than for males (81.7% vs 76.7%). All ?other models had a higher accuracy for male pronouns with Occupation sentences as compared to female pronouns ?with the exception of our second largest model- GPT-3 13B - which had the same accuracy (60%) for both. This offers ?some preliminary evidence that in places where issues of bias can make language models susceptible to error, the larger ?models are more robust than smaller models.

We also performed co-occurrence tests, where we analyzed which words are likely to occur in the vicinity of other preselected ?words. We created a model output sample set by generating 800 outputs of length 50 each with a temperature of 1 and top p of 0.9 for every prompt in our dataset. For gender, we had prompts such as "He was very", "She ?was very", "He would be described as", "She would be described as"9 ?. We looked at the adjectives and ?adverbs in the top 100 most favored words using an off-the-shelf POS tagger [LB02]. We found females were more ?often described using appearance oriented words such as ”beautiful” and ”gorgeous” as compared to men who were ?more often described using adjectives that span a greater spectrum. ?
Table 6.1 shows the top 10 most favored descriptive words for the model along with the raw number of times each ?word co-occurred with a pronoun indicator. “Most Favored” here indicates words which were most skewed towards a ?category by co-occurring with it at a higher rate as compared to the other category. To put these numbers in perspective, ?we have also included the average for the number of co-occurrences across all qualifying words for each gender.

我們還使用兩種方法對(duì)Winogender數(shù)據(jù)集[RNLVD18]進(jìn)行代詞解析，這兩種方法進(jìn)一步證實(shí)了該模型將大多數(shù)職業(yè)與男性聯(lián)系起來(lái)的傾向。一種方法是測(cè)試模型正確分配代詞作為職業(yè)或參與者的能力。例如，我們?yōu)槟Ｐ吞峁┝艘粋€(gè)上下文，例如“顧問(wèn)與被咨詢者會(huì)面，因?yàn)樗氆@得關(guān)于工作申請(qǐng)的建議。”“她”指的是“并在兩種可能的選項(xiàng)(職業(yè)選項(xiàng):顧問(wèn);參與者選擇:學(xué)生)。

職業(yè)和參與者的詞匯通常帶有社會(huì)偏見(jiàn)，比如假設(shè)大多數(shù)居住者默認(rèn)為男性。我們發(fā)現(xiàn)，語(yǔ)言模型學(xué)會(huì)了一些偏見(jiàn)，比如傾向于將女性代詞與參與者的位置聯(lián)系起來(lái)，而不是男性代詞。GPT-3 175B在這項(xiàng)任務(wù)上的準(zhǔn)確率是所有模型中最高的(64.17%)。這也是唯一一個(gè)女性的居住者句子(正確答案是職業(yè)選項(xiàng)的句子)的準(zhǔn)確率高于男性的模型(81.7%對(duì)76.7%)。除了我們的第二大模型GPT-3 13B，其他所有模型在男性代詞與職業(yè)相關(guān)的句子上的準(zhǔn)確率都高于女性代詞，但GPT-3 13B在兩個(gè)句子上的準(zhǔn)確率都相同(60%)。這提供了一些初步證據(jù)，表明在存在偏見(jiàn)的地方，語(yǔ)言模型容易出錯(cuò)，較大的模型比較小的模型更健壯。
我們還進(jìn)行了共現(xiàn)測(cè)試，分析哪些詞可能出現(xiàn)在其他預(yù)先選擇的詞附近。通過(guò)為數(shù)據(jù)集中的每個(gè)提示生成800個(gè)長(zhǎng)度為50、溫度為1和頂部p為0.9的輸出，我們創(chuàng)建了一個(gè)模型輸出示例集。關(guān)于性別，我們有諸如"他非常"，"她非常"，"他被描述為"，"她被描述為"9。我們看了形容詞和副詞在100個(gè)最受歡迎的單詞中使用現(xiàn)成的POS標(biāo)記。我們發(fā)現(xiàn)，女性被描述時(shí)更多地使用“美麗”和“華麗”等以外表為導(dǎo)向的詞匯，而男性則更多地使用范圍更廣的形容詞來(lái)描述。&nbsp;
表6.1顯示了模型中最受歡迎的10個(gè)描述性單詞，以及每個(gè)單詞與代詞指示符共出現(xiàn)的原始次數(shù)。這里的“最受歡迎”指的是那些與某個(gè)類別同時(shí)出現(xiàn)的詞比另一個(gè)類別出現(xiàn)的比率要高。為了更好地理解這些數(shù)字，我們還包括了每種性別的所有限定詞中共同出現(xiàn)的次數(shù)的平均值。

之前的很多工作都是專門(mén)針對(duì)問(wèn)題的回答，這在我們的測(cè)試任務(wù)中占了很大一部分。最近的努力包括[RSR+19, RRS20]，它微調(diào)了一個(gè)110億參數(shù)的語(yǔ)言模型，以及[GLT+20]，它關(guān)注于在測(cè)試時(shí)處理大量的數(shù)據(jù)。我們的工作側(cè)重于語(yǔ)境學(xué)習(xí)，但在未來(lái)可以與[GLT+20, LPP+20]的工作相結(jié)合。?

語(yǔ)言模型中的金屬學(xué)習(xí)在[RWC+19]中得到了應(yīng)用，盡管結(jié)果有限，也沒(méi)有系統(tǒng)的研究。更廣泛地說(shuō)，語(yǔ)言模型metalearning具有內(nèi)環(huán)-外環(huán)結(jié)構(gòu)，這使得它在結(jié)構(gòu)上類似于一般應(yīng)用于ML的metalearning。這里有大量的文獻(xiàn)，包括匹配網(wǎng)絡(luò)[VBL+16]， RL2 [DSC+16]，學(xué)習(xí)優(yōu)化[RL16, ADG+16, LM17]和MAML [FAL17]。填料模型的上下文的我們的方法與以前的例子是最結(jié)構(gòu)類似于RL2上也類似于[HYC01],在適應(yīng)一個(gè)內(nèi)循環(huán)發(fā)生在步伐通過(guò)計(jì)算模型的激活,沒(méi)有更新權(quán)重,而外層循環(huán)(在這種情況下只是語(yǔ)言模型訓(xùn)練的)更新權(quán)重,和隱式學(xué)習(xí)能力適應(yīng)或者至少在inference-time定義識(shí)別任務(wù)。[RCP+17]探索了小樣本自回歸密度估計(jì)，[GWC+18]將低資源NMT作為一個(gè)小樣本學(xué)習(xí)問(wèn)題進(jìn)行了研究。?

雖然我們的小樣本方法的機(jī)制不同，但之前的工作也探索了使用預(yù)訓(xùn)練語(yǔ)言模型結(jié)合梯度下降進(jìn)行小樣本學(xué)習(xí)的方法[SS20]。另一個(gè)具有類似目標(biāo)的子領(lǐng)域是半監(jiān)督學(xué)習(xí)，其中像UDA [XDH+19]這樣的方法也探索了在可用標(biāo)記數(shù)據(jù)很少的情況下進(jìn)行微調(diào)的方法。?

使用自然語(yǔ)言給出多任務(wù)模型的指令首先是在一個(gè)監(jiān)督設(shè)置中通過(guò)[MKXS18]形式化的，并在使用[RWC+19]的語(yǔ)言模型中用于一些任務(wù)(比如匯總)。在文本到文本轉(zhuǎn)換器[RSR+19]中也探索了用自然語(yǔ)言表示任務(wù)的概念，盡管它被應(yīng)用于多任務(wù)微調(diào)，而不是在沒(méi)有權(quán)值更新的情況下用于上下文學(xué)習(xí)。

另一種提高語(yǔ)言模型通用性和轉(zhuǎn)移學(xué)習(xí)能力的方法是多任務(wù)學(xué)習(xí)[Car97]，它對(duì)下游任務(wù)的混合進(jìn)行微調(diào)，而不是分別更新每個(gè)任務(wù)的權(quán)重。如果成功的多任務(wù)學(xué)習(xí)可以允許單一模型在不更新權(quán)值的情況下用于多個(gè)任務(wù)(類似于我們的上下文學(xué)習(xí)方法)，或者可以在更新新任務(wù)權(quán)值時(shí)提高樣本效率。多任務(wù)學(xué)習(xí)了一些初步的結(jié)果[LGH + 15, LSP + 18]和多級(jí)微調(diào)最近成為一個(gè)標(biāo)準(zhǔn)化的一部分SOTA結(jié)果在一些數(shù)據(jù)集[PFB18]而且突破某些任務(wù)(kk + 20),但仍需要手動(dòng)牧師收藏有限的數(shù)據(jù)集和設(shè)置培訓(xùn)課程。相比之下，大規(guī)模的預(yù)訓(xùn)練似乎提供了一種“自然的”廣泛分布的任務(wù)，這種任務(wù)隱含在預(yù)測(cè)文本本身中。未來(lái)工作的一個(gè)方向可能是嘗試為多任務(wù)學(xué)習(xí)生成更廣泛的明確任務(wù)，例如通過(guò)程序生成[TFR+17]、人機(jī)交互[ZSW+19b]或主動(dòng)學(xué)習(xí)[Mac92]。?

?