1951年 “你不能制造一台机器替你思考”,这似乎是一个习以为常的说法,没有人想到要去质疑它。而本文的目的,就是要对它提出质疑。用图灵在广播的直播来开篇。有故事性。
‘You cannot make a machine to think for you.’ This is a commonplace that is usually accepted without question. It will be the purpose of this paper to question it.
图灵的故事,图灵奖,讲一讲,但不要这么啰嗦。
Turing was fascinated by machine capabilities throughout his career. In 1936 he made a fundamental contribution to the question of what it means for something to be “computable.” Kurt Gödel and Alonzo Church had recently tackled the question of how to define the set of computable functions, meaning the set of functions whose values can be calculated by an algorithm. Turing developed the most powerful way of thinking about this question. He imagined an abstract computer, now called a Turing machine, that can carry out computations according to the inputs specified on a possibly infinite tape—for example, instructions to implement basic mathematical operations. He then defined a function to be computable if such a machine could compute its values. A machine is said to be a universal Turing machine if it can compute any number that can be calculated by any Turing machine. Notably, if the human mind is in essence a very sophisticated computer and the tasks that it performs are within the class of computable functions, then a universal Turing machine could replicate all human capabilities. Before World War II, however, Turing did not venture into the question of whether machines could really think and how far they could go in performing human tasks. During the war, Turing joined the top-secret Bletchley Park research facility, where mathematicians and other experts worked to understand encrypted German radio messages. He devised a clever algorithm—and designed a machine—to speed up the breaking of enemy ciphers. This then helped British intelligence to quickly decipher encrypted communications that the Germans had presumed to be unbreakable. After Bletchley, Turing took the next step in his prewar work on computation. In 1947 he declared to a meeting of the London Mathematical Society that machines could be intelligent. Undeterred by the hostile reactions of participants, Turing continued to work on the problem. In 1951 he wrote: “‘You cannot make a machine think for you.’ This is a commonplace that is usually accepted without question. It will be the purpose of this paper to question it.” His seminal 1950 paper, “Computing Machinery and Intelligence,” defines one notion of what it means for a machine to be intelligent. Turing imagined an “imitation game” (now called a Turing test) in which an evaluator engages in a conversation with two entities, one human and one machine. By asking a series of questions communicated via a computer keyboard and screen, the evaluator attempts to tell which one is which. A machine is intelligent if it can evade detection. No machine is currently intelligent according to this definition, but one could turn it into a less categorical ranking of machine intelligence. The better a machine can imitate humans, the more intelligent it is. To make this operational, one can define the notion of “human parity” at a task, which would be achieved if a machine can perform that task at least as well as humans. Then, the more tasks a machine can reach human parity in, the more intelligent it is. Turing’s own thoughts on this subject were subtler. He understood that passing this test might not mean true thinking capacity: “I do not wish to give the impression that I think there is no mystery about consciousness. There is, for instance, something of a paradox connected with any attempt to localise it.” Despite this reservation, the modern field of AI followed in Turing’s footsteps and focused on artificial intelligence, defined as machines acting autonomously, reaching human parity, and subsequently outperforming humans.
1950年,首次提出,机器能思考吗?
I propose to consider the question, “Can machines think?” This should begin with definitions of the meaning of the terms “machine” and “think.” The definitions might be framed so as to reflect so far as possible the normal use of the words, but this attitude is dangerous, If the meaning of the words “machine” and “think” are to be found by examining how they are commonly used it is difficult to escape the conclusion that the meaning and the answer to the question, “Can machines think?” is to be sought in a
statistical survey such as a Gallup poll. But this is absurd. Instead of attempting such a definition I shall replace the question by another, which is closely related to it and is expressed in relatively unambiguous words.
AI的使用会自我强化那些从AI中受益的人,这些人也会获得更多的政治影响力,参与法律的制定。
that the use of AI can set up self-reinforcing dynamics in which those who benefit economically can gain political influence and power at the expense of wider democratic participation.
技术本身并无好坏之分,我们可以掌控它。技术我们不能阻止新技术的产生和发展,我们可以塑造它,引导其发展方向,从中获得更好的结果。
“We need these discussions,” Johnson says. “There’s nothing inherent in technology. It’s within our control. Even if you think we can’t say no to new technology, you can channel it, and get better outcomes from it, if you talk about it.”
IMF的工作论文,“任务暴露度”(task exposures),即每个职业中可以被人工智能自主完成的任务所占比例。研究发现,白领高技能工人面临的暴露度最高。
With an eye to identifying these groups, the economic literature has concentrated on the computation of “task exposures,” the share of tasks that AI might carry out autonomously in each job, finding that white-collar high-skilled workers are most exposed. Part of the literature adopts a view of AI as an automation technology—a technology that replaces workers, like industrial robots. In this view, occupations with high task exposure will face higher displacement, and exposed workers will see reduced employment opportunities and wages. Another strand of the literature instead tries to assess the actual consequences of such exposure, finding that AI may augment workers in exposed occupations. We close this section with a description of policy options to cope with potential worker displacement that research has proposed.
https://www.imf.org/-/media/files/publications/wp/2024/english/wpiea2024199-print-pdf.pdf
Hinton,AGI 5-20年实现。sam altman 5年实现。 AGI会对经济和社会带来转变,带来机会和危险。非常彻底的改变短期内。
1939年,爱因斯坦给罗斯福总统的信,警告核能可以被用来制造核武器,进入了核时代。卢瑟福1933年,moonshine,痴人说梦。我们面临很大不确定性。AI却不断扩张。
The rapid progress over the past few years has compressed the timelines for achieving AGI. In the 2010s, the median estimate of AI researchers for when AGI would be reached was in the second half of the 21st century (Grace et al., 2018). More recently, a growing number of AI researchers and industry leaders have offered much shorter timelines. Geoffrey Hinton, one of the three “godfathers of deep learning” who won the Turing award for their contributions to the field, proclaimed that “[he had] suddenly switched [his] views on whether these things are going to be more intelligent than us” and expects AGI to be reached in “5 to 20 years but without much confidence [since] we live in very uncertain times” (Hinton, 2023). Likewise, Sam Altman, CEO of OpenAI, stated that “AGI will be a reality in 5 years, give or take” in early 2024. These predictions are also in line with the expectations of the general public (Pauketat et al., 2023). AGI would be transformative for our economy and society, creating both opportunities and risks of unprecedented scope. This has led to a growing sense of alarm among technology experts who see potentially radical changes occurring within a short period. They see the exponential growth of AI and associated scaling laws and wonder why the world is not more alarmed. Geoffrey Hinton’s warnings are akin to Albert Einstein’s letter to US President Franklin Delano Roosevelt, in which he warned of the possibility that nuclear power could be harnessed for atomic weapons, giving rise to the nuclear age. There was significant uncertainty about how realistic the predictions of Einstein and other experts were at the time, and how soon their predictions would be realized. In 1933, Ernest Rutherford called the notion that nuclear power could ever be harnessed “moonshine.” We are facing similar uncertainty today, but the scaling of AI is nonetheless proceeding relentlessly.
从某种程度上来说,AI的改变社会和权力结构的能量和原子核能的力量一样大,当我们问AI是否能让我们生活变好,我们可以从“核能是否能让我们生活变好”的疑问获取一些答案。人类面对重大自然力量面前总是表现得不是很理性,先是核弹,又是核武器竞赛。
人们认识核能的威力,是从小男孩释放的蘑菇云开始的。人们利用核能,第一件事,是用来做武器。冷战,核武器足够摧毁地球100次。朝鲜半岛和中东态势,都有核能的影子。中国的核能占发电量多少?
就像开发核能,我们做的第一件事,是用于战争一样。即便那些科技开发者,创造AI初衷是为了人类更美好的未来,但企业采用部署AI,只有最简单的驱动力,就是降低劳动成本。
AI广泛应用造成最主要的经济问题就是收入分配的问题。AI是否会让我们生活变化,如果仅仅对这个问题,回答是和否,那就对作者本人太容易的目标了。我不仅需要回答结果,还要回答AI怎么会让我生活变化,或者如何会让我们生活变差。这是本书尝试讨论的问题。
“We believe that the primary economic challenge posed by the proliferation of AI will be one of income distribution. We economists set ourselves too easy a goal if we just say that technological progress can make everybody better off – we also have to say how we can make this happen. The following paper is an attempt to do so by discussing some of the key economic research issues that this brings up.”
凯恩斯在1930很有远见地预测到整个20世纪人均收入稳步增加,但是没能预测到广泛地技术性失业,当机器替代人类劳动力。
Keynes famously foresaw the steady increase in per capita income during the twentieth century from the introduction of new technologies, but incorrectly predicted that this would create widespread technological unemployment as machines replaced human labor (Keynes 1930).
Hinton在一次采访中说,对社会对冲击,很明显,很多工作会消失。AI是否能创造出更多工作还不清楚。这不是AI的问题。这是政治系统的问题。如果生产力大幅提高,这财富怎么分配呢?至少在美国,我们并没有完美的政府。有一点是肯定的,马斯克会变得更加富有。
Geoff Hinton:
Nobody—I think 20 years in the future—nobody’s got a clue what the impact of this is going to be. The impact on society in particular, because it’s clear that a lot of jobs are going to disappear. It’s not clear that it’s going to create jobs to replace them. This isn’t AI’s problem. This is our political systems’ problem. If you get a massive increase in productivity, how does that wealth get shared around? And we don’t—at least in the United States—you don’t at present have the ideal government for that.
Jeff Dean:
Yeah. I mean, I actually got together with a bunch of great co-authors last year and looked at what might the impact of AI be on a bunch of different areas—some of which it clearly could have amazing impact, like healthcare, education, being able to create new kinds of media. But we also looked at the potential impact on employment, misinformation, geopolitical issues. And I think there’s a whole balance of these things.
One of the areas I’m most excited about is how could we make scientific breakthroughs happen faster by making connections between disparate fields that in any one person’s head may not really necessarily realize this other thing is important in some completely different field, or automating the loop for scientific discovery for some fields where that’s possible.
Geoff Hinton:
Let me take off on that. One thing these big models have is they’re compressing a huge amount of knowledge into not many connections—only a trillion. And we know that to compress lots of knowledge, you have to find what’s common to apparently different bits of knowledge. So I believe that when you’re training these big models, they’re already finding commonalities between things where people haven’t ever seen the commonalities. They know much more than any one person. They’re probably finding commonalities between things in Greek literature and things in quantum [mechanics]…
李飞飞所说,AI增强我们的专业技能,加速人们的发现,放大对人们的关怀,而不是替换判断,创造,同情心。
Across all these domains, the possibilities are boundless, but the goal remains constant: AI that augments human expertise, accelerates human discovery, and amplifies human care—not replacing the judgment, creativity, and empathy that are central for being humans.
李开复的对AI的论断,应该写上,“像大部分科技一样,AI最终将产生对社会的影响,正面会多于负面。”
Supposedly, we will all be the beneficiaries of these spectacular new capabilities. The current CEOs of Amazon, Facebook, Google, and Microsoft have all claimed that AI will beneficially transform technology in the next decades. As Kai-Fu Lee, former president of Google China, puts it, “And like most technologies, AI will eventually produce more positive than negative impacts on our society.”
美国一项调查,选择AI最有可能带来的风险,接近一半的人选择 会增加失业,排名第二的是危险的军事机器人。
2023年的一项调查显示,73%受访者感觉,能思考的机器会伤害就业和经济。
一小部分人担心他们的工作被AI替代,北美大部分人不认为AI会在下一年替代他们。
AI产品和服务有更多的好处,比坏处多。中国相对比较乐观。
The two potential risks from advanced AI chosen as the most important by both the US and UK public from a list of seven were increasing unemployment (US: 44%, UK: 49%) and the creation of more dangerous military robots (US: 34%, UK: 39%). Significantly increasing electricity consumption (US: 15%, UK: 16%) and increasing economic inequality (US: 22%, UK: 25%) were chosen the least often (Public First, 2023a, 2023b).
Unemployment across society People are generally worried that AI will increase unemployment but this does not yet appear to be an overwhelming concern for the public.
In January 2023, 73% of US adults surveyed felt that machines with the ability to think for themselves would hurt jobs and the economy, largely unchanged since April 2015 (72%) (Monmouth University Poll, 2023).
In the same poll, the increase in unemployment was the top risk chosen by 49% of UK adults when asked to choose the greatest risk from advanced AI from a selection of seven (ahead of worries about more dangerous military robots, chosen by 39%). A similar pattern was observed in the US, with 44% of adults choosing the risk of increasing unemployment, again the top concern ahead of military robots (34%) (Public First, 2023a, 2023b).
Personal automation concern There is a non-negligible concerned minority in most countries that worry about their own jobs being replaced by AI, but the majority of people in North America and Europe do not think AI will replace them in the next years.
For example, in May 2023, 64% of UK adults thought that more jobs will be lost to automation by robotics/AI than will be created. Only 7% thought more jobs would be created, and 12% thought it would be about the same. Despite this, only 14% were very/fairly worried about the impact that robotics/AI would have on their current job, and only 22% about its impact on their future career, perhaps because a majority (59%) also thought that their job would primarily still be done by humans in the next 30 years (YouGov, 2023a).
The percentage who agree that AI products and services have more benefits than drawbacks is substantially higher in China (78%) and India (71%) than in the United States (35%) and Great Britain (38%). There are substantial other cross-country differences across the questions asked on the survey (Ipsos, 2022b).
AI,像其他革命性的技术一样,双刃剑,可能带来明显的进步,也可能带来负面的后果。广泛的技术应用,商业利益是主导的因素。企业考虑的就是利润。当前的市场机制,能否应对AI带来的变革,是一个开放性的问题。
Artificial Intelligence (AI), like any transformative technology, has the potential to be a double-edged sword, leading either toward significant advancements or detrimental outcomes for society as a whole. As is often the case when it comes to widely-used technologies in market economies (e.g., cars and semiconductor chips), commercial interest tends to be the predominant guiding factor. The AI community is at risk of becoming polarized to either take a laissez-faire attitude toward AI development, or to call for government overregulation.
我们还处在实用性AI的早起阶段,从业者,政策制定者,以及相关人,专注努力,才能AI带来正面影响最大化,负面影响最小化。
Our view is that we are still in the early days of practical AI, and that focused efforts by practitioners, policymakers, and other stakeholders can still maximize the upsides of AI and minimize its downsides.
最好假设AI进程会继续并加快,而不是变缓。AI对社会的影响将是巨大的。
We think the best bet going forward is to assume AI progress will continue or speed up, and not slow down. AI’s impact on society will be profound.
AI如果能当科学家的助手,帮助科学家在专业领域实现重大突破,癌症,可控核聚变,基因科学,宇宙,黑洞、星际航行,帮助人类实现科学发现和突破。那么AI将使我们过得更好。
如果AI不能做科学家的工作,只能做出租车司机的工作,清洁工的工作,流水线工人的工作,办公室流程性工作,那么即使提高人们的工作效率,可能不会让我们过得更好。这有点反直觉,但却是事实。
AI Milestone: AI Scientific Breakthroughs for the UN Sustainable Development Goals (SDGs). To encourage the greater use of AI systems in science and to help acknowledge the potential of AI systems to benefit humanity, this milestone is for an important scientific breakthrough using AI that helps with one or more of the UN SDGs. AI Milestone: Scientist’s AI Aide/Collaborator. John Jumper pointed out that one way to accelerate the pace of science is to improve the productivity of scientists. It’s easy to imagine a GenAI aide that helps with grant writing and progress reports, which can be tedious. Another task would be to identify important new publications of interest to the scientist, ideally customized to the individual to summarize what is new compared to what the scientist already knew. A more powerful AI system like the one Amodei envisions would go beyond what a Scientist’s Aide could do. To keep the human involved to ensure safety and affordability, we pose this advance as a “scientist’s AI collaborator.”
对教育和医疗、健康的需求弹性是很大的。这些行业如果AI能帮助提升效率,不太好影响老师的职业,这些行业的效率提升,有很大的正外部性。会让大家都过得更好。青少年受到更好的教育,所有人做到更好的健康管理。
但是,AI对行业的渗透率,取决于AI的能力以及AI能带来的利润增加或者成本减少。我们不能主观希望,AI的能力只应用于特定领域。
From an employment perspective, we believe that education is elastic, as there is a huge demand for improving the effectiveness and efficiency of learning. Indeed, the U.S. and many other highincome nations face a shortage of K-12 teachers, as well as STEM graduates who could teach those topics in K-12 schools.
Today’s AI tutors such as CK-12 and Khanmigo likely already help some students. A major educational challenge in the U.S. is that K-12 students in high-poverty schools do much worse on standardized tests compared to students in other countries or to U.S. students from low-poverty schools. Selective use of AI tools might track socioeconomic status, which inadvertently could expand the educational gap between students at high-poverty schools versus low-poverty schools.
医疗也是需求弹性极大的行业。
The next topic is healthcare, responsible for 16% of the U.S. GDP [Vankar]. Like education, many believe that society should offer high-quality healthcare regardless of the wealth of individuals [Einav and Finkelstein].
We believe that healthcare is also elastic: demand for healthcare will increase more than proportionately as the cost and quality of provided healthcare improves [Baumol]. Indeed, the U.S. and many other countries are facing a shortage of healthcare professionals. Beyond improving the employment prospects of healthcare workers via productivity gains, these tools must also keep healthcare professionals in the decision path for actual recommendations for patient therapy, as AI systems are not guaranteed to make the best recommendation 100% of the time. Since people and AI systems tend to make different mistakes, the collaboration of experts with AI systems might help the quality of healthcare.
宽泛地讲,技术发展总是将我们引入未知之地。一个创新越是根本的,越是能带来更多的未知,越是更困难应对。然而,对于大部分创新,我们大约知道,哪些要素会获益,哪些要素会受损。我们可能引导技术创新的路径。
More generally, technological progress is by definition always a step into the unknown. The more fundamental an innovation, the more unknowns there will be in practice, and the more difficult it will be to apply the proposed policies. Nonetheless, for a great deal of innovative activity, we do have a sense of which factors will benefit and which factors will be hurt. Even if policymakers cannot ascertain this, innovators might be able to. And it may also be possible to guide innovation by committing to implement some of the proposed policies with ex-post measures that are taken once the impact of an innovation is clear.
如果用投硬币来预测AI让我门过的更好的概率,那么过的更好的概率就是投掷一枚硬币,既不是正面,也不是反面,而是硬币竖起来的概率。
过去的冲击都是局部的,这次AI冲击涉及到各个行业。非常具有挑战性。
“what are the economic prospects for most existing humans in such a world? New technologies often bring labor market shocks, and in the past humans have always recovered from them, but I am concerned that this is because these previous shocks affected only a small fraction of the full possible range of human abilities, leaving room for humans to expand to new tasks. AI will have effects that are much broader and occur much faster, and therefore I worry it will be much more challenging to make things work out well.”
马尔萨斯提出人口增长,会导致战争,灾难。 马尔萨斯的预言没有成真,不是因为他的推论是错的,而是人们努力避免了他所描述的悲惨现实。
马尔萨斯名声不大好,一方面鼓吹人口过多带来的危害,一方面自己生五六个孩子。
人口将以1,2,4,8,16,这种方式增长,食物和生活必须维持生计的, 1,2,3,4,5这种方式,存在着必然的矛盾。
Taking the population of the world at any number, a thousand millions, for instance, the human species would increase in the ratio of—1, 2, 4, 8, 16, 32, 64, 128, 256, 512, &c. and subsistence as—1, 2, 3, 4, 5, 6, 7, 8, 9, 10, &c. In two centuries and a quarter, the population would be to the means of subsistence as 512 to 10: in three centuries as 4096 to 13; and in two thousand years the difference would be almost incalculabel, though the produce in that time would have increased to an immense extent.
食物是生存必须,性冲动是必须和长期存在,无法抑制。用孔夫子的话来讲,食色,性也。
First, That food is necessary to the existence of man. Secondly, That the passion between the sexes is necessary and will remain nearly in its present state.
马尔萨斯担心,如果不加限制,人口将以几何指数增长。维持生计的东西,只能线性增长。稍有数学知识的人,都知道指数增长的威力。根据自然法则,食物是人类所必须的,两股不平衡的力量最终必须匹配。
Population, when unchecked, increases in a geometrical ratio. Subsistence increases only in an arithmetical ratio. A slight acquaintance with numbers will shew the immensity of the first power in comparison of the second. By that law of our nature which makes food necessary to the life of man, the effects of these two unequal powers must be kept equal.
马尔萨斯理论很简单:人口如果任由其发展,将呈几何指数增长,而维持生计的东西仅能线性增长。 人口增长过快,人均食物摄入大大减少,又陷入贫困。 这个定理很简单,似乎很难找到其逻辑错误。但从马尔萨斯发布这篇论文以来,200多年来,人们似乎没有在饥饿的边缘挣扎,出来少数战争动乱地区外,其他人生活都过得更好了。
问题出在其假定上,人们主动有意识控制了人口大爆炸,节育,中国的计划生育,这降低了指数速率。另一方面,生活必须品,似乎不仅仅是线性。技术等发展,使得食品工业化,粮食产品攀升。最终使两个不平衡的力量最终平衡。
“Thomas Malthus’ Essay on the Principle of Population (1798) has an oft-quoted statement that neatly summarizes his theory: “Population, when unchecked, increases in a geometrical ratio. Subsistence increases only in an arithmetical ratio.”
The basic idea is that population grows exponentially, but the growth of a society’s means of subsistence is only linear. Linear growth in food supply cannot make up for the skyrocketing needs of an exponentially growing population. Conversely, exponential growth of population outpaces the linear increase of subsistence.
As population grows faster than subsistence, food intake per capita shrinks inexorably. At some point, population growth runs against the hard limit posed by minimum food intake per capita—with tragic results.
“Malthus was aware that population can temporarily exceed its long-term limits. For example, there can be good harvests for twenty or thirty years. In that case, population levels may exceed the longterm subsistence base. Malthus cautioned, however, that this can happen only for so long. The longer such overshoot lasts, the greater the overpopulation. With growing overpopulation, the famine bound to occur after a bad harvest will then be even more devastating. If the famine is not sufficient to decimate population to a viable level, then other calamities such as war and pandemics may do so. A combination of famine, war, pandemics, and deviant behaviour (“vice and misery”) will decimate population to a level consistent with the means of subsistence, until the cycle starts anew.”
“Logically speaking, the solution to the Malthusian problem is closing the gap between exponential growth in population and linear growth in subsistence. This can happen either through “vice and misery” or through a managed solution. One way of achieving a managed solution is to constrain”
Another way is exponential growth in the means of subsistence.
Malthus called for the former and discarded the latter, but modernity has shown that it is possible, at least temporarily, to increase agricultural yields at a pace exceeding population growth.
As it seems, however, most of history has neither followed classical Malthusian nor modern cornucopian patterns. Instead, the most common way of dealing with the problem of overpopulation has been to shift the problem to subalterns and/or outsiders.
By moral restraint, Malthus intended the control of reproductive behaviour in ways acceptable to him as a Protestant Christian.
Married couples should engage in sexual moderation to curtail the number of their offspring, and non-married people should renounce sexual intercourse altogether.
新马尔萨斯陷阱和马尔萨斯在人口论提出的有同样的结构。做了更为抽象的概括。一个函数的增长超过了另一个函数,两股力量,如果差异太大,就会导致平衡的破坏。 比如说环境,气候,能源消耗,温室气体排放超过了气候的承载能力。工业化石能源消耗等。
智能陷阱是另一种形式的马尔萨斯陷阱。AI创造就业岗位,超过了它消灭的岗位。这回导致很大的问题。
Neo-Malthusian traps are problems that have the same logical structure as the classical Malthusian trap. One function (f1) outpaces and strains another function (f2). The system has some inertia built into it, enabling temporary overshoot. Given the inexorable decline of the second function, however, overshoot leads to significant systemic disruptions, ultimately constraining the first function, and thus bringing the system back to equilibrium—but only after a devastating crisis
“In the classical version of the Malthusian trap, discussed in Section 2, population growth outpaces and strains the means of subsistence. Demographic inertia leads to overpopulation. Given the declining means of subsistence, overpopulation leads to what Malthus called “vice and misery,” constraining and disrupting population growth and thus bringing the system back to equilibrium, but only after a dreadful period of famine, war, pestilence, moral decay, and so on.”
Environmental neo-Malthusianism. According to ecological footprint analysis, overshoot results from society’s environmental impact outpacing and straining ecosystem services, leading to environmental degradation and thus undermining the Earth’s regenerative capacity.37 Unless society finds a way to reduce its impact deliberately to whatever ecosystem services are able to replenish, this is bound to lead to Malthusian calamities that are difficult to fathom and will force humanity’s environmental impact back to sustainable levels.38 • Climate-based neo-Malthusianism. When greenhouse gas emissions outpace the ability of the climate system to absorb them, climate change may cause serious trouble to human civilization, which appears ill-prepared for more than 2 °C of global warming. Especially when accompanied by positive reinforcements after possible tipping points,39 human misery may ultimately force a reduction of climate stresses but the climatic perturbation may last for centuries and the social and political consequences are bound to be catastrophic.40 • Energy-based neo-Malthusianism. Given the heavy dependence of industrial society on energy, fossil fuel depletion may lead to a decline, or even reversal, of economic growth. Insofar as industrial civilization needs economic growth to be sustainable, some authors argue that fossil fuel depletion may trigger the demise of prevailing social and economic models, forcing a new equilibrium at lower levels of energy throughput. It may be possible to reach such an equilibrium in the long term, but only after a long emergency.41
马尔萨斯,本质上,人口和技术的交互作用。智能陷阱,属于同样的范畴。人口和技术。
“The reinforcing interaction between technological progress and the size and composition of the population operated persistently throughout history, gradually gaining momentum. Nevertheless, for most of human history, this interaction had a largely negligible long-term impact on income per capita. Eventually, however, as the pace of technological advancement accelerated beyond a critical threshold, education became essential for navigating the rapidly evolving technological landscape, prompting parents to allocate some of their limited resources to their children’s education. Although technological progress increased parental income, enabling a surge in fertility and population growth,8 the allocation of resources toward children’s human capital caused population growth to lag behind technological progress, fueling the onset of economic growth.”
技术进步引发食品增加,人口快速增加,吃掉新增的产出,陷入贫困和饥饿。技术进步只能短期的生活水平提升。
自我强化的反馈循环人口和技术,从人类诞生之初就存在,伴随着人类的历史。
马尔萨斯陷阱,就是人口和技术的交互。 智能陷阱,也是人口和技术的交互。
Throughout most of human history, the development process was dominated by Malthusian dynamics. Technological progress and land expansion fueled rising birth rates and declining mortality rates, ultimately leading to proportional increases in both population and resources. Variations in technological progress and land productivity across societies contributed to differences in population densities but had only short-term effects on living standards.6 Yet, larger populations were more likely to give rise to ingenious individuals capable of developing new tools, goods, and practices (Simon 1977; Kremer,1993; Galor 2022), while also generating a greater demand for these innovations (Boserup 1965). Moreover, sizable societies benefited from increased specialization and cross-fertilization, facilitating the rapid dissemination of new technologies. This self-reinforcing feedback loop between population and technology emerged at the dawn of humanity and persisted over most of human history. Technological advances enabled larger populations to be sustained, while increasing population size spurred faster innovations. Nevertheless, during the Malthusian epoch, technological progress was ultimately counterbalanced by population growth, leaving income per capita hovering near the subsistence level in the long run. Just a few centuries ago, human life was often “nasty, brutish, and short” (Hobbes 1651). One in four newborns succumbed to cold, hunger, or illness before reaching their first birthday. Women frequently died during childbirth, and life expectancy rarely surpassed forty years. Most people subsisted on meager, monotonous diets and lived in a state of widespread illiteracy. Amid these grim realities, perhaps even more startlingly, economic crises did not merely demand austeritythey often triggered widespread starvation and societal collapse. Remarkably, most people endured conditions more akin to those of their distant ancestors millennia earlier than to those of their modern descendants. The living conditions of a fifteenthcentury English farmer were strikingly similar to those of a medieval Chinese serf or a Mayan peasant. Similarly, they closely resembled those of an ancient Greek herder, an Egyptian farmer, or even a shepherd in Jericho at the dawn of the Neolithic Revolution.
AI是自动化的延续。19世纪末和20世纪初的自动化了人们的体力劳动。信息技术的进步自动化了数据处理。然而,这些自动化仍然给人们留下了很多工作机会。
“The introduction of artificial intelligence (AI) is the continuation of a long process of automation. Advances in mechanization in the late‐nineteenth and early‐twentieth century automated much of the physical labor performed by humans. Advances in information technology in the mid‐ to late‐twentieth century automated much of the standardized data processing that used to be performed by humans. However, each of these past episodes of automation left large areas of work that could only be performed by humans.”
智能陷阱和马尔萨斯陷阱,共同之处有两点:一方面都是关于人,另一方面,陷阱,需要尽力才能避免。 马尔萨斯人主动增长,智能陷阱人被动冗余。
AI的浪潮,同样存在着极大的隐患,技术发展的路上,存在着陷阱。如果少有不慎,会带来很大的伤害。
AI能否促进科技技术实现大的突破,这很重要,如果不能,只是在现有流程和技术框架,进行优化,替代劳动,将会带来很大问题
“If AI significantly improves the practice of science and invention and/or creates new high-productivity tasks, such changes may occur in the future. But within a 10-year horizon, it is reasonable to assume that they are constant.”
其他人强调AI和过去的发明都不同:AI和人类的智能水平越来越近,许多人类面临着技能过时,被AI替代的风险。从这个角度来看,不是过去的简单延续,可能导向新的历史进程,就像James Barrat所说这可能是人类最后的发明。
“Some propose that advances in AI are merely the latest wave in this long process of automation (see e.g. Gordon, 2016). Others, by contrast, emphasize that AI critically differs from past inventions: as artificial intelligence draws closer and closer to human general intelligence, much of human labor runs the risk of becoming obsolete and being replaced by AI in all domains. In this view, progress in artificial intelligence is not only a continuation but the culmination of technological progress – it could lead to a course of history that is markedly different from the implications of previous waves of innovation, and may even represent what James Barrat (2013) has termed “Our Final Invention.””
技术性失业,技术变化导致工人相对多余,超过他们能找工作的速度,或者超过了新工作创造的速度。熊皮特所谓的创造性破坏。凯恩斯在1930年观察到这个现象。所谓存在自然失业率或者均衡失业率。技术发展速度加快,会导致更高的工作分离速率,导致更高的均衡失业率。
这个过渡期或许被延长如果技术意味着工人的技能变得过时,他们需要获得新技能或者找到适合他们技能的新工作。
即使从长期来看,工人适应了AI,转变仍然可能很困难。AI对特定行业的冲击远大于其他行业,这些工人都需要转岗。作为一个通用的教训,市场本身对于结构性转变并不理想。对工作的摧毁大于创造新的工作。
The second category of technological unemployment is as a transition phenomenon, i.e. when technological change makes workers redundant at a faster pace than they can find new jobs or that new jobs are created. This phenomenon was already observed by Keynes (1930). It is well understood that there is always a certain “natural” or “equilibrium” level of unemployment as a result of churning in the labor market. In benchmark models of search and matching to characterize this equilibrium level of unemployment (see Mortensen and Pissarides, 1994 and 1998), employment relationships are separated at random, and workers and employers need to search for new matches to replace them. The random shocks in this framework can be viewed as capturing, in reduced form, phenomena such as lifecycle transitions but also technological progress in individual firms. In this view, an increase in the pace of technological progress corresponds to a higher job separation rate and results in a higher equilibrium level of unemployment. The transition may be especially prolonged if technology implies that the old skills of workers become obsolete and they need to acquire new skills and/or find out what new jobs match their skills (see e.g. Restrepo, 2017). Even if in the long run, workers adjusted to AI, the transition may be difficult. AI will impact some sectors more than others, and there will be significant job dislocation. As a general lesson, markets on their own are not good at structural transformation. Often, the pace of job destruction is greater than the pace of job creation, especially as a result of imperfections in capital markets, inhibiting the ability of entrepreneurs to exploit quickly new opportunities as they are opened up, which has arguably been the case for globalization in many developing countries.
如果我们不像马匹一样被取代,人类在更为复杂的任务拥有比较优势。而马匹没有。如果人类能有这种比较优势很重要,并AI能持续创造新任务,那么就业和劳动份额就能保持稳定,即使面临快速的自动化。
the difference between human labor and horses is that humans have a comparative advantage in new and more complex tasks. Horses did not. If this comparative advantage is significant and the creation of new tasks continues, employment and the labor share can remain stable in the long run even in the face of rapid automation.
AI带来的进一步自动化会进一步加剧不平等,要比1980-2016年更大。对底层的工资影响更大。AI增加自动化的任务范围,但是没有对自动化进一步深化,已经自动化的任务提升生产效率。低技能工作受损,最高技能继续收益。
“These exercises suggest that a further wave of automation similar to that of 1980-2016 would increase inequality by even more, because this change would have a bigger impact at the bottom of the wage distribution, given the patterns of comparative advantage implied by 1980-2016 data. AI is predicted to increase inequality by even more, because it expands the set of automated tasks significantly, but does not induce as much “deepening of automation”—meaning productivity improvements in already-automated tasks—as a uniform fall in the price of capital, which tends to increase productivity, benefiting labor of all types. Consequently, low-skill workers are harmed even more by artificial intelligence, while the highest-skill workers continue to benefit, because there is an increase in task services that are complementary to their skills. A sizable minimum wage like $16 an hour, on the other hand, compresses the wage distribution considerably, raising wages at the bottom and reducing them at the top. The wage declines at the top are due to the fact that the minimum wage reduces overall employment and output, which then depresses demand for all tasks.”
生产率提升对工作的影响,取决于这工作的产出商品,需求弹性如何。
The impact of productivity gains on jobs depends on whether the demand for goods produced by that work is elastic or inelastic. If demand is inelastic, productivity gains means jobs will be lost [Bessen]. For example, agriculture is inelastic in the U.S., so gains meant dramatic declines in absolute numbers (fourfold) and its portion of the workforce (from 40% in 1900 to 20% in 1940, 4% in 1970, and 2% today) [Daly]. If product demand is sufficiently elastic, productivity-enhancing technology will increase industry employment [Bessen].
Another perspective on employment is the split between nonphysical tasks and physical tasks. In our view, the main impact of near-term AI systems will be on nonphysical tasks. We think robots will eventually have a large effect on the way in which physical tasks are performed in the world beyond manufacturing, but this may be five or more years behind the use of AI systems for purely digital or knowledge tasks [National Academies].
我们很难阻止AI能力不断提升,我们甚至无法避免最坏的情况发生,就像我们无法阻止核弹在广岛引爆一样。2023年,科学家曾发起倡议,暂停发布能力更强的模型,如我们所预料的那样,毫无效果。OpenAI,Google,Anthropic, DeepSeek这些AI公司,正在大幅提升这些LLM的能力,试图在越来越多的任务中打败人类。这正在发生并在加速。领先的AI能使公司获得巨大的利益。这是谁都无法拒绝的。美国政府,担心在AI竞争中丧生对中国的优势,害怕提前警告会吓坏工人,也很少宣传讨论。政府和国会既不监管也不警告美国民众。这没有改变的迹象。许多美国人,没有意识到增加的AI能力会威胁到它们的工作,很少关心。
在竞争中,各方都陷入囚徒困境之中,不断竞争,生怕落后。但我们什么都不能做吗?公众的意见和意识很重要。这也是本书的目的之一。如果能让大众更了解这场AI革命的逻辑和带来的影响,就能促使它们采取行动,继而推动政府和立法,保护自己的权益。
Here’s how Amodei and others fear the white-collar bloodbath is unfolding:
OpenAI, Google, Anthropic and other large AI companies keep vastly improving the capabilities of their large language models (LLMs) to meet and beat human performance with more and more tasks. This is happening and accelerating.
The U.S. government, worried about losing ground to China or spooking workers with preemptive warnings, says little. The administration and Congress neither regulate AI nor caution the American public. This is happening and showing no signs of changing.
Most Americans, unaware of the growing power of AI and its threat to their jobs, pay little attention. This is happening, too.
And then, almost overnight, business leaders see the savings of replacing humans with AI — and do this en masse. They stop opening up new jobs, stop backfilling existing ones, and then replace human workers with agents or related automated alternatives.
The public only realizes it when it’s too late.
无论是国家,还是公司,拥有强大的AI系统,都有战略优势。AI对国家不仅有战略利益,还有军事利益。公司层面,部署AI能拥有超越竞争对手的成本和创新优势。而个人层面,则成了沉默的羔羊。被AI系统考核,被AI系统分配任务,被AI系统取代。
在当前的近似均衡的经济中,AI的加入会产生什么样的冲击。AI本质上只生产,不消费。不像人那样。考虑AI的经济学抽象。AI会对均衡产生很大的冲击。当前的市场经济,要求生产和消费匹配。会导致什么后果。
在市场经济中,人既是生产者,也是消费者。人通过工作获得收入,通过消费推动需求,这两个角色构成了市场运转的闭环。而AI的崛起,正在打破这个闭环——它能生产,却不消费。
luckin咖啡出现了机器人,一杯拿铁不要9.9, 只要5.9,岂不很好。但问题是,那时候你还买得起吗?如果机器人能给你做美甲,会怎么样子?
大量“人力”资本涌入经济体会导致什么后果?科学研究,生物医药,制造,供应链,金融系统提升效率。
“What will be the effect of this infusion of incredible “human” capital on the economy? Clearly, the most obvious effect will be to greatly increase economic growth. The pace of advances in scientific research, biomedical innovation, manufacturing, supply chains, the efficiency of the financial system, and much more are almost guaranteed to lead to a much faster rate of economic growth. In Machines of Loving Grace, I suggest that a 10–20% sustained annual GDP growth rate may be possible.”