一个Youtube视频总结工具和一些思考

我发现最近几年,视频正在取代文字成为主要的获取信息的渠道。随着视频制作的门槛越来越低,估计未来绝大部分内容都会来自视频。但是高效地获取视频内容是一件比较困难的事情,因为时间轴的限制,无法像文字那样被快速浏览、反复回看、总结。

而且比起文章来,视频更能分散注意力,使得我们不断地在视频标题之间横跳。我们其实是在信息的海洋里漂流瓶,被动地接受很多信息。如果有一个工具在我们和视频本身之间做一个缓冲,可以让我们拿会对信息的主动权。

所以一直想做这么一个可以总结Youtube视频的工具,最近终于借助AI for coding的力量在Cursor的帮助下实现了。产品还是demo的状态,安装和使用需要一些终端的知识,依照文末的Github链接中的说明就可以运行。

Read More

2024年的一些总结

这篇总结躺在草稿箱里一个多月,断断续续地编辑,今天终于能发出来。
2024年经历了一个重要的事业转折点,这一年大部分的时间是与自己相处,跳出了以前的框架,想明白了很多事情,也许明白只是假象,以下是部分罗列。

  • 人生是一场游戏。人们为自己的人生旅途中赋予了很多意义,但其实人生的意义只在于体验。游戏让人上瘾因为它们都有一个共同点:快速的正反馈。可以把人生大小小的困难设计成游戏,分解目标,建立正反馈系统。

    Read More

强化学习和人工智能的奇点

Andre Karpathy近日在X平台上也对R1作了评价。评价本身不重要,重要的是他引申出了一个更加深刻的观点,即AI的自我进化可能远超我们想象,这个观点让人细思极恐。

他提出合成数据和强化学习是等价的。在强化学习的试错过程中,每一次“试验”本质上都是模型生成的合成数据,而它随后根据奖励函数来进行学习。反过来说,当你对合成数据进行筛选和排名时,这个过程实际上就是一个0-1奖励函数。可见,数据很大程度上是算力下游的产物。

Read More

互联网极简史

最早畅想互联网的人是谁?大部分美国人同意是万尼瓦尔,他在《诚如所思》中的描述是人类对互联网的最早的想象。其它版本众说风云,但也都指向了20世纪初。

未来的作者是否不再使用手写或打字的方式,而是直接对着记录机讲话就可以了呢?他会通过速记员或者一个大圆桶间接地去做这件事。如果他想直接录入一条键入的记录,所需的东西都是现成的。他需要做的就是充分利用现有装置并转换他的语言。

—— 万尼瓦尔.布什 《诚如所思》(1945)

互联网真正的开端大概在1960年,仍然比大部分人想象得要早得多。它起于军方,后扩展至大学,最后完全商业化,花了近30年时间。而之后的30年是互联网飞黄腾达的30年,前前后后60年,历史长河中的一瞬。

Read More

OpenAI-o1真的会思考吗

在OpenAI的眼中,实现通用人工智能大致要经历5个阶段:对话(conversation),推理(reasoning),代理(agent),创新(innovation),组织(organization)。OpenAI的o1模型已经达到了推理这一阶段,相信第三阶段也指日可待。在它到达第四阶段—创新—之前,个人认为还需要达到”直觉“这个阶段。

OpenAI在上周推出了最新的模型o1-preview。名字的含义是Orion(猎户座)一代。有人说计数器重置为1,因此很可能不会有GPT-5,o1将开启一个全新的时代。
很多人对o1模型能力进行了解读,也有大量的新奇的应用如雨后春笋一般涌现出来,总得来说o1是思维链(Chain of Thought, COT)的集大成者,它很可能推动LLM新一轮的范式改变:侧重点从训练到推理转移,然后以推理时间的增长来继续scaling law。但是它真的会“思考”吗?

Read More

李沐:语言模型的现状与未来

AI大牛李沐最近回到上海交通大学做了一次演讲,聊了聊语言模型的现状和未来趋势。李沐的观察很有启发,不愧是这个站在这个领域最前沿的人。他说,现在的AI基本可以完成文科白领的大部分工作,但是要完成复杂任务和与真实世界交互还有很长的路要走。而制约大模型发展的瓶颈主要是内存、电力、数据,其中数据的重要性在演讲中反复被强调。

李沐最后还给交大学子们指点人生迷津。他说创业就像是当海盗,天天看着市面上什么好的机会,一旦发现就all-in,抢到了就爽一把,没有抢到就死掉了。相比起在大公司里上班和读博深造,创业对动机(motivation)的要求是最高的。你内心深处要有那么一件十分想去做,不去做就抓耳挠腮,就会后悔的事情。这个事情要满足你最深层次的欲望,你还要能抗得住一次次的打击,在别人都不看好的时候坚持走你选择的路。创业就是要笃定,就是要让自己的内心强大到混蛋。

以下是李沐演讲中关于技术方面的总结。

Read More

AI is electricity in late 1800s

Formal Google CEO Eric Schmidt has stirred quite a bit of controversy with his comments on Google’s work life balance, the Ukraine War, and startups strategy on pursuing growth. Putting those aside, what resonated with me was a concept brought up by the host Erik Brynjolfsson, that is general purpose technology. He said general purpose technologies are powerful because they ignite other complimentary innovations, but it usually takes process innovation or organizational innovation to fully unleash that power.

He used electricity as an example. When electricity was first introduced into factories, they didn’t become significantly more productive than the factories that were powered by steam engines.

Read More

Patrick Collison's latest interview on Jensen Huang

“I’d rather torture you into greatness than firing you.” —- Jensen Huang

On April 24th, Patrick Collison, CEO of Stripe, interviewed Jensen Huang, who is the CEO of Nvidia. Below are the main takeaways:

No One-on-One Meetings. Jensen has 60 directors who report to him, but he prefers not to have one-on-one meetings. By having all 60 directors together at once, he has eliminated at least 7 layers from the company’s structure. He believes it is more effective to communicate with all stakeholders simultaneously, allowing information to flow more efficiently among people. Everyone can contribute to and share in the information flow. Feedback is learning. Not only do you work to solve the problem at hand, but you also create conditions for others to learn from your situation. On the other hand, isn’t it a great opportunity to learn from other people’s mistakes, disasters, and strategies?

Read More

The Art of Strategy: Lessons learned from Go

Go, the ancient board game originating from China, is not merely a game of skill but a profound exploration of strategy and decision-making. Its core concepts—such as Big Points, Frameworks, Influence, and Initiative—not only guide players to victory but also serve as metaphors for navigating life’s complexities. These principles offer invaluable insights into making better choices, anticipating outcomes, and achieving long-term success.

In Go, Big Points refer to key strategic areas on the board that yield the greatest potential gains. These points are often the first moves in a game and set the tone for future developments. Ignoring these points can lead to missed opportunities or allow opponents to gain a decisive advantage. Similarly, in life, identifying and prioritizing high-impact opportunities is essential. For example, an entrepreneur might focus on entering a fast-growing market rather than investing resources in smaller ventures. Recognizing the “big points” in life helps allocate energy effectively, ensuring meaningful progress.

Read More