我用AI看视频讲座

谷歌最近刚刚在其 AI Studio 上向公众发布了 Gemini 1.5 Pro。Gemini Pro 1.5 拥有 1,000,000 个多模态 token 上下文大小。这比 Claude 2.1 (200k) 和 GPT4-turbo (128k) 等现有模型有了巨大的飞跃

为了测试模型从其长上下文中检索内容的能力,我们使用了needle-in-a-haystack(大海捞针)测试。

1、Gemini 1.5 Pro简介

Gemini 1.5 pro 的召回率达到 99.7% 以上,甚至高达 10M 个 token!

gemini_v1_5_report.pdf

除了推理长文档和复杂代码库之外,我发现最有趣的是它分析和推理视频的能力。

在他们的演示中,他们向模型输入了 Buster Keaton 的 45 分钟无声电影“Sherlock Jr.”。并使用每秒一帧的速度,将其转换为 684k 个标记的输入上下文。

该模型可以回答相当复杂的问题(见下文)

Figure 5

你可以在此处观看完整的演示视频。

这开辟了很多可能性。

例如,Simon Willison 有创意地拍摄了一段 7 秒的书架视频,Gemini 能够返回书名和作者的 JSON 数组。

鉴于此,我想亲自测试一下。

2、让Gemin看视频

这段视频在我的稍后观看列表中已经有一段时间了,我想为什么不使用 Gemini 来回答“如何构建一个可扩展到公司的产品?”这个问题?

在我获得这个视频的mp4后,我前往Google AI Studio。

Google AI Studio

我使用视频标签上传了视频。

一开始它给我一个错误“视频太长”,所以我不得不把它缩短到 59 分 59 秒。我又试了一次,大约 5 分钟后,它就上传了。

它包含了高达 946,800 个 token!

3、让Gemini回答有关视频的问题

根据 OpenAI 的计算,100 个 token ~= 75 个单词,总计 710,100 个单词。

因此,在快速浏览完视频后,我针对几个问题进行了测试。

3.1 What is the rule of 40/20/20?

我首先给出一个简短的提示,要求它返回答案的时间戳,以便我可以核实它们。

The rule of 40/20/20 is a financial metric used to measure the health of software-as-a-service (SaaS) companies. It states that a company’s combined revenue growth rate and profit margin should be equal to or greater than 40%. Additionally, the rule suggests that sales and marketing expenses should be around 20% of revenue, while research and development and general and administrative expenses should each be around 20% of revenue.

The speaker discusses the rule of 40/20/20 at the following timestamps: 09:04–09:14.

我们来检查一下 09:04 是否提到了这条规则。

果然如此!

继续下一个。

3.2 What is the minimum viable segment?

回答如下:



太棒了!回答中的两个时间点都提到了这个术语!

3.3 How to check on your value proposition?

回答如下:



- Is it “BLAC” and white?

Is it simple to use and install?
Is it low to no initial cost?
Does it provide instant and ongoing value?
Does it play well in the ecosystem?

3.4 Why would a VC say no to your product? ❌

回答如下:



- The market is too small.
- The problem you are solving is not valuable enough.
- Your product is not differentiated enough.
- Your team is not strong enough.

我原本以为它会在 25:48 左右提到一些事情,其中​​一名学生提到 VC 可能会说“不”,以及你如何将其视为对公司的价值判断。但我想这个问题一开始就很模糊。

但第 38:10–38:44 段没有提到任何关于 VC 说“不”的事情。

3.5 List down all the questions asked in this talk and what the speaker responded as a suggestion/solution ❌

回答如下:



Question 1:

Speaker’s suggestion:

- Making it self-service.
- Providing clear and concise documentation.
- Offering a free trial or demo.

Question 2:

Speaker’s suggestion:

- Increase revenue
- Reduce costs
- Save time
- Reduce risk
- Gain a competitive advantage















问题 1 和 2 是视频中的真实问题,但问题 3 和 4 不是。它也错过了讲座中的其余问题。

3.6 Did the speaker say anything about how to name your product? ❌

回答如下:



- Memorable
- Easy to spell and pronounce
- Descriptive of what your product does

所以这是一个幻觉答案,我到了 33:07,演讲者根本没有提到这一点。

3.7 Provide a detailed summary for this lecture.

回答如下:









1. Friction-free products that SLIP:

2. Co-create a win-win via strategic partnerships:



3.8 Provide a glossary of all the terms mentioned in the video that is worth knowing and remembering.

回答如下:



- Product-company gap:
Product-go-to-market fit:
Minimum viable segment (MVS):
Friction-free products that SLIP:
Product-led growth (PLG):
Whole product:
BLAC:
Blatant need:
Latent need:
Aspirational need:
Critical need:
Customer acquisition cost (CAC):
Freemium:

3.9 What are all the important lessons mentioned?

回答如下:



- It’s not just about the product.
- Design for product-go-to-market fit.
- Make your product friction-free.
- Co-create a win-win via strategic partnerships.
- Focus on your core value.
- Provide proof of value.

3.10 What are 10 questions I should ask myself when scaling my product into a company?

回答如下:



Product-Market Fit

1. What is the core value proposition of my product?
2. What is the minimum viable segment (MVS) for my product?
3. Have I achieved product-market fit with my MVS?
4. How can I make my product more friction-free (SLIP)?

Business Model

5. What is my business model?
6. How will I price and package my product for different customer segments
7. How will I distribute my product and capture value?

Go-to-Market Strategy

8. What is my go-to-market strategy?
9. How will I position, message, and communicate my product to my target market?
10. What channels will I use to distribute my product and reach my target market?

4、结束语

看起来,问题不太具体、不太明确,很容易让人产生幻觉。

提示可以解决这个问题。

但另一方面,仅仅因为视频中没有这些信息并不意味着它没用,尤其是对于“为什么风险投资家会说不”这个问题。

所以,作为一个总结和学习 YouTube 视频的工具,我认为它仍然是一个很好的工具。


原文链接:I used AI to watch an hour-long lecture

BimAnt翻译整理,转载请标明出处

本文属于「AI × 3D」专题。查看专题全部文章 →