Latest Articles

324 articles · Fresh posts aggregated from independent blogs across the directory.

LLil'LogLil'Log·Oct 25, 2023

Adversarial Attacks on LLMs

The use of large language models in the real world has strongly accelerated by the launch of ChatGPT. We (including my team at OpenAI, shoutout to them) have invested a lot of effort to build default safe behavior into the model during the alignment process (…

lilianweng.github.ioRead article
HHello World: Re-ActHello World: Re-Act·Oct 24, 2023

SegmentFault 旗下开源问答软件 Answer 入选 Apache 孵化器

2022 年 10 月 24 日,SegmentFault 思否宣布开源旗下问答平台软件 Answer 1。今日,恰逢开源一周年之际,Answer 社区发布公告2 宣布项目已顺利通过投票,以全票通过的优秀表现正式进入 Apache 软件基金会(ASF)孵化器。 作为 Answer 背后的创始团队和中国新一代技术问答社区,SegmentFault 思否一直积极参与开源布道、拥抱开源生态,曾发布多篇深

gaoyang.devRead article
LLM Powered Autonomous Agents
LLil'LogLil'Log·Jun 23, 2023

LLM Powered Autonomous Agents

Building agents with LLM (large language model) as its core controller is a cool concept. Several proof-of-concepts demos, such as AutoGPT, GPT-Engineer and BabyAGI, serve as inspiring examples. The potentiality of LLM extends beyond generating well-written c…

lilianweng.github.ioRead article
Generative AI and AI Product Moats
JJay AlammarJay Alammar·May 9, 2023

Generative AI and AI Product Moats

Here are eight observations I’ve shared recently on the Cohere blog and videos that go over them.: Article: What’s the big deal with Generative AI? Is it the future or the present? Article: AI is Eating The World

jalammar.github.ioRead article
LLil'LogLil'Log·Mar 15, 2023

Prompt Engineering

Prompt Engineering, also known as In-Context Prompting, refers to methods for how to communicate with LLM to steer its behavior for desired outcomes without updating the model weights. It is an empirical science and the effect of prompt engineering methods ca…

lilianweng.github.ioRead article
LLil'LogLil'Log·Jan 27, 2023

The Transformer Family Version 2.0

Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many sect…

lilianweng.github.ioRead article
壹壹拾肆壹拾肆·Jan 16, 2023

2022 年终总结丨惠存这一年

去年没写年终总结,今年发生了很多事,觉得应该抽点时间,回顾记录,以重新出发。 仍旧是过的很快的一年,好像工作后的每一年都过得很快,书上说人之所以觉得成年后的日子过得快,是因为对很多事没有新鲜感了,没接触新的东西,没有记忆点,日复一日,所以很快。我觉得,对了一半。另一半也许因为年岁渐长,人们喜欢追忆,过去的时间也许也并没有比现在过得更慢,只是过去的日子被人们…

kaaaaai.cnRead article
LLil'LogLil'Log·Jan 10, 2023

Large Transformer Model Inference Optimization

[Updated on 2023-01-24: add a small section on Distillation.] Large transformer models are mainstream nowadays, creating SoTA results for a variety of tasks. They are powerful but very expensive to train and use. The extremely high inference cost, in both tim…

lilianweng.github.ioRead article

Page 14 of 18 · 324 articles