This speed hack from OpenAI searches URLs instantaneously.

System design course: https://interviewready.io/course-page/system-design-course
AI engineering course: https://interviewready.io/course-page/ai-engineering

Speed hack from OpenAI Engineering.

When you paste a link into ChatGPT's textbox, it starts loading the page in the background.

So even before you type your query, ChatGPT gains context through the link you paste.

This means time saved for page loading, vectorization, and KV-cache warmup. The resultant responses are instantaneous.

The concept isn't new. Instagram does something similar by asking users to add a description while their photos upload in the background.

Because faster responses lead to better user engagement.

AI Engineering for the win!

#AI #LLMs #RAG

Видео This speed hack from OpenAI searches URLs instantaneously. канала Gaurav Sen