Show HN: WebGPU enables local LLM in the browser – demo site with AI chat

03 Aug 2025

🧠 Hacker News Digest: AI, Prompt Engineering & Dev Trends

Welcome! This article summarizes high-impact discussions from Hacker News, focusing on AI, ChatGPT, prompt engineering, and developer tools.

Curated for clarity and relevance, each post offers a unique viewpoint worth exploring.

📋 What’s Included:

  • Grouped insights from Hacker News on Prompt Engineering, AI Trends, Tools, and Use Cases
  • Summarized content in original words
  • Proper attribution: 'As posted by username'
  • Code snippets included where relevant
  • Direct link to each original Hacker News post
  • Clean HTML formatting only

🗣️ Post 1: Show HN: WebGPU enables local LLM in the browser – demo site with AI chat

As posted by: andreinwald  |  🔥 Points: 126

https://andreinwald.github.io/browser-llm/

💬 Summary

Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android.

Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/

Code https://github.com/andreinwald/browser-llm

- No need to use your OPENAI_API_KEY - its local model that runs on your device

- No network requests to any API

- No need to install any program

- No need to download files on your device (model is cached in browser)

- Site will ask before downloading large files (llm model) to browser cache

- Hosted on Github Pages from this repo - secure, because you see what you are running

🗣️ Post 2: Google indexing ChatGPT convos, potentially exposing sensitive user data

As posted by: xpe  |  🔥 Points: 16

https://www.fastcompany.com/91376687/google-indexing-chatgpt-conversations

💬 Summary

[No content available]

🗣️ Post 3: Show HN: Cortex – OS-wide AI with instant context input

As posted by: andrewfhou  |  🔥 Points: 6

https://cortexdesktop.com/

💬 Summary

Hey HN! I’m Andrew, and I’ve been building Cortex (https://cortexdesktop.com/) for the last few weeks. Cortex is my attempt to reimagine how we interact with computers - starting with a simple interface, but aiming for something deeper: an AI layer over your OS that understands what you’re doing, remembers it, and helps you dynamically.

Right now, Cortex is just a floating overlay you can summon anywhere on your Mac. It works like an inline ChatGPT, but it lets you instantly send that context into the chat by highlighting text - so you don’t have to explain what you’re doing. Here is a demo: https://www.youtube.com/watch?v=fZEbpysqH2w&feature=youtu.be

That’s all it does today but the reason I’m building it is because I think that the current way we use computers is kind of antiquated - the OS is relatively dumb and memoryless. I feel like it would be so much better of an experience to work with a computer that is contextually and semantically smart.

This started as a tool I was hacking together for myself while context-switching between projects, tabs, and apps. I was using ChatGPT a lot, but every time I wanted to ask something, I had to re-explain what I was doing. “I’m building this project with (these) specs, and (this) stack, help me plan etc etc”

I realized that firstly, it was super tedious to constantly go back to GPT to query, and secondly that it was annoying that I constantly had to feed it context to make it work the way I wanted. Granted, Chat GPT does have a certain amount of memory nowadays but I mean something far more granular - file diffing, text changes, differences in entire workflows, etc.

I feel that the OS should have memory. It should be able to understand semantically, not just react to commands. Eventually, I want Cortex to become the operating system’s memory. A system that watches what you do across apps (files, text, window titles, tabs), builds a real-time semantic timeline of your work, and lets you ask questions like “What was I working on Thursday before lunch?” Or say “Open the Figma file I was editing after that Zoom call”.

I am technically getting ahead of myself, as right now I’m just trying to test the one use case of having access to AI anywhere in the OS. This is definitely an early-stage product. It’s glitchy in spots. But if you like trying new interfaces and imagining what comes next - I’d love your feedback.

You can use it free for 7 days — no signup needed. I’d love to hear your feedback, ideas, critiques, or even thoughts on how you’d want your computer to "remember."

Thanks!

-Andrew

🗣️ Post 4: What Happened When I Tried to Replace Myself with ChatGPT in My English Class

As posted by: lapcat  |  🔥 Points: 5

https://lithub.com/what-happened-when-i-tried-to-replace-myself-with-chatgpt-in-my-english-classroom/

💬 Summary

My students call it “Chat,” a cute nickname they all seem to have agreed on at some point. They use it to make study guides, interpret essay prompts, and register for classes, turning it loose on the course catalog and asking it to propose a weekly schedule. They use it to make their writing sound more “professional,” including emails to professors like me, fearing that we will judge them for informal diction or other human errors. Article continues after advertisement Like many teachers at every level of education, I have spent the past two years trying to wrap my head around the question of generative AI in my English classroom. To my thinking, this is a question that ought to...

🗣️ Post 5: ChatEBT – an exact replica for ChatGPT but no subscriptions

As posted by: jonanz  |  🔥 Points: 3

https://chatebt.so

💬 Summary

[No content available]

🎯 Final Takeaways

These discussions reveal how developers think about emerging AI trends, tool usage, and practical innovation. Take inspiration from these community insights to level up your own development or prompt workflows.