GPT-5
Ask HN: What are you using for LLM inference in production?
I started with OpenAI back in the GPT-3 days, then bounced between the major labs (with a brief interlude with Workers AI).I eventually settled on Gemini 2.5 Flash Lite as my workhorse, using it against structured data/vectors as a chatbot. It was cheap, good enough, and most importantly, fast - but it's now being sunset and I'm not sure where to go to find similar performance.Groq seems promising but developer access hasn't been available for months. I'd love to use ope
Show HN: Gander, an Android file viewer that asks for no permissions
Hi HN,I built an Android file viewer that opens PDF, Word, Excel, PowerPoint, images, video, audio, Markdown and code, and asks for no permissions at all.I have always been uneasy about opening files people send me. On Android you either install a 400 MB office suite and sign in or use a small free viewer that wants storage access and ends up uploading your file to a server to render it. Also the hassle of having to download different apps for different file formats was really annoying.Gander ho
Time for OpenAI and Anthropic to take a leaf from Microsoft's book?
Dear Sam & Dario, please add "AI is for entertainment purposes only" to all output, including your PR announcements of the latest impressive security achievements.<p>Thank you.
Show HN: AI Security Breaches, the problems and it's causes
There has been a recent security breaches by Anthropic and OpenAI that they have problems in difficulty in working and handling with these advance AI models.
OpenAI’s GPT-5.5 Instant reduces hallucinations by 52.5%
ChatGPT just got a quieter but significant upgrade, and most users will feel it before they even notice it. OpenAI rolled out GPT-5.5 Instant on Tuesday as the new default model for all ChatGPT users ...
Show HN: RunNburn – Run a 295B Moe from a 98GB GGUF on a 64GB RAM Desktop
runNburn is an Apache-2.0 Rust inference engine for quantized GGUF models that are too big for your fast memory.The core idea: weights stay file-backed (mmap), host residency stays under an explicit byte budget (--ram-budget), and GPU caches are sized from detected free/total VRAM — never from device-name presets. There is no conversion step, no sidecar cache files, no silent requantization. The GGUF on disk is the single source of truth.The result that made me want to post this: Tencent&#x
Show HN: APIs as First-Class Citizen
A few years ago, I encountered neovim and a new concept: APIs as first-class citizens.As I used it more and more in my work, I became increasingly aware of its importance.Exposing the software's state and operations through APIs greatly improves the debugging experience, provides extensibility, and makes it very convenient for other programs to call them.On the other hand, centering on APIs can also improve program structure, because the entire program is written around a single context.Cur
Show HN: A new engine to run Kimi K3 on a laptop
Kimi K3 has 2.78 trillion parameters and ships as 1.42 TB of weights. It clearly does not fit in the memory of a laptop.
But K3 is a Mixture-of-Experts model. For each token, only a small fraction of its 896 experts per layer is activated. That changes the problem: the entire model does not need to be resident in RAM, as long as the weights required by each token can be reached quickly enough.We built WASTE — the Weight-Aware Streaming Tensor Engine — to explore that idea.WASTE keeps the dense,
Show HN: Scout, understand any Enterprise Platform in minutes
Hi HN,I've been building Scout over the past few months.Point it at an OpenAPI spec and documentation, and it builds a grounded understanding of the platform: architecture, entities, workflows, starter code, a threaded AI chat, and an MCP server for coding agents.Everything runs locally. No accounts or hosted backend.One of the problems I kept running into was coding agents confidently inventing endpoints because they only knew APIs from training data. Scout uses the OpenAPI spec and docs a
Four Competing AIs Answer 1 Classic Question
I sought advice from four mainstream A.Is for a basic consumer use case question and to me, the differing style of the answers are quite revealing.Premise: A poorly hung clothes dryer spectacularly ripped from the wall whilst on and tumbling, smashing into the washing machine beneath and trying to exit out the laundry door in a manner reminiscent of Stephen King's haunted laundromat story The Mangler.After all the shards of glass, wall plaster etc were cleared up, the six month old washing
If U.S. labs slow down AGI development, this could be 2028
If U.S. labs slow down AGI development, this could be 2028:Moonshot Kimi 6, Alibaba Qwen 5, Z.ai, and MiniMax are all claiming AGI-level capabilities. Meanwhile, people barely talk about Anthropic or OpenAI—just like Gemini’s situation in 2026.Digital nomads are moving to Shanghai to flex cheap tokens. Major U.S. software companies are shifting core development teams to Europe and India ( Because they need to use Chinese AI) . China is supplying data-center infrastructure to developing countries
Show HN: AI Security Leaderboard – comparing cyber and CBRN safeguards
There's no shortage of leaderboards for model capabilities - but the security of models is becoming increasingly relevant, from the risk of an AI agent processing unsanitized input being hijacked to models being pulled due to cybersecurity jailbreaks. We developed an automated test suite that runs models through 1500 automatically generated jailbreak attempts and measures the number of universal jailbreaks: prompts that elicit compliant, detailed responses to >75% clearly harmful questio
Launch HN: Tokenless (YC S26) – Automatic model switching to save money
Hi HN, Rohit here from Tokenless (https://usetokenless.com/), which I’m building alongside co-founders Andrew and Kev. We’re building an API gateway which routes agent traffic dynamically turn-by-turn between different models to save on AI spend.The cost of AI tokens is top-of-mind for many. Companies like Uber and Salesforce have been complaining about blowing their yearly AI spend faster than expected.Frontier models are amazing for dev work, but are so expensive. Open-source mo
OpenAI ‘open-sourced’ its AI security scanner. The scanner is still locked up.
OpenAI open-sourced its Codex Security CLI to scan code for bugs, but kept the scanner gated. An AppSec land grab, and a shot at Anthropic’s Claude Security.
OpenAI is giving 100,000 scientists free AI. Here’s how it can afford to.
OpenAI is giving 100,000 researchers free frontier access through 2027, the same week it revealed how it cut its agents’ token costs to afford moves like it.
OpenAI pledges $71 million for Georgia college students to use AI platform
OpenAI’s $71 million estimate should be more than enough to grant $100 for every college student in the state. Enrollment at ...
Disney is ditching Microsoft's GitHub Copilot and adding OpenAI's Codex
Disney is shaking up its AI tools by moving on from Microsoft's GitHub Copilot. It's also planning to add OpenAI's Codex alongside Claude and Cursor.
Show HN: College application essay inspiration and brainstorm
I collected thousands of outstanding college application essays to train a specialized AI model designed to inspire and coach students throughout the essay-writing process.Unlike general-purpose AI, each essay is highly personalized based on the applicant's background, experiences, and personal story. The AI also adapts its writing to emphasize the qualities and values that different universities are looking for.You can browse our essay library for free, explore each applicant's profil
Show HN: Energy, carbon and water estimates for AI content, shown as ranges
Hi HN,I built this calculator because I noticed it's easy to know how much a LLM costs per token, but it's extremely difficult to know it's carbon footprint or power consumption. I created this as a reference based on some published papers and public information, and it helps to have a guide of the impact of photo and video generation using AI.I also added another factor about Token utilization, it's something that becomes important as the newer models start to use "thin
AMD and Anthropic Sign Major Chips-and-Investment Deal
The 2-gigawatt deal covers tens of billions of dollars’ worth of chips, and AMD will invest up to $5 billion in Anthropic.
