Parasail raises $32M for its pay-per-token inference cloud

Artificial intelligence infrastructure startup Parasail Inc. today announced that it has raised $32 million in early-stage ...

From LLMs to hallucinations, here’s a simple guide to common AI terms

The rise of AI has brought an avalanche of new terms and slang. Here is a glossary with definitions of some of the most ...
EDN

The truth about AI inference costs: Why cost-per-token isn’t what it seems

The AI industry has converged on a deceptively simple metric: cost per token. It’s easy to understand, easy to compare, and easy to market. Every new system promises to drive it lower. Charts show ...
InfoWorld

Google targets AI inference bottlenecks with TurboQuant

Google says its new TurboQuant method could improve how efficiently AI models run by compressing the key-value cache used in LLM inference and supporting more efficient vector search. In tests on ...
Network World

Nvidia targets inference as AI’s next battleground with Groq 3 LPX

The company says its new architecture marks a shift from training-focused infrastructure to systems optimized for continuous, low-latency enterprise AI workloads. 2026 is predicted to be the year that ...
Wall Street Journal

What Is Inference? Explaining the Massive New Shift in AI Computing

A significant shift is under way in artificial intelligence, and it has huge implications for technology companies big and small. For the past half-decade, most of the focus in AI has been on training ...
Business Insider

Nvidia expects to sell $1 trillion in AI chips through 2027 — and it's pushing further into inference

Nvidia CEO Jensen Huang debuted a new AI inference system during his GTC conference keynote. The product incorporates technology from Groq, with which Nvidia made a $20 billion deal. The chip can ...
Wall Street Journal

Amazon Announces Inference Chips Deal With Cerebras

Amazon Web Services plans to deploy processors designed by Cerebras inside its data centers, the latest vote of confidence in the startup, which specializes in chips that power artificial-intelligence ...
The Motley Fool

Forget AI Training: AI Inference Is the Real Money Maker in 2026. Here Are 2 Stocks to Own.

Inference will take over for training as the primary AI compute moving forward. Broadcom has struck gold with its custom ASICs for AI hyperscalers. Arm Holdings should benefit immensely as inference ...
VentureBeat

AI inference costs dropped up to 10x on Nvidia's Blackwell — but hardware is only half the equation

Lowering the cost of inference is typically a combination of hardware and software. A new analysis released Thursday by Nvidia details how four leading inference providers are reporting 4x to 10x ...
TechCrunch

AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say

Modal Labs, a startup specializing in AI inference infrastructure, is talking to VCs about a new round at a valuation of about $2.5 billion, according to four people with knowledge of the deal. Should ...