Predibase, the developer platform for productionizing open source AI, is debuting the Predibase Inference Engine, a comprehensive solution for deploying fine-tuned small language models (SLMs) quickly ...

Google Research unveiled TurboQuant, a novel quantization algorithm that compresses large language models’ Key-Value caches by up to 6x. With 3.5-bit compression, near-zero accuracy loss, and no ...

Inference startup Sail Research Inc. today announced that it has raised $80 million in funding at a $450 million valuation.

Enterprise conversations around artificial intelligence are beginning to shift noticeably. For the past few years, much of ...

Inference, what happens after you prompt an AI model like ChatGPT, has taken on more salience now that traditional model scaling has stalled. To get better responses, model makers like OpenAI and ...

As AI adoption accelerates, organizations will increasingly measure AI success not by model size, but by the economics of ...

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now DeepSeek’s release of R1 this week was a ...

Every GPU cluster has dead time. Training jobs finish, workloads shift and hardware sits dark while power and cooling costs keep running. For neocloud operators, those empty cycles are lost margin.

Advantech announced the integration of Intel Core Series 3 processors into its next-generation portfolio of industrial-grade ...

The burgeoning AI market has seen innumerable startups funded on the strength of their ideas about building faster, lower-power, and/or lower-cost AI inference engines. Part of the go-to-market ...