Replicate· Platform

IBM's Granite 4.0 is now on Replicate

IBM has released Granite 4.0, their latest family of open-source small language models built for speed and low cost. The Granite 4.0 models use a hybrid architecture that uses less memory than traditional models, so you can run them on regular consumer GPUs instead of expensive server hardware. They work well for document summarization, RAG systems, and AI agents. ibm-granite/granite-4.0-h-small is a 30 billion parameter long-context instruct model and it’s now available on Replicate. Running Granite 4.0 with an API You can start using Granite models right away on Replicate. Here’s how to run them with an API: cURL Copy curl -s -X POST \ -H "Authorization: Bearer $REPLICATE_API_TOKEN " \ -H "Content-Type: application/json" \ -d $'{ "version": "ibm-granite/granite-4.0-h-small", "input": { "messages": [ { "role": "user", "content": "Explain the key benefits of using open-source models in business environments" } ] } }' \ https://api.replicate.com/v1/predictions JavaScript Here’s an example using Replicate’s JavaScript client : Copy import Replicate from "replicate" ; const …

Announced

02 Oct 2025 00:00 UTC