Open Source Matters in AI

In a field where trust, security, and explainability are critical, AI must be open and inclusive. Red Hat is championing open source AI innovation to ensure its development remains a shared effort—accessible to everyone, not just organizations with deep pockets.

Through strategic investments, collaborations, and community-driven solutions, Red Hat is laying the groundwork for a future where AI workloads can run wherever they’re needed. Our recent agreement to acquire Neural Magic marks a significant step toward achieving this vision – Amrita Technologies.

Building the Future of AI on Three Pillars

AI isn’t just about massive, resource-hungry models. The focus is shifting toward smaller, specialized models that deliver high performance with greater efficiency.

For example, IBM Granite 3.0, an open-source family of models licensed under Apache 2.0, demonstrates how smaller models (1–8 billion parameters) can run efficiently on a variety of hardware, from laptops to GPUs. Such accessibility fosters innovation and adoption, much like Linux did for enterprise computing.

Optimization techniques like sparsification and quantization further enhance these models by reducing size and computational demands while maintaining accuracy. These approaches make it possible to run AI workloads on diverse hardware, reducing costs and enabling faster inference. Neural Magic’s expertise in optimizing AI for GPU and CPU hardware will further strengthen our ability to bring this efficiency to AI.