Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

980 followers
Boston
https://neuralmagic.com
@neuralmagic
company/neural-magic
channel/UCo8dO_WMGYbWCRnj_Dxr4EA

Overview
Repositories
Projects
Packages
People

More

Overview
Repositories
Projects
Packages
People

Pinned Loading

deepsparse deepsparse Public archive

Sparsity-aware deep learning inference runtime for CPUs

Python 3.2k 192

Repositories

Loading

Type

Select type

All Public Sources Forks Archived Mirrors Templates

Language

Select language

All C++ Cuda Dockerfile Go HTML Jupyter Notebook Makefile MDX Python Rust Shell

Sort

Select order

Last updated Name Stars

Showing 10 of 111 repositories

vllm-vcr Public
vLLM inference simulator and replay machine

neuralmagic/vllm-vcr's past year of commit activity

Rust 7 Apache-2.0 2 15 (2 issues need help) 14 Updated Sep 30, 2026
vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs

neuralmagic/vllm's past year of commit activity

Python 17 Apache-2.0 23,085 0 38 Updated Sep 30, 2026
crucible Public
Crucible: an autonomous goal-directed research loop engine

neuralmagic/crucible's past year of commit activity

Rust 9 Apache-2.0 3 7 10 Updated Sep 30, 2026
model-validation-configs Public

neuralmagic/model-validation-configs's past year of commit activity

2 2 1 10 Updated Sep 29, 2026
rh-custom-models-plugin Public

neuralmagic/rh-custom-models-plugin's past year of commit activity

Python 0 Apache-2.0 0 0 0 Updated Sep 29, 2026
eval-hub-contrib Public Forked from eval-hub/eval-hub-contrib
Community-contributed evaluation framework adapters for eval-hub

neuralmagic/eval-hub-contrib's past year of commit activity

Python 0 Apache-2.0 23 0 1 Updated Sep 29, 2026
inspect_k8s_sandbox Public Forked from UKGovernmentBEIS/inspect_k8s_sandbox
A Kubernetes sandbox environment for use with inspect_ai

neuralmagic/inspect_k8s_sandbox's past year of commit activity

Python 0 MIT 35 0 4 Updated Sep 29, 2026
axolotl Public Forked from axolotl-ai-cloud/axolotl
Go ahead and axolotl questions

neuralmagic/axolotl's past year of commit activity

Python 0 Apache-2.0 1,479 0 6 Updated Sep 27, 2026
DeepEP Public Forked from deepseek-ai/DeepEP
DeepEP: an efficient expert-parallel communication library

neuralmagic/DeepEP's past year of commit activity

Cuda 1 MIT 1,470 0 1 Updated Sep 25, 2026
inspect_evals Public Forked from UKGovernmentBEIS/inspect_evals
Collection of evals for Inspect AI

neuralmagic/inspect_evals's past year of commit activity

Python 0 MIT 457 0 9 Updated Sep 24, 2026

View all repositories

People

Top languages

Python Jupyter Notebook Cuda Rust Go

Most used topics

pruning nlp object-detection onnx rust

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.