Skip to content

@neuralmagic Neural Magic

Change the repository type filter

All

    Repositories list

    62 repositories

    • guidellm

      Public
      Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
      Python
      •
      Apache License 2.0
      •21•208•21•14•Updated Mar 6, 2025Mar 6, 2025

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •6.1k•10•0•18•Updated Mar 6, 2025Mar 6, 2025

    • research

      Public
      Repository to enable research flows
      Python
      •0•0•0•1•Updated Mar 6, 2025Mar 6, 2025

    • compressed-tensors

      Public
      A safetensors extension to efficiently store sparse quantized tensors on disk
      Python
      •
      Apache License 2.0
      •9•79•4•7•Updated Mar 6, 2025Mar 6, 2025

    • nm-actions

      Public
      Neural Magic GHA
      Python
      •
      Apache License 2.0
      •0•0•0•3•Updated Mar 5, 2025Mar 5, 2025

    • axolotl

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •969•0•0•2•Updated Mar 4, 2025Mar 4, 2025

    • yolov5

      Public
      YOLOv5 in PyTorch > ONNX > CoreML > TFLite
      Python
      •
      GNU General Public License v3.0
      •17k•20•0•3•Updated Mar 3, 2025Mar 3, 2025

    • upstream-transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •28k•1•0•0•Updated Feb 24, 2025Feb 24, 2025

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •1.5k•0•0•0•Updated Feb 20, 2025Feb 20, 2025

    • pytest-nm-releng

      Public
      Pytest plugin used by the Release Engineering team
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Feb 17, 2025Feb 17, 2025

    • nm-vllm-certs

      Public
      General Information, model certifications, and benchmarks for nm-vllm enterprise distributions
      vllm
      1•11•1•0•Updated Feb 15, 2025Feb 15, 2025

    • mistral-evals

      Public
      Python
      •7•0•0•1•Updated Feb 8, 2025Feb 8, 2025

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •2.2k•3•0•1•Updated Feb 3, 2025Feb 3, 2025

    • evalplus

      Public
      NeuralMagic fork of EvalPlus (Rigourous evaluation of LLM-synthesized code - NeurIPS 2023)
      Python
      •
      Apache License 2.0
      •137•0•0•1•Updated Jan 24, 2025Jan 24, 2025

    • vllm-flash-attention

      Public
      Fast and memory-efficient exact attention
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •1.5k•1•0•0•Updated Jan 23, 2025Jan 23, 2025

    • quant_kernel_benchmarks

      Public
      Benchmarking code for running quantized kernels from vLLM and other libraries
      Python
      •0•5•1•0•Updated Dec 3, 2024Dec 3, 2024

    • docs

      Public
      Top-level directory for documentation and general content
      MDX
      •7•121•0•4•Updated Nov 25, 2024Nov 25, 2024

    • graphs

      Public
      Apache License 2.0
      •0•0•0•0•Updated Nov 15, 2024Nov 15, 2024

    • alpaca_eval

      Public
      An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
      Jupyter Notebook
      •
      Apache License 2.0
      •259•0•0•0•Updated Nov 12, 2024Nov 12, 2024

    • upstream-llm-foundry

      Public
      LLM training code for MosaicML foundation models
      Python
      •
      Apache License 2.0
      •548•0•0•0•Updated Oct 24, 2024Oct 24, 2024

    • nm-vllm

      Public archive
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Other
      •6.1k•260•0•0•Updated Oct 11, 2024Oct 11, 2024

    • mteb

      Public
      MTEB: Massive Text Embedding Benchmark
      Jupyter Notebook
      •
      Apache License 2.0
      •337•0•0•1•Updated Oct 2, 2024Oct 2, 2024

    • transformers

      Public
      🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
      Python
      •
      Apache License 2.0
      •28k•9•0•13•Updated Oct 1, 2024Oct 1, 2024

    • AutoFP8

      Public
      Python
      •
      Apache License 2.0
      •24•178•11•3•Updated Oct 1, 2024Oct 1, 2024

    • OmniQuant

      Public
      [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
      Python
      •
      MIT License
      •59•0•0•1•Updated Sep 27, 2024Sep 27, 2024

    • temp-AutoGPTQ

      Public
      An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
      Python
      •
      MIT License
      •508•0•0•0•Updated Sep 16, 2024Sep 16, 2024

    • upstream-composer

      Public
      Supercharge Your Model Training
      Python
      •
      Apache License 2.0
      •435•0•0•0•Updated Aug 27, 2024Aug 27, 2024

    • MixEval

      Public
      NM fork of MixEval compatible with SparseAutoModel.
      Python
      •41•0•0•1•Updated Aug 20, 2024Aug 20, 2024

    • mamba

      Public
      Mamba SSM architecture
      Python
      •
      Apache License 2.0
      •1.2k•0•0•0•Updated Aug 12, 2024Aug 12, 2024

    • causal-conv1d

      Public
      Causal depthwise conv1d in CUDA, with a PyTorch interface
      Cuda
      •
      BSD 3-Clause "New" or "Revised" License
      •81•0•0•0•Updated Aug 8, 2024Aug 8, 2024