Metadata-Version: 2.1
Name: tensorrt-llm
Version: 0.14.0
Summary: TensorRT-LLM: A TensorRT Toolbox for Large Language Models
Home-page: https://github.com/NVIDIA/TensorRT-LLM
Download-URL: https://github.com/NVIDIA/TensorRT-LLM/tags
Author: NVIDIA Corporation
License: Apache License 2.0
Keywords: nvidia tensorrt deeplearning inference
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3.10
Requires-Python: >=3.7, <4
License-File: LICENSE
Requires-Dist: accelerate>=0.25.0
Requires-Dist: build
Requires-Dist: colored
Requires-Dist: cuda-python==12.5.0
Requires-Dist: diffusers>=0.27.0
Requires-Dist: numpy<2
Requires-Dist: onnx>=1.12.0
Requires-Dist: polygraphy==0.49.9
Requires-Dist: psutil
Requires-Dist: pynvml>=11.5.0
Requires-Dist: pulp
Requires-Dist: pandas
Requires-Dist: h5py==3.10.0
Requires-Dist: pywin32
Requires-Dist: StrEnum
Requires-Dist: sentencepiece>=0.2.0
Requires-Dist: tensorrt~=10.4.0
Requires-Dist: tokenizers>=0.14
Requires-Dist: torch==2.4.1+cu124
Requires-Dist: torchvision==0.19.1+cu124
Requires-Dist: nvidia-modelopt[torch]~=0.17.0
Requires-Dist: transformers<=4.45.1,>=4.38.2
Requires-Dist: wheel
Requires-Dist: optimum
Requires-Dist: evaluate
Requires-Dist: janus
Requires-Dist: mpmath==1.3.0
Provides-Extra: benchmarking
Requires-Dist: click; extra == "benchmarking"
Requires-Dist: pydantic; extra == "benchmarking"
Provides-Extra: devel
Requires-Dist: datasets; extra == "devel"
Requires-Dist: einops; extra == "devel"
Requires-Dist: graphviz; extra == "devel"
Requires-Dist: mypy; extra == "devel"
Requires-Dist: parameterized; extra == "devel"
Requires-Dist: pre-commit; extra == "devel"
Requires-Dist: pybind11; extra == "devel"
Requires-Dist: pybind11-stubgen; extra == "devel"
Requires-Dist: pytest-cov; extra == "devel"
Requires-Dist: pytest-forked; extra == "devel"
Requires-Dist: pytest-xdist; extra == "devel"
Requires-Dist: rouge-score; extra == "devel"
Requires-Dist: cloudpickle; extra == "devel"
Requires-Dist: typing-extensions==4.8.0; extra == "devel"
Requires-Dist: jsonlines==4.0.0; extra == "devel"
Requires-Dist: jieba==0.42.1; extra == "devel"
Requires-Dist: rouge==1.0.1; extra == "devel"

TensorRT-LLM: A TensorRT Toolbox for Large Language Models
