LogoTensorFusion 文档
LogoTensorFusion 文档
首页文档

QoS级别与计价

配置QoS级别和多租户应用级内部计价

配置QoS级别的调度优先级

🚧 Under Construction

配置GPU租用单价信息

kubectl edit configmap tensor-fusion-sys-public-gpu-info -n tensor-fusion-sys
# Refer:
#  - https://www.techpowerup.com/gpu-specs
#  - https://getdeploying.com/reference/cloud-gpu

# Field Definition:
# - 'model' is `GPUModel_BoardSlotType` to identify the GPU
# - 'costPerHour' is the average cost referring a few Cloud/Serverless GPU vendors
# - 'fp16TFlops' is the max FP16 TFLOPs of the GPU. For NVIDIA, it means none-sparsity performance and using Tensor Cores

# note that this sheet only contains TFLOPs, no VRAM, since variant GPUs have the same TFLOPs but different VRAM, VRAM can be easily detected from NVML lib
# TODO: this should be dynamic after user inputs their cloud vendor and discounts info, for example Azure/AWS has much higher price than this sheet

# Turing Architecture Series
- model: T4
  fullModelName: "Tesla T4"
  vendor: NVIDIA
  costPerHour: 0.53
  fp16TFlops: 65

目录

配置QoS级别的调度优先级
配置GPU租用单价信息