Megatron-Core

From wikieduonline

Jump to navigation Jump to search

wikipedia:Megatron-Core is a self contained, light weight PyTorch library that packages everything essential for training large scale transformer.

Pytorch, cross_entropy, Megatron-Core
Transformer, GPT, Transformer 8, Ethched, Megatron-Core

Nvidia, GPU, Nvidia tools, nvidia-smi, CUDA, Nvidia Drive, Tegra, EVGA Corporation, A10, A100, H100, T4, L4, K80, gpustat, Nvidia Xavier, NVML, TOPS, Nvidia broadcast, Mellanox, Jensen Huang, NVIDIA driver, Nvidia RTX, Tensor Cores, Nvidia DGX, Nvidia Omniverse Cloud, Drive Thor, Ada, Hopper, NVIDIA device plugin for Kubernetes, NVIDIA DCGM, NVIDIA GPU Operator, Megatron-Core, NVLM, NVIDIA GPU Boost, NVSwitch, NVIDIA Driver R450+

Retrieved from "https://www.wikieduonline.com/index.php?title=Megatron-Core&oldid=347289"

Advertising: