Category
Machine learning
Store
Wordery
Brand
Grant greenfelder
Communication optimization in Machine Learning : Grant Greenfelder : 9789434135113 : 9434135117 : 03 Apr 2023 : Recent studies showed that for large models, such as GPT-3 which requires 355 years to complete the training using one fastest GPU, it is necessary to use thousands of GPUs to finish the training. Therefore the design of scalable distributed training system imposes a significant implication for the future development of machine learning. One major bottleneck for the scalability of the training system is the communication cost, which could totally overweight the computation cost on commodity systems with that offer limited network bandwidth or high network latency.
22.99 GBP
Recommendations
Choose your language and region
Klarna is available around the world with a variable offering, choose one that suits you best.
Copyright © 2005-2024 Klarna Bank AB (publ). Headquarters: Stockholm, Sweden. All rights reserved. Klarna Bank AB (publ). Sveavägen 46, 111 34 Stockholm. Organization number: 556737-0431