You handle a small part of the model (about 8 gigabytes which is small compared to the 352 gigabytes required), and other people have other parts. The idea behind Petals is like BitTorrent. These AI language models are all the rage, but they take significant computer resources. Now Petals wants to use this same method with language models.
The idea was you would download bits and pieces of a file from different places and, in theory, people would download bits and pieces that you have if they need them. But with the widespread use of computer audio and video, it was easy to swamp an FTP server so - eventually - BitTorrent was born.
In the old days of the Internet, FTP was sufficient for downloading the occasional file.
0 kommentar(er)
