Fine tune a 70B language model at home
601 by jph00 | 146 comments on Hacker News.
Jeremy from Answer.AI here. This is our first project since launching our new R&D lab at the start of this year. It's the #1 most requested thing I've been hearing from open source model builders: the ability to use multiple GPUs with QLoRA training. So that's why we decided to make it our first project. Huge thanks to Tim Dettmers for helping us get started to this -- and of course for creating QLoRA in the first place! Let me know if you have any questions or thoughts.
New best story on Hacker News: The Worst Website in the Entire World
The Worst Website in the Entire World 386 by speckx | 187 comments on Hacker News.
-
рдмोрд░्рдбा рдпेрдеीрд▓ рдорд╣िрд▓ा рд╕рд░рдкंрдЪाрд╡рд░ рдЕрд╡िрд╢्рд╡ाрд╕ рдард░ाрд╡ рдоंрдЬूрд░ рд╡рд░ोрд░ा рд╢рд╣рд░ा рд▓рдЧрдд рдЕрд╕рд▓ेрд▓ी рдмोрд░्рдбा рдЧ्рд░ाрдордкंрдЪाрдпрдд рд╣ी рд╡िрдХрд╕िрдд рдЖрдгि рдЕрдзिрдХ рдорд╣рд╕ूрд▓ рдЕрд╕рд▓ेрд▓ी рдЧ्рд░ाрдордк...
-
рдЯ्рд░ॅрдХ्рдЯрд░рдЪ्рдпा рдЕрдкрдШाрддाрдд рдЪाрд▓рдХाрдЪा рдоृрдд्рдпू рдкाрд╡рдиा рдЧाрд╡ाрдЬрд╡рд│ीрд▓ рдШрдЯрдиा рд╕ंрдкाрджрдХ / рддुрд▓рд╕ीрджाрд╕ рдЕрд▓ाрдо рднрдж्рд░ाрд╡рддी - рдЯ्рд░ॅрдХ्рдЯрд░рдЪे рд╕рдоोрд░рдЪे рдПрдХ рдЪाрдХ рдЕрдЪाрдирдХ рдиि...
-
рд╕рд░рдкंрдЪा рд╡िрд░ोрдзाрдд рдЕрд╡िрд╢्рд╡ाрд╕ рдард░ाрд╡ рдоांрдбрд▓ा рддрд╕ीрд▓рджाрд░ांрдиी рд╕рд░рдкंрдЪाрд▓ा рдХेрд▓े рдЕрдкाрдд्рд░ рдШोрд╖िрдд рд╕рднेрддूрди рдмाрд╣ेрд░ рдиिрдШाрд▓्рдпाрдиंрддрд░ рдЙрдкрд╕рд░рдкंрдЪाрдиी рдХेрд▓ी рдЕрдкाрдд्рд░ рд╕рд░рдкंрдЪाрд▓ा рд╢िрд╡ी...