Natural Llamas have a somewhat restricted vary, in nature: the Andes Mountains, and that’s it. People weren’t content material to let the fluffy, friend-shaped creatures keep of their pure habitat, nonetheless, and so they can now be discovered on each continent besides Antarctica. The Llama2 Giant Language Mannequin is like that: whereas it could have began on a GPU someplace, because of enterprising hackers like [Caio Madeira], who has ported Llama2 to the PlayStation Moveable (PSP), the fluffiest LLM might be discovered nearly anyplace.
In the end this venture has its roots in Llama2.c by [karpathy], a venture we’ve seen used on Pentium II below Home windows 98, DOS machines working 486 processors, and even the venerable Commodore 64, of all not possible issues. Now, it’s the PSP’s flip. This implementation makes use of the identical 260K tinystories mannequin because the C64 port, upon which it’s primarily based. After all the PSP’s RAM has room for a a lot bigger mannequin, however [Ciao] apparently prefers to run the tiny mannequin quicker on this less-ancient gaming {hardware}.
Its attending to the purpose that it’s more durable to seek out programs that received’t run LLMs than people who do. Provided that Llama2 appears to be the brand new DOOM, it’s most likely solely a matter of time earlier than their digital fur is throughout all our outdated tools. Luckily for allergy victims, digital fur can’t set off a histamine response.
If you recognize of one other system getting LLMs (Alpaca-adjacent or in any other case), ship in a tip.
