floofloof@lemmy.ca to Technology@lemmy.worldEnglish · 7 months ago1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgexternal-linkmessage-square36fedilinkarrow-up1120arrow-down115
arrow-up1105arrow-down1external-link1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgfloofloof@lemmy.ca to Technology@lemmy.worldEnglish · 7 months agomessage-square36fedilink
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up11arrow-down1·7 months agoSmaller and speedier means larger token windows and greater variety of models. Not less energy.
Smaller and speedier means larger token windows and greater variety of models.
Not less energy.