Wudi@feddit.uk to Technology@lemmy.worldEnglish · 5 days agoCalifornia’s Universities Went All In on A.I. The Result Has Been Chaoswww.nytimes.comexternal-linkmessage-square29linkfedilinkarrow-up1132arrow-down15
arrow-up1127arrow-down1external-linkCalifornia’s Universities Went All In on A.I. The Result Has Been Chaoswww.nytimes.comWudi@feddit.uk to Technology@lemmy.worldEnglish · 5 days agomessage-square29linkfedilink
minus-squarephutatorius@lemmy.ziplinkfedilinkEnglisharrow-up1·3 days ago It takes a certain amount of electricity to run That’s not a constant across all LLMs. There are big differences between LLMs in how much inference you get per watt-hour.
That’s not a constant across all LLMs. There are big differences between LLMs in how much inference you get per watt-hour.