inari@piefed.zip to People Twitter@sh.itjust.worksEnglish · 2 days agoManagersmedia.piefed.zipimagemessage-square175linkfedilinkarrow-up1956arrow-down13
arrow-up1953arrow-down1imageManagersmedia.piefed.zipinari@piefed.zip to People Twitter@sh.itjust.worksEnglish · 2 days agomessage-square175linkfedilink
minus-squareIratePirate@feddit.orglinkfedilinkarrow-up7·2 days agoAn Nvidia B200 (192 Gigs of RAM) sells somewhere between 30-50k a pop. That’s feasible for a company.
minus-squareKazumara@discuss.tchncs.delinkfedilinkarrow-up4·1 day agoAnd then you can serve one inference at a time. Hopefully your devs are well distributed over timezones :-)
minus-squareDiurnambule@jlai.lulinkfedilinkarrow-up5·1 day agoWonderfull idea, may be they can connect to the same PC, and we can call it main frame or something. xD
minus-squarebaronofclubs@lemmy.worldlinkfedilinkarrow-up3·1 day agoI don’t see why it wouldn’t be feasible to rent someone else’s computer to use for something like this, seeing how it could amortize costs over time.
An Nvidia B200 (192 Gigs of RAM) sells somewhere between 30-50k a pop. That’s feasible for a company.
And then you can serve one inference at a time. Hopefully your devs are well distributed over timezones :-)
Wonderfull idea, may be they can connect to the same PC, and we can call it main frame or something. xD
I don’t see why it wouldn’t be feasible to rent someone else’s computer to use for something like this, seeing how it could amortize costs over time.