I’ve got 2 rtx 4090s on an EATX motherboard. Been using them to run the full 13B... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		valine on April 10, 2023 \| parent \| context \| favorite \| on: The LLama Effect: Leak Sparked a Series of Open So... I’ve got 2 rtx 4090s on an EATX motherboard. Been using them to run the full 13B un-quantized with a good deal of success. Getting about 20 tokens/s.

int_19h on April 10, 2023 [–]

What is your setup for cooling? I don't think I'd want to stick another 4090-size card in mine with just air cooling...

valine on April 10, 2023 | [–]

I have AIO liquid cooling for both cards. The radiators are annoying though, I might convert it to a custom loop if I ever add a third card.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact