Really why have the PCI/CPU artifice at all? Apple and Nvidia have the right ide... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kristjansson 3 months ago \| parent \| context \| favorite \| on: Big GPUs don't need big PCs Really why have the PCI/CPU artifice at all? Apple and Nvidia have the right idea: put the MPP on the same die/package as the CPU.

bigyabai 3 months ago | [–]

> put the MPP on the same die/package as the CPU.

That would help in latency-constrained workloads, but I don't think it would make much of a difference for AI or most HPC applications.

PunchyHamster 3 months ago | [–]

We need low power but high PCIE lane count CPUs for that. Just purely for shoving models from NVMe to GPU

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact