Start with the working set
Compare the model weights, numerical format, KV cache, batch size and application overhead with the per-GPU memory shown below. Additional memory can change which workload fits; it does not by itself establish application throughput.
Validate the whole server
Review the exact server qualification, PCIe topology, auxiliary power, airflow or liquid-cooling arrangement, rack power and supported firmware. A PCIe connector does not make these cards interchangeable in every server.
Specify the NVLink configuration
A bridge and supported card grouping are separate configuration decisions. Capacities and prices here are per listed GPU, not the combined memory or price of an NVLink pair, four-card assembly or complete server.