Memory bandwidth
This is the by far most likely explanation for why the new xbox consoles perform so poorly, if the issue was just difficulty giving all 52 compute units meaningful work then why is series S performing so poorly?
XSX
16 GB GDDR6 with 320-bit bus
10 GB @ 560 GB/s, 6 GB @ 336 GB/s...