For solutions for GenAI, benefits like bandwidth and capacity are important, but costs such as power, area and price need to be considered as well. As memory is a passive component dependent on the CPU, configuration changes based on the processor. In this regard, the recent strategic changes at ARM and the potential changes in MoE- based LLM could lead to changes in future architecture and solutions.
Source: Counterpoint Research
Access full 4-pager report here.
If you are not a client, reach out to us at [email protected]
