Talked with Grok and with Grok’s help, I realized that there could be an easy and simple way to realize chip level logic control for premainpost networks on intermediate omnitoken – a register for per processing unit and a tag for each data batch of input and output.
The logic control unit of the chip just store and send each data batch according to the batch tag, and the processing unit will process the data batch according to the batch tag and the register of the processing unit will store the batch tag of the data batch which is processed in the processing unit.
This processing unit register & batch tag together can be a very simple, easy and low work load solution to create an chip especially an inference chip which can adapt highly flexibly to different premainpost networks on intermediate omnitoken. Grok cannot find any previous chip which has applied this processing unit register & batch tag, haha, although it’s so simple, easy but powerful, isnt it?
The only limit is that this solution may require some processing units to share some big range of memory.
Be First to Comment