As promised:

So I ended up recoding the led matrix code to offload some of the heavy lifting to another box and just use the portal matrix board for display functions. I need to sleep a bit but I will write up the building/coding up later.

once again, thanks for buying me a coffee.