I’m working on something that does what you’re asking for, up to a 4x4 matrix, similar in feel to something like this: Piecewise Expressions in Notes | Component Based Approach
Not happy with how the Augmented Matrix side of things is turning out, so not sure when/if I’ll be done with it.