So, needed to fix the marshalling of managed types to the native plugin and to alter the way I was hashing the planes for lookup. Apparently you need to be aware of blittable types when it comes to sharing data between managed libraries and native ones.
Things are performing better, which is good.
Still writing unit tests to harden and solidify my core, while I watch some super hero movies with one eye.