Since getting my SD1, I've had it running on carbs, hotwire efi and now Megasquirt, the ignition system has changed from the original dizzy to EDIS8, and the problem has persisted exactly the same. Earlier today with the help of my dad we re-checked the ignition timing, did a few runs with different advances to rule out detonation, and done a compression test which gave 135-150psi on all 8 cylinders.
Another more recent problem is there's a light top end tapping at low rpm, with the engine at operating temperature, generally at light load cruising. Backing off or pressing the throttle makes it go away, sounds like one of the lifters has lost pressure and it does it most of the time. I'm not sure if this is related to the high rpm misfire problem? I have been wondering if it's one of the rods as it does it generally only at cruising loads?
My dad suggested the high rpm misfire could be some of the valves floating, a quick Google search does show very similar symptoms, as the engine has always felt flat at higher rpms, it doesn't pull hard like my old Land Rover did. Low to mid rpm it's fine, just lacks the ooomph when the throttle is held wide open

Any thoughts and suggestions before I go and tear the top end apart?