Latency is only a problem if you are signing dozens of events per second. Pomegranate is made for humans.
And encryption methods are supported, but they're unsafe, slow and shouldn't be used, it would be awful. NIP-4E is the only solution here.
Reconstructing the private key locally is not encouraged. The entire point is to make clients not have access to the key.