Like k9 mail, password store or conversations. This would also allow better management of keys when many apps are used together with the same key, for example OpenKeyChain allows remembering key password for a specified amount of time and currently pep android is completely unusable with an imported key.