Q: Does it allow us to implement our own non-standard encryption layer(filter) to do decryption for reading PDFs and also encryption for writing changes like annotations or form fields?
Custom security handlers are supported, as are the setting or modifying of security permissions associated with a document. Please refer to these relevant forum posts:
Additionally both Android and iOS SDK come with a sample custom filters.
For Android please see:
For iOS please see: