Well, it's currently 3.49 MB. Is there a chance that there are perhaps some corrupt portraits?
It's possible. Every custom portrait has to be in CI8 format, and use an RGB5A3 palette. If even one portrait doesn't use these formats, then you're looking at some problems.