Don't put too many CSPs onto common5.pac. Doing so will likely cause the game to freeze the instant you go to the character select screen.
I've been able to have up to 130 portraits without too much issues.
I've fit about 143 portraits with no freezing... Yet.