I'm pretty sure you can't just switch files, I think there's a LOT of hex editing nonsense that needs to be done and it's really a matter of no one wanting to commit all of that work. It's more unreasonable than impossible.
As far as I know the JP sounds and the US ones share all ID numbers, so it might work if you just use the US .brsar and put it in the correct folder(s). This is not the case with the Pal version due to the added languages (wich is why if you use a US PSA on a Pal game (and vica versa) that character's sounds will be diffrent/ not heard).