Codec transcoding takes a lot of CPU cycles.
Make sure ALL devices (OP and TP) have these settings set to Yes:
Example in which you can see that 284 calls takes 287.9% of CPU for Freeswitch: