Another Penalty...

Am I getting penalized for being AFK?? Only when I'm doing Castle Duels And after I've merged all my characters and am waiting for the opponent, that's it. It's about 20-30 seconds, or 40-50 seconds if it's long. Is this why I'm getting penalized;;;; Is there anyone else playing this game Who gets AFK penalties frequently like me?? Seriously, I can't even...