I'm fairly certain they don't take away your goodwill. You only lose good will for leaving a game.