Well, it did compromise the entire engagement.
The trusted agent calls your team lead about 45 minutes later to deconflict red team activity.
“Our IDS picked up a clear text OpenSSH key that exited the network and headed outbound towards an unknown IP address. Was this red team activity?”
Your team lead affirms that this was your activity.
“Huh… to be honest, we kind of expected your team to handle our sensitive information with a bit more care. I’ll confirm deconfliction with the defense team and you can continue the engagement, but I have to be honest and say that this is not going to look good in the final report.”
You took the easy way out and you paid for it. Your team lead sees this as an integrity violation and asks that you take a back seat for the rest of the engagement.