Update:
The mechanic thinks its a stuck valve in the transmission. They were driving it with a diagnostic plugged in, and were finally able to reproduce the issue (they were having a hard time reproducing it previously).

So they are going to add some cleaning fluid to the transmission, I will drive it for a couple weeks, and then they will flush it out.

Hopefully this works!