Sounds like maybe there is some crap in the fluid, if the very small passages get clogged well need I say more.
When you switch gears it changes the fluid flow and then back, this could move the crap along. Plus the fluid it thicker when it is cold compounding the problem.
I would try a trans...