Hello,
After all your tests it looks like a numerical instability caused by BTABOS (explicit part of the boundary condition), so we would have to look at the formula with this option 2. If it is really a matter of stability, reducing the time-step should solve the problem or allow to go further. I am not sure that a flux condition at a boundary like nut*dC/dn=ATABOS*(C-C0)=ATABOS*C+BTABOS is always stable (I anticipate that it is this kind of condition that we have). It is probably unstable if C is too far from C0.
With best regards,
Jean-Michel Hervouet