Reentry with o1 visa, while AOS pending

[Bouazizi]

Hi,

I am on O1 visa and travelled twice outside the US while my 485 is pending.
I reentered the US on my O1 visa, one time before I got the EAD card and one time after.
Does that mean that my AOS is now terminated? Does the USCIS communicate this and how long does it take them to find out?
I was mislead by my lawyer, who said that I can do that with my O1 visa.
Is the application of my children and wife also terminated even if they did not leave the US?
What are my options now?

PS: my I-140 was already approved.

Thanks for your answers.