Simply remove the disposal and the ‘sink disposal adapter’.  Then install a standard ‘sink flange’ (6 5/8″) to the proper pipe size.

This is exactly the solution your “plumber” should have come up with instantly.