Wallingford Town Council has agreed to proceed with plans to move out of the current office space next to the Regal.