City offices would ‘spoil Queen’s view’