Wandsworth council has said a new design for Putney Place is too tall.
It rejected a planning application for a build designed by Will Alsop saying it would "loom large" over the area.
The proposal was for two towers of apartments and commercial property, 21 and 26-storeys tall.
The Putney Society supports plans for tall buildings, but would prefer them to be limited to 16 storeys.
Despite this planning committee chairman Leslie McDonnell said: "The committee could not see any justification for a scheme of such overwhelming size and scale"
Mr McDonnell explained the real test for a design was whether it could improve an area.
"In the eyes of the community and the council, this scheme clearly fails that test," he said.
Developer Oracle has previously run into difficulty with the Committee of Architecture and Built Environment, which had criticised the designs sustainability plans.