A derelict former city swimming pool is set to be redeveloped after complaints from residents it has become an “eyesore”.