Securing stoppers, e.g. swing stoppers, which are held in position by associated pressure-applying means coacting with the bottle neck