Villagers at Ringstead, near Hunstanton, have been told they can't be connected to a popular bus service because it would lengthen journey times.