Before it terminated too quickly so it would incloude half of the duplicates. This would cause a problem if we added multiple bits with the same ident (nested record values for example).