Most people will notice if a work they just gifted someone and are eagerly waiting for comments and kudos on suddenly isn't gifted to that person anymore.

A couple months later? Maybe not, if you really must reject a gift and you wait a couple months to do it probably nobody will notice. But in the anon period they almost definitely will.