There has been a "worrying decline" in families approved to adopt a child, a charity has warned.