Simply, I disagree with you. The Special Teams unit was on the field when the TD happened, therefore, the Special Teams gets credit for it.
Kickers are different pending your league format. If your league specifically starts a kicker, then the kickers scoring is separate from the Special Teams. If you don't specifically start a kicker and he's a part of the special teams, then his scores are a part of the special teams.
You can't make it any simpler than: "If the Special Teams unit is on the field, the Special Teams gets the points".
You can disagree. The nfl doesnt.
If there is a down and distance its an offensive play. See how simple my response is to yours? Its really very black and white.