I hate when people say "they will remember you kindness", or something to that effect.

No they won't...not in general. They are far more likely to remember that one time you quarreled, and use that as the basis for everything else going forward. Your kindness never existed.