It sounds like you made an honest and caring decision for both of you. And he knew that too. People need to stop giving you advice and follow your example instead. Having followed your writing, I would have been surprised if you went on the date with your intuition saying don’t. It’s almost a no-brainer. I hardly know you but I know that much.