I read your question a couple of times so I got a good understanding of the story.
It is up to you to chose whether to tell him your honest feelings. I would encourage you to tell him how you feel. I know it is a risk but at least you would know for sure how he feels too and also it will be off your chest and something you won’t regret that you haven’t done.
Whatever you decide to do. Remember people come and go out of your life for a reason. It might not make sense at that moment but in the future it will make sense.
If the friendship doesn’t work out, it wasn’t meant to be. Take care of yourself and good luck 😊