Whether you go or not must be your future interest. You call each other neighbors across the street. I can see that your relationship is average. For ordinary neighbors, if the gift money is not too much, it is best to be kind, and there is no harm in going. There is an old saying in China: What's the harm of spending a little money with a little joy? Adding icing on the cake to others, it's okay to have fragrance in your hand.
In addition, if the other person's conduct is a bit unconventional, that is to say, he is very powerful, extreme and ungrateful, then it doesn't matter if he doesn't send it. After all, this kind of person is the kind of person we don't please, and it's useless to spend money.
Therefore, whether you go or not depends on the character of your neighbor.