My dear, its quite possible that he is too deep in thought at that moment to be attentive to you. This does not seem like it is a problem. But perhaps it would be wiser when he is fully attentive to you that you should then ask him what happens to him sometimes when he does not answer yu. He may be able to answer you better in such moments.