In this talk, I’ll share my thoughts on the state of progress in designing AI systems with neural networks. I’ll frame a perspective that views our success as relying on two separate and equally critical steps, that I refer to as neural knowledge acquisition and neural knowledge mobilization. Then I’ll describe my own research journey from that point of view using various examples, discuss lessons learned and highlight what I think are the opportunities and challenges ahead.