This is a great answer and I might add an increase in the number of dendrites at the synapse as well. These physical changes are thought to result in electrophysiological changes in the post-synaptic neuron, such as long-term potentiation (LTP). But u/chazwomaq, is correct in that nobody knows how these changes underlie the formation of memories.