New #neuromorphic #SpikingNeuralNetworks paper with Pengfei Sun, Zhe Su, nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqwmycn7r6cnhp5rlg63rp3vm40vex70hl5gk7dzzrdtcqzdr29mhq070g2l (nprofile…0g2l), nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqnvp92ljgp9mrztfh5gmwld2an0lmvyn74ykryh3sqsfyqp2jjyss35wyuq (nprofile…wyuq) and Danyal Akarca:
https://neural-reckoning.org/pub_dual_memory_pathways.html
Long story short, we found a neat new trick for augmenting spiking neural networks with a tiny separate memory buffer, that gives a huge boost to performance on tasks with temporal structure at a very low memory cost (state-of-the-art performance with 40-60% fewer parameters). It's also very neuromorphic hardware-friendly and gives us 4x increased throughput and 5x improvement in energy efficiency compared to state-of-the-art.
We think this is (a) a great example of where an abstraction inspired by biology can lead to networks that are both algorithmically effective and hardware-efficient, (b) shows the power of doing hardware-software co-design for neuromorphic computation.