See [comment](https://github.com/larq/larq/issues/508#issuecomment-683264080) by @Sreerag-ibtl in #508.