Updates storage

Could we delete updates once a new one is installed without issues, to increase memory storage on device?

Yes, because trying to downgrade but to an older one is not reccommended. So you need to do full reinstall anyway…

I have been deleting updates.

Yes… but I often save them to a USB or SD Card, just to have in case of something… and then delete.