Should it be a priority to update for every newly released version?

You should be at least with 2 or 3 releases at a min. However, it's always best to see the release notes to check if there are any emergency fixes that may require you to upgrade immediately.

I would look at the release notes and make sure you don't need the fixes or features added. I try to stay with the latest version. I do 2-3 updates a year. If there is a security risk then we upgrade quicker.

You don't have to update Go Anywhere too often because it rarely has huge changes. What I have observed is that whenever big changes are released it is always best to wait 3 weeks for the next patch and then apply that one. Big changes usually have bugs in GA. I suggest checking every 3 months.