Actions/setup-node cache with matrix of Node Versions

Is it necessary to use different cache folders when using different node versions (from a matrix)? I would like to know if it’s safe to use setup-node's cache option without worrying about the usage node versions or is it necessary to keep using actions/cache to keep using different cache folders for each node version.

More context on the discussion:

Interesting resource: