Unable to deploy package from Github Actions

In my company we have several internal Android libraries that we develop to offer the same solution through our Apps.

In order to make its usage easier we planned to deploy all of them to a single GitHub Repo using GitHub Packages feature.

To accomplish the deploy action we use the publish gradle task, set to upload files to this repo.

The problem we are running right now is that if we use this process locally it passes and successfully deploy the library, but if try to run it from GitHub Actions (on a different repo than the target repo to deploy to but with the same token used locally) we receive a 401 Unauthorized error.

Is there any limitation that prevents to accepted deployments from different repos?