How to cache external docker images?

External docker images from Docker Hub is always pulled in to the runner and the caching is not applicable. Is there a way we can cache external docker images? Using the Dockerfile based build are highly time consuming, especially during the initial try out phase.

Now github actions doesn’t support to cache docker images natively. You could add comment in the existing issue in action/cache repo: 

And peter-evans provide an example for Docker layer caching. You could see the Pull request here, see whether it could help