I want to preface this issue by saying we as an organization have over 5 Billion pulls from Dockerhub. I am not down right refusing to try things but I am near 100% confident this is a specific infrastructure issue with Github.
If anyone else is having this issue please bump this thread, even if it only happened once and a subsequent retry worked.
We recently implemted pushes to Gitlab, Quay.io, and Github along with Dockerhub.
When we push our images we do so in a loop with near identical logic for all of the endpoints.
Github has a realitively high failure rate since implementation a few days ago ( 5 out of our last 50 builds ), here are some example failures:
The problem is random and the error is always the same unknown blob
.
This exact random problem plagued Dockerhub for a brief time during an upgrade:
https://github.com/docker/hub-feedback/issues/1693
Officially they never wrote a post mortem, but unoficially it was related to load balancers being a little to aggressive and the eventual consistent model not working as frontend machines were not aware of the object that was just uploaded.
Please let me know if you need anymore information.