Github push fails due to large failes, no matter what I do

I am trying to push a Unity project into github but it keeps failing due to large file sizes. The files are:

Library/Il2cppBuildCache/Android/arm64-v8a/Native/arm64-v8a/libil2cpp.dbg.soLibrary/Il2cppBuildCache/Android/arm64-v8a/Native/arm64-v8a/libil2cpp.sym.soLibrary/Il2cppBuildCache/Android/armeabi-v7a/Native/armeabi-v7a/libil2cpp.dbg.soLibrary/Il2cppBuildCache/Android/armeabi-v7a/Native/armeabi-v7a/libil2cpp.sym.so

I have already tried adding them to .gitignore, and have also setup git large files and added them to .gtattributes as follows:

*.so binary

*.dbg.so binary

*.sym.so binary

I still get the file size error messages. I’ve also tried:

rm -r --cached .

and re-add and recommit, but no luck. Basically been trying for days but not getting anywhere.