Skip to main content ↑ ↓
Topic: Help please? FS or Git problem? (Read 738 times) previous topic - next topic
0 Members and 1 Guest are viewing this topic.

Help please? FS or Git problem?

Hi, I have been using Artix just over a week now. So far I am very happy with the Distro, in terms of what I use it for (Software development, and Gaming(Testing))

I have installed the Distro onto a Sandisc Cruzer 3, 32gb for mobility. Ext4.
(Runit, KDE Plasma version)
I have one issue so far:

When I clone from Gitlab, somehow the cloned files become currupt. (It doesn't seem like its doing it from other repos, just the specific one: I am busy helping with development)
The repo size is about 200mb, and it only clones 30-50mb. I have also tried to clone to another partition on a separate drive, and it still does the same though.
(Let alone sitting through a build for a hoir just to get a few errors: so and so file is currupt, etc)

Lately I have been getting errors when trying to download KDE Widgets, which it didn't do a few days ago.

1) Has anyone else had a similiar issue?

2) could it be because of the filesystem type? (Ext4) and would it fix the problem if I reinstall using xfs? Or f2fs?
(Which filesystem is best suited for running Artix from a USB drive? (If I reinstall on another usb drive, that I do it correctly?))

3) the git app might be currupt or broken?

4) could it be that the flashdrive fs is currupt? (It is a brand new usb drive that was bought specifically to test Artix).

Nr4 is my biggest suspicion, although I need some extra opinions incase I have missed something. I need the OS and FS 100%, because I can't afford to lose work etc because of it.
(I have tested the repo by cloning from it with an indentical USB drive with Mint on it, and also from my Win10 partition. So the repo files is 100%)

Thank you.

Re: Help please? FS or Git problem?

Reply #1 –
ext4 definitely works great with git. There would be a lot more panic if something is wrong. I have no idea what repo you are cloning but if it's just that specific repo that somehow has corrupt files, I would suspect someone committed those corrupted files.

Re: Help please? FS or Git problem?

Reply #2 –
BTRFS is better than EXT4 for corruption - it's Copy On Write which makes problems less likely to happen, it also has better checking and recovery functions, it will tell you what particular file(s) is/are corrupted. It won't fix a faulty drive but will be more helpful about it. Cheap USB's often fail, although yours is a good brand. You can run an fsck with EXT4 too though, so you ought to be able to see if the actual file system is corrupted, or if the file system is fine and it's just the file itself, in which case you won't get any fsck / btrfs scrub errors:
Code: [Select]
e2fsck -vf /dev/sd?
or btrfs:
mount /dev/sd?? mntpoint
btrfs scrub start mntpoint
btrfs scrub status mntpoint
e2fsck used to tell you there were errors, delete the problem "inodes" then let you figure out what was missing!
(You can even convert EXT4 to BTRFS without reinstalling, although backing up first is recommended, easy and no problems when I tried this in the past.)
Another possibility is some kind of transmission issue between you and GitLab, although that would be pretty weird and unlikely.
There have been some browser compatibility issues on both GitHub and GitLab recently too, various things not working, and searching about the issue, in the past there have been bugs with the GitLab code where repo corruption can occur as a result of an incomplete push due to a crash for example. But as you say  you can download the same thing OK elsewhere it's probably not that.

Re: Help please? FS or Git problem?

Reply #3 –
Thank you for your advice.

How do I do the fsck command when the (main) partition is still mounted?
Or is there a way to schedule it with the next boot?
Or do I boot into a recovery/terninal mode?

(I did clone the repo again, using my mint flashdrive, did my work, commit, MR, etc, no problems with git)

The Repo I am/was, cloning/working is:

https://gitlab.com/veloren/dev/veloren/

Thanknyiu again so much

Re: Help please? FS or Git problem?

Reply #4 –
Run the fsck on the unmounted USB from Mint, it should tell you if it's OK or not.
But trying this, using https I only clone 39.60MB, and ssh doesn't work at all, possibly because I don't have a gitlab account or something:

Code: [Select]
$ git clone https://gitlab.com/veloren/dev/veloren.git
Cloning into 'veloren'...
remote: Enumerating objects: 154773, done.
remote: Counting objects: 100% (47275/47275), done.
remote: Compressing objects: 100% (8001/8001), done.
remote: Total 154773 (delta 43748), reused 41484 (delta 39110), pack-reused 107498
Receiving objects: 100% (154773/154773), 39.60 MiB | 873.00 KiB/s, done.
Resolving deltas: 100% (108267/108267), done.


$ git clone [email protected]:veloren/dev/veloren.git
Cloning into 'veloren'...
The authenticity of host 'gitlab.com (2606:4700:90:0:f22e:fbec:5bed:a9b9)' can't be established.
ED25519 key fingerprint is SHA256:eUXGGm1YGsMAS7vkcx6JOJdOGHPem5gQp4taiCfCLB8.
This key is not known by any other names
Are you sure you want to continue connecting (yes/no/[fingerprint])? y
Please type 'yes', 'no' or the fingerprint: yes
Warning: Permanently added 'gitlab.com' (ED25519) to the list of known hosts.
[email protected]: Permission denied (publickey,keyboard-interactive).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

$ git clone [email protected]:veloren/dev/veloren.git
Cloning into 'veloren'...
[email protected]: Permission denied (publickey,keyboard-interactive).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

Re: Help please? FS or Git problem?

Reply #5 –
Have you read the "Book" ?
https://book.veloren.net/contributors/working-with-git.html

They explicitly mention:
Quote
Note: Veloren needs git LFS installed before cloning to be able to download the assets. If you already cloned the repository before setting up git LFS use these steps to get the assets downloaded.
The steps can be found at:
https://book.veloren.net/contributors/troubleshooting.html#when-lfs-was-not-setup-before-cloning-the-repo

Right, get Git LFS ready:
https://book.veloren.net/contributors/development-tools.html#git-lfs
 

Re: Help please? FS or Git problem?

Reply #6 –
Yes, I do have git-lfs installed in Artix and  have followed the book.

however I was not aware of the steps in the troubleshoot section.

Mint seemed to have cloned the repo without any issues or using the trouble shoot walkthrough. I will test it later this weekend with Artix.
Thank you