Only if you've got it cranking all day. I've got a couple of Tiny (they're Micro, which is the same thing) systems that are silent when idle and nearly silent when running less than a load avg of 5. It's only if I try to spin up a heavy, CPU-bound process that their singular fan spins fast enough to be noticable.
So don't use one as a Mining rig, but if you want something that runs x64 workloads at 9-20 watts continuously, they're pretty good.
Not really. Windows only supports FAT and NTFS filesystems natively. There was an old ext-fs driver back in the day, but I have not looked for one in a decade or more. There might be one out there already.
The deal with case-insensative support is likely from Windows users who are annoyed that Readme.md, readme.md, and README.MD are separate files on ext4 but the same file in FAT or NTFS. UNIX and Linux come from a school of thought that allowed you to do things like use different case in filenames.