• invalidusernamelol [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    2
    ·
    18 hours ago

    Copyparty is cool, but it’s still a very green app. If you want to use that, I’d run it as a container within your TrueNAS/FreeNAS install. That way you get the foundation of the tested software with a fun UI added on top.

    Also having read some of the copy party source, it was written by a madman

    • decaptcha [none/use name]@hexbear.net
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      16 hours ago

      Yeah for sure if I get time to tinker I’ll just run copyparty separately, and that’s probably good advice for everyone, thanks. Wdym a madman? Did they leave a manifesto in the comments?

      • invalidusernamelol [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        9 hours ago

        There’s goofy design patterns and fun comments all over lol, the whole project is super cool, but absolutely someone’s passion project.

        I say this as someone who deeply respects what they have been able to accomplish. Namely making a Python application that can run on most versions of Python 2.7+ and Python 3.x.

        If you look at a lot of the backend stuff, they use a huge number of single and double character variables that live for the duration of an object and primarily use classes as namespaces. I’m just more used to seeing Python code that builds out clear abstractions and interfaces with the existing data model or implements interaction with that data model so you can use each component separately. Here’s an example of an __init__ for one of their monolithic classes (it’s ~5k lines in total)

        spoiler
        class SvcHub(object):
            """
            Hosts all services which cannot be parallelized due to reliance on monolithic resources.
            Creates a Broker which does most of the heavy stuff; hosted services can use this to perform work:
                hub.broker.<say|ask>(destination, args_list).
        
            Either BrokerThr (plain threads) or BrokerMP (multiprocessing) is used depending on configuration.
            Nothing is returned synchronously; if you want any value returned from the call,
            put() can return a queue (if want_reply=True) which has a blocking get() with the response.
            """
        
            def __init__(
                self,
                args: argparse.Namespace,
                dargs: argparse.Namespace,
                argv: list[str],
                printed: str,
            ) -> None:
                self.args = args
                self.dargs = dargs
                self.argv = argv
                self.E: EnvParams = args.E
                self.no_ansi = args.no_ansi
                self.tz = UTC if args.log_utc else None
                self.logf: Optional[typing.TextIO] = None
                self.logf_base_fn = ""
                self.is_dut = False  # running in unittest; always False
                self.stop_req = False
                self.stopping = False
                self.stopped = False
                self.reload_req = False
                self.reload_mutex = threading.Lock()
                self.stop_cond = threading.Condition()
                self.nsigs = 3
                self.retcode = 0
                self.httpsrv_up = 0
                self.qr_tsz = None
        
                self.log_mutex = threading.Lock()
                self.cday = 0
                self.cmon = 0
                self.tstack = 0.0
        
                self.iphash = HMaccas(os.path.join(self.E.cfg, "iphash"), 8)
        
                if args.sss or args.s >= 3:
                    args.ss = True
                    args.no_dav = True
                    args.no_logues = True
                    args.no_readme = True
                    args.lo = args.lo or "cpp-%Y-%m%d-%H%M%S.txt.xz"
                    args.ls = args.ls or "**,*,ln,p,r"
        
                if args.ss or args.s >= 2:
                    args.s = True
                    args.unpost = 0
                    args.no_del = True
                    args.no_mv = True
                    args.reflink = True
                    args.dav_auth = True
                    args.vague_403 = True
                    args.nih = True
        
                if args.s:
                    args.dotpart = True
                    args.no_thumb = True
                    args.no_mtag_ff = True
                    args.no_robots = True
                    args.force_js = True
        
                if not self._process_config():
                    raise Exception(BAD_CFG)
        
                # for non-http clients (ftp, tftp)
                self.bans: dict[str, int] = {}
                self.gpwd = Garda(self.args.ban_pw)
                self.gpwc = Garda(self.args.ban_pwc)
                self.g404 = Garda(self.args.ban_404)
                self.g403 = Garda(self.args.ban_403)
                self.g422 = Garda(self.args.ban_422, False)
                self.gmal = Garda(self.args.ban_422)
                self.gurl = Garda(self.args.ban_url)
        
                self.log_div = 10 ** (6 - args.log_tdec)
                self.log_efmt = "%02d:%02d:%02d.%0{}d".format(args.log_tdec)
                self.log_dfmt = "%04d-%04d-%06d.%0{}d".format(args.log_tdec)
                self.log = self._log_disabled if args.q else self._log_enabled
                if args.lo:
                    self._setup_logfile(printed)
        
                lg = logging.getLogger()
                lh = HLog(self.log)
                lg.handlers = [lh]
                lg.setLevel(logging.DEBUG)
        
                self._check_env()
        
                if args.stackmon:
                    start_stackmon(args.stackmon, 0)
        
                if args.log_thrs:
                    start_log_thrs(self.log, args.log_thrs, 0)
        
                if not args.use_fpool and args.j != 1:
                    args.no_fpool = True
                    t = "multithreading enabled with -j {}, so disabling fpool -- this can reduce upload performance on some filesystems, and make some antivirus-softwares "
                    c = 0
                    if ANYWIN:
                        t += "(especially Microsoft Defender) stress your CPU and HDD severely during big uploads"
                        c = 3
                    else:
                        t += "consume more resources (CPU/HDD) than normal"
                    self.log("root", t.format(args.j), c)
        
                if not args.no_fpool and args.j != 1:
                    t = "WARNING: ignoring --use-fpool because multithreading (-j{}) is enabled"
                    self.log("root", t.format(args.j), c=3)
                    args.no_fpool = True
        
                for name, arg in (
                    ("iobuf", "iobuf"),
                    ("s-rd-sz", "s_rd_sz"),
                    ("s-wr-sz", "s_wr_sz"),
                ):
                    zi = getattr(args, arg)
                    if zi < 32768:
                        t = "WARNING: expect very poor performance because you specified a very low value (%d) for --%s"
                        self.log("root", t % (zi, name), 3)
                        zi = 2
                    zi2 = 2 ** (zi - 1).bit_length()
                    if zi != zi2:
                        zi3 = 2 ** ((zi - 1).bit_length() - 1)
                        t = "WARNING: expect poor performance because --%s is not a power-of-two; consider using %d or %d instead of %d"
                        self.log("root", t % (name, zi2, zi3, zi), 3)
        
                if args.s_rd_sz > args.iobuf:
                    t = "WARNING: --s-rd-sz (%d) is larger than --iobuf (%d); this may lead to reduced performance"
                    self.log("root", t % (args.s_rd_sz, args.iobuf), 3)
        
                zs = ""
                if args.th_ram_max < 0.22:
                    zs = "generate thumbnails"
                elif args.th_ram_max < 1:
                    zs = "generate audio waveforms or spectrograms"
                if zs:
                    t = "WARNING: --th-ram-max is very small (%.2f GiB); will not be able to %s"
                    self.log("root", t % (args.th_ram_max, zs), 3)
        
                if args.chpw and args.have_idp_hdrs and "pw" not in args.auth_ord.split(","):
                    t = "ERROR: user-changeable passwords is not compatible with your current configuration. Choose one of these options to fix it:\n option1: disable --chpw\n option2: remove all use of IdP features; --idp-*\n option3: change --auth-ord to something like pw,idp,ipu"
                    self.log("root", t, 1)
                    raise Exception(t)
        
                noch = set()
                for zs in args.chpw_no or []:
                    zsl = [x.strip() for x in zs.split(",")]
                    noch.update([x for x in zsl if x])
                args.chpw_no = noch
        
                if args.ipu:
                    iu, nm = load_ipu(self.log, args.ipu, True)
                    setattr(args, "ipu_iu", iu)
                    setattr(args, "ipu_nm", nm)
        
                if args.ipr:
                    ipr = load_ipr(self.log, args.ipr, True)
                    setattr(args, "ipr_u", ipr)
        
                for zs in "ah_salt fk_salt dk_salt".split():
                    if getattr(args, "show_%s" % (zs,)):
                        self.log("root", "effective %s is %s" % (zs, getattr(args, zs)))
        
                if args.ah_cli or args.ah_gen:
                    args.idp_store = 0
                    args.no_ses = True
                    args.shr = ""
        
                if args.idp_store and args.have_idp_hdrs:
                    self.setup_db("idp")
        
                if not self.args.no_ses:
                    self.setup_db("ses")
        
                args.shr1 = ""
                if args.shr:
                    self.setup_share_db()
        
                bri = "zy"[args.theme % 2 :][:1]
                ch = "abcdefghijklmnopqrstuvwx"[int(args.theme / 2)]
                args.theme = "{0}{1} {0} {1}".format(ch, bri)
        
                if args.nid:
                    args.du_who = "no"
                args.du_iwho = n_du_who(args.du_who)
        
                if args.ver and args.ver_who == "no":
                    args.ver_who = "all"
                args.ver_iwho = n_ver_who(args.ver_who)
        
                if args.nih:
                    args.vname = ""
                    args.doctitle = args.doctitle.replace(" @ --name", "")
                else:
                    args.vname = args.name
                args.doctitle = args.doctitle.replace("--name", args.vname)
                args.bname = args.bname.replace("--name", args.vname) or args.vname
        
                if args.log_fk:
                    args.log_fk = re.compile(args.log_fk)
        
                # initiate all services to manage
                self.asrv = AuthSrv(self.args, self.log, dargs=self.dargs)
                ramdisk_chk(self.asrv)
        
                if args.cgen:
                    self.asrv.cgen()
        
                if args.exit == "cfg":
                    sys.exit(0)
        
                if args.ls:
                    self.asrv.dbg_ls()
        
                if not ANYWIN:
                    self._setlimits()
        
                self.log("root", "max clients: {}".format(self.args.nc))
        
                self.tcpsrv = TcpSrv(self)
        
                if not self.tcpsrv.srv and self.args.ign_ebind_all:
                    self.args.no_fastboot = True
        
                self.up2k = Up2k(self)
        
                self._feature_test()
        
                decs = {k.strip(): 1 for k in self.args.th_dec.split(",")}
                if not HAVE_VIPS:
                    decs.pop("vips", None)
                if not HAVE_PIL:
                    decs.pop("pil", None)
                if not HAVE_RAW:
                    decs.pop("raw", None)
                if not HAVE_FFMPEG or not HAVE_FFPROBE:
                    decs.pop("ff", None)
        
                # compressed formats; "s3z=s3m.zip, s3gz=s3m.gz, ..."
                zlss = [x.strip().lower().split("=", 1) for x in args.au_unpk.split(",")]
                args.au_unpk = {x[0]: x[1] for x in zlss}
        
                self.args.th_dec = list(decs.keys())
                self.thumbsrv = None
                want_ff = False
                if not args.no_thumb:
                    t = ", ".join(self.args.th_dec) or "(None available)"
                    self.log("thumb", "decoder preference: {}".format(t))
        ... # I hit the Hexbear character limit