• 1 Post
  • 24 Comments
Joined 28 days ago
cake
Cake day: June 18th, 2026

help-circle

  • yeah, well, this is what I mean by the inherent problems. The open models still hallucinate, they are still probability-driven. Even when guided by RAG and other precautions, it still is only as good as those supporting elements can offer (assuming they are high-quality themselves).

    On balance, I do not understand how this kind of tool will help officers in the field unless it is to advise on procedures for the officer to follow. Not trying to interpret situations as offenses or not, not trying to be a pocket legal interpreter.

    I only suggest that whomever decided to try this for VicPD is being supported by a LLM geek that probably at least cares how well the models are performing. They seem to understand what kind of safeguards should exist for this type of thing to exist in this space… I personally doubt its good enough, but I rather see this than ChatGPT.


  • It sounds like they are running self-hosted Ollama with custom RAG.

    If I believe Vic PD description of what they’ve made available, its probably one of the best possible situations. Someone who knows LLMs and understand what they are has created a relatively thoughtful implementation, its not just because some braindead executive wants to get in bed with Google.

    It still has a lot of the problems and should be scrutinized heavily, but at least they aren’t piping their data into Grok or anyone else for that matter.









  • Lots of good suggestions.

    The simplest answer assumes you have a router with a firewall that you can configure.

    The basic idea is a deny rule targeting the ‘source’ IP address from reaching the ‘destination’ ip addresses.

    There are various ways to do this, the best way will be very precise. Some folks have said separate VLAN, very good practice but not required. Some folks suggest pihole, thats really hit or miss unless you know your device relies explicitly on DNS and you also know how to manage that.

    It will be easies for you to learn the basic traffic policy before proceeding to other more advanced suggestions, but you will have to probably at least learn that bit of network security to attempt this task. Low difficulty in the grand scheme of things networky.