The ToS Trap: How Verdion can protect you from your Cable company/ISP

For those of you who wish to skip to the results, you may visit the demo results directly or get there from the demo index page.

Verdion is in the process of making its first hire, and one of the suggestions from a candidate involved something which would be shatteringly obvious to more or less anybody but me: Showcase some demos which come from the real world. Show Verdion off, addressing the use cases for which you think it’s best suited.

Well, of course that’s an incredible idea, and of course I hadn’t thought of it. Off I went.

User Agreements? Been There, Done That

Immediately, my mind went to those software agreements through which we all rush in a mad dash to get to the “I Agree” button so we can move on with our days. But those have been done to death. There have been television sit-coms written about them. I wanted something meatier.

The Dreaded Terms of Service

Adjacent to that, with the potential to make a customer’s life particularly miserable, are Customer Terms of Service. These are the documents which run into the dozens of pages which customers must sign in order to receive service from a business - whether that’s their gas company, their electricity company, a contractor, their cable company, their ISP - etc. It outlines various legal obligations fulfilled on the part of the company, and the legal means and rules by which customers must approach particular issues they may have with the service provider.

To say they tend to be slightly biased in favor of the service provider would be… something of an understatement.

The Experiment

I took a real cable company/ISP’s terms of service, verbatim, from the Internet. I scrubbed the name of the company from the document (replaced with “CableBurg”) to provide anonymity. I asked Verdion to surface any red flag Party B issues (in an agreement like this, the customer is “Party B” - the person agreeing to the service; a “red flag” issue is what it sounds like - something which could be worrisome in the right - or wrong - circumstances).

I then ran the exact same question through a single, solo model to provide a baseline comparison. I allowed the solo model to refine its own output three times, which was the maximum number of times it required Verdion to reach consensus in any of its multi-model runs.

Then I created a comparison-based demo: You can look at the solo run, the inexpensive Verdion models, and the premium Verdion models, side-by-side. The results speak for themselves.

The Results

I was floored. I expected Verdion to do well. Verdion has exceeded my expectations each time I’ve run it - with a couple exceptions - every time I’ve run it, and for prompts which are featured in the training corpora of the models in question, the number is even higher.

Legal Pay Dirt

I took the premium results to one or two lawyer acquaintances. They indicated to me that they would probably have to pay a team of paralegals for ~6-8 hours in order to come up with an analysis of this quality. Could a lawyer put their or their firm’s reputation behind this analysis as it stands? Probably not - I’m not a lawyer, so I don’t know. I suspect the analysis requires a final pass to ensure accuracy and that absolutely nothing was missed.

The Value Question

All that said, it’s clear that Verdion represents 6-7 orders of magnitude of value here in a real-world application. That’s a lot more than nothing, and we’ve barely begun scratching the surface. Get in touch with us if you are interested in scheduling a meeting or setting up a free demo. Get in front of your industry or vertical in terms of using adversarial AI and start reaping the benefits!