Stop Letting AI Train on Your Clients' Secrets: The NJ Small Firm Guide to Data Residency, BAAs, and SOC 2
Photo by Camille Brodard on Unsplash
6 min readApril 21, 2026

Stop Letting AI Train on Your Clients' Secrets: The NJ Small Firm Guide to Data Residency, BAAs, and SOC 2

data securityAI vendor due diligenceNJ ethics

Most NJ solo attorneys spend more time evaluating a new coffee maker than they do vetting the security posture of an AI tool that processes their clients' most sensitive information. That's not an insult — it's a structural problem. The marketing pages for legal AI tools are masterclasses in reassurance. "Bank-level encryption." "Enterprise-grade security." "Your data is safe with us." None of those phrases mean anything enforceable. Three checkpoints do: SOC 2 compliance, Business Associate Agreements (where applicable), and data residency terms. If you can't answer where your vendor stands on all three, you have a real exposure problem — and in New Jersey, that exposure has a name attached to it.

Why "Encrypted" Is Not the Same as "Secure Enough"

Encryption is a floor, not a ceiling. When a legal AI vendor tells you data is encrypted "in transit and at rest," they are describing the absolute minimum standard of modern software infrastructure. What they are not telling you is:

  • Whether their employees can access your uploaded documents for model training or quality review
  • Which third-party subprocessors receive your data (and whether those subprocessors have their own data-sharing agreements)
  • Whether a data breach would trigger notification obligations to you — and within what timeframe
  • Whether the vendor's infrastructure lives in the United States, the EU, or somewhere else entirely

For NJ attorneys, RPC 1.6 requires more than good intentions on confidentiality. The duty to "make reasonable efforts to prevent the inadvertent or unauthorized disclosure" of client information demands that you actually understand what happens to the data after you hit upload.

Checkpoint 1: SOC 2 Type II — Ask for the Report, Not the Badge

You will see SOC 2 logos on nearly every legal tech vendor's security page. The logo is close to meaningless without context. There are two types: SOC 2 Type I confirms that controls exist at a point in time. SOC 2 Type II confirms those controls operated effectively over a sustained period — typically six to twelve months. Type II is the standard you should require.

More importantly, ask for the actual audit report, not just the certification badge. A reputable vendor will provide it under NDA. The report will identify exactly which trust service criteria were tested (Security, Availability, Confidentiality, Processing Integrity, Privacy) and — critically — any exceptions the auditor noted. An exception in a SOC 2 Type II report is not automatically disqualifying, but it deserves a direct conversation with the vendor about remediation.

What to ask in writing: "Can you provide your most recent SOC 2 Type II report under NDA, including the auditor's exception log?"

Checkpoint 2: BAAs — Not Just for HIPAA Practices

Business Associate Agreements are contractually required when a vendor handles Protected Health Information under HIPAA. If you do any personal injury, workers' compensation, employment, or family law work, there is a reasonable chance that uploaded documents contain PHI — a client's medical records, mental health history, or prescription information.

But here's the part most NJ attorneys miss: even if HIPAA doesn't strictly apply to your practice, negotiating a BAA-style data processing addendum with your AI vendor is still smart practice. These agreements can contractually bind the vendor to:

  • Not use your data to train their models
  • Delete your data within a defined period after contract termination
  • Notify you within a specified window (72 hours is the GDPR standard; push for it) if a breach occurs
  • Identify and limit which subprocessors touch your data

Several major legal AI platforms now offer standard Data Processing Addendums (DPAs) without your having to ask. Others require you to negotiate. If a vendor flatly refuses to sign any form of DPA, that is itself a due diligence red flag.

Checkpoint 3: Data Residency — Geography Is a Legal Variable

Where your data physically lives determines which governments can access it, which breach notification laws apply, and how confidently you can represent to clients that their information stays in the United States. For NJ practitioners handling federal matters, immigration files, or any government-adjacent work, this is not an abstract concern.

Ask vendors two direct questions: (1) In which countries or regions are your servers located? (2) Can you contractually commit to U.S.-only data residency? Some platforms offer U.S. data residency as a paid tier feature — budget for it. Others build it into their enterprise plans but leave solo attorneys on data-promiscuous default settings.

Turning This Into a 20-Minute Vendor Audit

You do not need an IT department to run this checklist. Before you activate any new AI tool, send the vendor a short email requesting:

  1. SOC 2 Type II report (most recent, under NDA)
  2. Their standard Data Processing Addendum or willingness to sign one
  3. Written confirmation of data residency (U.S. only, or specify regions)
  4. Model training opt-out confirmation — in writing, not just a checkbox in settings

If the vendor responds quickly, clearly, and without hedging, that responsiveness is itself a positive signal about their security culture. If they send you a link to a generic FAQ page, you have learned something important.

The NJ Rules of Professional Conduct do not require perfection in vendor security. They require reasonable diligence. In 2025, reasonable diligence means understanding what SOC 2, BAAs, and data residency actually mean — and demanding answers before your clients' data starts moving through someone else's infrastructure.

Get the weekly roundup

New AI Sidebar articles delivered to your inbox. No spam, unsubscribe anytime.