Skip to content
Forward Deployed

Forward Deployed
System Design Practice

AI System for an Air-Gapped Environment

By Sourav Banerjee · Last updated 13 Oct 2026 · Report an issue

Read the worked design: AI System for an Air-Gapped Environment

PracticeAdvanced3 min read
For
Engineers preparing for Forward Deployed, solutions or applied-AI engineering interviews
Assumes
  • Two or three Discovery Foundations scenarios completed
  • Comfort with retrieval, agents, queues and multi-tenant cloud architecture
Objectives
  • Find the one constraint that makes the scenario dangerous before designing
  • Defend an architecture, evaluation plan and rollout under follow-up questions
How to use it
Allow about an hour. Work the discovery sections properly — they decide the design — then compare each section with the model answer and score yourself honestly.

Condensed from the sources credited on the How It Works page

0/36
Not saving
01

Interview prompt

You are the FDE (Forward Deployed Engineer) asked to bring GenAI capability into an Air-Gapped Environment, a network with no route to the internet. Treat that boundary as the heart of the design, not as an obstacle to work around.

02

Clarify the customer problem

  • Which classification level covers the data, and which handling rules come with it?
  • Is the local hardware fixed, and what exactly sits in the pool?
  • What is the path for bringing artifacts in, from scanning and approval to signing and roll-in?
  • Which identity, storage and directory services already run inside the boundary?
  • What limits apply to logging, retention and recovery?
03

Users and workflows

UserWorkflowCurrent painAI assist opportunityHuman approval needed?
Analyst (end user)
Operations / IT admin
Security / compliance officer
Programme sponsor
04

Requirements

Functional

Non-functional

  • Latency target
  • Availability target
  • Cost budget
  • Security/privacy constraints
  • Audit/compliance requirement
05

Data and integration map

Data sourceFormatOwnerFreshnessPermission modelRisk
06

Proposed architecture

Fill in each part of your architecture for this case:

  • Build and signing
  • Transfer inspection
  • Offline registry
  • Orchestration
  • Document pipeline
  • Local telemetry
07

Evaluation plan

MetricGood thresholdBad thresholdTest datasetOwner
Signature check resultsNo failed artifact admittedOne failed artifact admittedLogs from each transfer hopSecurity
Offline install successClean on every staging runInstall needs outside accessInstalls on matched staging nodesPlatform engineering
GPU and queue saturationStays under admission limitHeld above the limitLocal GPU and queue metricsOperations
Time per analyst caseLower than baselineNo change or slowerCase timings taken insideSponsor
08

Failure modes

  • Install halts on a missing transitive dependency
  • A bundle arrives damaged after a transfer hop
  • The model does not fit in local GPU memory
  • An internal certificate reaches its expiry date
  • A new release cannot read the existing index
  • A library tries to send telemetry out
09

Rollout plan

  1. Build a staging copy that matches production.
  2. Run the full transfer and import drill.
  3. Write the handoff down so anyone can repeat it.
  4. Put one canary node on live traffic.
  5. Build the rollback bundle and test it.
  6. Add nodes only while every gate passes.
10

Weak vs strong answer

Weak: "Put the model on a local server and lock down the firewall."

Strong: "The release path into the enclave is the most trusted part of the system. Every dependency is pinned and attested, and signatures are checked against trust roots held offline. Telemetry never leaves. An incomplete bundle is refused, and rollback is a bundle we have already tested."

11

Candidate scorecard

Evaluation
The closer

Final 2-minute spoken answer

Rehearse this out loud before you look at it. Summarising the whole design in two minutes is its own skill, and it is usually the last thing you are asked for.

Where next

Read the worked design
AI System for an Air-Gapped Environment
Revise the concepts