System design interview question
"Design the API platform for serving AI models to external customers. Businesses integrate your models into their products, send you their data, and are billed per token. Some are enterprises with strict data requirements. Design the security, isolation, and metering."
a security and multi-tenancy question wearing an ML costume. The inference serving is largely the same as any model-serving problem; what is distinctive is that customers send you their proprietary data, the model output is itself an untrusted and expensive artifact, and billing is per-token so metering must be exact. The signal is whether the candidate treats customer data handling as the central requirement.
On Practick another engineer interviews you live for 60 minutes on a question from this bank. They have the full interviewer guide beside the call: the answers to your clarifying questions, the numbers to hand out, a ladder of follow-ups and a scoring rubric. You get the model solution once the session settles. It is free: interview someone for an hour and you have earned your own.
Book a free mock interviewAll 132 system design interview questions
System design mock interviews · DSA interview questions · Free mock interview practice · Browse interviewers · Sign in