An aisle between cabinets in a company server room, cabling showing through the mesh doors
    Products / 02

    On-prem AI

    A server dedicated to your company alone.On your premises, or in a data centre.

    We deploy the model on it, connect it to your data and systems and set up access. Bringing it live and running it afterwards is on us.

    Book a technical consultationTwo routes
    What we take care of
    01Infrastructure

    We arrange the server on your premises, or in a data centre.

    02Model

    We pick it according to your tasks and deploy it.

    03Connection

    We connect the AI to the systems you already use.

    04Operations

    We run it and verify every update.

    § 01Two routes
    Route 01

    Openrokk AI Box

    COMPANY BOUNDARYERPDOCUMENTSEMAILSERVER INSIDE YOUR NETWORKMODEL · COMPUTE · STORAGEYOUR STAFF
    The query, the documents and the answer are processed inside your network. The server stands on your premises.
    Where the data is processed

    Inside your network

    Who owns the server

    You. You buy the AI Box from us.

    How you acquire it

    One-off purchase of the AI Box.

    Learn more
    Route 02

    AI housing

    COMPANY BOUNDARYERPDOCUMENTSEMAILGATEWAYENCRYPTED TUNNELDATA CENTREMODEL + GPUFOR YOUR COMPANY ONLYDATA LEAVES YOURNETWORK
    The server is dedicated to you alone, but it stands in a data centre. Data leaves your network to be processed.
    Where the data is processed

    On a dedicated server in a data centre

    Who owns the server

    The data-centre operator. We run it.

    How you acquire it

    Monthly, with no server to buy.

    § 02Where each process belongs

    First we assess whether you need a dedicated server at all.

    For most processes, a cloud service with contractual guarantees is enough, or sending only the part of the data the task needs. A dedicated server makes sense where a contract or internal policy will not let the data go to a shared service.

    HOW MUCH OF THE DATA LEAVES THE COMPANYOPEN CLOUDpublic materialCONTROLLED CLOUDoperational data,only the part neededWITHOUT IDENTIFIERSmaterial withoutnames or figuresNOTHINGOPENROKK AI BOXdata stays with youThis is decided per process, not for the whole company.

    If controlled cloud can run the process safely, we say so and deploy the AI there. Controlled cloud is a service shared by many customers. AI housing is a server dedicated to you alone, it just stands in a data centre.

    Close-up of the fan on a compute card
    § 03For security

    IT and security need concrete answers.

    Your IT and the people accountable for security get material they can assess. You get it at the design stage, not after signing.

    A sample list of questions for IT and security: where the model runs, where the data goes, whether the model is trained on it, who has access and how it is revoked, what stays in the operational records, who provides warranty and service, and what is deleted when the engagement ends.

    Questions for IT and securitysample
    Where the model runsOn a server at your site, or on a dedicated server in a data centre.
    Where your data goesWith the AI Box it is processed inside your network. With housing, on a dedicated server in a data centre.
    Is the model trained on your dataNo. Your content is not used for training.
    Who has access and how it is revokedWe keep a named register on our side and yours. The exact revocation procedure is part of the proposal.
    What stays in the operational recordsTime, run path and status of the task. Document content is not written into them.
    Who provides warranty and serviceWe deliver the AI Box and provide its warranty and service. With housing, we provide the operation.
    What is deleted when the engagement endsThe scope and deadlines for deletion are set in the contract and confirmed in writing.
    The real proposal carries your systems, access, deadlines and accountable owners.
    You get the material before sign-off. IT can check it before anything is signed.
    What we deliver with it
    01Data flow diagram
    02Named access list
    03Where the data is held
    04Scope and retention of records
    05Incident procedure
    06Engagement shutdown procedure
    § 04Layers

    There is a whole environment around the model.

    For the model to answer usefully, it has to get the right material, respect permissions and leave a record of what it did. We deliver the whole environment around it, not just the model.

    PRIVATE AI ENVIRONMENTINPUTSINSIDE THECOMPANYERPDOCUMENTSEMAILSHEETSOUTPUT BACKINTOOPERATIONSDRAFTRECORDBRIEFAPPROVALYOUR PEOPLE APPROVE THEFINAL STEP.PERIMETER AND ACCESSVPN, SERVICE ACCOUNTS, ALLOWLISTYOUR IT GRANTS AND REVOKESACCESS.DOCUMENTS AND DATADOCLING, OCR, PARSERSDOCUMENTS ARE PROCESSED INTHIS ENVIRONMENT.INDEX AND RULESQDRANT OR PGVECTORFINDS THE MATERIAL FOR THEQUERY.MODEL OPERATIONDOCKER, VLLM, QWEN OR LLAMARUNS ON A DEDICATED SERVER.API AND ACTIONSFASTAPI, JOB QUEUE, WEBHOOKSPERMITTED OPERATIONS ARELISTED.OBSERVABILITY AND AUDITOPENTELEMETRY, LOGS, EVALSEVERY TASK LEAVES ANOPERATIONAL RECORD.The model is chosen per task. The environment around it is built once.
    The environment is the same on both routes. Only the location of the server differs.
    § 05Running it

    Operations start once it is live.

    A deployment has to run reliably and keep pace with what models can do. We evaluate quality on your tasks and introduce changes where they help.

    RESULTS ON YOUR TASKSTIMEAVAILABLE MODELSA MANAGED DEPLOYMENTWITHOUT UPDATESDIFFERENCE IN CAPABILITYModels keep improving, so we keep verifying them.
    • We compare a new model version on your own tasks. If it brings no improvement, we stay on the previous one.
    • You can take operations over in time. The configuration and documentation stay yours.
    § 06Limits

    What we agree upfront.

    • Some tasks are handled better by a cloud model. We assess that on your processes.
    • Deployment needs your IT to take part in preparing access.
    • For every process we design what happens when the AI is unavailable.
    • We assess cost and requirements before choosing the route.
    The front of a server rack with its drive bays
    § 07Next step

    Start with one process.

    You pick one process and the data it works with. We go through it together with access and risk, then recommend a suitable way to run it.

    Book a technical consultationAll products

    We are happy to sign a non-disclosure agreement before the meeting.

    ProductsAI layerAI Data AuditAI AdsAI systems for operationsAutonomous softwareOpenrokk AI Academy