beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-28 16:12:51,786 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-28 16:12:53,955 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
INFO 2026-04-28 16:12:56,539 serve 3836 -- Started Serve in namespace "serve".
(ProxyActor pid=4644) INFO 2026-04-28 16:12:56,466 proxy 172.17.0.2 -- Proxy starting on node 5afd751c05717caed2a01fccb21fbb1ea3a3eb217acd74d62a25e49e (HTTP port: 8000).
(ProxyActor pid=4644) INFO 2026-04-28 16:12:56,536 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4643) INFO 2026-04-28 16:12:56,622 controller 4643 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4643) INFO 2026-04-28 16:12:56,623 controller 4643 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4644) INFO 2026-04-28 16:12:56,627 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4644) INFO 2026-04-28 16:12:56,633 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fd73c5f65c0>.
(ServeController pid=4643) INFO 2026-04-28 16:12:56,727 controller 4643 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
INFO 2026-04-28 16:13:00,662 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ProxyActor pid=4644) INFO 2026-04-28 16:13:00,640 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:01,825 mnist_classifier_MNISTClassifier rhuurgbr 82a614c4-fb6b-497a-83f2-0c9b86af3c7d -- POST / 200 474.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:01,829 mnist_classifier_MNISTClassifier rhuurgbr 29165bd6-3cbc-4d99-9f19-7259f663b2e1 -- POST / 200 458.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:01,831 mnist_classifier_MNISTClassifier rhuurgbr d1634faf-4b60-49a9-8110-ab01a4407c1e -- POST / 200 458.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:01,831 mnist_classifier_MNISTClassifier rhuurgbr cbc495cc-4863-4ee7-b720-b89664c0221a -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:01,892 mnist_classifier_MNISTClassifier rhuurgbr 0df2af2a-acce-4f15-b718-1d2e5799d6ad -- POST / 200 519.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:01,898 mnist_classifier_MNISTClassifier rhuurgbr 89c7c318-1fd6-459f-96b7-fba6df01c48d -- POST / 200 523.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,035 mnist_classifier_MNISTClassifier rhuurgbr 52e5cde8-d668-4b46-812f-6cf2607d2a6e -- POST / 200 659.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,035 mnist_classifier_MNISTClassifier rhuurgbr bebcb57a-629f-4496-8f1d-65a8001bb8a8 -- POST / 200 658.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,036 mnist_classifier_MNISTClassifier rhuurgbr 17b3da9f-98b5-4ab0-bcfc-0d4e6ca7238a -- POST / 200 658.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,037 mnist_classifier_MNISTClassifier rhuurgbr a71bfd54-c3f9-4c59-a74c-bef7f7e1d10e -- POST / 200 659.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,039 mnist_classifier_MNISTClassifier rhuurgbr 8e05731a-aa45-431d-966b-5bc73ae364e7 -- POST / 200 660.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,039 mnist_classifier_MNISTClassifier rhuurgbr 5be4de72-2260-403a-a404-d45ad6455c82 -- POST / 200 659.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,039 mnist_classifier_MNISTClassifier rhuurgbr 5948d620-e496-42ca-a352-74a1f8737a0f -- POST / 200 658.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,040 mnist_classifier_MNISTClassifier rhuurgbr f683ca4a-01f5-4fc3-a9c5-0649237c9717 -- POST / 200 658.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,040 mnist_classifier_MNISTClassifier rhuurgbr 7306c0d0-9799-4c2a-bee1-6b9ea9d302d8 -- POST / 200 533.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,041 mnist_classifier_MNISTClassifier rhuurgbr 336d466d-a8b0-448f-b0bf-b6f9290ac697 -- POST / 200 533.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,041 mnist_classifier_MNISTClassifier rhuurgbr 238e9fe9-1508-4d1e-9f1f-28d34cafdc38 -- POST / 200 532.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,042 mnist_classifier_MNISTClassifier rhuurgbr df88610a-c2c9-478e-b588-647a7a0fe513 -- POST / 200 532.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,042 mnist_classifier_MNISTClassifier rhuurgbr 9e5e4833-6687-476a-8953-17b501adf63c -- POST / 200 532.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,043 mnist_classifier_MNISTClassifier rhuurgbr 0042e8e6-e5fe-43e4-accc-6df60f696e66 -- POST / 200 531.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,043 mnist_classifier_MNISTClassifier rhuurgbr 43871c8b-04e7-45ab-a88e-ba665eeee48e -- POST / 200 530.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,043 mnist_classifier_MNISTClassifier rhuurgbr becfe711-86a3-417f-98cf-27d5aec1bdee -- POST / 200 529.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,043 mnist_classifier_MNISTClassifier rhuurgbr 5d451b8e-a097-4dbc-b0ac-b0a88af72941 -- POST / 200 527.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,044 mnist_classifier_MNISTClassifier rhuurgbr a5e3a76b-3331-42d3-bfe2-8a0b9ee20428 -- POST / 200 528.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,044 mnist_classifier_MNISTClassifier rhuurgbr 39ddb816-2aa1-4ccc-92df-4153a9586ce7 -- POST / 200 527.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,045 mnist_classifier_MNISTClassifier rhuurgbr 575d83f9-d0fc-41fc-9d70-498dd2168bc8 -- POST / 200 526.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,045 mnist_classifier_MNISTClassifier rhuurgbr 5804761d-728b-4ff0-ad12-f28230782bc5 -- POST / 200 526.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,046 mnist_classifier_MNISTClassifier rhuurgbr 47c7757e-3efd-42fd-a437-3c9454b06c42 -- POST / 200 528.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,047 mnist_classifier_MNISTClassifier rhuurgbr 2f084a13-a827-4a1f-901d-7e4137fd292e -- POST / 200 526.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,048 mnist_classifier_MNISTClassifier rhuurgbr 8d9497b6-5121-4223-8274-b44646efd9ba -- POST / 200 526.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,048 mnist_classifier_MNISTClassifier rhuurgbr 35319d15-5611-45fc-a9ad-9053d78264e0 -- POST / 200 526.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,050 mnist_classifier_MNISTClassifier rhuurgbr 0a1fbd74-2c23-4a39-aaa4-31c60425f7ed -- POST / 200 526.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,050 mnist_classifier_MNISTClassifier rhuurgbr 83c3353b-359b-48f2-9cc7-0cb1c8a87f8e -- POST / 200 524.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,053 mnist_classifier_MNISTClassifier rhuurgbr cefab920-77c7-46e3-8e2a-ef6f430b80d2 -- POST / 200 525.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,056 mnist_classifier_MNISTClassifier rhuurgbr 36bbbc7c-fada-4400-bd98-63dfc9207d43 -- POST / 200 527.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,057 mnist_classifier_MNISTClassifier rhuurgbr 97f99633-631b-47db-8152-bbccd70e9c2e -- POST / 200 527.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,057 mnist_classifier_MNISTClassifier rhuurgbr d5689d36-6714-48c6-bcae-c7036c8ec656 -- POST / 200 526.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,058 mnist_classifier_MNISTClassifier rhuurgbr 4fc8cd2c-a894-4192-8f60-c3326e5001a5 -- POST / 200 526.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,058 mnist_classifier_MNISTClassifier rhuurgbr ad1b53c0-21de-4683-afce-da0875be1a2e -- POST / 200 526.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,058 mnist_classifier_MNISTClassifier rhuurgbr c3dcf600-2052-4feb-9cb7-af5d9ee50fce -- POST / 200 525.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,059 mnist_classifier_MNISTClassifier rhuurgbr 01b56b37-a503-4805-84c3-973e1b6a596d -- POST / 200 524.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,059 mnist_classifier_MNISTClassifier rhuurgbr c6d69456-6cc9-49e3-b9b0-fe37c88e9a5a -- POST / 200 523.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,059 mnist_classifier_MNISTClassifier rhuurgbr c9676d82-912b-4578-a337-b691cf2f180b -- POST / 200 522.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,059 mnist_classifier_MNISTClassifier rhuurgbr 6cc9982f-38c1-431a-8f6d-3673da3b66c1 -- POST / 200 522.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,059 mnist_classifier_MNISTClassifier rhuurgbr 19fee0d9-2882-490e-98f9-d766eefd29e8 -- POST / 200 521.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,060 mnist_classifier_MNISTClassifier rhuurgbr cefda6b1-5877-420b-8e07-c137f3ce36db -- POST / 200 521.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,060 mnist_classifier_MNISTClassifier rhuurgbr 4dc737f5-66d6-488b-8691-272a1c14942c -- POST / 200 521.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,060 mnist_classifier_MNISTClassifier rhuurgbr 95d0c4ca-436f-4c65-b72c-1eb1be474519 -- POST / 200 520.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,060 mnist_classifier_MNISTClassifier rhuurgbr 3dbb3258-acdb-4b79-b061-4a521fbbd0ab -- POST / 200 519.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,061 mnist_classifier_MNISTClassifier rhuurgbr 1ba3480f-fe87-4b5f-896f-950252939fa5 -- POST / 200 519.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,061 mnist_classifier_MNISTClassifier rhuurgbr 2fed2fba-287b-4a53-b6c6-38ef649aa8ab -- POST / 200 519.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,061 mnist_classifier_MNISTClassifier rhuurgbr cbdabbbc-6b8a-4097-a72c-a69e16ebaf81 -- POST / 200 518.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,062 mnist_classifier_MNISTClassifier rhuurgbr 83a6ace9-ffd6-48f7-aeb0-972d2dbb1a3c -- POST / 200 518.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,062 mnist_classifier_MNISTClassifier rhuurgbr 8c33ba2f-32be-4c6e-bbe4-e40a7d258ed7 -- POST / 200 518.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,062 mnist_classifier_MNISTClassifier rhuurgbr fa5fd844-c1b3-4136-ac41-fca4769fec32 -- POST / 200 517.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,063 mnist_classifier_MNISTClassifier rhuurgbr 94c0f8b6-2988-4d62-a7eb-c5dde3fb8150 -- POST / 200 517.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,063 mnist_classifier_MNISTClassifier rhuurgbr 4f0617b6-2d35-494b-8945-53d96e8aba80 -- POST / 200 516.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,063 mnist_classifier_MNISTClassifier rhuurgbr df9c3c17-037b-4070-9513-f539895f790a -- POST / 200 515.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,063 mnist_classifier_MNISTClassifier rhuurgbr 9c17e486-95dd-43e0-ba39-e2afc72c51d3 -- POST / 200 515.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,064 mnist_classifier_MNISTClassifier rhuurgbr cdff945c-1853-4398-a756-8c9cc2fb60d1 -- POST / 200 516.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,065 mnist_classifier_MNISTClassifier rhuurgbr 6fef3ea8-f209-4407-8f50-f74d92af253c -- POST / 200 515.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,066 mnist_classifier_MNISTClassifier rhuurgbr b80d1dac-35ed-46e0-8863-338bc9b03eb6 -- POST / 200 507.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,083 mnist_classifier_MNISTClassifier rhuurgbr 3aff4e11-a2f3-449a-a223-b8d19d8e6be8 -- POST / 200 522.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,083 mnist_classifier_MNISTClassifier rhuurgbr b6c65140-735f-4c2a-a69e-69eb3cdf88fb -- POST / 200 522.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,083 mnist_classifier_MNISTClassifier rhuurgbr 28c5a571-55cc-456b-bacd-c9b7fd51d613 -- POST / 200 521.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,083 mnist_classifier_MNISTClassifier rhuurgbr c42b9aa8-524f-423c-a2ab-9ca448c09d07 -- POST / 200 520.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,083 mnist_classifier_MNISTClassifier rhuurgbr 93e21eaa-75ed-4544-b9f5-345224b72dcb -- POST / 200 519.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,084 mnist_classifier_MNISTClassifier rhuurgbr 6ff621aa-ae60-4023-b51b-bd06e6c73e42 -- POST / 200 518.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,084 mnist_classifier_MNISTClassifier rhuurgbr 34ff40a4-3fc1-4e78-85a6-05f8d937c483 -- POST / 200 517.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,084 mnist_classifier_MNISTClassifier rhuurgbr 630a66e5-bd18-439e-9fd7-64f0414d2c32 -- POST / 200 517.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,084 mnist_classifier_MNISTClassifier rhuurgbr 823c7b00-47f8-49b1-b122-70a54dfa243f -- POST / 200 516.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,084 mnist_classifier_MNISTClassifier rhuurgbr 2d905bee-f9eb-41e7-a387-82483b05d1a2 -- POST / 200 516.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,084 mnist_classifier_MNISTClassifier rhuurgbr d0c002be-be82-4362-a4f6-7f2edf2d250b -- POST / 200 515.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,085 mnist_classifier_MNISTClassifier rhuurgbr 1e088374-b7b0-45fd-8799-d2d88d564875 -- POST / 200 514.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,085 mnist_classifier_MNISTClassifier rhuurgbr f6dff3e2-b71e-4c7a-a104-d2c8f7160781 -- POST / 200 534.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,086 mnist_classifier_MNISTClassifier rhuurgbr ced1bfb0-106c-4664-9f52-6f5becfb8777 -- POST / 200 535.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,086 mnist_classifier_MNISTClassifier rhuurgbr e204500d-f48a-40c0-bf3d-d43412a69a80 -- POST / 200 535.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,086 mnist_classifier_MNISTClassifier rhuurgbr 5a3d2e39-d833-4a39-8298-6b83c8a1e8aa -- POST / 200 534.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,087 mnist_classifier_MNISTClassifier rhuurgbr aa39fc62-4329-4b2c-bef7-3a854576fcbd -- POST / 200 534.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,087 mnist_classifier_MNISTClassifier rhuurgbr 8964e996-2564-4672-b7e2-3921cee3ac8a -- POST / 200 534.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,087 mnist_classifier_MNISTClassifier rhuurgbr 4c4f6b58-e716-4b0c-818a-0288d69fa906 -- POST / 200 532.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,088 mnist_classifier_MNISTClassifier rhuurgbr e51f44ba-df7b-4398-bd8e-831e032b0d8b -- POST / 200 532.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,088 mnist_classifier_MNISTClassifier rhuurgbr 9fe349c5-906d-41cd-80cf-5bb3a5c396a8 -- POST / 200 532.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,088 mnist_classifier_MNISTClassifier rhuurgbr c290f5e3-6208-4ad0-9047-23cd68071295 -- POST / 200 531.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,088 mnist_classifier_MNISTClassifier rhuurgbr ad9bb649-d171-4f89-b052-0f203da5f576 -- POST / 200 530.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,089 mnist_classifier_MNISTClassifier rhuurgbr 1b470706-15d3-4e45-8fb2-a65091f7ae4a -- POST / 200 530.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,089 mnist_classifier_MNISTClassifier rhuurgbr 9df7257a-c093-429c-870c-2648abdd5ca2 -- POST / 200 530.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,089 mnist_classifier_MNISTClassifier rhuurgbr e142fc6e-925a-4444-a6ea-efdb966c3678 -- POST / 200 530.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,089 mnist_classifier_MNISTClassifier rhuurgbr 206bc48d-a480-49db-842b-615d869b44d7 -- POST / 200 530.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,090 mnist_classifier_MNISTClassifier rhuurgbr 5df2935d-f14a-4019-b086-26354bddddda -- POST / 200 519.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,090 mnist_classifier_MNISTClassifier rhuurgbr 56be7439-6bfb-404f-ab4a-958e8198d59e -- POST / 200 518.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,090 mnist_classifier_MNISTClassifier rhuurgbr 4293a0c0-038b-4aa8-8f8e-c3e51fa28040 -- POST / 200 518.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,091 mnist_classifier_MNISTClassifier rhuurgbr 38818476-05ec-4a48-a2d6-c43307ec6433 -- POST / 200 518.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,091 mnist_classifier_MNISTClassifier rhuurgbr 3a853b18-6de5-46ca-8a73-22e41eea585a -- POST / 200 518.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,091 mnist_classifier_MNISTClassifier rhuurgbr 93d5569e-555c-4a4c-b3de-30477a541de6 -- POST / 200 517.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,092 mnist_classifier_MNISTClassifier rhuurgbr a5352c52-a18f-447c-b8e4-1358c865f870 -- POST / 200 517.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,092 mnist_classifier_MNISTClassifier rhuurgbr 07d9446b-4b06-4ccb-9be9-8f9cccf5a329 -- POST / 200 515.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,092 mnist_classifier_MNISTClassifier rhuurgbr 9516055c-0cbb-4c42-9d17-8d08895dbeb9 -- POST / 200 515.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,092 mnist_classifier_MNISTClassifier rhuurgbr e2df3383-b861-4459-94b9-26e80f4b8cf9 -- POST / 200 514.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,093 mnist_classifier_MNISTClassifier rhuurgbr 8b7ce3ca-1414-4750-a087-476900bd9699 -- POST / 200 513.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,093 mnist_classifier_MNISTClassifier rhuurgbr c1b1e806-21f7-43b5-834e-069da3270380 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,093 mnist_classifier_MNISTClassifier rhuurgbr b27b7db9-918d-43f3-b85f-8ca0c02e51ba -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,094 mnist_classifier_MNISTClassifier rhuurgbr 1cc3da22-d623-4b9c-bf69-7fa1061e022c -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,094 mnist_classifier_MNISTClassifier rhuurgbr b1b519c3-cd14-461e-aecc-70469f254e3f -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,094 mnist_classifier_MNISTClassifier rhuurgbr 677f1f55-9c67-414c-9094-4f504f2aace4 -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,095 mnist_classifier_MNISTClassifier rhuurgbr 044737f6-1828-4c2e-a57c-3b62286d938c -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,334 mnist_classifier_MNISTClassifier rhuurgbr 5a0db992-68b0-4ab4-8ea3-d379bfb7df44 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,338 mnist_classifier_MNISTClassifier rhuurgbr d6d825b8-4d00-4b69-ac6e-7ffaad117837 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,339 mnist_classifier_MNISTClassifier rhuurgbr 3d3fc9e5-c2de-48a5-bcd5-651a47a80609 -- POST / 200 297.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,340 mnist_classifier_MNISTClassifier rhuurgbr de27e829-0b69-48fd-b8b1-d6d00b562086 -- POST / 200 290.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,341 mnist_classifier_MNISTClassifier rhuurgbr 30d845aa-6125-4137-991f-abe3cd2381a8 -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,341 mnist_classifier_MNISTClassifier rhuurgbr c0470fe0-638c-44e7-8418-75ea5965b6de -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,342 mnist_classifier_MNISTClassifier rhuurgbr 18826db0-e7c9-4658-a64c-ccdba60b6bae -- POST / 200 235.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,342 mnist_classifier_MNISTClassifier rhuurgbr ccf75765-284c-45cb-83c4-bfe859635858 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,343 mnist_classifier_MNISTClassifier rhuurgbr 22f0a8dc-31f4-4598-8343-5353f94eee52 -- POST / 200 233.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,343 mnist_classifier_MNISTClassifier rhuurgbr ad994378-6996-4b5e-81a0-a539d0a8aa09 -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,344 mnist_classifier_MNISTClassifier rhuurgbr 9fc5b732-3d82-4705-8582-207fac02d62a -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,344 mnist_classifier_MNISTClassifier rhuurgbr d404c08a-6fc5-48b8-85aa-bd96dfa401c1 -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,345 mnist_classifier_MNISTClassifier rhuurgbr f804a17e-20af-40bf-8133-7ed37c663fdd -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,346 mnist_classifier_MNISTClassifier rhuurgbr 7ef2138d-1198-45ec-91c8-7f2b6dced308 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,346 mnist_classifier_MNISTClassifier rhuurgbr 5231e67e-4fb1-4f96-8b27-00107fedade8 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,347 mnist_classifier_MNISTClassifier rhuurgbr 2c20d214-7d18-45fb-8bf5-f598756fe300 -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,348 mnist_classifier_MNISTClassifier rhuurgbr ba7c14b1-02d2-466f-9f06-1215e3d1cad3 -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,348 mnist_classifier_MNISTClassifier rhuurgbr b4f2716b-6b0b-47d2-8e92-542a9df92007 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,348 mnist_classifier_MNISTClassifier rhuurgbr 22e52645-9375-49d9-98a3-8ad38e3711b3 -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,489 mnist_classifier_MNISTClassifier rhuurgbr 0df442ce-473a-4ab8-b734-6042590d8a2e -- POST / 200 370.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,495 mnist_classifier_MNISTClassifier rhuurgbr 02df0ca5-1087-4769-94d9-013469e2cadd -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,496 mnist_classifier_MNISTClassifier rhuurgbr c2ba59b4-432d-42fc-aff4-d1e856a8d915 -- POST / 200 359.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,503 mnist_classifier_MNISTClassifier rhuurgbr 5be60059-2c6f-4cad-8f18-9475b87a976a -- POST / 200 383.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,504 mnist_classifier_MNISTClassifier rhuurgbr ba1003d3-6bd8-475e-868d-d7e98ae308d7 -- POST / 200 382.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,504 mnist_classifier_MNISTClassifier rhuurgbr adf2f934-8483-4eaf-b2ef-0193d3b5ab12 -- POST / 200 367.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,504 mnist_classifier_MNISTClassifier rhuurgbr 468d7142-39d8-440a-8391-3b749a781a42 -- POST / 200 381.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,559 mnist_classifier_MNISTClassifier rhuurgbr 203f1d63-4cee-4497-9150-0d682298e39f -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,560 mnist_classifier_MNISTClassifier rhuurgbr a4615bc4-ce41-41b5-8f1e-611c8a9e7240 -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,561 mnist_classifier_MNISTClassifier rhuurgbr b1181298-5013-482e-891a-f364ccd9577f -- POST / 200 434.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,561 mnist_classifier_MNISTClassifier rhuurgbr 9bbbd46f-f73e-476f-a20f-8dfac43b3b13 -- POST / 200 434.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,564 mnist_classifier_MNISTClassifier rhuurgbr e7b98752-6f27-402a-b170-00d5fb71a91d -- POST / 200 435.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,567 mnist_classifier_MNISTClassifier rhuurgbr e5c91c1e-04d4-4078-a31f-d090d938cef8 -- POST / 200 429.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,570 mnist_classifier_MNISTClassifier rhuurgbr 809d42f7-d4a2-4505-9246-c726e1ffefb8 -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,570 mnist_classifier_MNISTClassifier rhuurgbr f0b1b0ed-571a-4e0d-9057-8cc054bbd0a9 -- POST / 200 432.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,570 mnist_classifier_MNISTClassifier rhuurgbr 6bf5ca46-8e52-4b12-8e5b-34b0034c10d6 -- POST / 200 432.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,571 mnist_classifier_MNISTClassifier rhuurgbr 20488674-c623-4c97-9296-0be6410f541a -- POST / 200 428.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,571 mnist_classifier_MNISTClassifier rhuurgbr b7064fa4-5a42-45e6-9f0c-5778c881664e -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,572 mnist_classifier_MNISTClassifier rhuurgbr ac8844ac-31a0-4a2c-a8f7-7f524229dd77 -- POST / 200 427.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,572 mnist_classifier_MNISTClassifier rhuurgbr 57a175e3-d20d-4769-87f9-2d293dcfd35a -- POST / 200 427.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,572 mnist_classifier_MNISTClassifier rhuurgbr 3c63da87-472a-49a2-9f44-51d958f5ea94 -- POST / 200 426.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,574 mnist_classifier_MNISTClassifier rhuurgbr 0645e68a-e1e9-4653-8599-11eef17a9661 -- POST / 200 426.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,576 mnist_classifier_MNISTClassifier rhuurgbr 14f209db-7ded-4b81-9383-1c58892f4be0 -- POST / 200 415.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,577 mnist_classifier_MNISTClassifier rhuurgbr 9992f4a8-6a93-4dc2-a0cb-31e4954ee196 -- POST / 200 416.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,578 mnist_classifier_MNISTClassifier rhuurgbr c4e3e9d1-7e46-400b-9679-0c0dae73c39c -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,583 mnist_classifier_MNISTClassifier rhuurgbr 86bb9e65-2dbc-42c7-a83f-39bacbbf88b7 -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,583 mnist_classifier_MNISTClassifier rhuurgbr bab26574-fb24-4fa8-8400-910b67c59382 -- POST / 200 418.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,583 mnist_classifier_MNISTClassifier rhuurgbr 85c6ae61-bc2d-42f1-83ab-1d36866ac5fb -- POST / 200 409.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,584 mnist_classifier_MNISTClassifier rhuurgbr 2b4049e2-f9ec-4d9b-86c0-fd24e6029798 -- POST / 200 403.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,584 mnist_classifier_MNISTClassifier rhuurgbr a6bc63e4-3d46-4718-9858-e6a04689f265 -- POST / 200 396.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,585 mnist_classifier_MNISTClassifier rhuurgbr 5a534d13-c249-49c5-a403-a83d5db8ab44 -- POST / 200 396.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,586 mnist_classifier_MNISTClassifier rhuurgbr b6fdaf75-7fbd-4cd4-bf60-5f1e9be045af -- POST / 200 388.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,587 mnist_classifier_MNISTClassifier rhuurgbr c83b1c64-8a18-4eb5-88bb-57655c66f5b8 -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,589 mnist_classifier_MNISTClassifier rhuurgbr 95733025-afe5-470a-844a-98ea81ee76de -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,591 mnist_classifier_MNISTClassifier rhuurgbr 6234a82e-cf3d-4de8-adcb-1b7dcbe56441 -- POST / 200 390.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,593 mnist_classifier_MNISTClassifier rhuurgbr 830b8b5e-1480-413d-9d9d-8a3d33a02ad6 -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,595 mnist_classifier_MNISTClassifier rhuurgbr 6c55bcd9-c797-4271-a5c6-aad17f1ae8a5 -- POST / 200 384.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,597 mnist_classifier_MNISTClassifier rhuurgbr 4590d300-2f5d-40ad-9c1e-4168e4e3bcbd -- POST / 200 385.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,598 mnist_classifier_MNISTClassifier rhuurgbr e41ea08f-fbe2-4c12-9504-06e296fa0656 -- POST / 200 383.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,598 mnist_classifier_MNISTClassifier rhuurgbr 11e625ca-a1ca-4d46-9c7e-36af474164ac -- POST / 200 381.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,600 mnist_classifier_MNISTClassifier rhuurgbr 62b3dc0b-4747-4610-b34c-84c85125ef0e -- POST / 200 381.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,600 mnist_classifier_MNISTClassifier rhuurgbr 4edd8de7-c9bb-45de-8930-f927c48ce353 -- POST / 200 381.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,601 mnist_classifier_MNISTClassifier rhuurgbr 4a54bd61-dc35-4373-be5e-a71b43d2cef9 -- POST / 200 380.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,607 mnist_classifier_MNISTClassifier rhuurgbr 4cedd48a-8a0f-4332-a627-4294b4fe8b94 -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,608 mnist_classifier_MNISTClassifier rhuurgbr 132fc5b6-4784-4266-9fb4-fec5665b64e0 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,609 mnist_classifier_MNISTClassifier rhuurgbr d19ba8ec-5232-4b52-ab7d-60d1a4f66595 -- POST / 200 385.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,609 mnist_classifier_MNISTClassifier rhuurgbr a21595e5-3226-4a37-90bf-ca570a0e0c27 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,610 mnist_classifier_MNISTClassifier rhuurgbr dafdd61b-9a19-4fe7-98d7-6d5ee7c4d6fe -- POST / 200 385.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,611 mnist_classifier_MNISTClassifier rhuurgbr 032d2f8f-6457-4249-bb8c-f6d1dcc12c98 -- POST / 200 383.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,612 mnist_classifier_MNISTClassifier rhuurgbr ac1c31c1-b602-470e-8fae-fb38f6d63e06 -- POST / 200 378.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,612 mnist_classifier_MNISTClassifier rhuurgbr b89cf6ca-b993-454c-bbe7-9ca8e7b80006 -- POST / 200 375.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,612 mnist_classifier_MNISTClassifier rhuurgbr 31d4c6b2-84a9-4a59-9386-8f435776a162 -- POST / 200 375.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,613 mnist_classifier_MNISTClassifier rhuurgbr df08a172-8b44-4715-a46f-80e73a3ddbe6 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,613 mnist_classifier_MNISTClassifier rhuurgbr f94d5e7d-9c40-45fa-b2f8-b311d91e645f -- POST / 200 372.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,613 mnist_classifier_MNISTClassifier rhuurgbr 80bc05ba-3d9c-4e56-9387-f66ec7eb6a34 -- POST / 200 372.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,613 mnist_classifier_MNISTClassifier rhuurgbr 7e0e8a39-f795-4fcf-bfce-6070e970559b -- POST / 200 372.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,614 mnist_classifier_MNISTClassifier rhuurgbr 5285c3ce-ae22-4eb6-be14-8c5983aa22be -- POST / 200 372.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,658 mnist_classifier_MNISTClassifier rhuurgbr 132040b2-5a6f-445a-9a31-be6b9e9f27ba -- POST / 200 414.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,679 mnist_classifier_MNISTClassifier rhuurgbr e2be64c6-27bd-4b97-8751-b8fd8eed9635 -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,679 mnist_classifier_MNISTClassifier rhuurgbr 730a47bd-d585-4dbe-ae5b-9f165cd3dda8 -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,680 mnist_classifier_MNISTClassifier rhuurgbr 12278a54-2eb4-4fdc-b5d1-bf10e8d71d5e -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,680 mnist_classifier_MNISTClassifier rhuurgbr c192efe5-7ea8-4d70-a1eb-7518e2a28b71 -- POST / 200 430.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,680 mnist_classifier_MNISTClassifier rhuurgbr 9b9bec12-5b32-4e3f-8190-3ad1117c4199 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,680 mnist_classifier_MNISTClassifier rhuurgbr d17f4ffd-3cfc-449e-954e-45480a6f87ee -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,681 mnist_classifier_MNISTClassifier rhuurgbr d101c575-498a-4132-909d-a677b52880b6 -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,682 mnist_classifier_MNISTClassifier rhuurgbr ec2b57aa-f6e0-4ed6-aad4-5346a303c866 -- POST / 200 435.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,685 mnist_classifier_MNISTClassifier rhuurgbr cdb84349-0425-4950-8049-0356192c643b -- POST / 200 435.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,685 mnist_classifier_MNISTClassifier rhuurgbr 88941c9c-1d7d-4c96-9124-0baa848f5334 -- POST / 200 438.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,686 mnist_classifier_MNISTClassifier rhuurgbr cf740042-1099-41be-9cb9-cd77774988c8 -- POST / 200 437.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,687 mnist_classifier_MNISTClassifier rhuurgbr 33704646-56cb-4064-ab39-bd466c8f2b8d -- POST / 200 436.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,687 mnist_classifier_MNISTClassifier rhuurgbr e73bf9f9-a5f5-4bbc-9045-98ce38381008 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,688 mnist_classifier_MNISTClassifier rhuurgbr 9bda6a68-c64b-47af-be7f-a23f67921e7a -- POST / 200 433.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,688 mnist_classifier_MNISTClassifier rhuurgbr 6cd99ae5-e5c0-4b2c-a5a3-7b5da425ba6d -- POST / 200 432.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,688 mnist_classifier_MNISTClassifier rhuurgbr 016c5cf0-d186-4151-99be-508fb6152e79 -- POST / 200 432.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,689 mnist_classifier_MNISTClassifier rhuurgbr 323ece40-16e9-4c80-8e76-7024e79f3a7d -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,689 mnist_classifier_MNISTClassifier rhuurgbr 1d252c74-1a44-4aa3-99ec-5cb90b38cb43 -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,689 mnist_classifier_MNISTClassifier rhuurgbr 61026919-ac3b-4009-ba55-783ad1678a4d -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,690 mnist_classifier_MNISTClassifier rhuurgbr 4917612e-3c46-488d-ab94-cde2c2ccfc48 -- POST / 200 431.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,690 mnist_classifier_MNISTClassifier rhuurgbr 5c9ed8d2-a79a-455d-9e6d-73047d74cf8a -- POST / 200 431.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,690 mnist_classifier_MNISTClassifier rhuurgbr 691b3c9e-0565-4213-8119-9e395bfa8b5e -- POST / 200 428.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,691 mnist_classifier_MNISTClassifier rhuurgbr af176da4-079c-420d-8dcc-413579e25e2a -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,691 mnist_classifier_MNISTClassifier rhuurgbr 7cf7dd79-bb6c-41a4-a34d-4c28f958d405 -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,691 mnist_classifier_MNISTClassifier rhuurgbr 272ab4f8-718b-4ccc-beec-536b98fa8410 -- POST / 200 189.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,692 mnist_classifier_MNISTClassifier rhuurgbr 99a861fd-cfed-42a5-baa2-85cc226350ce -- POST / 200 358.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,692 mnist_classifier_MNISTClassifier rhuurgbr a84929c4-baf5-4422-9bd6-930b824d5d43 -- POST / 200 179.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,692 mnist_classifier_MNISTClassifier rhuurgbr 851992d7-18ec-4d12-be45-35960a8bb6db -- POST / 200 180.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,692 mnist_classifier_MNISTClassifier rhuurgbr ab3fdc3e-1910-48e5-aea5-0efca46e892a -- POST / 200 179.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,692 mnist_classifier_MNISTClassifier rhuurgbr b1e74e1a-fcaf-4a75-a66e-747e5b0f89d2 -- POST / 200 179.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,693 mnist_classifier_MNISTClassifier rhuurgbr c98e356a-5a42-4d50-8b72-bc0385c2613d -- POST / 200 179.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,694 mnist_classifier_MNISTClassifier rhuurgbr e576179a-8d51-48a4-9720-e6852ad6d667 -- POST / 200 180.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,696 mnist_classifier_MNISTClassifier rhuurgbr 19c91c97-2660-485b-b653-9b5c615583e4 -- POST / 200 182.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,697 mnist_classifier_MNISTClassifier rhuurgbr bf36e123-6e42-48f5-88b9-637405a6cc1b -- POST / 200 181.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,697 mnist_classifier_MNISTClassifier rhuurgbr 57e643b9-393f-40e0-a267-f2e74c7bf13b -- POST / 200 179.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,697 mnist_classifier_MNISTClassifier rhuurgbr 62846dbf-4150-4352-9c82-6ed39f64c70d -- POST / 200 178.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,820 mnist_classifier_MNISTClassifier rhuurgbr 969d406a-cbc2-45d2-9720-ac7a5e948370 -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,821 mnist_classifier_MNISTClassifier rhuurgbr c03b6064-993c-4864-8da5-cb6aaa112be7 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,822 mnist_classifier_MNISTClassifier rhuurgbr 90360bcd-450f-4b17-8510-87b9eed1e294 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,824 mnist_classifier_MNISTClassifier rhuurgbr 722e3547-fef8-46db-b162-279831796a66 -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,825 mnist_classifier_MNISTClassifier rhuurgbr 87ef2254-f82e-4937-988d-8c2129f6257b -- POST / 200 304.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,825 mnist_classifier_MNISTClassifier rhuurgbr 4995c8ab-ba8c-4a5d-8ebf-27faf5447113 -- POST / 200 304.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,826 mnist_classifier_MNISTClassifier rhuurgbr 42591820-fcc6-4b8e-9161-512581d4c5c4 -- POST / 200 302.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,827 mnist_classifier_MNISTClassifier rhuurgbr 08401819-9d3f-408c-8037-4a291eeb3509 -- POST / 200 305.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,827 mnist_classifier_MNISTClassifier rhuurgbr 2808ad17-00f8-4b0e-8577-469bdee8af1a -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,831 mnist_classifier_MNISTClassifier rhuurgbr 8e87753f-eb34-45b5-b89a-067ba0f37bda -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,831 mnist_classifier_MNISTClassifier rhuurgbr 0dc62bcf-0e60-4927-8a25-af684d3edbb6 -- POST / 200 308.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,833 mnist_classifier_MNISTClassifier rhuurgbr ba2515ed-86d5-427d-a495-79d3c59d26f4 -- POST / 200 308.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,833 mnist_classifier_MNISTClassifier rhuurgbr e08cf5a8-2097-4d9e-8459-1264f1b36495 -- POST / 200 307.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,834 mnist_classifier_MNISTClassifier rhuurgbr 44cd78b6-75fb-4708-a029-4461d5394eae -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,834 mnist_classifier_MNISTClassifier rhuurgbr 49372b42-dc60-440d-ae27-d33406556ef3 -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,835 mnist_classifier_MNISTClassifier rhuurgbr 6fd9ff24-da29-47dc-8263-5fbfa9bc5086 -- POST / 200 233.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,838 mnist_classifier_MNISTClassifier rhuurgbr 6154fd50-257e-4fd9-80e0-f1e97d6a50cb -- POST / 200 221.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,838 mnist_classifier_MNISTClassifier rhuurgbr 3679938f-09d6-4084-9e47-676b86aabad9 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,839 mnist_classifier_MNISTClassifier rhuurgbr 56f20359-ee22-4701-bf98-69ed99480a1d -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,842 mnist_classifier_MNISTClassifier rhuurgbr ffb132e4-5a93-4159-9abf-81251947be8d -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,842 mnist_classifier_MNISTClassifier rhuurgbr be5c5aad-742c-405d-b7fc-f4f653d822dd -- POST / 200 221.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,854 mnist_classifier_MNISTClassifier rhuurgbr 70d3e7e2-76a1-4ca2-bdc7-3c65d407a622 -- POST / 200 228.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,855 mnist_classifier_MNISTClassifier rhuurgbr 29f96393-5f93-4e63-a39d-69ff161a27c6 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,856 mnist_classifier_MNISTClassifier rhuurgbr 66b09926-7d63-42d4-aa3d-c5e051e7b625 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,857 mnist_classifier_MNISTClassifier rhuurgbr bfb60889-f17a-48b0-8294-19e5dfb69163 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,857 mnist_classifier_MNISTClassifier rhuurgbr 09a7c18b-1b1c-465d-856f-21dfb0dec240 -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,857 mnist_classifier_MNISTClassifier rhuurgbr 4e351605-cb8d-462c-a7c8-6ddd5f75f5ed -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,858 mnist_classifier_MNISTClassifier rhuurgbr 8260a996-bf98-4e66-8e39-0c09ce679aa1 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,858 mnist_classifier_MNISTClassifier rhuurgbr 91f13514-dfd4-4807-a208-ed8447e4de8e -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,859 mnist_classifier_MNISTClassifier rhuurgbr 19f843b8-4dde-4377-b975-935a59711e42 -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,992 mnist_classifier_MNISTClassifier rhuurgbr 9cf59b3f-fa5f-4725-b1fc-7ad9dba8180d -- POST / 200 362.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,993 mnist_classifier_MNISTClassifier rhuurgbr e3d59a9a-aea9-41e9-9f20-0a417fe9502e -- POST / 200 363.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,994 mnist_classifier_MNISTClassifier rhuurgbr 468aefae-0d2c-41a9-a28b-bd41744cb20c -- POST / 200 363.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,994 mnist_classifier_MNISTClassifier rhuurgbr d5b41cff-6b98-40d8-8732-ed52873c309f -- POST / 200 364.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,995 mnist_classifier_MNISTClassifier rhuurgbr cb7f3fee-31fa-4d0d-906e-090d412e9f18 -- POST / 200 311.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,995 mnist_classifier_MNISTClassifier rhuurgbr f8fa1285-ce90-4844-8e1f-c931ced0ad90 -- POST / 200 365.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,996 mnist_classifier_MNISTClassifier rhuurgbr 4294290f-f3a7-43da-bd2a-0ea81cd36f5d -- POST / 200 363.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,997 mnist_classifier_MNISTClassifier rhuurgbr 1b029757-13dd-4bc5-bed9-d987d1e37ff9 -- POST / 200 360.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,997 mnist_classifier_MNISTClassifier rhuurgbr 338cce38-1401-48ab-9aa5-ea787483cbdd -- POST / 200 357.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,998 mnist_classifier_MNISTClassifier rhuurgbr bec98b65-df99-447c-aa06-b6e30f389c39 -- POST / 200 314.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,998 mnist_classifier_MNISTClassifier rhuurgbr 5ce32516-5d78-4ba5-bb0b-0a0168545429 -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,999 mnist_classifier_MNISTClassifier rhuurgbr 80f467c1-0d17-4369-a893-13a494a00103 -- POST / 200 314.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:02,999 mnist_classifier_MNISTClassifier rhuurgbr 4a48ad43-b264-4d7a-9d98-7326aefe40ef -- POST / 200 300.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,000 mnist_classifier_MNISTClassifier rhuurgbr 950c7bb0-209a-48d1-9fe1-cd16b9860af4 -- POST / 200 300.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,000 mnist_classifier_MNISTClassifier rhuurgbr dc3cbe85-9492-4bd0-be5a-59f65b808add -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,001 mnist_classifier_MNISTClassifier rhuurgbr 4697dd87-1492-4ae9-bdd7-3fe6b65bee43 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,002 mnist_classifier_MNISTClassifier rhuurgbr c5b5bd6f-2012-4e59-a166-ff722199c68b -- POST / 200 299.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,003 mnist_classifier_MNISTClassifier rhuurgbr a33b3983-a445-4adb-9262-fa9188d8beaf -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,003 mnist_classifier_MNISTClassifier rhuurgbr bb2a370b-5a85-407e-862d-7b29d6084edc -- POST / 200 288.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,003 mnist_classifier_MNISTClassifier rhuurgbr db9318bc-4828-4300-a575-ad63a9be81db -- POST / 200 289.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,007 mnist_classifier_MNISTClassifier rhuurgbr 54400524-282b-44cc-aebd-f91727ce833e -- POST / 200 291.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,007 mnist_classifier_MNISTClassifier rhuurgbr 884aeaf1-e83d-45b0-9ef3-02ebb2f13b42 -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,011 mnist_classifier_MNISTClassifier rhuurgbr 71985fed-4737-4dc3-897c-5e6ad8af185c -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,012 mnist_classifier_MNISTClassifier rhuurgbr fc521a3a-8e82-4080-96bb-87b3d710badd -- POST / 200 294.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,012 mnist_classifier_MNISTClassifier rhuurgbr e700f034-e01a-4b63-9983-ec22e1cca1a1 -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,012 mnist_classifier_MNISTClassifier rhuurgbr 68e51168-917a-4602-a1f4-3e85bca1c0c4 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,013 mnist_classifier_MNISTClassifier rhuurgbr c047fb72-0e91-4161-8f0e-c5417dc7f867 -- POST / 200 291.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,013 mnist_classifier_MNISTClassifier rhuurgbr 9b2f5859-3da9-49ac-8894-103ec9487722 -- POST / 200 288.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,013 mnist_classifier_MNISTClassifier rhuurgbr 58c8f930-1726-4541-8627-7becb17d3ea2 -- POST / 200 291.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,013 mnist_classifier_MNISTClassifier rhuurgbr daa44e34-03d0-488e-81a5-7b513932ab46 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,014 mnist_classifier_MNISTClassifier rhuurgbr 6b3ee734-0eb0-4845-a3dc-671ed92fffa6 -- POST / 200 287.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,014 mnist_classifier_MNISTClassifier rhuurgbr 3bf03f3b-49c8-4013-a0a3-3209b05c1107 -- POST / 200 287.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,014 mnist_classifier_MNISTClassifier rhuurgbr 29be554f-87e1-4d84-8adb-74e7fd76172d -- POST / 200 289.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,022 mnist_classifier_MNISTClassifier rhuurgbr 4245ef67-891f-4fd5-9665-08485a56c7a5 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,022 mnist_classifier_MNISTClassifier rhuurgbr 84759451-6572-42ab-b521-1b9c89dbb6ca -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,023 mnist_classifier_MNISTClassifier rhuurgbr 5fe20f82-9d70-4f81-a095-643788742d20 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,023 mnist_classifier_MNISTClassifier rhuurgbr 2da979c0-10ec-40d9-9fbf-7d13aa0f0e12 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,023 mnist_classifier_MNISTClassifier rhuurgbr 823f8932-0469-485e-8c8b-f30f76defc8d -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,023 mnist_classifier_MNISTClassifier rhuurgbr a08625d2-59e0-4ff8-9330-922a07384010 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,023 mnist_classifier_MNISTClassifier rhuurgbr 48835500-cb88-4d06-98da-76232a8fad7f -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,024 mnist_classifier_MNISTClassifier rhuurgbr db486f53-4b73-4706-be16-3eb1d7bcc742 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,024 mnist_classifier_MNISTClassifier rhuurgbr 9cf15a27-f8a9-4349-b459-7f8f2697edbd -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,024 mnist_classifier_MNISTClassifier rhuurgbr 513a9db7-f632-412e-a3aa-93e2505857d0 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,024 mnist_classifier_MNISTClassifier rhuurgbr e8c387c5-6fea-4bbf-848e-5bcde558e142 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,024 mnist_classifier_MNISTClassifier rhuurgbr 2d986b42-fccb-48e1-9b88-dd6010990ad0 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,024 mnist_classifier_MNISTClassifier rhuurgbr 586c94f0-f57d-45d0-bcb9-bc0110824592 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,025 mnist_classifier_MNISTClassifier rhuurgbr 1caa1c32-06af-4cba-a3eb-cf8d7acff575 -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,025 mnist_classifier_MNISTClassifier rhuurgbr 5e29a36e-be80-4bd7-bb72-0a58c7be62ee -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,025 mnist_classifier_MNISTClassifier rhuurgbr d03a3ef6-441d-4f21-9a45-c8128e244f3a -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,025 mnist_classifier_MNISTClassifier rhuurgbr 01b5e3ef-275d-4390-a98d-97a074173c86 -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,025 mnist_classifier_MNISTClassifier rhuurgbr 1ba5c40d-593d-46a5-9760-27a09e46a02f -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,025 mnist_classifier_MNISTClassifier rhuurgbr 2d6f88ae-becb-461c-b8b7-60a3a01794d3 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,026 mnist_classifier_MNISTClassifier rhuurgbr 05091590-af49-46e5-9cdc-8fdc3489dbd2 -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,026 mnist_classifier_MNISTClassifier rhuurgbr c0ad298b-0859-4df5-916d-ebd2ec4b9471 -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,027 mnist_classifier_MNISTClassifier rhuurgbr 8e6c20ca-0f87-43fe-97b1-accc842f6372 -- POST / 200 241.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,029 mnist_classifier_MNISTClassifier rhuurgbr 97155baa-dd1a-450f-a3af-c73766b5eef2 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,030 mnist_classifier_MNISTClassifier rhuurgbr 66d33ade-153f-4162-93cf-121fffdeb366 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,031 mnist_classifier_MNISTClassifier rhuurgbr a5f6f0e9-e430-4a4f-985b-f75e9cfccc96 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,032 mnist_classifier_MNISTClassifier rhuurgbr 4ce62daa-cffa-4505-b41e-08ca6f0a6503 -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,032 mnist_classifier_MNISTClassifier rhuurgbr 6130e87e-ecc8-42d7-a7ad-59b1b832c6c1 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,033 mnist_classifier_MNISTClassifier rhuurgbr fa65f783-73fe-4f68-b5f8-dc77445d9e1b -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,033 mnist_classifier_MNISTClassifier rhuurgbr 61657181-6aad-485b-a2e9-fd4f1029dcc5 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,033 mnist_classifier_MNISTClassifier rhuurgbr e931d131-7da6-4096-816e-99a5eb767d81 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,034 mnist_classifier_MNISTClassifier rhuurgbr 9e989963-5910-4dbd-bbdb-b4076990d5cc -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,034 mnist_classifier_MNISTClassifier rhuurgbr 74a57095-870f-4119-b792-1466753efd0c -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,034 mnist_classifier_MNISTClassifier rhuurgbr ec1d8196-6073-4400-829c-39865f1f140e -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,035 mnist_classifier_MNISTClassifier rhuurgbr a81c349d-4b00-4477-b75b-a59241bcf8dc -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,035 mnist_classifier_MNISTClassifier rhuurgbr 236b28c0-7f87-4fc5-afb0-8081bb1b052e -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,035 mnist_classifier_MNISTClassifier rhuurgbr fb4415b7-b6c3-4315-8ba8-91b40f094271 -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,069 mnist_classifier_MNISTClassifier rhuurgbr 23732dd4-0af0-4f28-925a-c8667a60a62d -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,120 mnist_classifier_MNISTClassifier rhuurgbr bc61f8f6-e734-4c50-882c-2d1c151ce9a5 -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,121 mnist_classifier_MNISTClassifier rhuurgbr 532b9668-0bdd-4c93-8b0b-0fddde05d35a -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,122 mnist_classifier_MNISTClassifier rhuurgbr 82111b97-7cab-461f-87d5-6379998fe079 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,122 mnist_classifier_MNISTClassifier rhuurgbr f3c47b27-25d6-46cb-bb6c-c69b4c7d131a -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,122 mnist_classifier_MNISTClassifier rhuurgbr e4de2812-f1aa-425f-bb52-982a65d1b47a -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,122 mnist_classifier_MNISTClassifier rhuurgbr 899b0ff5-203c-47e1-bf39-6fce86e48632 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,122 mnist_classifier_MNISTClassifier rhuurgbr e7a59b33-355f-4d04-91cf-ad14b05115d5 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,122 mnist_classifier_MNISTClassifier rhuurgbr 6a59d4ed-b73b-4a15-aae0-5875a94bdac9 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,123 mnist_classifier_MNISTClassifier rhuurgbr c497376c-9840-416d-8f02-60780a3b0054 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,123 mnist_classifier_MNISTClassifier rhuurgbr 1bf9674f-d26a-4a30-86be-7f1c4c96a6e2 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,123 mnist_classifier_MNISTClassifier rhuurgbr 2558c39c-c0c7-422e-82e9-73c7dd9af983 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,123 mnist_classifier_MNISTClassifier rhuurgbr 1db76334-5930-47e7-b738-6c7887664fa6 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,123 mnist_classifier_MNISTClassifier rhuurgbr e4845217-8e18-44f5-9a9e-85486e8b75fe -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,123 mnist_classifier_MNISTClassifier rhuurgbr 01434f34-c536-451f-9332-afcf30afb052 -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,124 mnist_classifier_MNISTClassifier rhuurgbr 2fc16b28-2875-4edc-bb07-df37c6787e33 -- POST / 200 232.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,124 mnist_classifier_MNISTClassifier rhuurgbr ef6df821-df70-472b-948f-a37af7c68bad -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,124 mnist_classifier_MNISTClassifier rhuurgbr 7e584957-9984-4f7f-8343-c6063255c5e8 -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,124 mnist_classifier_MNISTClassifier rhuurgbr ed292071-829f-4d49-a1d0-9c42a2188247 -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,124 mnist_classifier_MNISTClassifier rhuurgbr 8720a8e1-393f-46ae-b0aa-99cf7f0c6631 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,124 mnist_classifier_MNISTClassifier rhuurgbr c491edba-01f7-489e-80c1-5b14a4a57920 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr 61c8052d-2865-4946-b737-4412ca2aac88 -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr 81ed98c3-51c7-4c0a-9d0f-8c683c7fc74d -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr 71d9a7e5-c98b-45ca-aa98-7a2641bbe5b8 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr 4f5b8a1d-e0bf-4e9a-b75e-f254a804fb8a -- POST / 200 223.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr f013286c-3993-4892-8cdc-614cab130031 -- POST / 200 217.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr 164c3b19-764b-4ce1-957b-b18a5a94a557 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,125 mnist_classifier_MNISTClassifier rhuurgbr be4406a2-817a-44c4-8c33-4c49283192a1 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,126 mnist_classifier_MNISTClassifier rhuurgbr 991f56e5-0a30-4ad7-a10e-df3d0c9b2756 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,126 mnist_classifier_MNISTClassifier rhuurgbr de52e3ff-2d43-4434-b36e-eec3c4b41dae -- POST / 200 213.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,126 mnist_classifier_MNISTClassifier rhuurgbr 6b5075fa-7874-4611-969d-66ef04167d52 -- POST / 200 213.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,126 mnist_classifier_MNISTClassifier rhuurgbr 49b66aa7-b16b-418a-ac7a-f1fb67f6f27f -- POST / 200 129.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,198 mnist_classifier_MNISTClassifier rhuurgbr 719089cf-d07a-42c5-8e5c-6ad52cbcb500 -- POST / 200 189.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,230 mnist_classifier_MNISTClassifier rhuurgbr c827e232-f63c-484d-91ef-507d3f54456f -- POST / 200 203.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,236 mnist_classifier_MNISTClassifier rhuurgbr 15362655-2e79-4c81-9d0c-577e17932db5 -- POST / 200 199.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,237 mnist_classifier_MNISTClassifier rhuurgbr 45a1ab1c-72fe-473d-865c-5a77f079ce49 -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,238 mnist_classifier_MNISTClassifier rhuurgbr a7377357-0b5b-43e3-b0d7-bc5bb2192909 -- POST / 200 197.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,238 mnist_classifier_MNISTClassifier rhuurgbr 7c06c6ff-500a-4433-909d-b67611951050 -- POST / 200 197.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,239 mnist_classifier_MNISTClassifier rhuurgbr aa456856-923d-4959-ae09-9d6ae4f10958 -- POST / 200 108.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,515 mnist_classifier_MNISTClassifier rhuurgbr 787cc89c-7da1-4fc0-90d0-9dc35b65f37b -- POST / 200 383.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,520 mnist_classifier_MNISTClassifier rhuurgbr 549a529c-5672-4bbe-a864-a42dba1624e7 -- POST / 200 387.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,520 mnist_classifier_MNISTClassifier rhuurgbr a366c350-2aeb-4b4d-9083-0405d861dfcd -- POST / 200 386.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,522 mnist_classifier_MNISTClassifier rhuurgbr f5384e14-65c3-4547-933d-fd024feba5db -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,523 mnist_classifier_MNISTClassifier rhuurgbr 46200265-6dfe-4185-b0f2-10045a21a808 -- POST / 200 385.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,526 mnist_classifier_MNISTClassifier rhuurgbr 4ea29aba-650e-4081-839b-497920408338 -- POST / 200 388.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,527 mnist_classifier_MNISTClassifier rhuurgbr 5098817c-8211-4d95-bfb7-519bfdd3bb18 -- POST / 200 389.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,527 mnist_classifier_MNISTClassifier rhuurgbr 83c68d50-012e-4159-9e46-ad8d7d1a985c -- POST / 200 389.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,528 mnist_classifier_MNISTClassifier rhuurgbr 5b7ba706-1e7f-478b-9ba3-f15bdecee5ce -- POST / 200 386.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,530 mnist_classifier_MNISTClassifier rhuurgbr c85e8e31-48c5-408e-9b11-0fe10f1efc52 -- POST / 200 390.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,530 mnist_classifier_MNISTClassifier rhuurgbr 7d1e564e-89f7-4897-bb20-5f99f6241fcb -- POST / 200 388.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,531 mnist_classifier_MNISTClassifier rhuurgbr 8374cfd2-e5e4-4f14-b7f2-ffdc28497653 -- POST / 200 385.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,533 mnist_classifier_MNISTClassifier rhuurgbr 9401f487-a3ea-4027-981f-375aceaabe44 -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,534 mnist_classifier_MNISTClassifier rhuurgbr 4c1a1796-2818-46c3-8500-ea5f4c058893 -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,535 mnist_classifier_MNISTClassifier rhuurgbr a98beb15-d36e-43b2-aa25-8b6935cc9f2d -- POST / 200 391.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,536 mnist_classifier_MNISTClassifier rhuurgbr 2301e0bf-391e-4358-bdeb-62013f8c5bd4 -- POST / 200 389.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,537 mnist_classifier_MNISTClassifier rhuurgbr ac186292-c9d5-4510-a3e7-faf4c8ab1280 -- POST / 200 389.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,537 mnist_classifier_MNISTClassifier rhuurgbr 3b72a84b-8bf5-4963-840d-3f8e546ed325 -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,538 mnist_classifier_MNISTClassifier rhuurgbr 4e91d0cf-f476-4db4-ac53-2bdee5c5621d -- POST / 200 391.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,538 mnist_classifier_MNISTClassifier rhuurgbr ed3ba7bf-324f-4dfc-b3d6-3c64d74d3fa5 -- POST / 200 389.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,538 mnist_classifier_MNISTClassifier rhuurgbr 155b0b71-2ad3-4c6e-96ee-e04dd2e93414 -- POST / 200 389.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,539 mnist_classifier_MNISTClassifier rhuurgbr 0962f12d-efb1-4fa7-b323-8ce4ab7535fc -- POST / 200 389.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,541 mnist_classifier_MNISTClassifier rhuurgbr 4630ba21-7499-49f8-ad90-40aabb541500 -- POST / 200 389.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,544 mnist_classifier_MNISTClassifier rhuurgbr dfc0ce16-88f8-4d16-b2d9-a6a0341bd884 -- POST / 200 394.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,546 mnist_classifier_MNISTClassifier rhuurgbr 2fc79cb5-ba99-4a5d-a96d-7ed9df5f85a7 -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,547 mnist_classifier_MNISTClassifier rhuurgbr eed54589-1284-4d7d-a771-bb060b10c15b -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,547 mnist_classifier_MNISTClassifier rhuurgbr eb00d7e9-3b95-40c3-bdd8-8d4f3c9b0a00 -- POST / 200 393.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,548 mnist_classifier_MNISTClassifier rhuurgbr 30ddacab-66d3-4219-a01e-0eedfda5c4bd -- POST / 200 393.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,548 mnist_classifier_MNISTClassifier rhuurgbr eebbe1bd-0600-4368-aa76-90c57084b2e7 -- POST / 200 393.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,549 mnist_classifier_MNISTClassifier rhuurgbr 378c2306-b312-40b5-8206-83d4e4187801 -- POST / 200 393.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,549 mnist_classifier_MNISTClassifier rhuurgbr 5d4cb25a-dcbf-4c11-aa62-841205f2818a -- POST / 200 393.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,549 mnist_classifier_MNISTClassifier rhuurgbr 60d33455-446a-42fe-b4a3-ba67f06ad6c3 -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,550 mnist_classifier_MNISTClassifier rhuurgbr 7e1796f4-a15d-4952-99ee-be7dd7d103c0 -- POST / 200 391.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,550 mnist_classifier_MNISTClassifier rhuurgbr c2c293ea-0f61-400b-94b1-95c36f1c2bef -- POST / 200 398.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,550 mnist_classifier_MNISTClassifier rhuurgbr 6851955b-41d2-4365-afa8-950a1c6fe34c -- POST / 200 391.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,551 mnist_classifier_MNISTClassifier rhuurgbr b7f50dde-8a15-4332-a769-a5d7ab1a5566 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,633 mnist_classifier_MNISTClassifier rhuurgbr 6f694eff-6317-46ea-99fe-85516a2d75e4 -- POST / 200 471.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,638 mnist_classifier_MNISTClassifier rhuurgbr f50b757a-b9e1-4afe-b001-d6c08316a428 -- POST / 200 476.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,639 mnist_classifier_MNISTClassifier rhuurgbr 39a1673c-403d-4c72-94c9-9e5139d3eae1 -- POST / 200 477.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,639 mnist_classifier_MNISTClassifier rhuurgbr 0038c157-1202-4b95-ba08-f0df215de149 -- POST / 200 475.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,640 mnist_classifier_MNISTClassifier rhuurgbr a6cbd57a-cf69-4ee7-8942-a9cb90784195 -- POST / 200 477.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,641 mnist_classifier_MNISTClassifier rhuurgbr dd5cfc52-b587-45ce-b08f-3743a4168a1c -- POST / 200 477.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,642 mnist_classifier_MNISTClassifier rhuurgbr cb8eb4a4-402f-44ee-8189-9b165d4d1600 -- POST / 200 475.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,645 mnist_classifier_MNISTClassifier rhuurgbr c889a844-7628-4ad6-a611-784cf45aaf7f -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,646 mnist_classifier_MNISTClassifier rhuurgbr aa55e5c5-523a-4bd0-81b7-9d6150758f05 -- POST / 200 479.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,653 mnist_classifier_MNISTClassifier rhuurgbr 7082dd90-347b-4324-a78c-f437b5e979bd -- POST / 200 484.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,656 mnist_classifier_MNISTClassifier rhuurgbr 968c04ef-84b4-4b26-8d2a-c9a9ebec99c0 -- POST / 200 487.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,657 mnist_classifier_MNISTClassifier rhuurgbr bef92711-fe97-4590-920b-2a48c1985120 -- POST / 200 482.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,657 mnist_classifier_MNISTClassifier rhuurgbr 39b4e1e5-a928-40fd-9b88-8cd2478dab06 -- POST / 200 488.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,658 mnist_classifier_MNISTClassifier rhuurgbr 0181e9dc-b787-4e02-9152-b48a5231d3c2 -- POST / 200 472.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,658 mnist_classifier_MNISTClassifier rhuurgbr 7f66121c-3c31-4801-820d-4d4b767922fd -- POST / 200 476.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,659 mnist_classifier_MNISTClassifier rhuurgbr 8d8891b4-c0d6-45ea-b826-c3a96adf5adf -- POST / 200 477.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,659 mnist_classifier_MNISTClassifier rhuurgbr c15648c4-9dd9-409d-975b-ee08b4ccb0e3 -- POST / 200 472.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,660 mnist_classifier_MNISTClassifier rhuurgbr 12ad15fe-b43c-41f8-b789-01a29c45c50a -- POST / 200 476.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,661 mnist_classifier_MNISTClassifier rhuurgbr dec203c3-ea05-43a6-b631-c6c218a4afc1 -- POST / 200 476.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,661 mnist_classifier_MNISTClassifier rhuurgbr 3e502f92-d6bc-4ec8-9df7-ebf25c7c5058 -- POST / 200 476.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,663 mnist_classifier_MNISTClassifier rhuurgbr 0fdce934-9028-4b21-9f17-c383d84313d7 -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,663 mnist_classifier_MNISTClassifier rhuurgbr 1a257953-f3f1-4b0a-b454-845c2b34f68e -- POST / 200 476.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,663 mnist_classifier_MNISTClassifier rhuurgbr 642b9f88-4a84-4a20-bc6c-8252cfb41adb -- POST / 200 475.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,664 mnist_classifier_MNISTClassifier rhuurgbr 6232abe2-61c5-4d44-90eb-7ae23aa5d3f5 -- POST / 200 475.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,664 mnist_classifier_MNISTClassifier rhuurgbr b1431440-1048-448b-93e8-e0072836175d -- POST / 200 474.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,665 mnist_classifier_MNISTClassifier rhuurgbr 85c34baa-8f55-4b5a-b0a2-a98a46a18665 -- POST / 200 425.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,666 mnist_classifier_MNISTClassifier rhuurgbr f76ba20a-a2d7-4b12-a2fc-a7d6eb27e3a1 -- POST / 200 426.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,668 mnist_classifier_MNISTClassifier rhuurgbr 4f749540-c511-437b-8724-46c7c1f56e3c -- POST / 200 427.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,669 mnist_classifier_MNISTClassifier rhuurgbr 5d0795ed-3d30-4c3d-87d2-7d6fbc97cc7b -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,669 mnist_classifier_MNISTClassifier rhuurgbr e23346e1-cd91-4a42-959d-edfca742943f -- POST / 200 428.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,670 mnist_classifier_MNISTClassifier rhuurgbr 242c3bfe-fa13-45a6-8680-c2156f3f412b -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,671 mnist_classifier_MNISTClassifier rhuurgbr 886230ee-cecb-49f8-9798-db67a664e569 -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,671 mnist_classifier_MNISTClassifier rhuurgbr 7f1f734d-3297-4ab7-b994-16783a52e4c3 -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,676 mnist_classifier_MNISTClassifier rhuurgbr 346467f9-7bd2-4166-af95-f73f679d99f9 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,678 mnist_classifier_MNISTClassifier rhuurgbr ee4fd705-7634-4cf0-aaa7-8148a0478b0b -- POST / 200 435.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,678 mnist_classifier_MNISTClassifier rhuurgbr 4bc0b399-44be-4812-b860-5ab3d732997f -- POST / 200 436.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,679 mnist_classifier_MNISTClassifier rhuurgbr 4bbce68a-dfd3-4e33-93a0-77f055d55267 -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,679 mnist_classifier_MNISTClassifier rhuurgbr a4c56b59-326e-4eb0-a490-8051b76f7668 -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,679 mnist_classifier_MNISTClassifier rhuurgbr 3e02b466-bcd6-4ce6-9446-f9ed4838acb7 -- POST / 200 436.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,680 mnist_classifier_MNISTClassifier rhuurgbr a65d8457-b444-455b-aff9-2b85f84d484f -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,680 mnist_classifier_MNISTClassifier rhuurgbr d0799fe2-0695-4543-afec-b6ea7dcbc961 -- POST / 200 433.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,682 mnist_classifier_MNISTClassifier rhuurgbr 586afff4-dfbf-43d2-a7c3-a91088742a71 -- POST / 200 433.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,682 mnist_classifier_MNISTClassifier rhuurgbr 34f883cd-0a15-481f-ad4b-67ea49c9db19 -- POST / 200 429.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,683 mnist_classifier_MNISTClassifier rhuurgbr d6f97617-5866-432d-8bfe-8aa4429d7d3a -- POST / 200 429.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,683 mnist_classifier_MNISTClassifier rhuurgbr 6e9f71b9-a7e1-433a-8125-4ae810f49917 -- POST / 200 428.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,684 mnist_classifier_MNISTClassifier rhuurgbr d7a26f0c-97a2-4dae-ab16-01db4d412ba8 -- POST / 200 424.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,684 mnist_classifier_MNISTClassifier rhuurgbr 3a4d04cb-f327-43de-8b3e-62c7e483810d -- POST / 200 423.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,684 mnist_classifier_MNISTClassifier rhuurgbr 0fe61fa0-badf-47c5-a228-7f63214de73e -- POST / 200 421.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,685 mnist_classifier_MNISTClassifier rhuurgbr c3d79bc2-d77c-4cae-8af7-d670cafd719a -- POST / 200 421.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,685 mnist_classifier_MNISTClassifier rhuurgbr fe174e36-5b29-4364-8e16-33cd517dfd6d -- POST / 200 421.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,685 mnist_classifier_MNISTClassifier rhuurgbr 4eb74a73-32e4-450c-b6de-7fe498cb98a1 -- POST / 200 421.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,686 mnist_classifier_MNISTClassifier rhuurgbr 3ec6cbca-67ca-4188-9b69-1e4f7188e6f8 -- POST / 200 418.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,686 mnist_classifier_MNISTClassifier rhuurgbr ceb0bdaf-7f55-44e8-a5f3-9190b61b5af7 -- POST / 200 416.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,686 mnist_classifier_MNISTClassifier rhuurgbr a5add101-f783-4277-8db0-f4e4352af07c -- POST / 200 415.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,686 mnist_classifier_MNISTClassifier rhuurgbr 77b5103d-663b-4eb5-8639-06747ef4f04b -- POST / 200 415.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,686 mnist_classifier_MNISTClassifier rhuurgbr 2c9b30fb-91fc-414e-8f5f-1527f2f54359 -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr 56c04951-b9d6-48ba-ac6b-b2dbd5e51120 -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr 109ec38e-8ee8-43fb-a2cc-26d21c2bdd56 -- POST / 200 403.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr cdd092cd-0bd4-478d-a99b-c2b86f00fdf0 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr edaab5c3-4d39-4e95-aefc-fd5a4dbb8591 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr 2cf784aa-48a0-4f1f-b99d-71cafa072be4 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr 6e3520ab-e98b-41f6-b1d5-4186bbe9d018 -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,687 mnist_classifier_MNISTClassifier rhuurgbr 91bf4a04-4044-4f57-972d-22bb38fe04bb -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,688 mnist_classifier_MNISTClassifier rhuurgbr 2ac72d14-329a-4a5d-a268-a42f36de9437 -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,688 mnist_classifier_MNISTClassifier rhuurgbr 5ee6ef09-a24a-4833-8364-785a9f8ee595 -- POST / 200 183.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,688 mnist_classifier_MNISTClassifier rhuurgbr f5cad22c-b31d-4f4f-8403-6297cbf2e35a -- POST / 200 183.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,688 mnist_classifier_MNISTClassifier rhuurgbr 74a7d24d-cac0-41ad-84fa-08e74f45f081 -- POST / 200 183.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,688 mnist_classifier_MNISTClassifier rhuurgbr 72ac1d79-bc40-41ca-92fe-d97243842842 -- POST / 200 183.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,688 mnist_classifier_MNISTClassifier rhuurgbr 3c38ad20-63c6-419c-a9c8-d0b2b1bdb876 -- POST / 200 178.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,689 mnist_classifier_MNISTClassifier rhuurgbr 30de8112-af26-48a9-8c53-163290e10c47 -- POST / 200 145.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,738 mnist_classifier_MNISTClassifier rhuurgbr 741f261b-e0e5-41e2-9a08-ce49ed3cb1fc -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,779 mnist_classifier_MNISTClassifier rhuurgbr 5d2a1468-8914-45d9-a376-0243523809e1 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,779 mnist_classifier_MNISTClassifier rhuurgbr bee549e7-c3af-4263-89a9-606b1cd09d9f -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,779 mnist_classifier_MNISTClassifier rhuurgbr 31c8317b-7b46-41c0-b1da-0bf8f0a05b81 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,784 mnist_classifier_MNISTClassifier rhuurgbr bcfb76d4-8a2e-419a-a782-0392569a096e -- POST / 200 275.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,785 mnist_classifier_MNISTClassifier rhuurgbr e0807b26-5ceb-4017-b35e-4e614918a6ed -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,786 mnist_classifier_MNISTClassifier rhuurgbr a129e526-9ce3-415b-b46f-eb373aa542b5 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,786 mnist_classifier_MNISTClassifier rhuurgbr 1e39574d-fc70-41ac-acc5-570eeb7d94c8 -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,786 mnist_classifier_MNISTClassifier rhuurgbr 2c914b89-3384-42f3-92ba-efd167218009 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,788 mnist_classifier_MNISTClassifier rhuurgbr d6b184e6-02ba-41f4-a6ef-861182146878 -- POST / 200 227.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,789 mnist_classifier_MNISTClassifier rhuurgbr b0ec1101-d336-42f1-b0af-aac35ec5e3b8 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,789 mnist_classifier_MNISTClassifier rhuurgbr 4c4fc375-cf17-46dd-9ca0-a7ce21c58788 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,791 mnist_classifier_MNISTClassifier rhuurgbr 8fe22e0a-6992-478a-8e12-6e33a26ecf83 -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,791 mnist_classifier_MNISTClassifier rhuurgbr 9d977b29-8a0a-4b1f-90fa-a23af23add9b -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,791 mnist_classifier_MNISTClassifier rhuurgbr 61fdec9d-cbbd-490c-9038-f34ae4e2c327 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,793 mnist_classifier_MNISTClassifier rhuurgbr 7648abe4-5d90-4ec8-860c-deb2c6eb0ffe -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,793 mnist_classifier_MNISTClassifier rhuurgbr c36087c3-d90b-4ad0-a42d-beed80427f02 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,794 mnist_classifier_MNISTClassifier rhuurgbr d7778b84-06f5-4349-97d6-b270bd8eaad1 -- POST / 200 225.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,794 mnist_classifier_MNISTClassifier rhuurgbr 7e408503-c836-4249-adaa-5a15b0bb8371 -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,794 mnist_classifier_MNISTClassifier rhuurgbr 7af365d1-9abd-4a11-bcb8-fad8b82d9b41 -- POST / 200 223.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,794 mnist_classifier_MNISTClassifier rhuurgbr b2543c73-d8ad-4b9d-8713-d3a79da3ccb6 -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,794 mnist_classifier_MNISTClassifier rhuurgbr ac72e1a6-b447-49ef-88e0-08fb0f290ea5 -- POST / 200 225.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,795 mnist_classifier_MNISTClassifier rhuurgbr 1304e736-ac6d-448f-80fc-fd41822d58cf -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,795 mnist_classifier_MNISTClassifier rhuurgbr 13eb4eaa-6418-47dc-94c0-1c4308378a9f -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,795 mnist_classifier_MNISTClassifier rhuurgbr 101b77c5-92a4-4dfe-8f93-b06e6a8882c2 -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,795 mnist_classifier_MNISTClassifier rhuurgbr 3896f56f-1853-47f0-96d9-70923911350f -- POST / 200 219.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,796 mnist_classifier_MNISTClassifier rhuurgbr f9a43828-1eb4-4796-a03d-d8ba6f9fb26c -- POST / 200 218.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,796 mnist_classifier_MNISTClassifier rhuurgbr 2e889921-cd1c-435b-a405-628caa50b31b -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,796 mnist_classifier_MNISTClassifier rhuurgbr 2e72e54d-c2ea-4318-8840-a50f1e5e2a2e -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,796 mnist_classifier_MNISTClassifier rhuurgbr fef39c28-4ea7-4e54-b03e-da0eb4ad30a0 -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,905 mnist_classifier_MNISTClassifier rhuurgbr 6d313cff-3614-4bd1-a68f-08d29cd06d37 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,909 mnist_classifier_MNISTClassifier rhuurgbr b2918ed5-73fc-4801-82a6-99f39f377581 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,910 mnist_classifier_MNISTClassifier rhuurgbr e19bf4c6-4472-41be-b5ca-debdd4aa315b -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,912 mnist_classifier_MNISTClassifier rhuurgbr 2775b720-8c43-4b88-a4e3-42701890c3c3 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,915 mnist_classifier_MNISTClassifier rhuurgbr ea456c42-5c69-48ce-b29f-4f90a119ad2c -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,917 mnist_classifier_MNISTClassifier rhuurgbr bbbfe79a-46a5-4c78-86b5-307bc585e03b -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,917 mnist_classifier_MNISTClassifier rhuurgbr 565a0d1f-93be-40d6-be35-d88bb475b1fa -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,918 mnist_classifier_MNISTClassifier rhuurgbr 7cb5e968-34cb-4b7d-94ac-01084b98e7c4 -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,921 mnist_classifier_MNISTClassifier rhuurgbr ed0bfa07-a52d-4122-ba70-4386866112bd -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,921 mnist_classifier_MNISTClassifier rhuurgbr 6a1ca141-f731-4a6e-9b47-303ec218ea24 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,922 mnist_classifier_MNISTClassifier rhuurgbr 6ce64fa4-4f7a-4d8e-b6dd-dfeb8c12b999 -- POST / 200 219.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,923 mnist_classifier_MNISTClassifier rhuurgbr ecebde73-2970-4297-b74e-739ba5ed86e6 -- POST / 200 216.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,923 mnist_classifier_MNISTClassifier rhuurgbr 5edab274-3523-4c1b-a627-65f2629f1967 -- POST / 200 216.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,924 mnist_classifier_MNISTClassifier rhuurgbr 4ebd7e5d-a956-4a3f-9a99-7341505f27d2 -- POST / 200 214.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,925 mnist_classifier_MNISTClassifier rhuurgbr 1bfce049-209e-4833-b36c-f7a73237028f -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,926 mnist_classifier_MNISTClassifier rhuurgbr bf95c64a-fa9c-462a-9e2b-93fd9d62bd9f -- POST / 200 216.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,926 mnist_classifier_MNISTClassifier rhuurgbr f92a3df6-25cb-4d28-9a4b-96650e699bb9 -- POST / 200 216.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,927 mnist_classifier_MNISTClassifier rhuurgbr 8f42482b-0335-44a1-989c-a490a317c4df -- POST / 200 214.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,927 mnist_classifier_MNISTClassifier rhuurgbr 13e577ff-e297-4970-a036-238a6ff1cea9 -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,928 mnist_classifier_MNISTClassifier rhuurgbr dcd3ad1a-8046-42a5-b856-654c2adaeb11 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,928 mnist_classifier_MNISTClassifier rhuurgbr 4f053d36-5374-4c3b-b919-6ec2de96eb28 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,929 mnist_classifier_MNISTClassifier rhuurgbr 70f45247-465a-46cb-bce2-66bfd0b0cda2 -- POST / 200 213.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,929 mnist_classifier_MNISTClassifier rhuurgbr 9ea20774-be47-4517-ac88-ed54d3cab1a9 -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,929 mnist_classifier_MNISTClassifier rhuurgbr bf16a370-fcc1-454b-b08f-89e8ed05435e -- POST / 200 212.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,931 mnist_classifier_MNISTClassifier rhuurgbr b01b44d9-2647-4a78-ae47-86917d510b56 -- POST / 200 212.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,931 mnist_classifier_MNISTClassifier rhuurgbr 179ea354-5a9c-4a96-b4be-32c76e65b388 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:03,932 mnist_classifier_MNISTClassifier rhuurgbr d1e22ec4-ccdd-465f-813b-90227f3fe103 -- POST / 200 197.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,069 mnist_classifier_MNISTClassifier rhuurgbr e6f26bf2-c571-4281-90d8-d3ab1269879e -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,070 mnist_classifier_MNISTClassifier rhuurgbr 687eab12-ba3d-413c-98a1-4dd8e51654e4 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,071 mnist_classifier_MNISTClassifier rhuurgbr 9b4c9bcc-694b-4fe0-ac1e-52475c3afb72 -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,071 mnist_classifier_MNISTClassifier rhuurgbr 4b9b1563-b0fe-41b0-83f2-f89a9076ad98 -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,072 mnist_classifier_MNISTClassifier rhuurgbr ff40f90e-00fb-4f86-b3dd-fd787371549e -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,072 mnist_classifier_MNISTClassifier rhuurgbr 8e7183e7-cbd7-487d-bb70-d129f8fc6124 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,072 mnist_classifier_MNISTClassifier rhuurgbr 2d85ab5f-6ba5-407c-af30-41a42101a3c4 -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,073 mnist_classifier_MNISTClassifier rhuurgbr 8d074e3a-645f-4ca7-97b0-2d7b61be85c9 -- POST / 200 272.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,074 mnist_classifier_MNISTClassifier rhuurgbr ddecb835-86c9-46f8-be90-966fc70f2b6c -- POST / 200 274.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,074 mnist_classifier_MNISTClassifier rhuurgbr 8d0bb796-3f72-47a5-a81e-92b20b4385fa -- POST / 200 274.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,075 mnist_classifier_MNISTClassifier rhuurgbr 20e99830-c8d5-4f6a-bcf7-ca2c39e370cf -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,076 mnist_classifier_MNISTClassifier rhuurgbr c89920f2-b027-4936-be1b-ecaf2b3e256b -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,078 mnist_classifier_MNISTClassifier rhuurgbr af34ffc5-a7a4-47c9-8e18-d14918f6c234 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,078 mnist_classifier_MNISTClassifier rhuurgbr 69c41dc5-8ed6-4758-ab11-0efa50249ceb -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,079 mnist_classifier_MNISTClassifier rhuurgbr 6b8d13f3-a66e-41c4-92b1-c9142fa07bc1 -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,081 mnist_classifier_MNISTClassifier rhuurgbr fdc466fb-ca23-4977-8622-e3d1f74f9c08 -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,081 mnist_classifier_MNISTClassifier rhuurgbr 1b24e298-1e4a-4d23-8282-bd0c3ad9ac53 -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,084 mnist_classifier_MNISTClassifier rhuurgbr c79f1743-62e2-49a4-9a7f-1d9a5994c89b -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,085 mnist_classifier_MNISTClassifier rhuurgbr 1a61389c-2580-4fd0-9dae-f6939d253ae9 -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,085 mnist_classifier_MNISTClassifier rhuurgbr 50dd866c-2dd7-4215-9b9b-2fac4117ad0a -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,086 mnist_classifier_MNISTClassifier rhuurgbr da19fdb4-eefe-4bcb-be64-6b628999e3d4 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,086 mnist_classifier_MNISTClassifier rhuurgbr 3f958637-c4ac-429f-9c32-95c77dc0c06e -- POST / 200 280.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,087 mnist_classifier_MNISTClassifier rhuurgbr dafabc12-c946-4114-b323-6829bdaaee9e -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,087 mnist_classifier_MNISTClassifier rhuurgbr 85cddd40-252e-45a9-b236-13fc96599137 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,087 mnist_classifier_MNISTClassifier rhuurgbr d7f82720-3eca-4537-830d-40302e00517a -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,087 mnist_classifier_MNISTClassifier rhuurgbr 9e823c6b-58fa-4cad-b771-01cecd0d7214 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,088 mnist_classifier_MNISTClassifier rhuurgbr 9a41199c-7363-4387-b111-a86a890ea89b -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,088 mnist_classifier_MNISTClassifier rhuurgbr 65831af5-c3b6-4f45-8b7f-07161fb4f1ed -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,088 mnist_classifier_MNISTClassifier rhuurgbr 8c568d2a-42b8-45af-bbd4-2f65b0fc082c -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,088 mnist_classifier_MNISTClassifier rhuurgbr b287498c-cd2f-4413-bf42-6c755a3b81d6 -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,089 mnist_classifier_MNISTClassifier rhuurgbr c8bc4435-321e-4f41-8cf9-a0171dc4441d -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,089 mnist_classifier_MNISTClassifier rhuurgbr e8f3a9f6-5c6c-4ace-8c51-3f1c237f11ea -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,089 mnist_classifier_MNISTClassifier rhuurgbr d3027a87-2ab8-4362-8235-d2f286f649c2 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,090 mnist_classifier_MNISTClassifier rhuurgbr f5624b82-38f3-4feb-8b19-fa12d2de03e7 -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,090 mnist_classifier_MNISTClassifier rhuurgbr a075a825-4916-4e21-8f5f-d946bcb38be2 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,090 mnist_classifier_MNISTClassifier rhuurgbr fe64d6d4-d942-40fc-9131-fd390065ba03 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,090 mnist_classifier_MNISTClassifier rhuurgbr b5a35549-cd21-44c3-b1ca-876a034204d7 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,090 mnist_classifier_MNISTClassifier rhuurgbr bac56029-b367-44fb-89ca-83d0bce306b5 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,091 mnist_classifier_MNISTClassifier rhuurgbr bf47be0f-1a4c-41ff-a80e-e7231046cf8b -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,091 mnist_classifier_MNISTClassifier rhuurgbr 2a158655-3858-4ccc-b75f-a3e7350d580f -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,091 mnist_classifier_MNISTClassifier rhuurgbr cc57672e-8cf0-4872-9f5e-0c43f3ad2668 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,092 mnist_classifier_MNISTClassifier rhuurgbr 4295c7d5-398f-44b0-b44e-fe391c91fd55 -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,092 mnist_classifier_MNISTClassifier rhuurgbr 87a86c77-1925-4305-873e-43efa7dd7993 -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,092 mnist_classifier_MNISTClassifier rhuurgbr ac017c27-e000-475c-9d6c-3192544385a7 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,093 mnist_classifier_MNISTClassifier rhuurgbr 32ef35ef-f5aa-43af-9a0e-a49fb6552f00 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,093 mnist_classifier_MNISTClassifier rhuurgbr ce2292bd-2867-4538-b3da-dc6ddbf992bd -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,093 mnist_classifier_MNISTClassifier rhuurgbr f27b5760-2214-4e60-b94e-10497acbeb4c -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,093 mnist_classifier_MNISTClassifier rhuurgbr 806949f0-1ec8-4fd1-9889-0640b4f1fb4b -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,097 mnist_classifier_MNISTClassifier rhuurgbr 93efb6e6-1907-462e-aa4e-fc1210d8944c -- POST / 200 207.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,105 mnist_classifier_MNISTClassifier rhuurgbr 2c4e13bf-1724-4e5b-abb0-b63f88640560 -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,106 mnist_classifier_MNISTClassifier rhuurgbr 391b5273-a827-491f-93cf-984c67170a70 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,106 mnist_classifier_MNISTClassifier rhuurgbr 9d39cfcb-f432-4bf3-989d-5f4fd5241897 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,106 mnist_classifier_MNISTClassifier rhuurgbr 958c4ae8-3a0a-47b7-b1de-663725af499e -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,106 mnist_classifier_MNISTClassifier rhuurgbr 733af453-2d97-4768-b716-1a00fc0fa996 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,107 mnist_classifier_MNISTClassifier rhuurgbr a38d160c-6081-4c53-99d7-5f4753d90b6a -- POST / 200 155.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,107 mnist_classifier_MNISTClassifier rhuurgbr 0f9a326e-8489-4572-aaf2-14752eebc713 -- POST / 200 154.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,107 mnist_classifier_MNISTClassifier rhuurgbr 448eada5-691c-48fa-b6da-48f25c94cd17 -- POST / 200 153.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,108 mnist_classifier_MNISTClassifier rhuurgbr 8bb207f5-a613-4cbe-8a0e-305b9ce72a68 -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,109 mnist_classifier_MNISTClassifier rhuurgbr dc5c4177-62b6-4756-95f4-abfab20911f6 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,109 mnist_classifier_MNISTClassifier rhuurgbr 05e36863-3e64-4afc-9d00-cb5466e110ad -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,109 mnist_classifier_MNISTClassifier rhuurgbr 7afb13f4-5160-4bbe-955f-367899447e67 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,110 mnist_classifier_MNISTClassifier rhuurgbr 5b9fc70f-caf8-4881-a224-6cc6ac77e963 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,110 mnist_classifier_MNISTClassifier rhuurgbr fd7c0a56-299d-45c9-be7a-34e4015a9416 -- POST / 200 232.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 84a949b2-1b3e-4e44-a94a-e6e41717e095 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 0dafd0cc-1a9d-418d-adc2-3aa05de1f8f2 -- POST / 200 231.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 1e1b0a6f-d4d9-4ebb-a969-988430e9e5aa -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 2d458450-8c95-4883-b6a7-6ae6f361e0bc -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 9fdafe39-d635-4e37-8fa6-00c9f2a38fe4 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 8e1fadb5-a473-445b-a205-d7ae988533ab -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,111 mnist_classifier_MNISTClassifier rhuurgbr 2d0bafd7-46d2-4288-a372-d808dc9aa9c7 -- POST / 200 227.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,112 mnist_classifier_MNISTClassifier rhuurgbr 17206963-2a75-49e9-aca6-7078b12032ac -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,112 mnist_classifier_MNISTClassifier rhuurgbr 637d3693-c515-4914-8568-2fab52583949 -- POST / 200 225.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,112 mnist_classifier_MNISTClassifier rhuurgbr eb524fc6-0fa6-4d9b-9386-84132ad8e8e3 -- POST / 200 225.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,112 mnist_classifier_MNISTClassifier rhuurgbr 669e74c3-1158-46ab-8b31-528a0217d2a1 -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,112 mnist_classifier_MNISTClassifier rhuurgbr 668366f9-df4c-4a89-a9ab-7beefb44ccda -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,113 mnist_classifier_MNISTClassifier rhuurgbr bea8ded9-2bbb-42bc-a48b-588e8336c4c3 -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,113 mnist_classifier_MNISTClassifier rhuurgbr b803ce18-6212-4152-b757-1884d0e7c7a7 -- POST / 200 158.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,150 mnist_classifier_MNISTClassifier rhuurgbr 447b7f3c-b7d9-440d-b608-dff7fa0c1bef -- POST / 200 191.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,174 mnist_classifier_MNISTClassifier rhuurgbr 0fce402d-bd9d-435e-839e-7092082b1f6d -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,175 mnist_classifier_MNISTClassifier rhuurgbr 0b2d118d-3ece-4080-a35d-4dc2c7065560 -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,175 mnist_classifier_MNISTClassifier rhuurgbr f2663b37-14ca-4b7f-aa3f-1076e88cf2de -- POST / 200 213.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,176 mnist_classifier_MNISTClassifier rhuurgbr 98e9c7df-98d0-41be-acdc-342903a684a4 -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,176 mnist_classifier_MNISTClassifier rhuurgbr 1400925c-dd0f-422b-850b-edbccb61a7a5 -- POST / 200 203.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,176 mnist_classifier_MNISTClassifier rhuurgbr b74e833b-695b-499f-bdc0-614d0eb8b0d5 -- POST / 200 201.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,176 mnist_classifier_MNISTClassifier rhuurgbr 35770cfa-4029-482c-ab1c-68eef1b2a4c8 -- POST / 200 200.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,176 mnist_classifier_MNISTClassifier rhuurgbr bec496a5-a2ba-4dfe-aa3e-ea3347e52342 -- POST / 200 198.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,177 mnist_classifier_MNISTClassifier rhuurgbr 771e25ca-6180-45e6-b32c-c1b49cd05110 -- POST / 200 189.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,177 mnist_classifier_MNISTClassifier rhuurgbr 0294e3e9-39e9-4342-bf2f-425fc14e47bb -- POST / 200 188.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,177 mnist_classifier_MNISTClassifier rhuurgbr f9a63f09-ed7b-4538-955d-6e4e57757503 -- POST / 200 188.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,177 mnist_classifier_MNISTClassifier rhuurgbr de1e29f6-6f86-4be7-b653-518b8292c330 -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,177 mnist_classifier_MNISTClassifier rhuurgbr b93a3d6b-8044-45e3-a40f-f2f1c734c5d1 -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,177 mnist_classifier_MNISTClassifier rhuurgbr 12d0e865-6b2d-4369-9613-6fa6d6446a3c -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr 861f806f-3029-4168-8710-574ddcdb5ee1 -- POST / 200 188.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr a6579fa3-8c54-44fb-a69a-d4ffe25df6c3 -- POST / 200 187.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr 19ea0af5-7a78-4fb5-a017-5ed64fc0421f -- POST / 200 187.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr 9140a911-1237-49de-b619-612a5a96e129 -- POST / 200 187.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr 87a30f61-2772-400c-9fd9-eb92e9fae6e3 -- POST / 200 187.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr 67cf4828-a251-4d38-9195-b0b5e8f30d84 -- POST / 200 187.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,178 mnist_classifier_MNISTClassifier rhuurgbr f3d91a33-6b70-46ce-897e-e2df83276917 -- POST / 200 186.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,183 mnist_classifier_MNISTClassifier rhuurgbr 27d98d93-ef83-4c68-a030-429c95aaab11 -- POST / 200 191.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,463 mnist_classifier_MNISTClassifier rhuurgbr 740d2998-e7ba-4796-85bc-de4d0b5722fa -- POST / 200 337.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,464 mnist_classifier_MNISTClassifier rhuurgbr 8778e6c3-1b5e-4117-b7bc-995ff6aadae3 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,465 mnist_classifier_MNISTClassifier rhuurgbr da88f8e7-5e7a-408e-b7cd-2157bcf67d51 -- POST / 200 381.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,465 mnist_classifier_MNISTClassifier rhuurgbr 53c49c5d-b3d1-4797-adb4-4d1c6eef30af -- POST / 200 351.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,466 mnist_classifier_MNISTClassifier rhuurgbr e7feae13-411b-4956-bc36-ba3160fe6694 -- POST / 200 348.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,466 mnist_classifier_MNISTClassifier rhuurgbr bec57a84-6e8d-4c39-a4c6-e874c39708d3 -- POST / 200 347.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,469 mnist_classifier_MNISTClassifier rhuurgbr 2bc67931-028d-434a-80ae-da2a0992d73a -- POST / 200 346.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,470 mnist_classifier_MNISTClassifier rhuurgbr 88bf04da-f34c-47a4-a9d3-4507a640dc1f -- POST / 200 347.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,474 mnist_classifier_MNISTClassifier rhuurgbr 27ba37e8-5f02-4b7c-b6ba-918ebfe7848c -- POST / 200 351.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,481 mnist_classifier_MNISTClassifier rhuurgbr c3e9164d-d9dc-49e8-bba3-22b1d055d385 -- POST / 200 355.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,492 mnist_classifier_MNISTClassifier rhuurgbr 3087241b-2e84-4020-80ee-8708c8e9c3bc -- POST / 200 365.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,579 mnist_classifier_MNISTClassifier rhuurgbr 1fa1d906-d819-4f2b-9876-3fb4384304db -- POST / 200 451.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,579 mnist_classifier_MNISTClassifier rhuurgbr 1716e09f-5b6c-4c67-8b87-3e363c0686f2 -- POST / 200 452.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,580 mnist_classifier_MNISTClassifier rhuurgbr dc1efd86-cbd5-43af-b9e4-1b11a285ddac -- POST / 200 381.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,581 mnist_classifier_MNISTClassifier rhuurgbr 75817fd0-c62e-4cb6-af6c-95b84a382038 -- POST / 200 451.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,581 mnist_classifier_MNISTClassifier rhuurgbr ecc14499-3904-4b94-b015-e12a78596cac -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,581 mnist_classifier_MNISTClassifier rhuurgbr acbfeeca-87d6-4994-85ac-e5a41e9f5105 -- POST / 200 432.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,582 mnist_classifier_MNISTClassifier rhuurgbr 757ef395-a796-4b25-b435-66cc83a3b125 -- POST / 200 409.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,583 mnist_classifier_MNISTClassifier rhuurgbr 16aca9b0-39c8-4190-92d3-e7e6a1535a28 -- POST / 200 394.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,584 mnist_classifier_MNISTClassifier rhuurgbr e50ca7a1-affc-47f9-ba4d-c3633483c21a -- POST / 200 394.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,584 mnist_classifier_MNISTClassifier rhuurgbr 8aa37cc9-bf98-47f8-917a-e27e435c1b53 -- POST / 200 393.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,585 mnist_classifier_MNISTClassifier rhuurgbr a616e14c-a84d-4df6-b365-7b05e130eb28 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,585 mnist_classifier_MNISTClassifier rhuurgbr 139b3d93-801e-4249-908d-64e487e720c1 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,586 mnist_classifier_MNISTClassifier rhuurgbr ecdc7283-0e10-4398-8c55-d8522c7c6850 -- POST / 200 391.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,587 mnist_classifier_MNISTClassifier rhuurgbr bd1796bd-f10f-4e11-9d14-986bbfb564ab -- POST / 200 391.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,587 mnist_classifier_MNISTClassifier rhuurgbr 476391c1-0e36-47d2-b81e-224658290189 -- POST / 200 391.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,588 mnist_classifier_MNISTClassifier rhuurgbr a22d96cb-e45b-4ee0-9986-5c425e3623ba -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,588 mnist_classifier_MNISTClassifier rhuurgbr 9acb85a9-1a4f-4b83-96a7-0a23fe548939 -- POST / 200 391.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,588 mnist_classifier_MNISTClassifier rhuurgbr ca79052d-b119-4ca4-8649-4f0c62252b28 -- POST / 200 391.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,588 mnist_classifier_MNISTClassifier rhuurgbr 168e790e-7b2f-4ae0-864f-6bbabe52c77c -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,589 mnist_classifier_MNISTClassifier rhuurgbr 84e35ae7-f3bd-4b49-bf13-b0801d866b29 -- POST / 200 392.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,590 mnist_classifier_MNISTClassifier rhuurgbr cdd477c2-38f1-44f7-a0c6-12b0f2318168 -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,590 mnist_classifier_MNISTClassifier rhuurgbr 2382870e-b5b9-4988-afee-fb8428fac391 -- POST / 200 382.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,591 mnist_classifier_MNISTClassifier rhuurgbr 09881d90-bb83-4118-afe2-615cf05e3595 -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,592 mnist_classifier_MNISTClassifier rhuurgbr cce6ed35-16f9-4f6d-957a-455b9a995902 -- POST / 200 383.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,594 mnist_classifier_MNISTClassifier rhuurgbr 8ba4f67c-9483-4ab9-ac8c-44067d1a4c7d -- POST / 200 389.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,595 mnist_classifier_MNISTClassifier rhuurgbr 59f533c6-8971-4fb9-bb58-7405374e0aea -- POST / 200 388.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,598 mnist_classifier_MNISTClassifier rhuurgbr 8012c158-d918-4d1a-b73d-41533ef87054 -- POST / 200 391.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,598 mnist_classifier_MNISTClassifier rhuurgbr 45e3f83a-94bc-4a25-907c-d927e7989b77 -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,599 mnist_classifier_MNISTClassifier rhuurgbr 3e8381cb-ba07-4b8f-ae98-18fa4ab73247 -- POST / 200 388.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,599 mnist_classifier_MNISTClassifier rhuurgbr dde14eae-4bcf-4558-a7dd-1da76152c99b -- POST / 200 388.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,599 mnist_classifier_MNISTClassifier rhuurgbr 500af382-eb1c-465a-8872-4548c0fe07cc -- POST / 200 388.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,600 mnist_classifier_MNISTClassifier rhuurgbr a4174dc2-db72-4057-b900-10ccd2912deb -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,600 mnist_classifier_MNISTClassifier rhuurgbr a624df66-375a-4eaa-b017-f9b21a5160b8 -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,602 mnist_classifier_MNISTClassifier rhuurgbr a7dd12d9-042d-44ec-a781-0929e3ee559f -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,603 mnist_classifier_MNISTClassifier rhuurgbr 5c779695-635f-4559-98f4-e14405fc39b5 -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,604 mnist_classifier_MNISTClassifier rhuurgbr 307ac953-24f0-4f59-a38a-697d3b1597b3 -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,604 mnist_classifier_MNISTClassifier rhuurgbr 3013e5fd-bd7a-45a6-a63e-9ad36b468ceb -- POST / 200 387.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,604 mnist_classifier_MNISTClassifier rhuurgbr ecc67c08-8faa-4bf3-8cc4-4c36cdab6b2e -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,605 mnist_classifier_MNISTClassifier rhuurgbr 39b8ba01-dc6f-4ea1-9f93-ae2b59b3b528 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,605 mnist_classifier_MNISTClassifier rhuurgbr 525c051e-1ad7-43b9-bd64-4a69b75db654 -- POST / 200 385.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,605 mnist_classifier_MNISTClassifier rhuurgbr 1fe6cd64-b42c-478f-bc61-32bc86a925bd -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,606 mnist_classifier_MNISTClassifier rhuurgbr 415669d8-2dd4-488b-bd62-0e577ffe98cc -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,606 mnist_classifier_MNISTClassifier rhuurgbr 219bd229-828f-481c-b511-0c45fdb5e2b3 -- POST / 200 383.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,607 mnist_classifier_MNISTClassifier rhuurgbr 49d812f2-1e57-433f-a872-cb8ccebd0d49 -- POST / 200 378.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,607 mnist_classifier_MNISTClassifier rhuurgbr ee9a5132-eec5-41f6-a893-00698fc0660e -- POST / 200 378.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,607 mnist_classifier_MNISTClassifier rhuurgbr f57e7180-4248-47a8-8a48-58b4baa204d2 -- POST / 200 377.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,608 mnist_classifier_MNISTClassifier rhuurgbr 4bc2300e-4990-4406-a67f-925fc8d9bffd -- POST / 200 377.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,608 mnist_classifier_MNISTClassifier rhuurgbr 5f88c11c-274f-428d-ac22-085ba775dcad -- POST / 200 377.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,608 mnist_classifier_MNISTClassifier rhuurgbr e9882f88-4105-4a10-8bdf-357aec448347 -- POST / 200 375.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,609 mnist_classifier_MNISTClassifier rhuurgbr 2b600818-bf3e-4af1-a8b3-b23255bd7954 -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,609 mnist_classifier_MNISTClassifier rhuurgbr 34c0f79c-57e3-4b09-8547-0cbfa345c604 -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,610 mnist_classifier_MNISTClassifier rhuurgbr af7c0e9e-aa4e-4e2b-8a59-01b9d30f9c93 -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,610 mnist_classifier_MNISTClassifier rhuurgbr 29d7a053-d615-47bb-b915-218cd29f57c7 -- POST / 200 374.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,610 mnist_classifier_MNISTClassifier rhuurgbr 4b96a865-d9e0-47f4-89b3-720d26a793ca -- POST / 200 374.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,610 mnist_classifier_MNISTClassifier rhuurgbr edea91e8-a704-4684-aa22-189be25a8b0c -- POST / 200 373.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,610 mnist_classifier_MNISTClassifier rhuurgbr 210fff34-ab3b-49bb-b483-79a79df10187 -- POST / 200 373.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,611 mnist_classifier_MNISTClassifier rhuurgbr bd601048-76ef-4d9d-a03c-4bf227544ad1 -- POST / 200 373.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,611 mnist_classifier_MNISTClassifier rhuurgbr e2428881-15ca-4703-a846-4f371941b1e7 -- POST / 200 372.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,611 mnist_classifier_MNISTClassifier rhuurgbr beb65412-c0e6-4649-8938-06cf7fcc007b -- POST / 200 368.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,611 mnist_classifier_MNISTClassifier rhuurgbr c5a5852d-11db-4fe4-a1b8-e7baeab1a470 -- POST / 200 367.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,614 mnist_classifier_MNISTClassifier rhuurgbr ab8bd58c-efda-41bd-8e99-53aeb8ba87cd -- POST / 200 369.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,614 mnist_classifier_MNISTClassifier rhuurgbr bb24a04e-991f-4832-ab36-6a8879467947 -- POST / 200 366.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,614 mnist_classifier_MNISTClassifier rhuurgbr 9af8db8d-8c68-4a31-978c-c7dc8940e3ea -- POST / 200 366.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,614 mnist_classifier_MNISTClassifier rhuurgbr 2d536a4f-bc79-40c8-bd95-c5a1b4800af1 -- POST / 200 366.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,614 mnist_classifier_MNISTClassifier rhuurgbr 10f13178-d644-44e2-9ff6-210c6d2a0a7c -- POST / 200 365.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,615 mnist_classifier_MNISTClassifier rhuurgbr 4a182c9c-4286-4a67-8173-fdae5ff96e03 -- POST / 200 366.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,615 mnist_classifier_MNISTClassifier rhuurgbr 27016481-e767-4368-a1f2-98882ddcf699 -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,616 mnist_classifier_MNISTClassifier rhuurgbr 29aba5f7-fc87-4a69-92d0-e3e0a3f5a836 -- POST / 200 214.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,617 mnist_classifier_MNISTClassifier rhuurgbr 5fe4b8f4-5059-4f6a-bf3a-bcfc98696cf1 -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,620 mnist_classifier_MNISTClassifier rhuurgbr feb613fd-8296-40f7-9be2-cad1537a59bf -- POST / 200 216.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,621 mnist_classifier_MNISTClassifier rhuurgbr 879b8686-111f-4359-bba6-ddcdb26b77a8 -- POST / 200 216.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,621 mnist_classifier_MNISTClassifier rhuurgbr 5f813114-064e-4310-add3-7a9f83fa76fb -- POST / 200 216.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,621 mnist_classifier_MNISTClassifier rhuurgbr 25df50fc-2bff-4214-911c-fc41c61f662e -- POST / 200 217.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,621 mnist_classifier_MNISTClassifier rhuurgbr c97c067d-f851-4ac2-b2aa-236894f7400f -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,622 mnist_classifier_MNISTClassifier rhuurgbr 75134ee6-396a-4cd3-881f-ce5dd8d621d6 -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,622 mnist_classifier_MNISTClassifier rhuurgbr df663ed2-50d4-40bb-b07f-3ce86c51b9dc -- POST / 200 214.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,624 mnist_classifier_MNISTClassifier rhuurgbr c21a4670-fd4d-4e9a-8bf7-f6c8f436e2e7 -- POST / 200 216.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,625 mnist_classifier_MNISTClassifier rhuurgbr 3bdbc838-6ee2-4600-92ef-8d702f961bd1 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,625 mnist_classifier_MNISTClassifier rhuurgbr 218e3a9c-613e-483b-a10c-9ecfeb334e5f -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,626 mnist_classifier_MNISTClassifier rhuurgbr 45473047-fd57-40b9-9ca0-b686396b4cd8 -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,626 mnist_classifier_MNISTClassifier rhuurgbr 442ac86c-6561-4faa-b6fb-7d70be11c305 -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,626 mnist_classifier_MNISTClassifier rhuurgbr 921d45dd-d1fd-4b75-939d-2ccd7c45610f -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,626 mnist_classifier_MNISTClassifier rhuurgbr c9f2191f-7ba1-48f3-82a3-c29ce659e021 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,626 mnist_classifier_MNISTClassifier rhuurgbr 66ef8723-a941-433b-a071-1091af599380 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,626 mnist_classifier_MNISTClassifier rhuurgbr 552d823d-a212-4aeb-9caf-0139d45d2bc0 -- POST / 200 214.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,628 mnist_classifier_MNISTClassifier rhuurgbr 58fc7912-94bd-4456-aaae-858024c8fba2 -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,628 mnist_classifier_MNISTClassifier rhuurgbr d61fe830-ede1-4eaa-8b26-3de88550aa98 -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,628 mnist_classifier_MNISTClassifier rhuurgbr 6673e2c8-e6ac-4542-bcdf-e8b79cf343be -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,629 mnist_classifier_MNISTClassifier rhuurgbr 091a8daf-8fc8-41e5-ac2b-c4b96f921975 -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,629 mnist_classifier_MNISTClassifier rhuurgbr 41080d2a-da42-4fe5-ac0e-20baa1a58eaa -- POST / 200 182.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,631 mnist_classifier_MNISTClassifier rhuurgbr caa91adf-d838-4819-9930-d79cf959b4b3 -- POST / 200 178.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,633 mnist_classifier_MNISTClassifier rhuurgbr b64bf395-c8eb-4dce-98e0-ea2f90fef584 -- POST / 200 177.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,634 mnist_classifier_MNISTClassifier rhuurgbr ad3123ae-81ed-4146-ad19-07d192d482d8 -- POST / 200 131.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,634 mnist_classifier_MNISTClassifier rhuurgbr 15b7cba8-1903-4757-aad1-db1933ac1d03 -- POST / 200 126.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,634 mnist_classifier_MNISTClassifier rhuurgbr 2355ecd7-f28f-4858-be44-b5dc6ae28229 -- POST / 200 123.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,677 mnist_classifier_MNISTClassifier rhuurgbr 092a1847-aca6-48ee-93ba-926d117bf292 -- POST / 200 166.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,741 mnist_classifier_MNISTClassifier rhuurgbr 4f41ebed-fb74-4656-b4e1-3467b16e2281 -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,742 mnist_classifier_MNISTClassifier rhuurgbr 9d3e3447-6b6a-4014-954e-52d2c20282a2 -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,742 mnist_classifier_MNISTClassifier rhuurgbr 5e7b9f6c-4d1f-4a5e-b853-4ff4c10e21ec -- POST / 200 227.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,742 mnist_classifier_MNISTClassifier rhuurgbr 9bfb45e7-5b17-45f4-90ca-490a48f14a49 -- POST / 200 227.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,870 mnist_classifier_MNISTClassifier rhuurgbr 6206632d-7f6a-4b90-8412-d846e3793d9b -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,874 mnist_classifier_MNISTClassifier rhuurgbr f38a2bad-11f8-4322-8e4e-df9b1d267182 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,874 mnist_classifier_MNISTClassifier rhuurgbr cb0a228e-313e-42ae-b94e-c584b7c8fa9a -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,874 mnist_classifier_MNISTClassifier rhuurgbr b7390c27-2095-4faf-aa09-5df2ca3ffc21 -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,876 mnist_classifier_MNISTClassifier rhuurgbr 4a70d9dd-fbc2-4a72-b9a5-05fce3f1f7ae -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,876 mnist_classifier_MNISTClassifier rhuurgbr 7ee73773-788e-4fc5-a054-ada238f0402c -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,877 mnist_classifier_MNISTClassifier rhuurgbr 64904641-57e1-41dc-bb2f-2060ef83b43c -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,877 mnist_classifier_MNISTClassifier rhuurgbr e8d48153-2be7-4be6-a498-15fbde888c90 -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,881 mnist_classifier_MNISTClassifier rhuurgbr b6e6a9ee-b8b8-4d7f-a106-d1c007337dba -- POST / 200 230.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,881 mnist_classifier_MNISTClassifier rhuurgbr 212bc1fd-1dd4-46ad-9b77-1529b5a50cfd -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,881 mnist_classifier_MNISTClassifier rhuurgbr e791a5c3-a696-431a-852a-0a11abf548a6 -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,882 mnist_classifier_MNISTClassifier rhuurgbr d4580e62-744c-48f4-9497-7832f10ac705 -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,884 mnist_classifier_MNISTClassifier rhuurgbr 6ea4eb76-53c6-41da-b27c-f0d37a718c17 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,884 mnist_classifier_MNISTClassifier rhuurgbr 4b399cde-bdd0-4c66-b05e-79f055780685 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,884 mnist_classifier_MNISTClassifier rhuurgbr 4b5a517c-65a5-4a33-a602-84d4cb440d12 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,887 mnist_classifier_MNISTClassifier rhuurgbr b7ddb9b0-447c-462e-b3ce-811fe2a7a15b -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,888 mnist_classifier_MNISTClassifier rhuurgbr 0a9bbf02-2533-4105-94cd-646396d6255d -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,972 mnist_classifier_MNISTClassifier rhuurgbr 8bcf9400-55da-44ec-bfdd-38f0d26c219c -- POST / 200 314.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,973 mnist_classifier_MNISTClassifier rhuurgbr e9f6483b-6a3f-41ec-b295-2b8dd74d226e -- POST / 200 314.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,974 mnist_classifier_MNISTClassifier rhuurgbr ee19bb72-7b76-42bc-94d1-353321bf620c -- POST / 200 314.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,975 mnist_classifier_MNISTClassifier rhuurgbr a2809419-54ef-49c4-a982-eb33aa2cc611 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,975 mnist_classifier_MNISTClassifier rhuurgbr 4b883fd8-fd4c-4553-aef4-0c5e5e6fe3ff -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,976 mnist_classifier_MNISTClassifier rhuurgbr bfdf8e2d-6ae5-4b01-ae55-8f61b8222ea7 -- POST / 200 315.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,979 mnist_classifier_MNISTClassifier rhuurgbr d68145a3-a1e8-4a36-9959-f013b70cbe77 -- POST / 200 315.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,980 mnist_classifier_MNISTClassifier rhuurgbr b428f52d-cb8d-4fe1-9810-d031a861d2f8 -- POST / 200 316.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,981 mnist_classifier_MNISTClassifier rhuurgbr e1596d52-e8cc-4e35-ad3a-f4d66d16c78b -- POST / 200 316.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,983 mnist_classifier_MNISTClassifier rhuurgbr 6a16aab8-4f2d-48ef-8448-8bb2030ef000 -- POST / 200 311.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,987 mnist_classifier_MNISTClassifier rhuurgbr e1c9775f-119f-404a-845c-65bfcd9a6b00 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,987 mnist_classifier_MNISTClassifier rhuurgbr eda947bd-7ccc-41ba-8756-29b99cf16190 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,988 mnist_classifier_MNISTClassifier rhuurgbr 2837776c-58e2-4ee1-a70f-7f7adda5781c -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,991 mnist_classifier_MNISTClassifier rhuurgbr aa388407-f94b-4c37-ad6e-fd4666f3f0ce -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,992 mnist_classifier_MNISTClassifier rhuurgbr e71a036a-4b30-4754-a104-caa1878a641e -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:04,999 mnist_classifier_MNISTClassifier rhuurgbr 3ed3b6da-91c7-48ad-ad88-efa986c0ce3d -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,002 mnist_classifier_MNISTClassifier rhuurgbr 3fa8b4fa-211f-4561-acc0-d8be97963722 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,004 mnist_classifier_MNISTClassifier rhuurgbr 89280099-d6e7-4ff7-b519-b09e8c06b2cc -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,005 mnist_classifier_MNISTClassifier rhuurgbr c3dacc88-7f59-412f-9f32-55f8f85160e0 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,005 mnist_classifier_MNISTClassifier rhuurgbr 340e4de3-193a-4d19-9d9b-929d4e915fd8 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,006 mnist_classifier_MNISTClassifier rhuurgbr 5d6854f9-10be-4808-8e35-f0464dc70960 -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,006 mnist_classifier_MNISTClassifier rhuurgbr 02eb4d9c-e7a1-40d4-a589-966f34005d61 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,006 mnist_classifier_MNISTClassifier rhuurgbr 39ac3252-5d62-407e-8a1a-d7cc732feacd -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,007 mnist_classifier_MNISTClassifier rhuurgbr 3b02ffac-e9cc-4d4f-a2fe-91877bf495e2 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,007 mnist_classifier_MNISTClassifier rhuurgbr 813dfde4-efbe-40de-b72d-429b0f052897 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,007 mnist_classifier_MNISTClassifier rhuurgbr a810161b-8fce-41d4-84e4-2c32d76b05fb -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,008 mnist_classifier_MNISTClassifier rhuurgbr 84379f7f-5fa8-4d18-b842-2950805327f9 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,009 mnist_classifier_MNISTClassifier rhuurgbr e5403cfc-34d9-4a65-8fbb-23e3ca006e8a -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,010 mnist_classifier_MNISTClassifier rhuurgbr 7467646a-5748-474a-a4e8-05900d880437 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,010 mnist_classifier_MNISTClassifier rhuurgbr c5d3c0ac-aaf9-43f1-a3fb-8af79b0297b3 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,010 mnist_classifier_MNISTClassifier rhuurgbr 03a362c7-0734-4d23-b3c9-31731637055d -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,013 mnist_classifier_MNISTClassifier rhuurgbr f7a2ad05-5d84-4f85-b64d-49fbab4d7e09 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,014 mnist_classifier_MNISTClassifier rhuurgbr c74c61b6-c213-42fe-90a3-6b917a9475ed -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,015 mnist_classifier_MNISTClassifier rhuurgbr c9e82b79-39cc-4ed9-9c2c-d0fbb754dd95 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,016 mnist_classifier_MNISTClassifier rhuurgbr 288a56fb-587b-4833-ad66-e89ae0ba5910 -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,016 mnist_classifier_MNISTClassifier rhuurgbr 919ffb08-a324-45e3-b7ac-c8d9c6d5d74f -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,016 mnist_classifier_MNISTClassifier rhuurgbr 46f5a9f5-65d5-48e5-ba39-2b89bc731767 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,017 mnist_classifier_MNISTClassifier rhuurgbr dd3f0966-a64a-4e66-9519-c7204e80b6d9 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,018 mnist_classifier_MNISTClassifier rhuurgbr e3ab6160-47d7-4f4b-af6f-3095f504c679 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,018 mnist_classifier_MNISTClassifier rhuurgbr 761574e7-3066-4196-9890-15d9dbeb9434 -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,019 mnist_classifier_MNISTClassifier rhuurgbr ba5a8237-d010-44b4-9752-0bfd37aefd58 -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,019 mnist_classifier_MNISTClassifier rhuurgbr ac41fe1e-10e4-4683-b3b8-c6f8704df178 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,019 mnist_classifier_MNISTClassifier rhuurgbr 0d50f086-6c37-4391-b2ea-b54d0ee9cd8f -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr 2f1304d3-3311-4d69-b416-b9dde030f112 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr d03bca97-2354-4f37-8dc6-381f1dd6bf85 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr ad56e70c-54d2-4da0-b20e-7e0b201108a8 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr bc76eeeb-74e4-4bdb-91d8-7b7ae315a8bf -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr 25132806-7d36-4ba8-ab40-61a1f4496722 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr e91604ad-3e8c-467c-aefe-47f4987b5f49 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,020 mnist_classifier_MNISTClassifier rhuurgbr b87ca631-8cae-443a-bee4-dc6782b654e6 -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr f7feb5fd-bf96-4d95-bdbb-d64a0b3ea21c -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr ee1d3d56-0414-4aaa-b05e-e402949b3269 -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr 477182bc-9329-467a-a8a3-8753bfcc69c0 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr e9f6ef29-6c8d-4926-9f29-a393dfb8f4f7 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr ea169821-0665-4a5a-bd68-561554086e8a -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr c515989e-4a30-4541-ae89-10dc1f23406e -- POST / 200 234.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,021 mnist_classifier_MNISTClassifier rhuurgbr 8291b07d-143e-4adb-8714-b4d913e123e8 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr eab51409-96d7-4856-a9c3-83af9de11cde -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr 166f32d2-8357-4698-a4e3-f640c1fbbc4b -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr 4181de17-1683-4e2a-9447-8ce5d840b3ee -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr da6c18eb-b246-4ea8-9075-dc5755d5bcfa -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr 00d02642-78f3-4831-a8bc-51ce7f50f9fa -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr 962aa8ab-aeb8-4357-a144-88df20e16c24 -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,022 mnist_classifier_MNISTClassifier rhuurgbr eb6e62cf-0989-4ca9-b6a1-60a85d8b9d0a -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,069 mnist_classifier_MNISTClassifier rhuurgbr 3375b9bd-a470-430c-9ad7-37409d77c70f -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,110 mnist_classifier_MNISTClassifier rhuurgbr 2847ea32-68d3-4dff-9b91-6ec02cd543b9 -- POST / 200 311.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,112 mnist_classifier_MNISTClassifier rhuurgbr 7323792e-2ec4-43ab-bb9f-b44cd2c13a03 -- POST / 200 313.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,112 mnist_classifier_MNISTClassifier rhuurgbr a361e0a9-c524-4ce2-b881-980cf3b9b907 -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,113 mnist_classifier_MNISTClassifier rhuurgbr fe8fb058-1c3e-487a-8ffd-9f8e50a2a4de -- POST / 200 312.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,114 mnist_classifier_MNISTClassifier rhuurgbr a13c213b-f57f-434c-af8f-c39405d83825 -- POST / 200 312.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,114 mnist_classifier_MNISTClassifier rhuurgbr e2465dac-1e67-48fb-95b8-d730f4d10173 -- POST / 200 312.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,114 mnist_classifier_MNISTClassifier rhuurgbr 4450e70a-6184-4826-b2a1-881f30498d80 -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,115 mnist_classifier_MNISTClassifier rhuurgbr b9ee6018-fd2a-44f9-be9f-a20858457c42 -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,115 mnist_classifier_MNISTClassifier rhuurgbr b35209fc-655f-49f0-b980-35fa57db51d0 -- POST / 200 311.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,115 mnist_classifier_MNISTClassifier rhuurgbr 5a369b9b-6fe5-475d-8230-aa0a3a72c55d -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,117 mnist_classifier_MNISTClassifier rhuurgbr e94a56e4-0ca8-4ee7-bb2a-117b8748e649 -- POST / 200 312.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,117 mnist_classifier_MNISTClassifier rhuurgbr 1d6575f3-9d56-416b-aad1-9af285d75516 -- POST / 200 312.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,118 mnist_classifier_MNISTClassifier rhuurgbr 7ed37d6c-a45e-4e6f-9df0-d57ff8000cbe -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,119 mnist_classifier_MNISTClassifier rhuurgbr 54dcdba8-e0b9-4a7b-98d8-7758a2a6663f -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,119 mnist_classifier_MNISTClassifier rhuurgbr 0dc7b3c2-b0c0-41ff-9d86-7bf43c9081a5 -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,119 mnist_classifier_MNISTClassifier rhuurgbr 531a78d7-5203-4077-869a-98557188cbf8 -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,120 mnist_classifier_MNISTClassifier rhuurgbr 48e472b8-90e3-4b75-89e5-18710e6a3bd1 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,120 mnist_classifier_MNISTClassifier rhuurgbr 769f903e-1d26-4e78-be26-4563f3814e21 -- POST / 200 273.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,122 mnist_classifier_MNISTClassifier rhuurgbr d23ca0a4-7ab9-4c68-be2c-157b1db39e69 -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,124 mnist_classifier_MNISTClassifier rhuurgbr 4cfb06f3-5678-47aa-93e8-88108c2afa4c -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,124 mnist_classifier_MNISTClassifier rhuurgbr 4a2b6994-3d78-4338-ac68-534793ed98f8 -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,125 mnist_classifier_MNISTClassifier rhuurgbr db07ca33-1fcd-413f-8c88-aa8a23361470 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,128 mnist_classifier_MNISTClassifier rhuurgbr 5b27a694-310a-4caa-a3fe-486210113fdb -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,128 mnist_classifier_MNISTClassifier rhuurgbr 2533c43b-f523-40b5-9514-91b4962a7fc6 -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,129 mnist_classifier_MNISTClassifier rhuurgbr 7002827b-40a1-44da-9c8c-22bcdc039f14 -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,129 mnist_classifier_MNISTClassifier rhuurgbr 2125947a-aa61-4a3f-bff3-81ab95d1606e -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,130 mnist_classifier_MNISTClassifier rhuurgbr 06419393-f1d4-4578-967f-5539206e1058 -- POST / 200 223.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,130 mnist_classifier_MNISTClassifier rhuurgbr 757bb051-db19-462b-8332-c6a8f67b9fce -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,131 mnist_classifier_MNISTClassifier rhuurgbr e8ee8240-aa74-42ba-8890-75e641f7f4a2 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,131 mnist_classifier_MNISTClassifier rhuurgbr fe48b979-d261-4f00-89e4-0c0fa3214efc -- POST / 200 218.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,131 mnist_classifier_MNISTClassifier rhuurgbr 97a01306-517c-4e0c-b00a-dcefc0827351 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,132 mnist_classifier_MNISTClassifier rhuurgbr 961ac3bc-1aa2-45c0-a5ea-a180e19e0205 -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,135 mnist_classifier_MNISTClassifier rhuurgbr 53255b8e-477a-4dd1-b8f9-bdb6df0be40a -- POST / 200 216.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,136 mnist_classifier_MNISTClassifier rhuurgbr d2ae10d9-faf9-4e71-bf1c-dddf61684aae -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,137 mnist_classifier_MNISTClassifier rhuurgbr b92921e4-c111-4fc6-8a7c-a5e1201ede82 -- POST / 200 216.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,382 mnist_classifier_MNISTClassifier rhuurgbr 530873be-ac87-40a4-a6f1-9ab8d909746f -- POST / 200 383.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,384 mnist_classifier_MNISTClassifier rhuurgbr 2196b2b3-2248-45dd-acbe-fc7d9a955d20 -- POST / 200 379.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,384 mnist_classifier_MNISTClassifier rhuurgbr b4fac8e2-a7de-4b69-8974-f4d8840331b7 -- POST / 200 361.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,385 mnist_classifier_MNISTClassifier rhuurgbr 546eb20d-ed39-4cfd-8d7b-41d14b869fc5 -- POST / 200 377.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,386 mnist_classifier_MNISTClassifier rhuurgbr a3bd855f-4da0-40d9-8649-16d1da03f718 -- POST / 200 371.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,386 mnist_classifier_MNISTClassifier rhuurgbr 07fbd50d-f8b9-4699-81ed-91b05958e401 -- POST / 200 371.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,386 mnist_classifier_MNISTClassifier rhuurgbr e093df31-d3a0-46f7-beae-4589d64ac108 -- POST / 200 359.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,386 mnist_classifier_MNISTClassifier rhuurgbr 38bdbbbc-0f32-468f-9f26-d6677dc4de4b -- POST / 200 355.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,387 mnist_classifier_MNISTClassifier rhuurgbr 84950bef-a7ae-45d2-b1d8-05f640e57843 -- POST / 200 355.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,387 mnist_classifier_MNISTClassifier rhuurgbr 409fb259-5b28-4102-a117-5ca28950e235 -- POST / 200 354.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,388 mnist_classifier_MNISTClassifier rhuurgbr bf812118-e219-4e88-a1ab-7fd9d806d075 -- POST / 200 351.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,388 mnist_classifier_MNISTClassifier rhuurgbr ef09ab35-689a-439f-87bb-a9dac95d8b83 -- POST / 200 351.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,389 mnist_classifier_MNISTClassifier rhuurgbr 0882b4ad-a11e-4fda-99e0-0838d57e059f -- POST / 200 352.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,389 mnist_classifier_MNISTClassifier rhuurgbr 3cfb5d4b-3db7-4f3a-9b6b-68ece3620fbf -- POST / 200 352.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,390 mnist_classifier_MNISTClassifier rhuurgbr 66813008-3b14-44bf-ae22-d379768e2c44 -- POST / 200 352.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,390 mnist_classifier_MNISTClassifier rhuurgbr aed09c9e-ee7d-4353-8c5e-441ecc7b8bfc -- POST / 200 350.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,391 mnist_classifier_MNISTClassifier rhuurgbr 4039d689-926f-44f8-8c1d-7fc4c7889c7b -- POST / 200 351.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,391 mnist_classifier_MNISTClassifier rhuurgbr 8bd9951f-dae6-42de-b674-d96071b6eb8e -- POST / 200 351.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,392 mnist_classifier_MNISTClassifier rhuurgbr ff7c68c3-561e-46c2-8c34-f7c944aa36c1 -- POST / 200 352.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,392 mnist_classifier_MNISTClassifier rhuurgbr c45114f1-0ea6-4b0b-8346-5c65fb58c17d -- POST / 200 351.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,393 mnist_classifier_MNISTClassifier rhuurgbr 8c8249d8-b645-4e4d-b63d-f0e97ab1c5a1 -- POST / 200 339.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,394 mnist_classifier_MNISTClassifier rhuurgbr 5dc9499d-9ac1-43f0-9937-0601c66cd04f -- POST / 200 352.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,394 mnist_classifier_MNISTClassifier rhuurgbr 589fbb54-ba4f-4f53-bf35-94a5cc8eb81b -- POST / 200 338.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,395 mnist_classifier_MNISTClassifier rhuurgbr 52be4134-67ab-407f-85fc-09ab42101d08 -- POST / 200 349.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,396 mnist_classifier_MNISTClassifier rhuurgbr 608a336e-1a5d-4636-bfaf-5b9738a5a6d6 -- POST / 200 344.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,559 mnist_classifier_MNISTClassifier rhuurgbr 74330aa6-2879-4e07-bcb3-821e03fb46ee -- POST / 200 419.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,560 mnist_classifier_MNISTClassifier rhuurgbr c410d594-d6ad-4706-8972-0f932727091c -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,560 mnist_classifier_MNISTClassifier rhuurgbr 367deb0d-cc56-416c-8594-c98ff63e1e6c -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,561 mnist_classifier_MNISTClassifier rhuurgbr b58722f8-1eb2-45a3-a05b-ab27f0ae817e -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,562 mnist_classifier_MNISTClassifier rhuurgbr ee63e3ff-7a88-4e37-8bde-2d65651383e3 -- POST / 200 421.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,562 mnist_classifier_MNISTClassifier rhuurgbr 871bd84a-4907-4e89-be88-467131c8ea51 -- POST / 200 421.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,563 mnist_classifier_MNISTClassifier rhuurgbr ce3f1532-e755-48fd-b78a-dc398ea2a993 -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,565 mnist_classifier_MNISTClassifier rhuurgbr b0dd0e24-ebe4-4fbe-8a44-d30a4805ea58 -- POST / 200 422.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,566 mnist_classifier_MNISTClassifier rhuurgbr a1f73c21-8454-435e-a7d3-deb0053828f2 -- POST / 200 423.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,566 mnist_classifier_MNISTClassifier rhuurgbr d32b5a5a-ad3f-4e73-a8ba-07208666e5d7 -- POST / 200 423.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,567 mnist_classifier_MNISTClassifier rhuurgbr 77c8b86b-b657-4b4c-8df1-d63769aa9352 -- POST / 200 423.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,567 mnist_classifier_MNISTClassifier rhuurgbr 2a905434-cefe-4072-8d85-e39dcc41c77b -- POST / 200 408.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,568 mnist_classifier_MNISTClassifier rhuurgbr 9ede97a6-beee-49eb-93b3-28b73952f347 -- POST / 200 408.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,568 mnist_classifier_MNISTClassifier rhuurgbr bd886a95-c7a8-42ba-b476-27c537eabddd -- POST / 200 408.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,569 mnist_classifier_MNISTClassifier rhuurgbr d5d2f5ae-a049-4cd7-a0ab-0ba249dac0ea -- POST / 200 408.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,569 mnist_classifier_MNISTClassifier rhuurgbr fe75d872-a5db-4a8a-a13b-d43b46512698 -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,570 mnist_classifier_MNISTClassifier rhuurgbr 37bae491-67cf-41f2-bd92-26dee66bc028 -- POST / 200 404.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,570 mnist_classifier_MNISTClassifier rhuurgbr 556d8fb6-9956-4247-a6e2-4c4ddfb25bb7 -- POST / 200 403.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,571 mnist_classifier_MNISTClassifier rhuurgbr 6a491006-0348-4f6b-8338-4896fd245a96 -- POST / 200 403.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,571 mnist_classifier_MNISTClassifier rhuurgbr 5deba1b5-6e85-4b21-8d84-3d8ee91ce7fb -- POST / 200 424.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,574 mnist_classifier_MNISTClassifier rhuurgbr d5417718-94be-4597-bab1-8880f4a4dc0f -- POST / 200 405.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,575 mnist_classifier_MNISTClassifier rhuurgbr 300c25e6-4ae2-471c-92dc-6198239bffe6 -- POST / 200 405.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,576 mnist_classifier_MNISTClassifier rhuurgbr 02afdbd2-ffe1-420f-869b-38fa60202fe9 -- POST / 200 403.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,576 mnist_classifier_MNISTClassifier rhuurgbr eb488c69-314f-4c5b-8bd9-b83c2e2e83d9 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,577 mnist_classifier_MNISTClassifier rhuurgbr a763ccb2-f161-44cf-8e93-740fb82b2b07 -- POST / 200 401.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,577 mnist_classifier_MNISTClassifier rhuurgbr 2d754376-3b45-4c2c-a1a2-0564f385a122 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,577 mnist_classifier_MNISTClassifier rhuurgbr 581ef180-7d24-4d3a-87c3-19b2117e58f2 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,577 mnist_classifier_MNISTClassifier rhuurgbr 0c999768-507a-4ae1-8e6f-281d5db65e7c -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,578 mnist_classifier_MNISTClassifier rhuurgbr 514d2f72-bf60-4928-bbb0-9d8fc817e3da -- POST / 200 405.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,578 mnist_classifier_MNISTClassifier rhuurgbr e42a0f32-76e1-48a4-8d85-e525b67afe94 -- POST / 200 396.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,578 mnist_classifier_MNISTClassifier rhuurgbr a3d228cf-2276-47a8-a624-d2674c6e50ed -- POST / 200 402.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,578 mnist_classifier_MNISTClassifier rhuurgbr 2a731b08-ffba-4f94-a2cc-e4faf1aab475 -- POST / 200 402.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,579 mnist_classifier_MNISTClassifier rhuurgbr 7a67da72-3750-4250-a5c1-f94cf0473128 -- POST / 200 401.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,579 mnist_classifier_MNISTClassifier rhuurgbr 7b21479d-aa93-4e6a-87a0-4e34608ab840 -- POST / 200 400.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,579 mnist_classifier_MNISTClassifier rhuurgbr 5eccb938-5098-4b2d-a44f-ba0e77983663 -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,579 mnist_classifier_MNISTClassifier rhuurgbr 9665abfc-5ce3-422f-b8c0-cc0acf97510b -- POST / 200 398.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,580 mnist_classifier_MNISTClassifier rhuurgbr c90e9044-4491-4d29-89cb-b8723566918e -- POST / 200 396.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,580 mnist_classifier_MNISTClassifier rhuurgbr baeafd71-6efd-4f0c-8c29-57e8173c38f9 -- POST / 200 396.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,580 mnist_classifier_MNISTClassifier rhuurgbr d11dadce-c79f-48bf-b867-7a2cab206cc6 -- POST / 200 396.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,580 mnist_classifier_MNISTClassifier rhuurgbr 32fd15b1-e31c-4ae3-85ae-5d13b685efec -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,582 mnist_classifier_MNISTClassifier rhuurgbr 382003dc-869f-4b1b-8e60-188f50408940 -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,582 mnist_classifier_MNISTClassifier rhuurgbr e0ab1da3-05db-48ae-ae58-016af395d70c -- POST / 200 389.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,583 mnist_classifier_MNISTClassifier rhuurgbr 64a1e4a9-8068-42d4-9c8b-09cdcbea646f -- POST / 200 389.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,583 mnist_classifier_MNISTClassifier rhuurgbr 192b7913-658e-4d96-8b1e-e699f713366f -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,584 mnist_classifier_MNISTClassifier rhuurgbr 856b673b-83cd-4a79-813e-80fcfb41a93c -- POST / 200 389.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,587 mnist_classifier_MNISTClassifier rhuurgbr 04449418-9e86-4985-a4fa-582ed7df084f -- POST / 200 393.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,588 mnist_classifier_MNISTClassifier rhuurgbr 9e0e66a1-d1d9-4cdf-951a-cfe35a9c0be2 -- POST / 200 381.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,592 mnist_classifier_MNISTClassifier rhuurgbr 8c2c21eb-1d1e-473c-9c77-0ecbbb89aac6 -- POST / 200 385.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,592 mnist_classifier_MNISTClassifier rhuurgbr 95c18ae5-8f12-4f29-b27d-f628da67a303 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,592 mnist_classifier_MNISTClassifier rhuurgbr 127205af-3745-4a46-9fc9-6cf76f5ac8aa -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,592 mnist_classifier_MNISTClassifier rhuurgbr 5dda8311-4da4-4231-be3c-c62efbc46dfb -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,593 mnist_classifier_MNISTClassifier rhuurgbr f8a8bce8-8a23-4039-9381-19f119397c6c -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,595 mnist_classifier_MNISTClassifier rhuurgbr e60cd903-f365-4ace-ac70-66b4b519e083 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,595 mnist_classifier_MNISTClassifier rhuurgbr 90a937ff-0cbe-4ac7-a268-8148668ca349 -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,597 mnist_classifier_MNISTClassifier rhuurgbr 3ceba879-4c3e-4eaf-832a-3d29da8976bc -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,598 mnist_classifier_MNISTClassifier rhuurgbr c60df8e5-9b41-492f-9f33-ffb38f866467 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,601 mnist_classifier_MNISTClassifier rhuurgbr 34f9263a-3649-49fa-8a6e-748311818ab9 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,602 mnist_classifier_MNISTClassifier rhuurgbr 3ed29d5a-19ee-4907-9e00-060ba7b1e3ca -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,602 mnist_classifier_MNISTClassifier rhuurgbr 96b2ea58-665d-4aac-bacb-e51904d49939 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,602 mnist_classifier_MNISTClassifier rhuurgbr 162b751f-b98a-4218-8be9-94048398935e -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,602 mnist_classifier_MNISTClassifier rhuurgbr 4ffe8a20-2ac1-442d-8609-d680f2a3d6b3 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,602 mnist_classifier_MNISTClassifier rhuurgbr 63f13cb1-a224-4e56-966f-34c3715f1d60 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,604 mnist_classifier_MNISTClassifier rhuurgbr 424b70b7-70bc-48e0-ab4b-5bc39a2aa0d7 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,604 mnist_classifier_MNISTClassifier rhuurgbr 9e18d657-5f87-406d-87e2-8ebcef47adb4 -- POST / 200 191.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,605 mnist_classifier_MNISTClassifier rhuurgbr 317991f8-0138-48b7-a82c-6931480e1a68 -- POST / 200 189.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,605 mnist_classifier_MNISTClassifier rhuurgbr d56677e5-2baa-4896-ae4b-802d2688c4dd -- POST / 200 188.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,607 mnist_classifier_MNISTClassifier rhuurgbr d3934776-770a-4c50-bc00-ca8609c6f3e8 -- POST / 200 189.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,612 mnist_classifier_MNISTClassifier rhuurgbr 43bacf42-41c8-4e51-aec0-70be2e2e4bff -- POST / 200 194.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,613 mnist_classifier_MNISTClassifier rhuurgbr 8b5a56bf-f909-446e-92e4-61cde00a9758 -- POST / 200 193.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,613 mnist_classifier_MNISTClassifier rhuurgbr 3f9557a1-e7bd-42c4-a619-48af1ac19f2c -- POST / 200 193.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,613 mnist_classifier_MNISTClassifier rhuurgbr 2264cb88-cff7-40c4-849a-525375312271 -- POST / 200 192.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,614 mnist_classifier_MNISTClassifier rhuurgbr ba7df2c0-474b-4d93-86d9-bf578cff51a0 -- POST / 200 193.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,615 mnist_classifier_MNISTClassifier rhuurgbr 4a3cc1e8-c260-4f71-80ca-1282bc2ba171 -- POST / 200 193.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,615 mnist_classifier_MNISTClassifier rhuurgbr d6c0f464-d7fc-473c-87ea-6163371e408f -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,616 mnist_classifier_MNISTClassifier rhuurgbr 246ff3eb-2114-4206-b359-064df96d0b69 -- POST / 200 193.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,617 mnist_classifier_MNISTClassifier rhuurgbr 9782bd79-69ef-49f8-aaeb-d0c680ef3eb1 -- POST / 200 193.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,617 mnist_classifier_MNISTClassifier rhuurgbr a97e94f1-84a1-4d2c-a6aa-6bd19a43ad05 -- POST / 200 193.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,618 mnist_classifier_MNISTClassifier rhuurgbr 9536766a-98ee-47ef-ba0f-b705b54c4d2a -- POST / 200 191.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,619 mnist_classifier_MNISTClassifier rhuurgbr a4975392-0bb3-444d-8665-85e460f837a3 -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,619 mnist_classifier_MNISTClassifier rhuurgbr 55240a07-1bf8-4dab-a752-ed09af3da73d -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,620 mnist_classifier_MNISTClassifier rhuurgbr 79f6bfa9-b47e-4f5d-9adf-9e2335de61ec -- POST / 200 187.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,621 mnist_classifier_MNISTClassifier rhuurgbr f003b89d-1f86-48ba-8e96-c6abd050ac3a -- POST / 200 186.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,622 mnist_classifier_MNISTClassifier rhuurgbr 3bbc89e7-24a2-4603-beff-09143c4617b3 -- POST / 200 186.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,623 mnist_classifier_MNISTClassifier rhuurgbr f84edbb7-05e6-4713-92b9-d0721ad258b1 -- POST / 200 187.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,623 mnist_classifier_MNISTClassifier rhuurgbr 321ac7d5-2ce5-4ccc-9604-7fc9972de62f -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,624 mnist_classifier_MNISTClassifier rhuurgbr 1f4fa4d0-816b-4738-bc47-04b3ee5ad16d -- POST / 200 186.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,624 mnist_classifier_MNISTClassifier rhuurgbr b314d6d2-f846-4e13-9353-f8db70637799 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,624 mnist_classifier_MNISTClassifier rhuurgbr 9c281429-4bec-4831-bbf5-93dd8021c826 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,626 mnist_classifier_MNISTClassifier rhuurgbr ea9c2f94-8bc7-4c08-86b1-d4f81ae1496c -- POST / 200 277.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,628 mnist_classifier_MNISTClassifier rhuurgbr 7ebfefd4-4323-41a1-9b3e-84dfbb11aea2 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,628 mnist_classifier_MNISTClassifier rhuurgbr 555041d3-8162-41ff-8420-667a0aecfdb6 -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,628 mnist_classifier_MNISTClassifier rhuurgbr 86662008-f185-47e3-9726-9027d9b98d20 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,628 mnist_classifier_MNISTClassifier rhuurgbr 83a92acb-48ed-446d-8c32-c0e5987458f6 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,629 mnist_classifier_MNISTClassifier rhuurgbr ece3dfb6-d6f9-4d3a-a3f1-7436944f31ca -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,629 mnist_classifier_MNISTClassifier rhuurgbr 33770e1b-1aac-4966-912c-942613a4df46 -- POST / 200 277.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,629 mnist_classifier_MNISTClassifier rhuurgbr 10dd2d2b-54db-4272-bb00-3a0318e4ff05 -- POST / 200 276.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,630 mnist_classifier_MNISTClassifier rhuurgbr dfffe181-bcf2-456a-9df7-6ccbe8723946 -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,630 mnist_classifier_MNISTClassifier rhuurgbr 282ec184-dc00-42ff-8b4f-fb1cf74cc185 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,630 mnist_classifier_MNISTClassifier rhuurgbr c25e0ef1-e2bc-44fc-a743-79e933da5d3d -- POST / 200 275.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-04-28 16:13:05,631 mnist_classifier_MNISTClassifier rhuurgbr b592fd08-a235-4866-ba62-0e8b7b4f071e -- POST / 200 275.7ms
Processed 1000 requests in 5.15 seconds
Throughput: 194.34 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.