sailfork / t3code-github / .repos/ alchemy-effect/ benchmark/ container/ report/ report.md

Cold-start benchmark

Run 2026-07-02T01-28-09-381Z — 700 samples. Metric: time to usable service (host start → first successful request).

Methodology: targets run sequentially so they never contend for shared quotas. Containers are measured under concurrent load (10 rounds × 10 simultaneous boots). MicroVMs are measured independently — 25 serial boots at concurrency 1 — because the Lambda MicroVM API is throttled per account/Region (RunMicrovm 5 TPS/burst 5, TerminateMicrovm 10 TPS), so concurrent boots would measure API admission rather than VM cold start. Each boot launches, waits until the service is usable, then terminates before the next; the image is pre-warmed once (untimed) so we measure cold start, not first-pull distribution.

environmentvariantokready p50ready p95ready meanready maxfirst → last round (mean)
containereffectful100/1002.3s24.0s4.7s46.7s15.3s → 2.1s
containerbun100/1001.7s23.9s3.9s47.3s17.4s → 1.7s
containerremote100/1002.6s24.4s4.5s26.1s11.5s → 2.4s
containeropencode100/10010.5s15.6s12.0s58.6s25.4s → 10.6s
lambda→microvmeffectful-bun25/252.9s4.4s2.8s4.8s4.8s → 2.0s
lambda→microvmeffectful-node25/253.2s3.7s3.6s16.6s3.4s → 2.5s
lambda→microvmbun25/252.7s3.2s2.7s3.7s3.2s → 2.3s
lambda→microvmnode25/253.3s3.8s3.2s4.2s3.5s → 3.3s
lambda→microvmexternal25/252.2s2.8s2.2s2.8s2.4s → 2.2s
lambda→microvmopencode25/253.4s4.1s3.4s4.5s3.8s → 4.1s
worker→microvmeffectful-bun25/252.7s3.7s2.8s4.1s3.7s → 3.2s
worker→microvmeffectful-node25/253.6s9.4s4.0s9.6s6.0s → 2.8s
worker→microvmbun25/253.1s3.8s2.9s5.4s3.8s → 3.2s
worker→microvmnode25/253.2s4.3s3.4s6.9s3.2s → 3.0s
worker→microvmexternal25/252.4s2.9s2.3s3.0s3.0s → 2.9s
worker→microvmopencode24/253.6s4.0s3.5s4.2s1.9s → 3.1s

Raw per-boot samples: data/samples-2026-07-02T01-28-09-381Z.csv. Aggregates: report/summary.csv.