benchmark

Valkey 9.0 on ElastiCache t3.small: What Three One-Hour Runs Actually Agree On

Three completed Valkey 9.0 test executions on a single cache.t3.small Amazon ElastiCache node do not produce one stable throughput number. They do produce one repeatable operating condition: the cache reaches full memory and begins evicting keys.

Average throughput ranges from 9,133.3 to 13,663.6 ops/s, a 49.6% difference between the lowest and highest results. The exact throughput is therefore a range for this workload, while memory saturation is the stronger architectural finding.

AI-Assisted Engineering: When the Best Model Isn't the Best Value

The latest Arena leaderboards reveal a market that no longer has one simple winner. Anthropic dominates several language-heavy categories, OpenAI leads image generation, and lower-cost models from Chinese labs are approaching the frontier fast enough to change the economics of production AI.

The practical question is no longer only which model is best? It is where does premium capability justify premium cost, and where is a cheaper model already good enough?

AI-Assisted Engineering: When a Better Model Becomes a Worse Tool

I tested Fable 5 on two coding tasks in parallel with Claude 4.8 and ChatGPT. In those tests, Fable 5 was slightly better. It understood the work, produced strong results, and looked like a genuine step forward.

But two successful tasks measure capability, not operational reliability. I have also seen repeated reports of Fable 5 degrading during real workflows, wasting tokens, breaking pipelines, and consuming time without producing usable results. Some users eventually rolled back to 4.8. At that point the newer model was not merely weaker. It was worse than useless because its output created additional work.

Valkey 9.0 AWS ElastiCache t4g.micro Benchmark: 9 Workers (run 3)

Node Memory
0.5GiB
Redis Cost
$0.016/h
Avg Throughput
8,726ops/sec
Peak Throughput
27,080ops/sec
Throughput CV
28.4%
Avg Latency
2.06ms
Max Latency
7.52ms
Total Bandwidth
6.40MB/s
Avg ECS CPU
15.5%
Peak ECS CPU
22.6%
ECS Mem Peak
6MB
Loadgen Tasks
9
Avg Memory
87.69%
Max Memory
100.00%
Mem Headroom
-0.0%
Engine CPU Peak
14.7%
Cache Hit Rate
65.9%
Total Evictions
222,878
Min Free Mem
94MB
Peak Key Count
287,386
First Eviction
22m 05s
OOM Rejections
0
First OOM Rejection
None

Memtier Benchmark

report window

Infrastructure

report window

Client Latency

ECS EMF

ElastiCache Deep-Dive

report window

Valkey 9.0 AWS ElastiCache t4g.micro Benchmark: 9 Workers (run 2)

Node Memory
0.5GiB
Redis Cost
$0.016/h
Avg Throughput
8,849ops/sec
Peak Throughput
42,446ops/sec
Throughput CV
52.0%
Avg Latency
2.03ms
Max Latency
3.75ms
Total Bandwidth
6.47MB/s
Avg ECS CPU
15.2%
Peak ECS CPU
16.7%
ECS Mem Peak
6MB
Loadgen Tasks
9
Avg Memory
88.01%
Max Memory
100.00%
Mem Headroom
-0.0%
Engine CPU Peak
19.2%
Cache Hit Rate
65.7%
Total Evictions
239,203
Min Free Mem
117MB
Peak Key Count
287,466
First Eviction
21m 53s
OOM Rejections
0
First OOM Rejection
None

Memtier Benchmark

report window

Infrastructure

report window

Client Latency

ECS EMF

ElastiCache Deep-Dive

report window

Valkey 9.0 AWS ElastiCache t4g.micro Benchmark: 9 Workers

Node Memory
0.5GiB
Redis Cost
$0.016/h
Avg Throughput
9,252ops/sec
Peak Throughput
38,350ops/sec
Throughput CV
44.5%
Avg Latency
1.94ms
Max Latency
3.22ms
Total Bandwidth
6.81MB/s
Avg ECS CPU
15.8%
Peak ECS CPU
33.1%
ECS Mem Peak
6MB
Loadgen Tasks
9
Avg Memory
89.18%
Max Memory
100.00%
Mem Headroom
-0.0%
Engine CPU Peak
25.7%
Cache Hit Rate
66.7%
Total Evictions
242,510
Min Free Mem
115MB
Peak Key Count
287,512
First Eviction
20m 22s
OOM Rejections
0
First OOM Rejection
None

Memtier Benchmark

report window

Infrastructure

report window

Client Latency

ECS EMF

ElastiCache Deep-Dive

report window

Valkey 9.0 AWS ElastiCache t4g.micro Benchmark: 3 Workers (run 2)

Node Memory
0.5GiB
Redis Cost
$0.016/h
Avg Throughput
5,512ops/sec
Peak Throughput
14,068ops/sec
Throughput CV
25.0%
Avg Latency
1.09ms
Max Latency
1.71ms
Total Bandwidth
3.82MB/s
Avg ECS CPU
27.4%
Peak ECS CPU
55.9%
ECS Mem Peak
6MB
Loadgen Tasks
3
Avg Memory
79.35%
Max Memory
100.00%
Mem Headroom
-0.0%
Engine CPU Peak
18.7%
Cache Hit Rate
61.8%
Total Evictions
75,313
Min Free Mem
111MB
Peak Key Count
287,519
First Eviction
36m 16s
OOM Rejections
0
First OOM Rejection
None

Memtier Benchmark

report window

Infrastructure

report window

Client Latency

ECS EMF

ElastiCache Deep-Dive

report window

Valkey 9.0 AWS ElastiCache t4g.micro Benchmark: 3 Workers

Node Memory
0.5GiB
Redis Cost
$0.016/h
Avg Throughput
5,966ops/sec
Peak Throughput
16,928ops/sec
Throughput CV
27.9%
Avg Latency
1.00ms
Max Latency
1.96ms
Total Bandwidth
4.08MB/s
Avg ECS CPU
29.8%
Peak ECS CPU
58.6%
ECS Mem Peak
6MB
Loadgen Tasks
3
Avg Memory
82.14%
Max Memory
100.00%
Mem Headroom
-0.0%
Engine CPU Peak
18.1%
Cache Hit Rate
60.7%
Total Evictions
114,833
Min Free Mem
114MB
Peak Key Count
287,518
First Eviction
30m 02s
OOM Rejections
0
First OOM Rejection
None

Memtier Benchmark

report window

Infrastructure

report window

Client Latency

ECS EMF

ElastiCache Deep-Dive

report window

Valkey 9.0 AWS ElastiCache t3.micro Benchmark: 3 Workers (run 2)

Node Memory
0.5GiB
Redis Cost
$0.017/h
Avg Throughput
5,251ops/sec
Peak Throughput
8,510ops/sec
Throughput CV
8.7%
Avg Latency
1.14ms
Max Latency
7.19ms
Total Bandwidth
3.64MB/s
Avg ECS CPU
22.9%
Peak ECS CPU
24.6%
ECS Mem Peak
6MB
Loadgen Tasks
3
Avg Memory
76.65%
Max Memory
100.00%
Mem Headroom
-0.0%
Engine CPU Peak
9.0%
Cache Hit Rate
60.5%
Total Evictions
65,751
Min Free Mem
111MB
Peak Key Count
287,884
First Eviction
39m 56s
OOM Rejections
0
First OOM Rejection
None

Memtier Benchmark

report window

Infrastructure

report window

Client Latency

ECS EMF

ElastiCache Deep-Dive

report window