10. Deployment size Small farm Medium farm Large farm
Total number of users < 10,000 < 100,000 < 500,000
Recommended cache size
for the Distributed Cache
service
1 GB
(Default 10% RAM)
2.5 GB
(Manual adjustment)
12 GB
(Limit of16GB per server)
Total memory allocation
for the Distributed Cache
service (double the
recommended cache size
above)
2 GB
(Memory size must
match in all servers)
5 GB
24 GB
(32GB Max Limit)
Recommended
architectural
configuration
Dedicated server or co-
located on a front-end
server
Dedicated server Dedicated server
Minimum cache hosts per
farm
1 1 1
15. Throttling Rules
Rule
1
Rule
2
Rule
3
Execution Group 0
Rule
1
Rule
2
Rule
3
Execution Group 1
Rule
5
Rule
6
Rule
7
Execution Group 3
Rule
8
Rule
9
Rule
0
Machine Pool 1
Server
1
Server
2
Server
3
Machine Pool 2
Server
4
Server
5
Server
6
16. Counter name Description
Connections Current
The total number of connections that are
currently open by Request Manager.
Connections Reused / Sec
The number of connections per second that are
reused when the same client connection makes
another request without closing the connection.
Routed Requests / Sec
The number of routed requests per second. The
instance determines the application pool and
server for which this counter tracks.
Throttled Requests / Sec The number of throttled requests per second.
Failed Requests / Sec The number of failed requests per second.
Average Processing Time
The time to process the request that is, the time
to evaluate all the rules and determine a routing
target.
Last Ping Latency
The last ping latency (that is, Request Manager's
PING feature) and the instance determine which
application pool and machine target.
Connection Endpoints Current
The total number of endpoints that are
connected for all active connections.
Routed Requests Current
The number of unfinished routed requests. The
instance determines which application pool and
machine target.