System.Threading.RateLimiting
9.0.0-preview.6.24327.7
Prefix Reserved
See the version list below for details.
dotnet add package System.Threading.RateLimiting --version 9.0.0-preview.6.24327.7
NuGet\Install-Package System.Threading.RateLimiting -Version 9.0.0-preview.6.24327.7
<PackageReference Include="System.Threading.RateLimiting" Version="9.0.0-preview.6.24327.7" />
paket add System.Threading.RateLimiting --version 9.0.0-preview.6.24327.7
#r "nuget: System.Threading.RateLimiting, 9.0.0-preview.6.24327.7"
// Install System.Threading.RateLimiting as a Cake Addin #addin nuget:?package=System.Threading.RateLimiting&version=9.0.0-preview.6.24327.7&prerelease // Install System.Threading.RateLimiting as a Cake Tool #tool nuget:?package=System.Threading.RateLimiting&version=9.0.0-preview.6.24327.7&prerelease
About
Provides a set of types that enable application developers to control the rate of operations. This can be used to ensure that applications do not exceed certain limits when interacting with resources or services.
Key Features
- Flexible rate-limiting primitives that can be applied to various scenarios.
- Supports token bucket, fixed window, and sliding window strategies.
How to Use
This is an example of an HttpClient that does client side rate limiting.
Define a rate limiter.
internal sealed class ClientSideRateLimitedHandler : DelegatingHandler, IAsyncDisposable
{
private readonly RateLimiter _rateLimiter;
public ClientSideRateLimitedHandler(RateLimiter limiter)
: base(new HttpClientHandler())
{
_rateLimiter = limiter;
}
// Override the SendAsync method to apply rate limiting.
protected override async Task<HttpResponseMessage> SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
{
// Try to acquire a token from the rate limiter.
using RateLimitLease lease = await _rateLimiter.AcquireAsync(permitCount: 1, cancellationToken);
// If a token is acquired, proceed with sending the request.
if (lease.IsAcquired)
{
return await base.SendAsync(request, cancellationToken);
}
// If no token could be acquired, simulate a 429 Too Many Requests response.
var response = new HttpResponseMessage(HttpStatusCode.TooManyRequests);
// Add a 'Retry-After' header if the rate limiter provides a retry delay.
if (lease.TryGetMetadata(MetadataName.RetryAfter, out TimeSpan retryAfter))
{
response.Headers.Add("Retry-After", ((int)retryAfter.TotalSeconds).ToString(NumberFormatInfo.InvariantInfo));
}
return response;
}
// Implement IAsyncDisposable to allow for asynchronous cleanup of resources.
public async ValueTask DisposeAsync()
{
// Dispose of the rate limiter asynchronously.
await _rateLimiter.DisposeAsync().ConfigureAwait(false);
// Call the base Dispose method.
Dispose(disposing: false);
// Suppress finalization.
GC.SuppressFinalize(this);
}
// Dispose pattern to clean up the rate limiter.
protected override void Dispose(bool disposing)
{
base.Dispose(disposing);
if (disposing)
{
// Synchronously dispose of the rate limiter if disposing is true.
_rateLimiter.Dispose();
}
}
}
Using the rate limiter.
using System.Globalization;
using System.Net;
using System.Threading.RateLimiting;
// Initialize the rate limiter options.
// TokenLimit: Maximum number of tokens that can be acquired at once.
// QueueProcessingOrder: The order in which queued requests will be processed.
// QueueLimit: Maximum number of queued requests.
// ReplenishmentPeriod: How often tokens are replenished.
// TokensPerPeriod: Number of tokens added each period.
// AutoReplenishment: If true, tokens are replenished automatically in the background.
var options = new TokenBucketRateLimiterOptions
{
TokenLimit = 4,
QueueProcessingOrder = QueueProcessingOrder.OldestFirst,
QueueLimit = 2,
ReplenishmentPeriod = TimeSpan.FromMilliseconds(1),
TokensPerPeriod = 2,
AutoReplenishment = true
};
// Create a new instance of the TokenBucketRateLimiter with the defined options.
TokenBucketRateLimiter tokenBucketRateLimiter = new TokenBucketRateLimiter(options);
// A custom HttpMessageHandler that limits the rate of outgoing HTTP requests.
ClientSideRateLimitedHandler clientsideRateLimitedHandler = new ClientSideRateLimitedHandler(tokenBucketRateLimiter);
// Create an HttpClient that uses the rate-limited handler.
using HttpClient client = new HttpClient(clientsideRateLimitedHandler);
// Generate a list of dummy URLs for testing the rate limiter.
var oneHundredUrls = Enumerable.Range(0, 100).Select(i => $"https://example.com?iteration={i:00}");
// Issue concurrent HTTP GET requests using the HttpClient.
// The rate limiter will control how many requests are sent based on the defined limits.
await Parallel.ForEachAsync(oneHundredUrls.Take(0..100), async (url, cancellationToken) =>
{
using HttpResponseMessage response = await client.GetAsync(url, cancellationToken);
Console.WriteLine($"URL: {url}, HTTP status code: {response.StatusCode} ({(int)response.StatusCode})");
});
Main Types
The main types provided by this library are:
System.Threading.RateLimiting.RateLimiter
System.Threading.RateLimiting.ConcurrencyLimiter
System.Threading.RateLimiting.FixedWindowRateLimiter
System.Threading.RateLimiting.ReplenishingRateLimiter
System.Threading.RateLimiting.SlidingWindowRateLimiter
System.Threading.RateLimiting.TokenBucketRateLimiter
System.Threading.RateLimiting.PartitionedRateLimiter<TResource>
Additional Documentation
Related Packages
Feedback & Contributing
System.Threading.RateLimiting is released as open source under the MIT license. Bug reports and contributions are welcome at the GitHub repository.
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 is compatible. |
.NET Core | netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
.NET Standard | netstandard2.0 is compatible. netstandard2.1 was computed. |
.NET Framework | net461 was computed. net462 is compatible. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
MonoAndroid | monoandroid was computed. |
MonoMac | monomac was computed. |
MonoTouch | monotouch was computed. |
Tizen | tizen40 was computed. tizen60 was computed. |
Xamarin.iOS | xamarinios was computed. |
Xamarin.Mac | xamarinmac was computed. |
Xamarin.TVOS | xamarintvos was computed. |
Xamarin.WatchOS | xamarinwatchos was computed. |
-
.NETFramework 4.6.2
- Microsoft.Bcl.AsyncInterfaces (>= 9.0.0-preview.6.24327.7)
- System.Threading.Tasks.Extensions (>= 4.5.4)
-
.NETStandard 2.0
- Microsoft.Bcl.AsyncInterfaces (>= 9.0.0-preview.6.24327.7)
- System.Threading.Tasks.Extensions (>= 4.5.4)
-
net8.0
- No dependencies.
-
net9.0
- No dependencies.
NuGet packages (37)
Showing the top 5 NuGet packages that depend on System.Threading.RateLimiting:
Package | Downloads |
---|---|
Polly.RateLimiting
Polly.RateLimiting is a .NET resilience and transient-fault-handling library that allows developers to express resilience strategies using a Rate Limiter in a fluent and thread-safe manner. |
|
Microsoft.AspNetCore.ConcurrencyLimiter
ASP.NET Core middleware for queuing incoming HTTP requests, to avoid threadpool starvation. This package was built from the source code at https://github.com/dotnet/aspnetcore/tree/abc2c7226ff616316cd1e05d76e6c36b49ce06a1 |
|
Microsoft.AspNetCore.RateLimiting
ASP.NET Core middleware for enforcing rate limiting in an application This package was built from the source code at https://github.com/dotnet/aspnetcore/tree/b12b77b241f0a093d53508c3cb2084860bd5339d |
|
RedisRateLimiting
Redis extensions for rate limiting |
|
Phoesion.Glow.SDK.Firefly.Abstractions
Phoesion Glow SDK Abstractions |
GitHub repositories (10)
Showing the top 5 popular GitHub repositories that depend on System.Threading.RateLimiting:
Repository | Stars |
---|---|
App-vNext/Polly
Polly is a .NET resilience and transient-fault-handling library that allows developers to express policies such as Retry, Circuit Breaker, Timeout, Bulkhead Isolation, and Fallback in a fluent and thread-safe manner. From version 6.0.1, Polly targets .NET Standard 1.1 and 2.0+.
|
|
DGP-Studio/Snap.Hutao
实用的开源多功能原神工具箱 🧰 / Multifunctional Open-source Genshin Impact Toolkit 🧰
|
|
Scighost/Starward
Game Launcher for miHoYo - 米家游戏启动器
|
|
microsoft/dotnet-podcasts
.NET reference application shown at .NET Conf featuring ASP.NET Core, Blazor, .NET MAUI, Microservices, Orleans, Playwright, and more!
|
|
smartstore/Smartstore
A modular, scalable and ultra-fast open-source all-in-one eCommerce platform built on ASP.NET Core 7
|