net9.0
namespace Microsoft.ML.Tokenizers
{
public sealed class BpeTokenizer : Tokenizer
{
public override OperationStatus Decode(IEnumerable<int>! ids, Span<char> destination, out int idsConsumed, out int charsWritten);
}
}
.NET | 5.06.07.08.09.0 |
---|---|
.NET Core | 2.02.12.23.03.1 |
.NET Framework | 4.6.14.6.24.74.7.14.7.24.84.8.1 |
.NET Standard | 2.02.1 |
Information specific to net9.0 | |
Assembly | Microsoft.ML.Tokenizers , Version=1.0.0.0, PublicKeyToken=cc7b13ffcd2ddd51 |
Referencing | Your project needs a package reference to |
Package | Microsoft.ML.Tokenizers (0.22.0-preview.24526.1) net8.0 |
Preview | This API is contained in a prerelease package. |
Platform Restrictions | This API is supported on all platforms. |