Package Usage: npm: gptoken
Javascript BPE Encoder Decoder for GPT-2 / GPT-3. The "gpt-3-encoder" module provides functions for encoding and decoding text using the Byte Pair Encoding (BPE) algorithm. It can be used to process text data for input into machine learning models, or to
6 versions
Latest release: over 3 years ago
1 dependent package
3,164 downloads last month
View more package details: https://packages.ecosystem.code.gouv.fr/registries/npmjs.org/packages/gptoken