Group Abstract Group Abstract

Message Boards Message Boards

The Encoder-Decoder Transformer Neural Network Architecture

                                   enter image description here
POSTED BY: Jofre Espigule-Pons
4 Replies
Sort By:
Sangdon Lee
Sangdon Lee
Posted 9 months ago

Hi, Jofre, I am working through your notebook and stuck at the following command. Could you please let me know how to modify the command? 

vocabulary = NetExtract[ResourceFunction["GPTTokenizer"][], "Tokens"]

(* this creates an error, and it is modified as follows*)

netDecoder = NetDecoder[{"Class", NetExtract[ResourceFunction["GPTTokenizer"][], "Tokens"]}]
netDecoderModified = NetDecoder[{"Class", {netEncoder, "Tokens"}}]
POSTED BY: Sangdon Lee

Sangdon-san,

It seems that the problem is caused by a difference in the GPTTokenizer version.At the time this post was made, the GetTokenizer version was 1.0.0. Currently, it is 1.2.0, and there seems to be an incompatibility issue. It may work well by specifying the version in GetTorganizer as follows.

NetDecoder[{"Class",
  NetExtract[ResourceFunction["GPTTokenizer", "Version" -> "1.0.0"][],
    "Tokens"]}]
POSTED BY: Kotaro Okazaki
Sangdon Lee
Sangdon Lee
Posted 9 months ago

Kotaro-san, Thank you very. I appreciate.

POSTED BY: Sangdon Lee
POSTED BY: EDITORIAL BOARD
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard