Group Abstract Group Abstract

Message Boards Message Boards

The Encoder-Decoder Transformer Neural Network Architecture

                                   enter image description here
POSTED BY: Jofre Espigule-Pons
4 Replies
Sort By:
Sangdon Lee
Sangdon Lee
Posted 1 month ago

Hi, Jofre, I am working through your notebook and stuck at the following command. Could you please let me know how to modify the command? 

vocabulary = NetExtract[ResourceFunction["GPTTokenizer"][], "Tokens"]

(* this creates an error, and it is modified as follows*)

netDecoder = NetDecoder[{"Class", NetExtract[ResourceFunction["GPTTokenizer"][], "Tokens"]}]
netDecoderModified = NetDecoder[{"Class", {netEncoder, "Tokens"}}]
POSTED BY: Sangdon Lee

Sangdon-san,

It seems that the problem is caused by a difference in the GPTTokenizer version.At the time this post was made, the GetTokenizer version was 1.0.0. Currently, it is 1.2.0, and there seems to be an incompatibility issue. It may work well by specifying the version in GetTorganizer as follows.

NetDecoder[{"Class",
  NetExtract[ResourceFunction["GPTTokenizer", "Version" -> "1.0.0"][],
    "Tokens"]}]
POSTED BY: Kotaro Okazaki
Sangdon Lee
Sangdon Lee
Posted 1 month ago

Kotaro-san, Thank you very. I appreciate.

POSTED BY: Sangdon Lee

enter image description here -- you have earned Featured Contributor Badge enter image description here Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!
POSTED BY: EDITORIAL BOARD
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard