Group Abstract Group Abstract

Message Boards Message Boards

The Encoder-Decoder Transformer Neural Network Architecture

                                   enter image description here

4 Replies
Posted 11 days ago

Hi, Jofre, I am working through your notebook and stuck at the following command. Could you please let me know how to modify the command?

vocabulary = NetExtract[ResourceFunction["GPTTokenizer"][], "Tokens"]

(* this creates an error, and it is modified as follows*)

netDecoder = NetDecoder[{"Class", NetExtract[ResourceFunction["GPTTokenizer"][], "Tokens"]}]
netDecoderModified = NetDecoder[{"Class", {netEncoder, "Tokens"}}]
POSTED BY: Sangdon Lee

Sangdon-san,

It seems that the problem is caused by a difference in the GPTTokenizer version.At the time this post was made, the GetTokenizer version was 1.0.0. Currently, it is 1.2.0, and there seems to be an incompatibility issue. It may work well by specifying the version in GetTorganizer as follows.

NetDecoder[{"Class",
  NetExtract[ResourceFunction["GPTTokenizer", "Version" -> "1.0.0"][],
    "Tokens"]}]
POSTED BY: Kotaro Okazaki
Posted 10 days ago

Kotaro-san, Thank you very. I appreciate.

POSTED BY: Sangdon Lee

enter image description here -- you have earned Featured Contributor Badge enter image description here Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!

POSTED BY: EDITORIAL BOARD
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard