Group Abstract Group Abstract

Message Boards Message Boards

0
|
30 Views
|
1 Reply
|
0 Total Likes
View groups...
Share
Share this post:

Nonlinearity in inputs without activation function layers?

Iuval Clejan
Posted 10 hours ago

I would like to set up a network for which the output has both linear and quadratic terms in the input nodes, but nothing of higher order. So for example Out1=a11 In1+a12 In2+b12 In1 In2. Is this possible with the current infrastructure?
POSTED BY: Iuval Clejan
1 Reply
Sort By:

A graph like this should do what you want

NetGraph[
 {
  AggregationLayer[Times, 1],
  AppendLayer[],
  LinearLayer[{}]
  },
 {{NetPort["Input"], 1} -> 2 -> 3},
 "Input" -> 2
 ]
  • AggregationLayer is combining the two values using Times
  • AppendLayer is appending the product the the input
  • LinearLayer is learning the linear transformation
POSTED BY: Giulio Alessandrini
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Tag limit exceeded
Note: Only the first five people you tag will receive an email notification; the other tagged names will appear as links to their profiles.
Reply Preview
Attachments
Remove
or Discard