This is now in the Function Repository!
The new version is named RuleNetGraph, and there have been several improvements:
- You can use Subscript to name layers
- Pure functions and functions supported by ElementwiseLayer and ThreadingLayer are automagically converted into valid Layers! (ElementwiseLayer taking precedence)
- You can provide a list of rules as the input.
ResourceFunction["RuleNetGraph"][LinearLayer[64] -> LogisticSigmoid -> (#*17 + 8 &)]
The implementation is fairly similar aside from some changes to improve usability, but feel free to download the source notebook from the function repository site view the latest changes.