What you are looking for seems to be AggregationLayer[Max] which will take [channels, height, width] and return [channels] using Max to aggregate the other dimensions.
AggregationLayer[Max]
[channels, height, width]
[channels]
Max
