Month: May 2026

I wrote the code below line by line manually. Although I have 2 coding agents on my VS code I just used them for advice,…

Just tried two new LUs – PowerLU and ExpoLU which have continuous value y but are not continuously differentiable just like ReLU. ExpoLU beats ReLU…

I just tried some simple activation functions for UAT/Neural Network – ParaLU and QuartLU which are Parabolic Linear Unit and Quartic Linear Unit. ParaLU and…