Foundations of Neural Networks Explain the Empirical Success of the "Surrogate" Approach to Ordinal Regression -- and Recommend What Next

Authors

Salvador Robles, The University of Texas at El PasoFollow
Martine Ceberio, The University of Texas at El PasoFollow
Vladik Kreinovich, The University of Texas at El PasoFollow

Publication Date

4-1-2023

Comments

Technical Report: UTEP-CS-23-09

Abstract

Recently, a new efficient semi-heuristic statistical method -- called Surrogate Approach -- has been proposed for dealing with regression problems. How can we explain this empirical success? And since this method is only an approximation to reality, what can we recommend if there is a need for a more accurate approximation? In this paper, we show that this empirical success can be explained by the same arguments that explain the empirical success of neural networks -- and these arguments can also provide us with possible more general techniques (that will hopefully lead to more accurate approximation to real-life phenomena).