HODLRdD: A new black-box fast algorithm for N-body problems in d-dimensions with guaranteed error bounds: Applications to integral equations and support vector machines
Ritesh Khan, V A Kandappan, and Sivaram Ambikasaran
We study rank of sub-matrices arising out of kernel functions, F(x,y):Rd×Rd↦R, where x,y∈Rd and F(x,y) is smooth everywhere except along the line y=x. Such kernel functions are frequently encountered in a wide range of areas. To our knowledge, this is the first work to formally study rank growth of matrices arising out of a wide range of kernel functions in any dimension. In this article, we prove two new theorems bounding rank of different sub-matrices arising from these kernel functions. Bounds like these are often useful for analyzing the complexity of various hierarchical matrix algorithms. We also plot the numerical rank growth of different sub-matrices arising out of various kernel functions in 1D, 2D, 3D and 4D, which agrees with the proposed theorems. Another significant contribution of this article is that using the obtained rank bounds, we also propose a way to extend the notion of weak-admissibility for hierarchical matrices in higher dimensions. Based on this proposed weak-admissibility condition, we develop a black-box (kernel-independent) fast algorithm for N-body problems, hierarchically off-diagonal low-rank matrix in d dimensions (HODLRdD), which can perform matrix-vector products with O(pNlog(N)) complexity in any dimension d. Our theorems guarantee that p does not grow with any positive power of N, which implies our HODLRdD algorithm scales almost linearly.1 The C++ implementation with OpenMP parallelization of the HODLRdD is available at https://github.com/SAFRAN-LAB/HODLRdD. We also discuss the scalability of the HODLRdD algorithm and showcase the applicability by solving an integral equation in 4D and accelerating the training phase of the support vector machines (SVM) for the data sets with four and five features.1The proposed algorithm scales almost linearly, i.e., O(Nlogα(N)), α>0.
2023
HODLR2D: A New Class of Hierarchical Matrices
V A Kandappan, Vaishnavi Gujjula, and Sivaram Ambikasaran
Abstract. This article introduces HODLR2D, a new hierarchical low-rank representation for a class of dense matrices arising out of \(N\) -body problems in two dimensions. Using this new hierarchical framework, we propose a new fast matrix-vector product that scales almost linearly. We apply this fast matrix-vector product to accelerate the iterative solution of large dense linear systems arising out of radial basis function interpolation and discretized integral equation. The space and computational complexity of HODLR2D matrix-vector products scale as \(\mathcalO(pN \log (N))\) , where \(p\)is the maximum rank of the compressed matrix subblocks. For the logarithmic kernel function, we prove that \(p ∈\mathcalO \left (\log \left (N\right ) \log \left (\log \left (N\right ) \right ) \right )\) . We also numerically observe a similar scaling for other kernel functions in 2D. We thereby demonstrate that the storage and computational complexity of HODLR2D matrix-vector products remain tractable for large \(N\) . Additionally, we also study the parallel scalability of HODLR2D as part of this article.
arXiv
HODLR3D: Hierarchical matrices for N-body problems in three dimensions
V A Kandappan, Vaishnavi Gujjula, and Sivaram Ambikasaran
In recent times, machine learning is finding many important use cases in the financial services industry. Financial datasets usually pose significant statistical challenges, and hence, traditional econometric methods fail in many practical applications. Though several approaches are suggested and being used, to predict whether a borrower would default on the loan availed, it is still an open challenge. In this work, two approaches are proposed based on LSTM (Long Short Term Memory) along with a hybrid neural network architecture to understand the context between financial transactions and loan defaults. The novelty of the proposed methods is in how they handle structured data and the associated temporal data. Further, the performance of the proposed approaches using debit card transactions and loan application information of customers to predict default is demonstrated. The experiments provided promising accuracies. Bidirectional LSTMs with a hybrid architecture achieve an accuracy of 94%. Hybrid neural network architectures used in this work provide an appropriate direction for making an early warning system through online loan default prediction.Kandappan, V. A.Rekha, A. G.
2015
IJAER
Effect of time sychronization error in phasor measurement unit
Gomathi Venugopal, and V A Kandappan
International journal of applied engineering research, Dec 2015