# Neural Network and Finite Element Method¶

We consider the solution to a differential equation

Neural network is quite similar to finite element method. In terms of finite element method, we can write down a neural network structured form of a function [Freitag2007]

where \(\mathcal N\) is the neural network structure. Specifically,

The function is parameterized using the network. Such parameterization is similar to collocation method in finite element method, where multiple basis is used for each location.

One of the choice of the function \(F\) is a linear combination,

and \(A(x_i)\) should take care of the boundary condition.

Relation to finite element method

This function is similar to the finite element function basis approximation. The goal in finite element method is to find the coefficients of each basis functions to achieve a good approximation. In ANN method, each sigmoid is the analogy to the basis functions, where we are looking for both the coefficients of sigmoids and the parameters of them. These sigmoid functions are some kind of adaptive basis functions.

With such parameterization, the differential equation itself is parameterized such that

such that the minimization should be

at each point.

## References and Notes¶

[Freitag2007] | Freitag, K. J. (2007). Neural networks and differential equations. |