Questions tagged [hessian-matrix]
The Hessian matrix of function is used to second derivative test when $f$ has a critical point $x$. If the Hessian is positive definite at $x$, then $f$ attains a local minimum at $x$. If the Hessian is negative definite at $x$, then $f$ attains a local maximum at $x$. If the Hessian has both positive and negative eigenvalues then $x$ is a saddle point for $f$.
894 questions
0 votes
0 answers
14 views
Properties of self-concordant functions
Consider a self-concordant function $f(\cdot)$. This implies; $$ \|f'''(x)[u]\| \leq M \|u\|_{f''(x)}^{3/2} \; \text{for some M and} \; \forall u \in \mathbb{R}^{n}, \text{and} \; x \in \text{domain} \...
0 votes
1 answer
60 views
Two functions having the same zero set
If $f$ and $g$ are $C^2$ functions $\mathbb{R}^2\to\mathbb{R}$ having the same zero set $\cal C$. I want to ask whether $$\kappa_f:= \frac{\text{Hess}_f(t,t)}{\|\nabla f\|}$$ is equal to (up to a sign)...
1 vote
1 answer
74 views
If the second partial derivatives are matrices, can I plug them into the a new matrix and call new matrix the Hessian $H$ to show $H \succeq 0$?
$\def\diag{\operatorname{diag}} \Lambda^{-1}=\diag\left(\dfrac{1}{\lambda_i}\right).$ $\lambda_i \geq 0$ $w_i \in \mathbb{R}$ $C>0, C \in \mathbb{R}_{++}$ $\mathbf w$ is length $d$ and so is lambda....
1 vote
1 answer
51 views
The meaning of the elements of the inverse of the Jacobian (and Hessian)
Page 147, equation (3.9.9, of "The Finite Element Method Linear Static and Dynamic Finite Element Analysis" by Thomas J. R. Hughes contains the following formula $$ \begin{bmatrix} \dfrac{\...
1 vote
0 answers
47 views
Is there a smooth function having any given number of extrema and saddles?
For which triples $(l,s,h) \in \mathbf{Z}^3_{\geq 0}$ does there exist an example of a smooth function $f\colon \mathbf{R}^2 \to \mathbf{R}$ that has $l$ local minimums (low points), $s$ saddle points,...
3 votes
1 answer
241 views
Is there vocabulary for critical points of multivariable functions at which the second partial derivative test fails?
For a smooth multivariable function $f \colon \mathbf{R}^2 \to \mathbf{R}$, a critical point of $f$ is any $(a,b)$ at which $\nabla f(a,b) = \mathbf{0}$. Whether a critical point corresponds to a ...
1 vote
1 answer
117 views
Why is the Hessian of the negative log-likelihood in multinomial logistic regression positive definite?
I am studying the convexity properties of the negative log-likelihood in multinomial logistic regression. Let me briefly set up the notation: We have a dataset $$ D = \{(x_n, y_n)\}_{n=1}^N, \quad ...
0 votes
0 answers
46 views
Why does the product of the Hessian and the transformation determinant only involve first derivatives?
In Leonard Dickson's Modern Algebraic Theories (p. 3), the Hessian $h$ of a function $f$ is introduced, where the elements of the ith row are $\frac{\partial^2}{\partial x_i \partial x_1}, \frac{\...
2 votes
0 answers
107 views
Index notation for mixed partial derivatives – $f_{xy}=(f_x)_y$ or $f_{xy}=(f_y)_x$?
The mixed partial derivative $\frac{\partial^{2} f}{\partial x \, \partial y} := \frac{\partial}{\partial x}\!\left( \frac{\partial f}{\partial y} \right)$ is obtained by first differentiating with ...
1 vote
1 answer
71 views
Is the hessian of a smooth planar projective complex cubic again smooth?
I have a planar complex projective cubic, let’s call it $F$. I’ve proven that it’s nonsingular and I’m now asked to prove that $D=\det(H(F))$ is again a smooth cubic. ($H$ is the hessian matrix of $F$....
0 votes
1 answer
48 views
Characterization of positive definite matrices and convexity
Let $f\colon \mathbb{R}^d \to \mathbb{R}$ be twice continuously differentiable. In the theory of Hamilton–Jacobi–Bellman or convex analysis in general one can encounter conditions on data like $$(\...
2 votes
2 answers
119 views
How do I find and classify a stationary point of the function $5x^3 - 3yx - 6y^3 - 2$ using Newton's method and the Hessian eigenvalues?
Setup to the problem: We are going to determine the stationary points of the function $5x^3 - 3yx - 6y^3 - 2$ in the region $-1 \leq x \leq 1, \ -1 \leq y \leq 1$. Calculate the gradient $\nabla f(\...
0 votes
1 answer
76 views
How does this proof connect to the claim?
This proof was taken from the book Multivariable Mathematics by Theodore Shifrin. How does the definition of continuity in the second part of the proof connect to the claim that $$f(\mathbf a+\mathbf ...
0 votes
1 answer
59 views
Gradient and Hessian of a pseudo-quadratic form
Problem formulation I would like to generalize the following well-known and super-nice formulas for the gradient $\nabla J(x)$ and Hessian $\nabla^2 J(x)$ of a quadratic cost $J(x)\triangleq x'Qx$ \...
0 votes
1 answer
136 views
Hessian matrix and gradient vector for the regularized quadratic function
Let $\mathcal{l}$ be the following quadratic loss function: $\frac{1}{2} \theta ^t H \theta$ where H is Hessian matrix, $\theta \in R^d$ is the parameter vector. If we define the regularized version ...