7
$\begingroup$

From the point of view of linear algebra, the "natural" multiplication operation for matrices is the usual matrix product, and there are lots of theorems involving this product---e.g. the result $\det(AB) = \det(A)\det(B)$, or $\text{tr}(AB) = \text{tr}(BA)$, etc. However, there are lots of matrices one encounters in practice whose structure allows them to be written in a convenient way as an element-wise (Hadamard) product of two other matrices. This is one of the reasons why the default multiplication of arrays is element-wise in many programming languages (e.g. Python). In situations where element-wise products appear, it could be very nice to have theorems (like the above determinant & trace relations) concerning the linear algebraic character of the element-wise product. My question is: Do any "interesting" such theorems exist?

[I don't expect to find any results as slick as the above $\det$ and $\text{tr}$ identities, but perhaps there are analogous inequalities, or maybe some non-trivial statements about diagonalizability, or eigenvalue relations, etc.]

$\endgroup$
2
  • 1
    $\begingroup$ "This is one of the reasons why the default multiplication of arrays is element-wise in many programming languages (e.g. Python)." I can't speak for language/library designers, but you seem to be confusing matrix operations with array operations. A well designed software library shall put matrix operations and array operations in two different modules. When there are operations in common, it should provide the same API in both modules. I find some software libraries (such as numpy) very annoying because they do not separate matrix operations from array operations cleanly. $\endgroup$
    – user1551
    Commented Jul 15, 2016 at 8:04
  • $\begingroup$ The wiki page has a nice collection of facts, as the answer points out. $\endgroup$ Commented Jul 15, 2016 at 19:30

2 Answers 2

6
$\begingroup$

A matrix $A$ is called doubly nonnegative (DN) if it is entrywise nonnegative and positive semidefinite. For $A \in M_n (\mathbb{C})$ and $\alpha \in \mathbb{R}$, denote by $A^{(\alpha)}$ the entryise Hadamard power, i.e., $A^{(\alpha)} = [a_{ij}^\alpha]$.

Let $A$ be a DN matrix. Horn and Fitzgerald [MR0506356; J. Math. Anal. Appl. 61 (1977), no. 3, 633–642] showed that $A^{(\alpha)}$ is DN if and only if $\alpha \in \mathbb{N} \cup [n-2,\infty)$. The methods in this paper are also used to give another proof of the Schur product theorem (cited in another answer).

Interestingly, this lower bound is the same for conventional matrix powers; Johnson et al. [MR2810562; Linear Algebra Appl. 435 (2011), no. 9, 2175–2182] established the existence of a critical exponent and conjectured that $A^\alpha$ is DN for every $\alpha \ge 2$. Guillot et al. [MR3091314; Linear Algebra Appl. 439 (2013), no. 8, 2422–2427] settled the conjecture in the affirmative.

For $A \in M_n(\mathbb{C})$, denote by $\rho(A)$ the spectral radius of $A$. It is known that the spectral radius is sub-multiplicative with respect to the Hadamard product ($\odot$) for non-negative matrices; i.e., $$ \rho(A \odot B) \le \rho(A)\rho(B),~\forall A,B \ge 0. $$ The standard reference for this is Topics in matrix analysis by Horn and Johnson.

$\endgroup$
1
  • 1
    $\begingroup$ To continue off the last one, we also have $\rho(A^{(\alpha)} \odot B^{(\beta)}) \le \rho(A)^{\alpha}\rho(B)^{\beta} ~\forall A,B$ primitive. (It is generalizable to any product of such matrices with nonnegative powers summing to $\geq 1$. ( L. Elsner ) $\endgroup$
    – Jacob A
    Commented Dec 19, 2021 at 2:09
5
$\begingroup$

Yes, there is the Schur product theorem. See here: https://en.wikipedia.org/wiki/Schur_product_theorem

The Schur product or Hadamard product of two matrices is the elementwise product. The Schur product theorem states that the Schur product of two positive definite matrices is again positive definite.

$\endgroup$
2
  • 1
    $\begingroup$ Not very interesting. The Hadamard product is a principal submatrix of the Kronecker product. $\endgroup$ Commented Mar 24, 2018 at 18:08
  • $\begingroup$ ... and, echoing @darijgrinberg's comment, the Kronecker product has the structural sense (and coordinate-independent sense) of being a tensor product operator, etc. $\endgroup$ Commented Jun 21, 2020 at 19:52

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .